Data management services of NorduGrid
(2005) Computing in High Energy CHEP'04 2. p.765-766- Abstract
- In common grid installations, services responsible for storing big data
chunks, replication of those data and indexing their availability are usually
completely decoupled. And a task of synchronizing data is passed to either
user-level tools or separate services (like spiders) which are subject to
failure and usually cannot perform properly if one of underlying services
fails too.
The NorduGrid Smart Storage Element (SSE) was designed to try to
overcome those problems by combining the most desirable features into one
service. It uses HTTPS/G for secure data transfer, Web Services for
control (through same HTTPS/G channel) and can provide information... (More) - In common grid installations, services responsible for storing big data
chunks, replication of those data and indexing their availability are usually
completely decoupled. And a task of synchronizing data is passed to either
user-level tools or separate services (like spiders) which are subject to
failure and usually cannot perform properly if one of underlying services
fails too.
The NorduGrid Smart Storage Element (SSE) was designed to try to
overcome those problems by combining the most desirable features into one
service. It uses HTTPS/G for secure data transfer, Web Services for
control (through same HTTPS/G channel) and can provide information to
indexing services used in middlewares based on the Globus Toolkit (TM). At
the moment, those are the Replica Catalog and the Replica Location
Service. The modular internal design of the SSE and the power of C++
object programming allows to add support for other indexing services in
an easy way.
There are plans to complement it with a Smart Indexing Service capable of
resolving inconsistencies hence creating a robust distributed data storage
system. (Less)
Please use this url to cite or link to this publication:
https://lup.lub.lu.se/record/979488
- author
- Konstantinov, A.
; Eerola, Paula
LU
; Konya, Balazs
LU
; Smirnova, Oxana
LU
; Ekelöf, T. ; Ellert, M. ; Renner Hansen, J. ; Langgard Nielsen, J. and Wäänänen, A.
- author collaboration
- organization
- publishing date
- 2005
- type
- Chapter in Book/Report/Conference proceeding
- publication status
- published
- subject
- keywords
- NorduGrid Data management services
- host publication
- CERN-2005-002
- editor
- Aimar, A. ; Harvey, J. and Knoors, N.
- volume
- 2
- pages
- 2 pages
- publisher
- CERN
- conference name
- Computing in High Energy CHEP'04
- conference location
- Interlaken, Switzerland
- conference dates
- 2004-09-27
- project
- ATLAS
- language
- English
- LU publication?
- yes
- id
- 178b021f-23f0-481d-b90a-03ee0d5914ff (old id 979488)
- date added to LUP
- 2016-04-04 10:16:52
- date last changed
- 2024-01-26 14:26:07
@inproceedings{178b021f-23f0-481d-b90a-03ee0d5914ff, abstract = {{In common grid installations, services responsible for storing big data<br/><br> chunks, replication of those data and indexing their availability are usually<br/><br> completely decoupled. And a task of synchronizing data is passed to either<br/><br> user-level tools or separate services (like spiders) which are subject to<br/><br> failure and usually cannot perform properly if one of underlying services<br/><br> fails too.<br/><br> The NorduGrid Smart Storage Element (SSE) was designed to try to<br/><br> overcome those problems by combining the most desirable features into one<br/><br> service. It uses HTTPS/G for secure data transfer, Web Services for<br/><br> control (through same HTTPS/G channel) and can provide information to<br/><br> indexing services used in middlewares based on the Globus Toolkit (TM). At<br/><br> the moment, those are the Replica Catalog and the Replica Location<br/><br> Service. The modular internal design of the SSE and the power of C++<br/><br> object programming allows to add support for other indexing services in<br/><br> an easy way.<br/><br> There are plans to complement it with a Smart Indexing Service capable of<br/><br> resolving inconsistencies hence creating a robust distributed data storage<br/><br> system.}}, author = {{Konstantinov, A. and Eerola, Paula and Konya, Balazs and Smirnova, Oxana and Ekelöf, T. and Ellert, M. and Renner Hansen, J. and Langgard Nielsen, J. and Wäänänen, A.}}, booktitle = {{CERN-2005-002}}, editor = {{Aimar, A. and Harvey, J. and Knoors, N.}}, keywords = {{NorduGrid Data management services}}, language = {{eng}}, pages = {{765--766}}, publisher = {{CERN}}, title = {{Data management services of NorduGrid}}, url = {{https://lup.lub.lu.se/search/files/5503793/979549}}, volume = {{2}}, year = {{2005}}, }