Advanced

Data management services of NorduGrid

Konstantinov, A.; Eerola, Paula LU ; Konya, Balazs LU ; Smirnova, Oxana LU ; Ekelöf, T.; Ellert, M.; Renner Hansen, J.; Langgard Nielsen, J. and Wäänänen, A. (2005) Computing in High Energy CHEP'04 In CERN-2005-002 2. p.765-766
Abstract
In common grid installations, services responsible for storing big data

chunks, replication of those data and indexing their availability are usually

completely decoupled. And a task of synchronizing data is passed to either

user-level tools or separate services (like spiders) which are subject to

failure and usually cannot perform properly if one of underlying services

fails too.

The NorduGrid Smart Storage Element (SSE) was designed to try to

overcome those problems by combining the most desirable features into one

service. It uses HTTPS/G for secure data transfer, Web Services for

control (through same HTTPS/G channel) and can provide information... (More)
In common grid installations, services responsible for storing big data

chunks, replication of those data and indexing their availability are usually

completely decoupled. And a task of synchronizing data is passed to either

user-level tools or separate services (like spiders) which are subject to

failure and usually cannot perform properly if one of underlying services

fails too.

The NorduGrid Smart Storage Element (SSE) was designed to try to

overcome those problems by combining the most desirable features into one

service. It uses HTTPS/G for secure data transfer, Web Services for

control (through same HTTPS/G channel) and can provide information to

indexing services used in middlewares based on the Globus Toolkit (TM). At

the moment, those are the Replica Catalog and the Replica Location

Service. The modular internal design of the SSE and the power of C++

object programming allows to add support for other indexing services in

an easy way.

There are plans to complement it with a Smart Indexing Service capable of

resolving inconsistencies hence creating a robust distributed data storage

system. (Less)
Please use this url to cite or link to this publication:
author
organization
publishing date
type
Chapter in Book/Report/Conference proceeding
publication status
published
subject
keywords
NorduGrid Data management services
in
CERN-2005-002
editor
Aimar, A.; Harvey, J.; Knoors, N.; ; and
volume
2
pages
2 pages
publisher
CERN
conference name
Computing in High Energy CHEP'04
project
ATLAS
language
English
LU publication?
yes
id
178b021f-23f0-481d-b90a-03ee0d5914ff (old id 979488)
date added to LUP
2008-01-28 22:00:39
date last changed
2016-04-16 07:42:06
@inproceedings{178b021f-23f0-481d-b90a-03ee0d5914ff,
  abstract     = {In common grid installations, services responsible for storing big data<br/><br>
chunks, replication of those data and indexing their availability are usually<br/><br>
completely decoupled. And a task of synchronizing data is passed to either<br/><br>
user-level tools or separate services (like spiders) which are subject to<br/><br>
failure and usually cannot perform properly if one of underlying services<br/><br>
fails too.<br/><br>
 The NorduGrid Smart Storage Element (SSE) was designed to try to<br/><br>
overcome those problems by combining the most desirable features into one<br/><br>
service. It uses HTTPS/G for secure data transfer, Web Services for<br/><br>
control (through same HTTPS/G channel) and can provide information to<br/><br>
indexing services used in middlewares based on the Globus Toolkit (TM). At<br/><br>
the moment, those are the Replica Catalog and the Replica Location<br/><br>
Service. The modular internal design of the SSE and the power of C++<br/><br>
object programming allows to add support for other indexing services in<br/><br>
an easy way.<br/><br>
 There are plans to complement it with a Smart Indexing Service capable of<br/><br>
resolving inconsistencies hence creating a robust distributed data storage<br/><br>
system.},
  author       = {Konstantinov, A. and Eerola, Paula and Konya, Balazs and Smirnova, Oxana and Ekelöf, T. and Ellert, M. and Renner Hansen, J. and Langgard Nielsen, J. and Wäänänen, A.},
  booktitle    = {CERN-2005-002},
  editor       = {Aimar, A. and Harvey, J. and Knoors, N.},
  keyword      = {NorduGrid Data management services},
  language     = {eng},
  pages        = {765--766},
  publisher    = {CERN},
  title        = {Data management services of NorduGrid},
  volume       = {2},
  year         = {2005},
}