Performance of the NorduGrid ARC and the Dulcinea Executor in ATLAS Data Challenge 2
Sturrock, R. ; Eerola, Paula LU ; Konya, Balazs LU ; Smirnova, Oxana LU
and Lindemann, Jonas
LU
(2005)
Computing in High Energy Physics CHEP'04
2.
p.1095-1098
- Abstract
- This talk describes the various stages of ATLAS Data Challenge 2 (DC2)
in what concerns usage of resources deployed via NorduGrid's Advanced
Resource Connector (ARC). It also describes the integration of these
resources with the ATLAS production system using the Dulcinea
executor.
ATLAS Data Challenge 2 (DC2), run in 2004, was designed to be a step
forward in the distributed data processing. In particular, much
coordination of task assignment to resources was planned to be
delegated to Grid in its different flavours. An automatic production
management system was designed, to direct the tasks to Grids and
conventional resources.
... (More) - This talk describes the various stages of ATLAS Data Challenge 2 (DC2)
in what concerns usage of resources deployed via NorduGrid's Advanced
Resource Connector (ARC). It also describes the integration of these
resources with the ATLAS production system using the Dulcinea
executor.
ATLAS Data Challenge 2 (DC2), run in 2004, was designed to be a step
forward in the distributed data processing. In particular, much
coordination of task assignment to resources was planned to be
delegated to Grid in its different flavours. An automatic production
management system was designed, to direct the tasks to Grids and
conventional resources.
The Dulcinea executor is a part of this system that provides interface
to the information system and resource brokering capabilities of the
ARC middleware. The executor translates the job definitions recieved
from the supervisor to the extended resource specification language
(XRSL) used by the ARC middleware. It also takes advantage of the ARC
middleware's built-in support for the Globus Replica Location Server
(RLS) for file registration and lookup.
NorduGrid's ARC has been deployed on many ATLAS-dedicated resources
across the world in order to enable effective participation in ATLAS
DC2. This was the first attempt to harness large amounts of strongly
heterogeneous resources in various countries for a single
collaborative exercise using Grid tools. This talk addresses various
issues that arose during different stages of DC2 in this environment:
preparation, such as ATLAS software installation; deployment of the
middleware; and processing. The results and lessons are summarized as
well. (Less)
Please use this url to cite or link to this publication:
https://lup.lub.lu.se/record/979573
- author
- Sturrock, R.
; Eerola, Paula
LU
; Konya, Balazs
LU
; Smirnova, Oxana
LU
and Lindemann, Jonas
LU
- author collaboration
- organization
- publishing date
- 2005
- type
- Chapter in Book/Report/Conference proceeding
- publication status
- published
- subject
- keywords
- NorduGrid ATLAS Data-challenge
- host publication
- CERN-2005-002
- editor
- Aimar, A. ; Harvey, J. and Knoors, N.
- volume
- 2
- pages
- 4 pages
- publisher
- CERN
- conference name
- Computing in High Energy Physics CHEP'04
- conference location
- Interlaken, Switzerland
- conference dates
- 2004-09-27
- project
- ATLAS
- language
- English
- LU publication?
- yes
- id
- 7d86c063-5180-46ab-9f04-3979e570ed67 (old id 979573)
- date added to LUP
- 2016-04-04 11:40:28
- date last changed
- 2024-01-26 13:52:03
@inproceedings{7d86c063-5180-46ab-9f04-3979e570ed67,
abstract = {{This talk describes the various stages of ATLAS Data Challenge 2 (DC2)<br/><br>
in what concerns usage of resources deployed via NorduGrid's Advanced<br/><br>
Resource Connector (ARC). It also describes the integration of these<br/><br>
resources with the ATLAS production system using the Dulcinea<br/><br>
executor.<br/><br>
<br/><br>
ATLAS Data Challenge 2 (DC2), run in 2004, was designed to be a step<br/><br>
forward in the distributed data processing. In particular, much<br/><br>
coordination of task assignment to resources was planned to be<br/><br>
delegated to Grid in its different flavours. An automatic production<br/><br>
management system was designed, to direct the tasks to Grids and<br/><br>
conventional resources.<br/><br>
<br/><br>
The Dulcinea executor is a part of this system that provides interface<br/><br>
to the information system and resource brokering capabilities of the<br/><br>
ARC middleware. The executor translates the job definitions recieved<br/><br>
from the supervisor to the extended resource specification language<br/><br>
(XRSL) used by the ARC middleware. It also takes advantage of the ARC<br/><br>
middleware's built-in support for the Globus Replica Location Server<br/><br>
(RLS) for file registration and lookup.<br/><br>
<br/><br>
NorduGrid's ARC has been deployed on many ATLAS-dedicated resources<br/><br>
across the world in order to enable effective participation in ATLAS<br/><br>
DC2. This was the first attempt to harness large amounts of strongly<br/><br>
heterogeneous resources in various countries for a single<br/><br>
collaborative exercise using Grid tools. This talk addresses various<br/><br>
issues that arose during different stages of DC2 in this environment:<br/><br>
preparation, such as ATLAS software installation; deployment of the<br/><br>
middleware; and processing. The results and lessons are summarized as<br/><br>
well.}},
author = {{Sturrock, R. and Eerola, Paula and Konya, Balazs and Smirnova, Oxana and Lindemann, Jonas}},
booktitle = {{CERN-2005-002}},
editor = {{Aimar, A. and Harvey, J. and Knoors, N.}},
keywords = {{NorduGrid ATLAS Data-challenge}},
language = {{eng}},
pages = {{1095--1098}},
publisher = {{CERN}},
title = {{Performance of the NorduGrid ARC and the Dulcinea Executor in ATLAS Data Challenge 2}},
url = {{https://lup.lub.lu.se/search/files/5828647/979581}},
volume = {{2}},
year = {{2005}},
}