Alex Read, Dept. of Physics

Grid Activities in Norway

R-ECFA, Oslo, 15 May, 2009

Alex Read, Dept. of Physics

Grid activities in Norway

• World-wide LHC Computing Grid (Norway~1.8%)• Advanced Resource Connector-related projects• Norwegian Tier-1(+2) sites• Tier-3 status• Ganga (multi-grid job submission tool)• ARC performance in ATLAS production• Norwegian, Nordic, European grid initiatives

Alex Read, Dept. of Physics

Norwegian resources for WLCG

– Provided outside the HEP projects (ALICE & ATLAS)• Tier-1 & 2: Binding through MoU yearly basis• Tier-3 for analysis through NorGrid/NOTUR

– 2 Grid-related post-docs for Alice and Atlas (50% HEP projects, 50% Uninett-Sigma (Norwegian eScience)

F. Ould-Saada

Alex Read, Dept. of PhysicsF. Ould-Saada

Distributed!

Alex Read, Dept. of Physics

Norwegian participation (and quite some leadership) in the Norwegian participation (and quite some leadership) in the NorduGrid Collaboration and the 3 ARC middleware-NorduGrid Collaboration and the 3 ARC middleware-related Grid projectsrelated Grid projects

• NorduGrid Collaboration (www.nordugrid.org)– Develop, support, and coordinate inputs to the Advanced

Resource Connector (ARC) middleware

• The KnowARC project (www.knowarc.eu)– Create a novel, powerful Next Generation Grid middleware

based on ARC and bridge the gaps between business and academia in Grid development

• NDGF (www.ndgf.org)– NDGF is a production grid facility that leverages existing,

national computational resources and grid infrastructures Nordic Tier-1 and external Tier-2’s

• NGIn (www.nordugrid.org/ngin)– Train new Grid experts, securing further technology

development 5 PhD grants, Grid school

ARC ~ 2M Euros / year Farid Ould-Saada

(rest of ATLAS is jealous)

Alex Read, Dept. of Physics

Grid activities in Bergen• Tier-1 resources

• 136 cores, 2 GB ram per core• 240 TB storage• Tape backup, tape storage• After upgrades in May 2009, 50/50 share of

Tier-1 hardware in Bergen and Oslo• Main focus on ALICE support (Oslo has

concentrated on ATLAS)

Boris Wagner

Alex Read, Dept. of Physics

Grid activities at UiO / USIT

• Tier-1, Tier-2 (NDGF) compute resources– 4000 core cluster (titan), Condor pool

– Atlas (significant fraction of Nordic T1)

– Alice production (to resume spring 09)

– 362 dedicated cores, 552 dedicated cores (April 2009)

– free resource (idle cores)

– Regularly see > 1000 grid jobs

– NorGrid production site

• Tier-1 storage pools (dCache)– 120 TB 2008, 260 TB 2009 (April)

Hans Eide

Alex Read, Dept. of Physics

Grid activities at UiO / USIT (cont.)

• Collaboration between HEP group and USIT– Middleware development (ARC)

– Graduate students (2)

• Tier-3 Atlas activities coming– Dedicated storage

– Interactive nodes

Hans Eide

Alex Read, Dept. of Physics

Tier-3 coming along

• Norwegian resources useful for LHC analysis (stallo, titan) are ARC-enabled

Alex Read, Dept. of Physics

Distributed analysis in ATLAS

• Ganga is the primary tool in ATLAS to submit user analysis jobs to the WLCG (which has 3 diverse middlewares: VDT, gLite, ARC)

• Norway supports the ARC backend• Follow up and support integration of ARC into Ganga:

– Full support for all ATLAS analysis work flows– Full support for ARC job control through Ganga, independent of ATLAS

• Use Ganga/ARC for continous, heavy testing of ARC resources under various conditions, to ensure maximum reliability

Ganga in action

Bjørn Samset

Alex Read, Dept. of Physics

ATLAS Production System

11

Task request interfaceprodDB: jobdefs, job states, metadata

Input: DQ2 datasetsTask states

Output: DQ2 datasets3 grids/10 Clouds

Monitor sites, tasks, jobs

Panda

Alex Read, Dept. of Physics

Performance of ARC-enabled NDGFJan-Sep 2008

Effective use of (less than 10%) computing resources

Fast response

Highest eff.

2007

NDGF cloud

Alex Read, Dept. of Physics

Get on the grid...snip...

The default grid middleware that is used by the NorGrid initiative is the Advanced Resource Connector (ARC). You need to install the ARC middleware client on your local desktop. There is a wealth of documentation on ARC middleware. In particular, the ARC User Guide is recommended literature. ...snip...

Alex Read, Dept. of Physics21/04/23 F. Ould-Saada 14

http://www.nordforsk.org/text.cfm?id=499&path=58,66

•Principal goal is to establish a Nordic eScience committee and management structure with respect to other stakeholders.•Activities include programme plans for resourcing computational grand challenge research•An expert group on Grid infrastructure is established: NDGF, Nordic participation in WLCG (including LHC upgrade plans) are among central topics in the mandate of the group.

eNoria – The Nordic eScience Initiative

Alex Read, Dept. of Physics

Establishing a sustainable grid (EGI)

Thanks to NorduGrid, NDGF (and others), production grids are reality today

F. Ould-Saada

Alex Read, Dept. of Physics

ARC as part of EGI middleware

F. Ould-Saada

• NorduGrid participation in EGI_DS middleware task force• UMD session at NorduGrid 2008 conference, including panel discussion• UMD meeting, Rome December 2008• UMD meeting, Munich, February 2009• Oslo UMD workshop, 11-12 March 2009

Alex Read, Dept. of Physics21/04/23

OSLO Workshop: March 11-12http://indico.cern.ch/conferenceDisplay.py?confId=52786

Next workshop: CERN April 23-24http://indico.cern.ch/conferenceProgram.py?confId=54910

Common EU application towards end of 2009?Common middleware for LHC and other applications?

Towards a first implementation of UMD

Proposal2/3/2009

Farid Ould-Saada et al

F. Ould-Saada

Alex Read, Dept. of Physics

Summary

• The Norwegian contribution to WLCG is in good shape

• The utilization of the ARC-enabled resources is excellent

• NDGF (distributed Tier-1) is a great success• The Norwegian grid infrastructure for computational

science is well-established and growing• Grid activity in Norway is strongly influencing the

Nordic and European scenes