28.11.2011 1
Current Status of the Grid Computing for Physics in Romania
Horia Hulubei National Institute of R&D in Physics and Nuclear Engineering (IFIN-HH)
RO-LCG WORKSHOPIFIN-HH, Magurele, 28.11.2011
M. DuleaElementary Particles and Information Technology Dept.
Applications of Grid Technology and High Performance Computing in Advanced Research
28.11.2011 2
OVERVIEW
NATIONAL GRID INFRASTRUCTURE
USER COMMUNITIES
MONITORING SERVICES AND TOOLS
ROMANIAN TIER-2 FEDERATION RO-LCG
RO-LCG RESOURCES, GRID PRODUCTION
2011 RESULTS
ORGANIZATION
PROSPECTS
FUNDING
RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011
06.04.2011 3
NATIONAL GRID INFRASTRUCTURE
Network infrastructure: NREN RoEduNet; backbone + connection to GEANT (10 Gbps)
Certified & active resource centers:
RO-LCG Federation:IFIN-HH, 5 Grid sites.ISS, Inst. for Space Sciences (2 sites)UPB, Univ. Politehnica Bucharest (susp.)ITIM, NIRD in Molecular & Isotopic Technologies - ClujUAIC, Univ. Alex. Ioan Cuza - Iasi
ROGRID_NGI: ICI, NIRD in Informatics, BucharestUTCN, Technical Univ. Cluj-NapocaUVT, West Univ. Timisoara; UPB
Other: certified and not active (2), or not certified and active (RO): GRIDIFIN, MEDGRID, UTCB
RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011
National Grid for Physics and Related Areas (GriNFiC) <=
GRINFIC - NETWORK TOPOLOGY
28.11.2011 4
RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011
RESOURCES @ CTI/DPETImax.1100 cores, 270 TB
RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011
28.11.2011 6
USER COMMUNITIES (VOs)
GriNFiC
LHC user community: ALICE, ATLAS, LHCb (RO-LCG)
HEP: ILC, HONE
ITER user community: FUSION (in progress)
SPACE SCIENCES
National: GRIDIFIN - support the running of the physics applications of non-LCG users
ex.: computational modeling of materials
99% of the total grid production on national VOs
SAM: IFOPS - monitoring of the sites of GriNFiC, including those of RO-LCG
OTHERS (RO-09-UTCN)
envirogrids.vo.eu-egee. org - supports Black Sea region environment studies
gridmosi.ici.ro - High Performance Modelling, Simulation and Optimization
see, seegrid - regional SE Europe
RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011
28.11.2011 7
GRID PRODUCTION PER SITE and VO
RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011
LCG VOs: 97.55%HEP total: 98.03%National VOs: 0.91%Other VOs: 1.06%
28.11.2011 8
MONITORING SERVICES
- NGI seems not be able, or not enough motivated to ensure reliable SAM services for RO-LCG
- RO-LCG site admins of are not notified about the problems
=> development of a parallel system for SAM and real-time notificationThe service is provided through IFOPS VO, which plays a similar role as OPS.The tests are modified to replace the part wich publishes the results to a STOMP server with the gsi-ftp transfer to GriNFiC's WMS. The results are collected and published using Nagios.
RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011
28.11.2011 9
MONITORING SERVICES
RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011
28.11.2011 10
MONITORING/ACCOUNTING TOOLS
job monitoring (queued/exec) on each VO
job accounting (megaSI2k) on each VO
data trensfer
RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011
Tools for monitoring/accounting of jobs, network traffic for clusters & storage, developed in IFIN-HH
07.12.09 11
ROMANIAN TIER-2 FEDERATION RO-LCGObjective: Coordination of the provision of the pledged hardware resources and the necessary manpower for computational simulation and analysis necessary in ALICE, ATLAS, LHCb, together with the realization of the minimal Tier-2 SLAs assumed in the MoU with CERN. Today, RO-LCG benefits of its own monitoring services.
MEMBERS: 5 institutions, 8 sites, > 3500 cores, > 1PetaByte• IFIN-HH
• NIHAM (ALICE / AliEn) - DFH • RO-02-NIPNE (ATLAS, HONE) - DPETI (ATLAS building) - Gabriel Stoicea• RO-07-NIPNE (ALICE, ATLAS, LHCb) - DPETI (CC) - Mihai Ciubancan• RO-11-NIPNE (LHCb) - DPETI (CC) - Teodor Ivanoaica
• Institute for Space Sciences (ISS)• ISS (ALICE / AliEn), RO-13-ISS - Sorin Zgura / Ionel Stan;
• "Alexandru Ioan Cuza" University - Iasi (UAIC)• RO-16-UAIC (ATLAS) - Octavian Rusu / Ciprian Pinzaru
• University “Politehnica” - Bucharest (UPB)• RO-03-UPB, (ALICE) - Nicolae Tapus - NCIT (currently suspended)
• Natl. Inst.for Isotopic and Molecular Technology - Cluj( ITIM-Cluj)• RO-14-ITIM (ATLAS) - Felix Farcas
RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011
28.11.2011 12
RO-LCG RESOURCES
Minimum network connectivity: 10 Gb/sec. (connection to RoEduNet backbone)Capacities now:
RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011
site cores TBRO-02-NIPNE 416 194RO-07-NIPNE 1100 270RO-11-NIPNE 120RO-13-ISS 64 156RO-14-ITIM 240 35RO-15-NIPNE 108 21RO-16-UAIC 248 82
total 2216 758
+ NIHAM (ALICE)(>1500 cores, > 1000 TB)
06.04.2011 13
NATIONAL GRID PRODUCTION PER VO and PER SITE
RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011
28.11.2011 14
RO-LCG RESULTS - 1/2
NUMBER of LCG JOBS
During the last 12 months RO-LCG provided 1,72 % of
the total number of jobs processed by all the Tier-2
centres worldwide, ranking 11th of 33 countries in the
WLCG collaboration
RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011
GRID PRODUCTION on the 3 LCG VOs
RO-LCG had a higher annual rate of growth than Tier-2s
(Nov.2010-Oct.2011 / Nov.2009-Oct.2010)
RO-LCG rate of production growth: 2.25
Worldwide rate of growth of Tier-2s on the 3 VOs: 2.03
Source: EGI accounting portal http://www3.egee.cesga.es/
28.11.2011 15
RO-LCG - RESULTS - 2/2
AVAILABILITY/RELIABILITY
Global improvement between Jan.2009 - Sep. 2011
Positive linear trend towards the ideal value of 95%
RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011
Minima mainly due to network andhardware failures
Source: Lcg Office, monthly reliability & availability reports
ORGANIZATION
Romanian Association for the Promotion of the Advanced Computational Methods in Scientific Research (ARCAŞ) - organization of scientists, IT professionals, and institutions engaged in the use of high performance computing technologies and methods for scientific research.
ARCAŞ is a Romanian private legal entity, apolitical, non-governmental, non-profit, which complies with the Romanian laws in force.
The purpose of ARCAŞ is to unify and coordinate at national level the efforts of the scientific community towards the promotion and development of advanced computational methods and the realization of a sustainable computing infrastructure for scientific research.
Founded in 2011 by a group of professionals from UAIC, IFIN-HH, ISS, UPB, UTCN, ROSA, UVT
Main objectives:
• Support of the development and application of advanced computational methods in scientific research, such as HPC, Grid computing, and cloud computing
• Strengthening the role of the scientific research and education community in the coordination at the national level of the HPSC activity
15.09.2011 16
RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011
PROSPECTS
RO-LCG
Participate to intense activity in 2012 in order to find evidence of new physics
Preparing for reprocessing and reanalysis of LHC data to be performed during the LHC
stop 2013-2014
GriNFiC
Enlarge the user community
Programing and/or implementation of new user tools
ARCAS
Increase number of members (persons and institutions)
Take part actively to the coordination of the advanced computing activities, projects, etc.
15.09.2011 17
RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011
FUNDING
RO-LCG Grid infrastructure was realized in the framework of various national projects within programmes of the National Plan for Research, Development and Innovation 1 & 2 (PNCDI1 & PNCDI2), financed by the National Authority for Scientific Research (ANCS)
GRIDIFIN infrastructure was realized with funding from the GRICEFCO project, special structural funds call SOP IEC 2.2.3 for Grid and RoEduNet
The collaboration with LIT-JINR / Dubna in the framework of the Hulubei-Meshcheriakov programme (2005-2013), theme Optimization Investigations of the GRID and Parallel Computing Facilities at LIT-JINR and Magurele Campus
The operational support of the HPC infrastructure that will be accessed through GriNFiC benefits of the FP7 HP-SEE project High-Performance Computing Infrastructure for South East Europe’s Research Communities, www.hp-see.eu
15.09.2011 18
RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011
28.11.2011 19
THANK YOU FOR YOUR ATTENTION !
RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011