www.egi.eu EGI
EGI
www.egi.eu EGI
EGI A Foundation for Compute and Data
Intensive Research
Per Öster EGI Council
30/05/2011 EGI - October 2011 1
www.egi.eu EGI
What is a Grid?
• A grid consists of distributed resources controlled by separate organisations that be systematically used securely by users external to that organisation
• Resources can include: – Commodity or HPC clusters – Disk and tape storage – Instruments – Data Archives and Digital Libraries – i.e. any resources on internet
30/05/2011 EGI - October 2011 2
www.egi.eu EGI
EGI
www.egi.eu EGI
The EGI Model
30/05/2011 EGI - October 2011 3
www.egi.eu EGI
EGI Collaboration
N G I
N G I
N G I
N G I
E I R O
E I R O EGI.eu
30/05/2011 EGI - October 2011 4
NGI: Na'onal Grid Ini'a've EIRO: European Intergovernmental Research Organisa'on
(e.g. CERN, EMBL, ESA, …)
Research Community
Research Community
Research Community
www.egi.eu EGI
EGI.eu • Coordination for European Grid resources
– Established February 8th 2010 – Central policy & services
needed to run a grid – Sustainable small
coordinating organisation • Based in Amsterdam
– Coordinating core (~20 people) in Amsterdam – Technical services from partners (~20 people)
30/05/2011 EGI - October 2011 5
EGI and EGI.eu: Supported by the EGI-InSPIRE project
EGI.eu Executive Board
www.egi.eu EGI
EGI.eu Governance
• EGI.eu established as non-profit foundation • Governance & ownership by its participants
– Participants: • European NGIs
– Associated participants: • Organizations aligned with EGI.eu’s objectives
– EIROS, non-eligible NGIs,…
• EGI Council contains all participants – Votes linked to financial contributions
30/05/2011 EGI - October 2011 6
www.egi.eu EGI
EGI Council
30/05/2011 EGI – October 2011 7
www.egi.eu EGI
EGI Objectives
30/05/2011 EGI – October 2011 8
www.egi.eu EGI
Statutes Policy Terms of Reference
Terms of Reference (ToR)
Policy Development Process (PDP)
Common Glossary (GCG)
EGI Governance
Technology
Technical Coordina'on
Board
Security
Security Coordina'on
Group
Opera'ons
Opera'ons Management
Board
Users
User Community
Board
9 EGI – October 2011
EGI Council
hLp://www.egi.eu/policy/groups/ hLp://go.egi.eu/policies_and_procedures
EGI.eu Execu've Board
www.egi.eu EGI
EGI Ecosystem
30/05/2011 EGI - October 2011 10
Public Funding Bodies
European Commission
Na'onal Research Councils
Service & Resource Providers
EGI.eu
Resource Infrastructure Providers
Technology Providers
Open Source Providers
Commercial Providers
Requirements + Feedback
Policies + Funding
Policies + Funding
Policies + Funding
Strategic Feedback
Requirements + Feedback
User Community
Services + Support
Requirements + Feedback
Technology + Support
www.egi.eu EGI
EGI-InSPIRE Project
Integrated Sustainable Pan-European Infrastructure for Researchers in Europe
A 4 year project with €25M EC contribution
– Project cost €72M – Total Effort ~€330M – Effort: 9261 PMs
30/05/2011 EGI - October 2011 11
Project Partners (50) EGI.eu, 38 NGIs, 2 EIROs Asia Pacific (9 partners)
www.egi.eu EGI
European Grid Infrastructure (July 2011 and increase from Apr 2010)
EGI-InSPIRE Update, Lyon 2011 12
Logical CPUs (cores) • 248,424 EGI (+29.3%) • 337,608 All 106.7 PB disk and 112.8 PB tape Resource Centres • 329 EGI • 346 All (+6.8%) • 93 supporting MPI (+6.8%) Countries (+11.5%) • 50 EGI • 57 All
38 NGIs providing resources • 26 National Operations Centres • 12 NGIs in 4 Federated Operations Centres 1 EIRO providing resources (CERN) 19 countries in 4 non-European Operations Centres
www.egi.eu EGI
EGI Usage (July 2011)
EGI-InSPIRE Update, Lyon 2011 13
Year to Year Increase 19,980 End-users (+61%) 278 VOs (+17.7%) ~30 high activity VOs (no change)
Average usage May 2010-July 2011 vs 2009-2010 • 28.9M jobs/month, 949,000 jobs/day (+ 90%) • 79.5M CPU wall clock hours/month (+31%) • 2.8M jobs/month for non-HEP users (+47%)
User Communities Archeology Astronomy Astrophysics Civil Protection Comp. Chemistry Earth Sciences Finance
Fusion Geophysics High Energy Physics Life Sciences Multimedia Material Sciences
…
www.egi.eu EGI
EGI Resource Providers and Operations Centres 1/2
• 22 National Operations Centres – Armenia, Belarus, Bosnia and Herzegovina, Bulgaria, Cyprus,
Croatia, Czech Republic, France, FYR of Macedonia, Germany, Georgia, Greece, Hungary, Israel, Italy, Montenegro, Poland, Romania, Serbia, Slovakia, Slovenia and Turkey
• 5 Federated Operations Centres (16 NGIs) – IberGrid (Portugal and Spain) – The Netherlands Federation (Belgium and The Netherlands) – Russian Federation (Russia and Ukraine) – NDGF Federation (Austria, Denmark, Estonia, Finland, Latvia,
Lithuania, Norway and Sweden) – United Kingdom/Ireland Federation
30/05/2011 EGI - October 2011 14
www.egi.eu EGI
EGI Resource Providers and Operations Centres 2/2
• 1 EIRO Operations Centre: CERN • 4 Non-European Operations Centres
– Asia Pacific Federation: Australia, China, India, Japan, Malaysia, Philippines, South Korea, Taiwan and Thailand
– Canada Federation: Canada and China – GISELA Consortium (IGALC Federation): Argentina,
Brazil, and Venezuela – Latin America: Brazil, Chile, Colombia and Mexico
30/05/2011 EGI - October 2011 15
www.egi.eu EGI
EGI
www.egi.eu EGI
Future Plans
30/05/2011 EGI - October 2011 16
www.egi.eu EGI
Key
Alignment to the Cloud
EGI – October 2011 17
Infrastructure
PlaRorms
SoSware
gLite UNICORE dCache ARC Globus
Central Services
Domain Services
Community Services
Virtual Research
Communi'es (Users)
NGI NGI EIRO NGI NGI Planning &
Coordina'o
n
Supp
ort
Services
Ecosystem Partners
NGIs + EIRO EGI.eu
www.egi.eu EGI
Summary
• EGI.eu established in Amsterdam – Supported through EGI-InSPIRE project
• EGI has transitioned from a federation of regional to national resource providers
• EGI will with technology providers to have a standards based open architecture
• EGI will evolve to support the needs of its current and new user communities
30/05/2011 EGI - October 2011 18
www.egi.eu EGI
Contacts • EGI.eu Director
– [email protected] • EGI.eu Operations Team
– [email protected] • EGI.eu User Community Support Team
– [email protected] • EGI.eu Policy Team
– [email protected] • EGI.eu Dissemination Team
– [email protected] • EGI.eu Secretariat
– [email protected] • EGI Council
30/05/2011 EGI - October 2011 19