Embed Size (px)
Citation preview
European Grid Initiative
Per ÖsterDirector Application Services, CSC – IT Center for Science Ltd, Finland
EGI Council Chair
Chair EGI.eu Executive Board
Why Still Grids?
2
Evolution of European Grid
Testbeds UtilityProductive Use
National/Regional
EU Projects
European e-Infrastructure
3
Grids and key Europeane-Infrastructure
• European Data Grid (EDG)– Explore concepts in a testbed
• Enabling Grid for E-sciencE (EGEE)– Moving from prototype to production
• European Grid Infrastructure (EGI)– Routine usage of a sustainable e-infrastructure
4
EGI – European Grid Initiative
• Overall governing body:– EGI Council
• NGIs + other associated partners (e.g. EIRO members)
• Legal entity, 8 Feb 2010:– EGI.eu
• Coordinating organization -“glue” between different distributed computing infrastructures in Europe and beyond
EGI Council
24 Member Countries1 June 2010
Committed to the EGI objectives and yearly fee
Participant Country Council Member
1 BELNET Belgium Rosette Vandenbroucke
2 IPP-BAS Bulgaria Kiril Boyanov
3 SWITCH Switzerland Christoph Witzig
4 CESNET Czech Republic Jan Gruntorád
5 Gauß-Allianz Germany Dieter Kranzlmüller
6 CSIC Spain Isabel Campos
7 CSC Finland Per Öster
8 CNRS France Michel Spiro
9 GRNET Greece Panagiotis Louridas
10 SRCE Croatia Ivan Marić
11 Grid-Ireland Ireland Brian Coghlan
12 INFN Italy Mirco Mazzucato
13 NCF the Netherlands Arjen van Rijn
14 CYFRONET AGH Poland Michał Turała
15 IPB Serbia Aleksandar Belic
16 ARNES Slovenia Marko Bonac
17 IISAS Slovakia Ladislav Hluchý
18 ULAKBIM Turkey Serkan Orcan
19 JISC United Kingdom Andrew Richards
20 CERN EIRO Robert Jones
21 UNINETT Sigma AS Norway Jacko Koster
22 EENet Estonia Mihkel Kraav
23 SNIC Sweden Sverker Holmgren
24 CyGrid Cyprus Marios Dikaiakos
6
EGI ObjectivesEGI.eu Statutes Article 3.1
• “The objective of the foundation is to create and maintain a pan-European grid infrastructure in collaboration with NGIs in order to guarantee its long-term availability for performing research and innovation activities.”
7
EGI European Grid Initiative
8
EGI.eu:The legal Entity
EGI Council: The overall governing body
EGI Interaction
9
EGI.eu Organization in Amsterdam
• Director– Steven Newhouse
• Chief Administrative Officer– Catherine Gater
• Chief Community Officer– Steven Brewer
• Chief Operations Officer– Tiziana Ferrari
• Chief Technology Officer– Vacant(www.egi.eu/about/jobs)
• User Community Support Team
• Policy Development Team
• Dissemination Team• Financial Officer
10
http://www.egi.eu/about/staff/
EGI Infrastructure
…
International Research Collaboration
NationalGrid
Initiative 1
NationalGrid
Initiative 2
NationalGrid
Initiative N
Mid
dle
wa
re
A
Mid
dle
wa
re
B
Mid
dle
wa
re
B
Mid
dle
wa
re
X
gL
ite
UN
ICO
RE
AR
C
EGI.eu European-level Grid Services
Services
12
The EGI-InSPIRE Project Integrated Sustainable Pan-European Infrastructure for Researchers in Europe
• A 4 year project with €25M EC contribution– Project cost €69M– Total Effort ~€330M– Staff ~ 170FTE– Start 1 May 2010
Project Partners (48) EGI.eu, 37 NGIs, 2 EIROs, 8 AP
Funded
Un-Funded
EGI-InSPIRE Objectives
• Support Grids of high-performance and high-throughput computing resources
• Integrate existing and new Distributed Computing Infrastructures (DCIs)
• Be a coordinating hub for European DCIs– Support interoperation of individual national grid infrastructures
• Collect requirements and provide user-support for the current and new (e.g. ESFRI) users– Support new European and other international research
collaborations
13
EGI-InSPIRE Objectives
• Support current heavy users (e.g. WLCG)– In move their critical services and tools from a central support
model to ones driven by their own individual communities
• Define, verify and integrate within the Unified Middleware Distribution– middleware from external providers needed to access the e-
Infrastructure (European Middleware Initiative with ARC, gLite, and UNICORE, ….)
• Extend operational tools to support a national operational deployment model
• Include new DCI technologies in the production infrastructure– New Grid techs, Virtualization, Clouds,…
14
Scalable Community InteractionsU
SE
RS VOs
VOs
Virtual Research
Community
UserCommunity
Board
US
ER
S VOs
VOs
Virtual Research
Commmuity
US
ER
S
NGI
NGIHelpdesk
EGI.eu
Training Events
Trainers
Apps.DB
EGIHelpdesk
VRCHelpdesk
OtherHelpdesk
ESFRI Project
VOs
Virtual Research
Community
15
16
VRC Characteristics
• International Existence & Governance– A research community that spans borders– Ability for groups to join and leave– e.g. ESFRI, EIROForum, Collaboration, etc.
• Sustainable beyond just a funded project• Engagement with EGI
– Resources, Policies, Planning, ...• May provide community specific support
– Dissemination, Training, Application Porting, ...
European Strategy Forum on Research Infrastructures
• Roadmap updated in 2008• Preparatory phase funding for most projects• Big push in FP8 (2013 and beyond)?• 44 projects covering:
– Social Sciences and Humanities– Environmental Sciences– Energy– Biological and Medical Sciences– Materials and Analytical Facilities– Physical Sciences and Engineering– e-Infrastructures
Data Intensive ScienceNational commitments in European contextGlobal collaboration and shared accessLong lifetime (10-20+ years)
Road to Success yes/no?
• A few things to have in mind…
18
Be a Neutral Infrastructure
• Consider IP network providers– Open to any traffic from many different communities
• Restrictions to protect other users– Customised solutions within a generic framework
• Light paths on demand– Standards drive integrated deployment
• Hardware and fibre from many different providers
• And for sustainable E-Infrastructures?– Any application domain or middleware technology– A platform for domain specific innovation and use– Integration of any compliant compatible resources
Can we learn from others?
• Grids have benefited from commoditisation– Hardware: HTC & HPC affordable to all– Networking: >GBs can be moved over WAN– Software: Open source software comes of age
• How will commodity virtualisation impact us?– For transactional models
• Cloud Computing: A model based on compute not data
– For large distributed data-oriented models • The emergence of true ‘function shipping’?
Evolving Service Delivery Models
• Move towards an interoperable cloud infrastructure– Federated pan-European infrastructure– Use standards and the established AAAA mechanisms
• Provide a Data-Oriented Infrastructure as a Service– Use existing high performance data storage & transfers– Empower VRCs/VOs to source and run their own services
• Bring new research innovations into production– Federated cloud environments (i.e. VMs @ each site)– Experimenting with virtualised worker nodes in EGEE:
• e.g. INFN, BiG Grid, CERN, NGS, Dgrid, ...
What does this evolution mean?
• EGI coordinates the core infrastructure– Assessing & certifying technology for deployment– Ensure integration of the core services in Europe– Operate & manage domain specific environments
• If required by that domain!
• VOs now manage their own infrastructure– Decide what services are deployed where– Flexibility (& responsibility) to meet their own needs
Deregulate and open up the infrastructure(Where it makes sense to do so!)
A long-term need for Standards
• Data Layer– Secure reliable data movement– Standardised access to data resources
• Virtualisation Layer– VMM across trust domains within agreed policies– Monitoring as important as lifecycle control
• Service Layer– The services that go into the virtual machine– Avoid domain specific silos & promote reuse
Openness Consensus Balance Transparency
Sustainability
• Reduce barriers for collaborative data intensive science– Integration with GEANT provides unique offering– Support to ESFRI projects and new communities
• Flexibility to run the services and software they need
• Open global collaboration of e-infrastructures providers– Domain driven collaboration with other infrastructures– Open standardised interfaces to avoid vendor lock in– Add value where we can and outsource where we can’t
‘Europe as a hub for sustainable e-science and continuous service innovation’
Summary• EGI:
– Provide a sustainable production e-infrastructure• EGI.eu is now a legal entity based in Amsterdam
– Supported transition for 4 years through EGI-InSPIRE• Contact: [email protected]
EGI Technical Forum14-17th September 2010 in Amsterdam
withNRENS and Grids Workshop 15th Sept
www.terena.org/nrens-n-grids
Acknowledgment
• EGI.eu• Steven Newhouse, EGI.eu Director
26
