View
214
Download
0
Category
Tags:
Preview:
Citation preview
Extensions of the European Grid Infrastructure
Federico Ruggieri – INFN(Federico.Ruggieri@roma3.infn.it)
IX International Conference on Science Arts and CultureECSAC2009 - Veli Losinj - 29 August 2009
Outline
• A bit of history (my version, sorry !)
• The European Vision
• Regional Grid Infrastructures co-funded by the European Commission
• Commonalities and differences
• A common strategy for the future
• Conclusions
A bit of (my) short history of Grids
• In 1998 I. Foster & K. Kesselman - The Grid: Blueprint for a New Computing Infrastructure
• 1998 GRID presentation in CHEP’98 – Chicago.• 1999 Evaluation of Globus in INFN• 2000 CERN invited to take the lead of European Project
on Grids with LHC computing as the main user.
• In the 80’ and early 90’ the accent was on client-server and meta-computing.
• 2000 - 2003 First EU Project DataGRID and PPDG & GRIPHYN in US.
• 2003 – 2006 EGEE Project in EU and OSG in US• … etc.
Computing intensive science• Many vital challenges require community effort
– Fundamental properties of matter– Genomics– Climate change– Medical diagnostics
• Research is increasingly digital, with increasing amounts of data
• Computation ever more demanding• e.g.: experimental science uses ever more
sophisticated sensors • Huge amounts of data• Serves user communities around the world• International collaborations
The European Vision• The Research Network infrastructure provides
fast interconnection and advanced services among Research and Education institutes of different countries’
– Projects: GEANT, SEEREN, EUMEDCONNECT, etc.
• The Research Grid infrastructure provides a distributed environment for sharing computing power, storage, instruments and databases through the appropriate software (middleware) in order to solve complex application problems
– Projects: EGEE, SEE-GRID, EUMEDGRID etc.
• This integrated networking & grid environment is called electronic infrastructure (eInfrastructure) allowing new methods of global collaborative research - often referred to as electronic science (eScience)
• The creation of the eInfrastructure is a key objective of the European Research Area
Network Infrastructure
e-Science Collaborations
Grid Infrastructure
Globalisation of Grid Infrastructures
CNGrid
Garuda
EUAsiaGrid
Virtual Communities & Impact• e-Infrastructures support wide geographically
distributed communities → enhance international collaboration of scientists → promote collaboration in other fields.
• Grids and networks allow the access of many researchers to scientific resources (laboratories and data) → disparity can be reduced and larger participation and contributions to high quality research.
• The e-Infrastructures promote the usage of network connectivity and stimulate scientific and technical development of countries → contribute to fight the digital divide and brain drain.
Two (at least) scenarios• Greenfield regions/countries
– No previous Grid and e-Infrastructures activities– Scarce knowledge and/or experience in deploying/managing
large e-Infrastructures.– Isolated spots of research activities with high computing
demands.• Advanced regions/countries
– e-Infrastructures already started/deployed– Locally developed MW.– Fair to good knowledge and experience in e-Infrastructures– High quality research groups and institutions with world
wide collaborations.
Consolidated Work-plan
Train users and site administrators to use and operate an e-Infrastructure based on the EGEE middleware
Disseminate, both “bottom-up” and “top-down”, the e-Infrastructure paradigm for long term sustainability of e-Science
Seek, identify, and support e-Science communities and deploy their applications
Set-up and manage a Pilot Grid Infrastructure
Instruments & methods• National Grid Initiatives
– Internal (national) Infrastructures sustainability is still an issue.
• Regional coordination– Difficult to shape the demand of collaboration with Europe
in a Regional perspective (bilateral agreements always preferred).
• Coordination and interoperation with EGEE (in future with EGI).
• Stable Communication Networks co-operations still under development.– Synergistic approach with GEANT and EU NRENs and
specific regional networks projects, i.e. ALICE, EUMEDCONNECT2, TEIN3, ORIENT
SEEGRID-SCI
Before
SEE-GRID-SCI
During
SEE-GRID-SCI
BalticGrid II
EUAsiaGrid
INFN (IT)INFN (IT)CESNET (CZ)CESNET (CZ)NCeSS (UK)NCeSS (UK)
HealthGrid (FR)HealthGrid (FR)AdMU (PH)AdMU (PH)ANU (AU)ANU (AU)
ASGC (TW)ASGC (TW)ASTI (PH)ASTI (PH)HAII (TH)HAII (TH)IDA (SG)IDA (SG)
IAMI (VN)IAMI (VN)ITB (ID)ITB (ID)
NECTEC (TH) NECTEC (TH) UPM (MY)UPM (MY)
MIMOS (MY)MIMOS (MY)
EUMEDGRID
MA-GRID
INFN -Roma3
INFN -Catania
INFN - CNAF
ULAKBIM
CYNET
IUCC
GRNETUniv. of Tunis
Un. of Malta
ERI/EUNCERIST
NGI
NGI
NGI
NGI
NGI
NGI
NGI
NGINGI
NGI
NGI
IUGAZA
HIAST
JUNet
GARUDA &• The Department of Information
Technology (DIT), Government of India has funded the Centre for Development of Advanced Computing (C-DAC) to deploy the nation-wide computational grid GARUDA.
• In Proof of Concept (PoC) phase which ended on March 2008, 17 cities across the country were connected with an aim to bring “Grid” networked computing to research labs and industry.
• From April 2008 the Foundation phase is in progress with an aim to include more users’ applications, providing Service Oriented architecture, improving network stability and upgrading grid resources.
CNGRID &• The China National Grid (CNGrid) Project is supported by the
"High Performance Computer and its Kernel Software " project, which is a key project in the National High-Tech R&D Program (the 863 program).
• CNGrid is equipped with independently developed grid oriented high performance computers(Lenovo DeepComp 6800, Dawning 4000A) and constructs an open grid environment by 8 nodes including Hongkong.
• There are 11 application grids from various industies in CNGrid, such as National Geological Application Grid.
GOS to gLite pipeline
Gateway
gLite to GOS Pipeline
Gateway
Training, training, …. Training !First EUMEDGRID Grid School
(Cairo, Egypt, 17-28 April 2007)– 9 applications selected, all “gridified”,– 80 nodes, 4 grid sites, 6 Mb/s connection installed in a hotel
Workshops, conferences, events !
Jointly organised by EUMEDGRID, EUMEDCONNECT and GEANT2
Policy agenda for e-Infrastructures in the Mediterranean Countries
• More than 60 high level participants (Ministers, Politicians, EC Officers, Telecom Operators).• High profile speakers (HRH Princess Sumaya of Jordan, Mr. Mashour Abudaka Minister,
Palestine, Dr. Najib Abdul Wahed Deputy Minister of Higher Education for Scientific Research, Syria, etc.) and qualified participation of European Commission.
• Final panel expressed a strong support for the continuation of e-Infrastructures in the Mediterranean.
Dissemination, … dissemination !
e-Infrastructures
across the Mediterranean
http://ec.europa.eu/information_society/activities/internationalrel/dialogue_coop/euromed/docs_euromed/e_infrastructures_across_the_mediterranean_2008.pdf
• Combined effort of EUMEDGRID, EUMEDCONNECT and GEANT2
• Distributed in the folder of the Ministerial event in Cairo.
Policy, policy,….policy !
»Building an Enabling Environment for the EUROMED Information Society«
Cairo 27 February 2008
http://www.euromedinfo.eu/site.168.news.en.3214.html
14. The Ministers stressed the fundamental need to ensure interconnection of research networks to support, inter alia, the creation of grid-enabled scientific e-Infrastructures able to make ICT Research and Development cooperation between Europe and the Mediterranean countries more efficient;
Networks, networks, …. Networks !
IUCC - Il
GRNET - Gr
TUBITAK - Tr
MARWAN - Ma
- It
RED.ES - Es
ARN - Dz
EUN - Eg
JUNET - Jo
CYNET - Cy
Specific topics• In Greenfield regions:
– gLite and European approaches have been exported;– the Grid infrastructures have been promoted and are not yet sufficiently
mature to be sustainable;
• In large, rapidly developing, countries:– they have already well defined Grid infrastructures (China, India);– different Middleware implementations (not only gLite and ARC);– Internal (national) sustainability should not be an issue.
• Interoperability and interoperations with European Infrastructures and sustainability are the main goals– presently addressed in the activities of short lived projects (2 years max.)
with different speeds and time shifts due to the different EU calls where they have been approved;
– coordination, alignment of results, common road-maps are difficult to achieve, although being strongly pursued by all the projects.
What’s next• A new step forward - International Virtual Research
Organisations highly need e-Infrastructures with coordinated management and support to create truly global communities in the future.
• Value for EU - Europe has decisively contributed to the advent of e-Infrastructures in emerging regions (Asia, LA, Mediterranean) and new candidate EU countries (SEE, Baltic). Their evolution towards sustainable regional e-Science infrastructures should be finalised.
• Possible objectives:– Enhance the collaboration / coordination and harmonisation of European
and non-European e-Infrastructures in coherence with the EGI implementation.
– Co-ordinate and support the dissemination towards politicians and stakeholders for long term sustainability of e-Infrastructures in the regions concerned.
– Actively promote the adoption of standards and interoperable middleware solutions among the different regions.
CHAIN proposal
• EU partners: those managing past and existing initiatives of Regional Grid Infrastructures
• A number of non-EU partners as representatives of their regions (Maximum 10). The preferred choice will be to have a JRU or a single Organisation representing the whole region.
• Activities1. Policy Development – coherent scheme of cooperation and
interoperation of European and non-EU e-Infrastructures2. Technical – export EGI supported solutions and promote
interoperation with other non-EU e-Infrastructures.3. Leverage on cross-region communities and applications,
promote inter-regional, e-Infrastructures based, research infrastructures.
Timing2009 2010 2011 2012
EGEE III
EELA II
BalticGrid II
EUAsiaGrid
CHAIN
EUMEDGRID-Support
EUIndiaGrid2
EGI
SEEGRID-SCI
Conclusions• It’s a long road … to build stable e-Infrastructures, even in
Europe. An unreasonable acceleration can’t be applied to other regions.
• On the other hand many of those regions need to accelerate in order to catch up the more developed countries.
• However, some rapidly developing countries have already made it and are willing to interoperate with similar Infrastructures in other regions of the world.
• World wide spread scientific communities have started to appreciate the opportunities of working together on large inter-regional e-Infrastructures.
• It’s time to produce a coherent, multi-region and multi-path road-map for the sustainability and interoperations of those Regional infrastructures towards EGI and among themselves.
Thank you !
Recommended