www.egi.eu
EGI-Engage is co-funded by the Horizon 2020 Framework Programme
of the European Union under grant number 654142
EGI.eu
EGI Today and Towards an
Open Science Commons
Yin Chen
Slides credit: EGI Federation members
29/8/2015
Outline
• EGI today
• EGI Technology
• EGI Communities
• Towards 2020, a Vision for Open
Science Commons
IEEE e-Science 2015, PLAN-E plenary 4th Sep – Munich
39/8/2015
Outline
• EGI today
• EGI Technology
• EGI Communities
• Towards 2020 and a Vision for
Open Science Commons
IEEE e-Science 2015, PLAN-E plenary 4th Sep – Munich
59/8/2015
EGI.eu and its participants - 2015
ParticipantsCERN, EMBL-EBI, Belgium, Bulgaria, Croatia, Czech Republic, Estonia, Finland, France, Germany, Greece, Hungary, Israel, Italy, FYR of Macedonia, Netherlands, Poland, Portugal, Romania, Slovakia, Slovenia, Spain, Switzerland, Sweden, Turkey, UK
Under discussionArmenia, Austria, Belarus,
Denmark, Moldova,
Norway, Russia, Ukraine
• 26 participants: 24 NGIs and 2
EIROs (CERN, EMBL-EBI)
– Opening membership to research
communities
– Opening membership to non-
European countries
• Affiliation programme
– Lower barriers of entry to widening
countries
EGI.eu in Amsterdam
IEEE e-Science 2015, PLAN-E plenary 4th Sep – Munich
69/8/2015
Federating e-infrastructures and data
• Distributed, federated storage, HTC
and cloud facilities
• Virtual Research Environments
• > 200 registered user research
projects
• ~350 resource centres in 54 countries
• 550,000 logical CPU cores
• >290 PB disk, 180 PB tape
• > 99.6% reliability
IEEE e-Science 2015, PLAN-E plenary 4th Sep – Munich
89/8/2015
Implementing the Open Science Commons
Researchers from all disciplines have
easy, integrated and open access to
the advanced digital services,
scientific instruments, data, knowledge
and expertise they need to collaborate
to achieve excellence in science,
research and innovation.
Projects and partnerships:E-infras, Res. Infras, Funding agencies
www.opensciencecommons.org
E-infrastr. Commons
Data Commons
Knowledge Commons
Scientific Instruments
EGI-Engage H2020 project:
• 30 months, Start: 1/March/2015
• 43 partners
• 8 m Euro EC contribution
99/8/2015 http://www.egi.eu/news-and-media/newsfeed/news_2015_025.html
EGI Strategy Map
Openness Collaboration Innovation Trustworthiness InclusivenessCore values
Trusted adviserFederate digital capabilities, resources
and expertise
Co-create and integrate open and user-drivenservices and solutions
Operate services across the federated infrastructure
Strategic Goals
Researchers from all disciplines have easy, integrated and open access to the advanced digital capabilities, resources and expertise
needed to collaborate and to carry out compute/data intensive science and innovation
Create and deliver open solutions for science and research infrastructures to federate digital capabilities,resources and expertise between communities and across national boundaries
EGI Vision
EGI Mission
Achieve sustainable future
Influence policyServe, support and
improve live servicesDesign, develop
and deploy solutionsEngage
research communities
Strategic Themes
……
Offering
Federated Cloud Federated Open Data processing
Federated Operations
Community driven Innovation & Support
Technical Expertise
High-Throughput Data analysis Policy advice
We want research that benefits the economy, society & environment;
We want Open Science without borders
EU & National governments
Empower us to perform collaborative compute/data intensive science across Europe &
worldwide, efficiently
Research communities, RIs and LToS
Help us exploit compute/data intensive science and research
data to innovate
SMEs and Industry
Target Groups
Quality Mgt. Training
109/8/2015
Outline
• EGI today
• EGI Technology
• EGI Communities
• Towards 2020 and a Vision for
Open Science Commons
IEEE e-Science 2015, PLAN-E plenary 4th Sep – Munich
119/8/2015
Platform diversification in EGI
• 2005-2014:
– Grid platform (gLite, ARC, Unicore, QCG, DG)
• 2014-2020:
– Federated Cloud platform
– Long-tail of science platform
– Open Data platform
– (GPGPU platform)
– Container (Docker)
– ELIXIR, BBMRI, …?
129/8/2015
Architecture of the EGI Federated Cloud
Cloud Providers
Cloud Site
(OpenStack)
Cloud Site
(OpenNebula)
Cloud Site
(Synnefo)
EGI Core Platform
Operation services
AAI(VOs)
Serviceregistry
Informationsystem
Accounting Monitoring
AppliancesMarketplace (AppDB)
Endorsed VM images
Uniform interfaces and behaviour
Imagereplication
Share & endorseVM images (OVF)
Manageinstances
IEEE e-Science 2015, PLAN-E plenary 4th Sep – Munich
139/8/2015
Typical Usage Models
• Service Hosting– Long-running services (e.g. web, database or
application servers)
• Compute and data intensive workloads– Batch and interactive computing with scalable and
customized environments
• Datasets repository– Store and manage large datasets for your applications
• Disposable and testing environments– Hosting for demos, trainings, tests with minimal
overhead
149/8/2015
Outline
• EGI today
• EGI Technology--Federated Cloud
• EGI Communities
• Towards 2020 and a Vision for
Open Science Commons
IEEE e-Science 2015, PLAN-E plenary 4th Sep – Munich
159/8/2015
EGI Engagement Strategy
http://go.egi.eu/engagementstrategy
Excellent
science
Events and
communicationConsultancy
and support
Virtual Teams
AND
Competence
Centres
OutreachTechnical
engagement Implementation
Outcome Joint
activity
plan
Awareness and
interest in EGI
Success cases, tools, champions, etc.
Existing
solutions
Usercommunities
NGIsDistributed Competence Centers
PLAN-E (eScience Centers)
IEEE e-Science 2015, PLAN-E plenary 4th Sep – Munich
169/8/2015
EGI-Engage Distributed Competence
Centers
EGI-Engage
BBMRI
DARIAH
EISCAT-3D
ELIXIR
EPOS
LifeWatch
MoBRAIN/INSTRUCT
Environment(disaster
mitigation)
IEEE e-Science 2015, PLAN-E plenary 4th Sep – Munich
179/8/2015
12%0.26
%
14%
74%
0.26% 0.12%
Engineering and Technology
Humanities
Medical and Health Sciences
Natural Sciences
Social Sciences
Support Activities
CPU time usage of EGI Scientific User Communities from the 03 - 08 2015
Note: Natural Sciences include physics, chemistry, earth science and some biology, etc
EGI User Communities
IEEE e-Science 2015, PLAN-E plenary 4th Sep – Munich
Community Increasing users #
increasing users %
Engineering & Technology +347 +13.7%
Medical& Health Sciences +419 +15.9%
Natural Sciences +5102 +28.6%
Social Sciences +225 +20.9%
Humanities +234 +21.1%
Support Activities -2331 -49.6%
Others +66 4%
189/8/2015
WeNMR VRC (Jan 2015)
• The 1st VRC officially recognized by EGI
• One of the largest (#users) VO in life sciences
• > 1600 VRC members (>60% outside EU)
• of which >680 VO-registered users (with certificates)
• ~ 100 000 CPU cores (from 41 sites)
• > 2000 SI2K CPU years
• > 5M jobs
• User-friendly access to Grid via web portals
www.wenmr.eu
NMR SAXS
A worldwide e-Infrastructure for NMR and structural biology
Serving ESFRI INSTRUCT
199/8/2015
EGI Usage statistics
End
of EU
fun
din
g
Geographic distribution(Nov 2013 – Nov 2014)Enabled via EGI
federated operation
Excluding OSG resources
Statistics http://accounting.egi.eu
209/8/2015
A&A Community
• Collection of heterogeneous, distributed, scientific (sub)-communities
• Study the different scientific aspects of formation and evolution of the Universe
• Commonalities in terms of technological challenges and requirements
– Computing (HTC but also HPC)
– Demanding in terms of data
IEEE e-Science 2015, PLAN-E plenary 4th Sep – Munich
219/8/2015
A&A Heavy User Community
• Research communities:– Radio Astronomy, Gamma Ray Astronomy,
Helio-physics, Stellar Astrophysics, cosmology….
• The A&A Virtual Organizations – 10 with
– about 500 users
– about 80000 cores
– about 100 TB storage
– More in other VOs
• A light weight coordination
• The A&A Heavy User Community
• Identify commonalities and common technical solutions.
IEEE e-Science 2015, PLAN-E plenary 4th Sep – Munich
229/8/2015
Success Stories
• Planck ESA satellite mission: measure the CMB.
• EGI used to execute simulations (resources) to estimate the Cosmological Parameters correcting instrumental and observational systematics.
• Main experiment in cosmology of the last 10 years (more that 700 papers in the last year)
• Planck VO: ~50 users, ~ 20000 Cores, 15TB
• CTA:– open observatory to a wide astrophysics
community
– explore our Universe in depth in Very High Energy
• VO– 120 users
– ~ 70K cores
– 7 EU countries and US
• Simulations and testing that requires large HTC facilities
vo.cta number of users
IEEE e-Science 2015, PLAN-E plenary 4th Sep – Munich
239/8/2015
Outline
• EGI today
• EGI Technology
• EGI Communities
• Towards 2020 and Vision for an
Open Science Commons
IEEE e-Science 2015, PLAN-E plenary 4th Sep – Munich
249/8/2015
Digital ERA – State of play 2015
• Incomplete national roadmaps for Research and e-Infrastructures
– E-Infrastructures and RIs should be components of the same research
system
• e-Infrastructure Commons not fully achieved yet
– Lack of e-Infrastructure capacity for multidisciplinary research and the
long tail of science
– Different access policies for user groups in each access
– Incomplete technical interoperability, different access policies
– The “Commons” governance principle not widely adopted
– Non organized landscape of multiple service providers and research
communities, lack of cross-border procurement/funding scheme that
allows coordinated resource management across Europe (except for
GEANT)
• Lack of one ‘backbone’ of European ICT capabilities
IEEE e-Science 2015, PLAN-E plenary 4th Sep – Munich
259/8/2015
Open Science Commons Vision
Researchers from all disciplines
have easy, integrated and open access
to the advanced digital services, scientific
instruments, data, knowledge and expertise
they need to collaborate and achieve
excellence in science, research and innovation.
They feel engaged in governing, managing and
preserving these resources for everyone’s
benefit, with the support of all stakeholders.
IEEE e-Science 2015, PLAN-E plenary 4th Sep – Munich
269/8/2015
Open Science Commons:
• Definition: A set of interrelated resource systems governed as commons
that support the open creation and dissemination of scholarly knowledge
• Developing a commons-oriented approach when designing systems
• Ensuring maximization of return from public investment
• Initial elements for Europe
– An open science infrastructure backbone for network, computing and data
– Stimulating research data as commons
– Networks of knowledge hubs for skills development, innovation and expert
support
Digital services and applications
Knowledge & Expertise
Instruments
Research Data
website: www.opensciencecommons.orgpaper: http://go.egi.eu/osc
279/8/2015
Open Science:
a Complex Resource System
• Shared resources
– Integrated, easy and fair access
• Engaged communities
– Participating in the process
– Culture of sharing
– Collaborating in the management and
stewardship
• Governance
– Rules to access
– Rules to resolve conflicts
– Rules to balance quality vs. openness
• Financial support
– For long-term availability
Digital services and applications
Knowledge & Expertise
Instruments
Research Data
IEEE e-Science 2015, PLAN-E plenary 4th Sep – Munich
289/8/2015
A common endeavor (EU perspective)
Digital services and applications
Knowledge & Expertise
Instruments
Research data
Centres of Excellence
Innovation Centres
IEEE e-Science 2015, PLAN-E plenary 4th Sep – Munich
299/8/2015
Future steps
• Broaden the dialogue on OSC to more stakeholders
• Establish a framework of discussion that
encourages participation and contribution
• Identify/analyse other key building blocks that need
development
• PLAN-E members are invited to EGI discussions
– Next Engagement meeting: 7 Sep, 14-16 (Amsterdam
time)
– Contact: Gergely Sipos ([email protected] )
– Agenda: https://indico.egi.eu/indico/conferenceDisplay.py?confId=2645
IEEE e-Science 2015, PLAN-E plenary 4th Sep – Munich
www.egi.eu
Thank you for your attention.
Questions?
This work by Parties of the EGI-Engage Consortium is licensed under a
Creative Commons Attribution 4.0 International License.
http://cf2015.egi.eu