EGI Today and Towards an Open Science Commons · PDF fileEGI-Engage is co-funded by the Horizon 2020 Framework Programme of the European Union under grant ... federated infrastructure

www.egi.eu

EGI-Engage is co-funded by the Horizon 2020 Framework Programme

of the European Union under grant number 654142

EGI.eu

EGI Today and Towards an

Open Science Commons

Yin Chen

Slides credit: EGI Federation members

29/8/2015

Outline

• EGI today

• EGI Technology

• EGI Communities

• Towards 2020, a Vision for Open

Science Commons

IEEE e-Science 2015, PLAN-E plenary 4th Sep – Munich

39/8/2015

Outline

• EGI today

• EGI Technology

• EGI Communities

• Towards 2020 and a Vision for



49/8/2015

Success with Grid


59/8/2015

EGI.eu and its participants - 2015

ParticipantsCERN, EMBL-EBI, Belgium, Bulgaria, Croatia, Czech Republic, Estonia, Finland, France, Germany, Greece, Hungary, Israel, Italy, FYR of Macedonia, Netherlands, Poland, Portugal, Romania, Slovakia, Slovenia, Spain, Switzerland, Sweden, Turkey, UK

Under discussionArmenia, Austria, Belarus,

Denmark, Moldova,

Norway, Russia, Ukraine

• 26 participants: 24 NGIs and 2

EIROs (CERN, EMBL-EBI)

– Opening membership to research

communities

– Opening membership to non-

European countries

• Affiliation programme

– Lower barriers of entry to widening

countries

EGI.eu in Amsterdam


69/8/2015

Federating e-infrastructures and data

• Distributed, federated storage, HTC

and cloud facilities

• Virtual Research Environments

• > 200 registered user research

projects

• ~350 resource centres in 54 countries

• 550,000 logical CPU cores

• >290 PB disk, 180 PB tape

• > 99.6% reliability


89/8/2015

Implementing the Open Science Commons

Researchers from all disciplines have

easy, integrated and open access to

the advanced digital services,

scientific instruments, data, knowledge

and expertise they need to collaborate

to achieve excellence in science,

research and innovation.

Projects and partnerships:E-infras, Res. Infras, Funding agencies

www.opensciencecommons.org

E-infrastr. Commons

Data Commons

Knowledge Commons

Scientific Instruments

EGI-Engage H2020 project:

• 30 months, Start: 1/March/2015

• 43 partners

• 8 m Euro EC contribution

https://www.opensciencecommons.org/

99/8/2015 http://www.egi.eu/news-and-media/newsfeed/news_2015_025.html

EGI Strategy Map

Openness Collaboration Innovation Trustworthiness InclusivenessCore values

Trusted adviserFederate digital capabilities, resources

and expertise

Co-create and integrate open and user-drivenservices and solutions

Operate services across the federated infrastructure

Strategic Goals

Researchers from all disciplines have easy, integrated and open access to the advanced digital capabilities, resources and expertise

needed to collaborate and to carry out compute/data intensive science and innovation

Create and deliver open solutions for science and research infrastructures to federate digital capabilities,resources and expertise between communities and across national boundaries

EGI Vision

EGI Mission

Achieve sustainable future

Influence policyServe, support and

improve live servicesDesign, develop

and deploy solutionsEngage

research communities

Strategic Themes

……

Offering

Federated Cloud Federated Open Data processing

Federated Operations

Community driven Innovation & Support

Technical Expertise

High-Throughput Data analysis Policy advice

We want research that benefits the economy, society & environment;

We want Open Science without borders

EU & National governments

Empower us to perform collaborative compute/data intensive science across Europe &

worldwide, efficiently

Research communities, RIs and LToS

Help us exploit compute/data intensive science and research

data to innovate

SMEs and Industry

Target Groups

Quality Mgt. Training

109/8/2015

Outline

• EGI today

• EGI Technology

• EGI Communities




119/8/2015

Platform diversification in EGI

• 2005-2014:

– Grid platform (gLite, ARC, Unicore, QCG, DG)

• 2014-2020:

– Federated Cloud platform

– Long-tail of science platform

– Open Data platform

– (GPGPU platform)

– Container (Docker)

– ELIXIR, BBMRI, …?

129/8/2015

Architecture of the EGI Federated Cloud

Cloud Providers

Cloud Site

(OpenStack)

Cloud Site

(OpenNebula)

Cloud Site

(Synnefo)

EGI Core Platform

Operation services

AAI(VOs)

Serviceregistry

Informationsystem

Accounting Monitoring

AppliancesMarketplace (AppDB)

Endorsed VM images

Uniform interfaces and behaviour

Imagereplication

Share & endorseVM images (OVF)

Manageinstances


139/8/2015

Typical Usage Models

• Service Hosting– Long-running services (e.g. web, database or

application servers)

• Compute and data intensive workloads– Batch and interactive computing with scalable and

customized environments

• Datasets repository– Store and manage large datasets for your applications

• Disposable and testing environments– Hosting for demos, trainings, tests with minimal

overhead

149/8/2015

Outline

• EGI today

• EGI Technology--Federated Cloud

• EGI Communities




159/8/2015

EGI Engagement Strategy

http://go.egi.eu/engagementstrategy

Excellent

science

Events and

communicationConsultancy

and support

Virtual Teams

AND

Competence

Centres

OutreachTechnical

engagement Implementation

Outcome Joint

activity

plan

Awareness and

interest in EGI

Success cases, tools, champions, etc.

Existing

solutions

Usercommunities

NGIsDistributed Competence Centers

PLAN-E (eScience Centers)


http://go.egi.eu/engagementstrategy

169/8/2015

EGI-Engage Distributed Competence

Centers

EGI-Engage

BBMRI

DARIAH

EISCAT-3D

ELIXIR

EPOS

LifeWatch

MoBRAIN/INSTRUCT

Environment(disaster

mitigation)


179/8/2015

12%0.26

%

14%

74%

0.26% 0.12%

Engineering and Technology

Humanities

Medical and Health Sciences

Natural Sciences

Social Sciences

Support Activities

CPU time usage of EGI Scientific User Communities from the 03 - 08 2015

Note: Natural Sciences include physics, chemistry, earth science and some biology, etc

EGI User Communities


Community Increasing users #

increasing users %

Engineering & Technology +347 +13.7%

Medical& Health Sciences +419 +15.9%

Natural Sciences +5102 +28.6%

Social Sciences +225 +20.9%

Humanities +234 +21.1%

Support Activities -2331 -49.6%

Others +66 4%

189/8/2015

WeNMR VRC (Jan 2015)

• The 1st VRC officially recognized by EGI

• One of the largest (#users) VO in life sciences

• > 1600 VRC members (>60% outside EU)

• of which >680 VO-registered users (with certificates)

• ~ 100 000 CPU cores (from 41 sites)

• > 2000 SI2K CPU years

• > 5M jobs

• User-friendly access to Grid via web portals

www.wenmr.eu

NMR SAXS

A worldwide e-Infrastructure for NMR and structural biology

Serving ESFRI INSTRUCT

199/8/2015

EGI Usage statistics

End

of EU

fun

din

g

Geographic distribution(Nov 2013 – Nov 2014)Enabled via EGI

federated operation

Excluding OSG resources

Statistics http://accounting.egi.eu

209/8/2015

A&A Community

• Collection of heterogeneous, distributed, scientific (sub)-communities

• Study the different scientific aspects of formation and evolution of the Universe

• Commonalities in terms of technological challenges and requirements

– Computing (HTC but also HPC)

– Demanding in terms of data


219/8/2015

A&A Heavy User Community

• Research communities:– Radio Astronomy, Gamma Ray Astronomy,

Helio-physics, Stellar Astrophysics, cosmology….

• The A&A Virtual Organizations – 10 with

– about 500 users

– about 80000 cores

– about 100 TB storage

– More in other VOs

• A light weight coordination

• The A&A Heavy User Community

• Identify commonalities and common technical solutions.


229/8/2015

Success Stories

• Planck ESA satellite mission: measure the CMB.

• EGI used to execute simulations (resources) to estimate the Cosmological Parameters correcting instrumental and observational systematics.

• Main experiment in cosmology of the last 10 years (more that 700 papers in the last year)

• Planck VO: ~50 users, ~ 20000 Cores, 15TB

• CTA:– open observatory to a wide astrophysics

community

– explore our Universe in depth in Very High Energy

• VO– 120 users

– ~ 70K cores

– 7 EU countries and US

• Simulations and testing that requires large HTC facilities

vo.cta number of users


239/8/2015

Outline

• EGI today

• EGI Technology

• EGI Communities

• Towards 2020 and Vision for an



249/8/2015

Digital ERA – State of play 2015

• Incomplete national roadmaps for Research and e-Infrastructures

– E-Infrastructures and RIs should be components of the same research

system

• e-Infrastructure Commons not fully achieved yet

– Lack of e-Infrastructure capacity for multidisciplinary research and the

long tail of science

– Different access policies for user groups in each access

– Incomplete technical interoperability, different access policies

– The “Commons” governance principle not widely adopted

– Non organized landscape of multiple service providers and research

communities, lack of cross-border procurement/funding scheme that

allows coordinated resource management across Europe (except for

GEANT)

• Lack of one ‘backbone’ of European ICT capabilities


259/8/2015

Open Science Commons Vision

Researchers from all disciplines

have easy, integrated and open access

to the advanced digital services, scientific

instruments, data, knowledge and expertise

they need to collaborate and achieve

excellence in science, research and innovation.

They feel engaged in governing, managing and

preserving these resources for everyone’s

benefit, with the support of all stakeholders.


269/8/2015

Open Science Commons:

• Definition: A set of interrelated resource systems governed as commons

that support the open creation and dissemination of scholarly knowledge

• Developing a commons-oriented approach when designing systems

• Ensuring maximization of return from public investment

• Initial elements for Europe

– An open science infrastructure backbone for network, computing and data

– Stimulating research data as commons

– Networks of knowledge hubs for skills development, innovation and expert

support

Digital services and applications

Knowledge & Expertise

Instruments

Research Data

website: www.opensciencecommons.orgpaper: http://go.egi.eu/osc

279/8/2015

Open Science:

a Complex Resource System

• Shared resources

– Integrated, easy and fair access

• Engaged communities

– Participating in the process

– Culture of sharing

– Collaborating in the management and

stewardship

• Governance

– Rules to access

– Rules to resolve conflicts

– Rules to balance quality vs. openness

• Financial support

– For long-term availability



Instruments

Research Data


289/8/2015

A common endeavor (EU perspective)



Instruments

Research data

Centres of Excellence

Innovation Centres


299/8/2015

Future steps

• Broaden the dialogue on OSC to more stakeholders

• Establish a framework of discussion that

encourages participation and contribution

• Identify/analyse other key building blocks that need

development

• PLAN-E members are invited to EGI discussions

– Next Engagement meeting: 7 Sep, 14-16 (Amsterdam

time)

– Contact: Gergely Sipos ([email protected] )

– Agenda: https://indico.egi.eu/indico/conferenceDisplay.py?confId=2645


mailto:[email protected]

https://indico.egi.eu/indico/conferenceDisplay.py?confId=2645

www.egi.eu

Thank you for your attention.

Questions?

This work by Parties of the EGI-Engage Consortium is licensed under a

Creative Commons Attribution 4.0 International License.

http://cf2015.egi.eu

http://creativecommons.org/licenses/by/4.0/

Documents

EGI Today and Towards an Open Science Commons · PDF fileEGI-Engage is co-funded by the Horizon 2020 Framework Programme of the European Union under grant ... federated infrastructure