EGI support for scientific communities

www.egi.euEGI-InSPIRE RI-261323

EGI-InSPIRE


EGI support for scientific communities

Gergely SiposEGI.eu

Technical Outreach [email protected]

European Grid Infrastructure

Joint agINFRA and SCI-BUS workshopBudapest, 30/May/2013

mailto:[email protected]


Outline

• EGI overview– Strategic activities, contributors, users

• Services for scientific communities– Software services and frameworks– Computing and storage services (grid & cloud)– User support & community building

• Summary

2


European Grid Infrastructure

• European– Over 35 countries

• Grid– Secure sharing of

IT resources• Infrastructure

– Computers (clusters)– Data– Applications– …. and beyond!!

• Technologies to – Federate resources– Access resources

3

Coordinator: EGI.eu,

Amsterdam


EGI’s strategic activities

Operational Infrastructure

Virtual Research EnvironmentsCommunity

& Coordination

•Operate a European wide grid infrastructure•Build a federated cloud infrastructure

•Integration & operation of scientific environments

• Governance• Communication

(inreach, outreach)

4


EGI community: contributors

National Grid Infrastructures

(NGIs)

Grid and cloud technologies:•EMI, • IGE,•EDGI, ...

Science domain specific:•agINFRA,•wLCG,•WeNMR,•ScalaLife•HMRC,...

High level technologies:•SCI-BUS, •SHIWA,•MAPPER,• ...

EGI.eu

Lega

l ent

ities P

rojectsSoftware + support(based on MoUs, SLAs)

European Intergovernmental

Research Organisations(CERN, EBI) Linking

infrastructures:•CHAIN•EUDAT...

5


Useservices

Createservices

Operateservices

EGI services forscientific communities

Operation tools, dashboards

Collab. & communic.

services

Scientific applications

7Research

infrastructure clusters

Application porting / hosting frameworks

Capacity (grid/cloud)

Research collaborations

Research infrastructures...

Individual researchers

http://www.eiscat3d.se/

http://www.wenmr.eu/wenmr/

http://www.elixir-europe.org/


Useservices

Createservices

Operateservices

EGI services forscientific communities

5. Operation tools,

dashboards

4. Collab. & communic.

services

1. Scientific applications

8Research

infrastructure clusters

3.Application porting /

hosting tools

2 .Capacity (grid/cloud)

Research collaborations

Research infrastructures...

Individual researchers

NGI and EGI.eu Support Teams

http://www.eiscat3d.se/

http://www.wenmr.eu/wenmr/

http://www.elixir-europe.org/


Software services: http://appdb.egi.eu

• Registered in EGI Applications Database http://appdb.egi.eu – Browse by scientific discipline

or software type: middleware, workflow tool, science gateway, scientific application

• Various types of access:– Via portal (username/pwd)– Register in a VO (X.509 cert)– Download to client side– ...

• Interact– Follow updates (RSS, Atom)– Rate & Comment– Contact provider/supporter

By discipline

9

By type

http://appdb.egi.eu/


Science gateway (framework)

Community-specific Virtual Research Environments

...App. 1 App. 2

Scientific applications AdministratorPower UserBasic User

Job / service management

engine

Data transfer engine

EGI grid EGI Federated Cloud

Authentiation&

Authorization

Local data (logs, authz, tmp,

cache,...)

10

Batch computing

App. porting tools

Service hosting

e.g. WS-PGRADE from SCI-BUS

www.mosgrid.de

Example: MosGrid portalhttps://mosgrid.de/portal

11

Job submission

engine

Data transfer engine

HPC access with UNICOREQuantum Chemical Calculations

based on approximated solutions of the Schrödinger equation

Average scalabilityGaussian, NWChem, Turbomole, …

Molecular Dynamicsbased on forcefields describing molecular interactionsGood scalabilityGromacs, NWChem, Amber, …

DockingBased on simplified forcefieldsExcellent scalabilityCADDSuite, FlexX, …

Authentication


Example: Digital library - gLibrary http://glibrary.ct.infn.it

3TByte in totalTIFF (100MB/A3 page)PDF (40-400MB/work)

(1) Digitalise

(2) Store

(3) Catalogue+

Meta-data

(4) BrowseDe Roberto, an Italian writer of the XIX/XX century, born in Naples, but spending his life in Catania

12

13

Example: IGI Portal for the EGI Federated Cloud (portal.italiangrid.it, http://go.egi.eu/cloud)

Domain specific service inside a Virtual Machine


Recent trends in Virtual Research Environments

14

• More specialised VREs (each with a small nb. of users)

• Mixed grid and cloud use

• Transparent auth:– Robot certificates– Identity federations

• Mobile access• Entry point on

Facebook – Africa Grid Science Gateway

(based on Catania SG Framework)


Operation Tools & dashboards

NGI-EGI services:• Service registry• Accounting• Service Availability Monitor• Helpdesk

15

Services to operate Research Infrastructure services...

Local NGIs

Service

Service Service

Service

RegistryAccountingMonitoring

Heldesk

Research infrastructure Scientific

services

Infrastructureservices

Community portals

Operation portals


Human support network http://www.egi.eu/about/ngis/

• NGI: single point of contact as regards ICT services for e-science.

• Manage the computing resources and support services provided to the European Grid Infrastructure.

• Has named contact for:– Support (User)– Operation (Infrastructure)– International liaison

16


Community building• Virtual Team projects

– Short (up to 6 month) project with multiple NGIs involved– Setup through NGI international liaisons by EGI.eu– https://wiki.egi.eu/wiki/Virtual_Team_Projects

• Current VT projects that build Research Communities:– NGI - ELIXIR ESFRI collaboration (Started in October)– Technology study for CTA ESFRI (Started in January)– Towards a Chemistry, Molecular & Materials Science and

Technology Virtual Research Community (Started in February)

17

https://wiki.egi.eu/wiki/Virtual_Team_Projects


Summary

• EGI is based on a federated model– NGIs and various projects provide resources and support

• Established grid, emerging cloud infrastructure• EGI is not just computing and storage

– Ready-to-use scientific applications– Application porting and hosting frameworks, portals– Infrastructure operation tools and dashboards– Human support network

EGI and SCI-BUS helps the agINFRA community evolve

18


EGI-InSPIRE


Thank you

[email protected]

19

mailto:[email protected]

Documents

EGI support for scientific communities