How the right combination of standards was key to our success, EGI Federated Cloud

www.egi.euEGI-InSPIRE RI-261323

EGI-InSPIRE


How the right combination of standards, amendments and proprietary interfaces

was key to our success

David Wallom

University of Oxford


RationaleGrowth of Providers

• High Throughput Platform– Academic resource providers

• Federated Cloud Platform– Diversity of resource providers

Tens of 1000’s MillionsFew related use cases

Single application modelMany diverse use cases & application models

Growth of Research Communities

2


User Model

• We offer our users:• Total control over deployed applications • Elastic resource consumption based on real needs • Workloads processed on-demand• Endorsed and accredited applications available from

multiple different communities shared• Single sign-on at multiple, independent providers • Centralised access to service information across

multiple providers

3


Principles of Federation

• Standards and validation: Recommended and common open standards for the interfaces and images – OCCI, CDMI, OVF, GLUE2, AAI

• Resource integration: Cloud Computing to be integrated into the existing production infrastructure.

• Heterogeneous implementation: no mandate on the cloud technology.

• Provider agnosticism: the only condition to federate resources is to expose the chosen interfaces and services.

4


EGI Cloud Infrastructure

5

EGI Core Platform

Federated AAIServiceRegistry Monitoring Accounting

EGI Cloud Infrastructure Platform

Instance Mgmt

Information Discovery

Storage Management

Help and Support

Security Co-ordination

Training and Outreach

EGI C

olla

bora

tion

Tool

s

EGI A

pplic

ation

D

BIm

age

Repo

sito

ryEG

I Clo

ud S

ervi

ce M

arke

tpla

ce

Sustainable Business Models

User Community

Cloud Management Stacks(OpenStack, OpenNebula, Synnefo, …)

GSIGLUE 2.0

Cloudinit CDMI 1.0

NAGIOS UR

OVF 2.0*

OCCI 1.1

GLUE 2.1

OCCI 1.2

EGI Profile?


PartnershipResources

– 12 NGIs provide 21 certified resources– 5 NGIs currently integrating resources– 5 NGIs with interested resource providers– Worldwide interest & integration

• Australia* (NeCTAR)• South Africa* (SAGrid)• South Korea* (KISTI)• United States* (NIST, NSF A.C. Centres)

* Not shown on map

Usage since launch- 244,913 (397,128) VMs certified

(uncertified)- 10.6M (12.3M) CPU hours (wall time)

6


Strengthening the underpinning platform

Continuing a Technology Evolution

• Broader support for open standards in Cloud management frameworks

• Profile all contributing standards and extensions

• Capture exemplar best practice in aspects not covered by standards

7

Valu

e ad

ded

serv

ices

for U

ser

Com

mun

ities

Science

How the right combination of standards was key to our success, EGI Federated Cloud