Accessing and using Cloud services

Hands on with data infrastructure that can power your agricultural data products, December 12th, 2013

Riccardo BRUNO – INFN, division of Catania, Italy (giuseppe.larocca@ct.infn.it)

2

Outline

• Introduction

• The Science Gateway and its applications

• The Cloud based infrastructure and its

services/applications

• MyCloud Portlet

• Conclusions

Time

3

Evolution of distributed computing

MainframeComputing

80’s-90’sCluster

Computing

90’s-00’sGrid

Computing

00’s-10’sCloud

Computing

Cost of hwCost of networks

Power of COTS WAN bandwidth

4

Virtual Research Community (VRC)

Grid/Cloud Infrastructure

The Research Network Infrastructure provides fast interconnection and advanced services among Research and Education institutes of different countries

The Research Grid/Cloud Infrastructure provides a distributed environment for sharing computing power, storage, instruments and databases through the appropriate software (middleware)

e-Infrastructure “an environment where research resources (hardware, software and content) can be readily shared and accessed where necessary to promote better and more efficient research”

The e-Infrastructure Vision

e-In

fras

tru

ctu

reNetwork Infrastructure

Research Networks at “global” scale

4

The “Global” Grid and middleware

7

Genesis II

7

Grid middleware is not straightforward

Users have to cope with complex security

procedures, execution scripts, job

description languages, command line based

interfaces and lack of standards

This makes the learning curve very steep

and keeps non IT-experts away

The Catania Science Gateway

8

• Intuitive and collaborative environment• No more complicated certificate handling• Federated Authentication• Fine grained Authorization• No more technical issues• Shareable applications (market)• User friendly environment• More secure access to shared resources• Standard-based approach for sustainability• Compliant with EGI traceability policyhttp://www.catania-science-gateways.it

http://sourceforge.net/projects/ctsciencegtwys/

17

The GridEngineGRID ENGINE Usage

• Java Libraries accessible from JSR 286 Portlets or by

stand-alone applications

• REST interface for programmatic access (new)

• api.ct.infn.it (under development)

• Client-Server interactions through OAUTH2 keys

• Server-Server SSH key exchange

• Developers/External services must request the keys

• AUP has to be signed to obtain the Keys

• The Key requestor will be the responsible of any

service activity making use of the REST APIs

(EGI traceabilty policy: user, IP, action, …)

• The Science Gateway owner will be the responsible of

any activity performed by the GridEngine

•

• OGF SAGA standard

• JSAGA implementation

18

The Science Gateway

Cloud #1 Cloud #n

Single domain

MyCloud

Orchestrator (based on OCCI)

• Open Cloud Computing Interface

• REST approach to manage Clouds

• Best solution seeking for Standards

The cloud stack

10

20

Survey available from the agINFRA SG

29 questions

PaaS/IaaS (1/2)

21

• 2 Possibilities– Requestor provides a VM

• More details must be provided• The user must provide a VM image file

– Requestor just asks for a new VM, three image types:• Three different CPU, RAM and Storage configurations

– Small, Medium, Large

• Requestor must agree and then sign an AuP– 2 questions in the Survey– 1 A MoU to be signed and send

• The VM content will be under full responsibility of the requestor

PaaS/IaaS (2/2)

22

SaaS

Science GatewayCatania Grid/Cloud Engine

Security context Job management Stage-in/out

2) kill VM

SG

stage-in& run app

VM 1) stage-outSG

VM

Ad

apto

r

VMSG

start VM

robot certificate

MyCloudCurrent functionalities

• Federated authentication

• Fine-grained authorisation

• Single/multi-deployment of VMs on a

cloud and across clouds

• Single/multi-move of VMs across

clouds

• Single/multi-deletion of VMs on a cloud

and across clouds

• SSH connection to VMs

• Direct web access to VMs hosting web

services

• Same domain name across clouds

24

Conclusions• The Catania Science Gateway Framework changes the way Grid

infrastructures are used, hugely widening their potential user base

across continents and organisations, especially non-IT experts and the

“citizen scientist”

• Developed applications are ‘shareable’ among different Science

Gateway isntances, this leads to a portfolio of appealing applications

developed by international task forces

• The MyCloud portlet ease the VM management (PaaS and IaaS)

targeting different Cloud management systems (OCCI compliant)

• The standards OCCI combined with SAGA, allow applications to be

executed in a SaaS fashion into a Federated Cloud environment; no

matter where the application physically runs.