Community Clouds - Shared Infrastructure as a Service

Community Clouds

Harold Teunissen et al.Juni 2011

Shared Infrastructure as as Service

Community Clouds - June 2011

Cloud Computing?

2

• Cloud computing is a model for enabling ubiquitous, convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction*

• Cloud Computing ≠ Web 2.0


Changing Behaviors

3

HierarchicalSecrecy

Loose AllianceSluggishNovelty

Tunnel Vision

Self OrganizingTransparencyCollaboration

UrgencyInnovationDidactic

Source: Sir Ken Robison


Motive

• Cloud cloud cloud — data explosion• Mobile mobile mobile — device explosion• Go go go — study + work + play + collaborate + organize

+ et cetera

• “Run you life on the cloud”

4

Source: AMD

SURFnet strategiesessie 2018 - 24 juni 2013Community Clouds - June 2011

Solution for everything...

5


Evolution towards the Clouds

6

Toepassingen draaien in de

cloud

Applications run on-premises

You own the hardware and

perform maintenance and operation of the

data center

Applications run in the IaaS Cloud

You pay someone to run your applications on hardware to your

speci!cation

Applications run in the cloud

You pay for computing capacity that can be used for

your applications

On-Premises IaaS Cloud In The Cloud

Applications

Runtimes

SOA / Integration

Databases

Server SW

Virtualization

Server HW

Storage

Networking

Applications

Runtimes

SOA / Integration

Databases

Server SW

Virtualization

Server HW

Storage

Networking

Applications

Runtimes

SOA / Integration

Databases

Server SW

Virtualization

Server HW

Storage

Networking

Doi

ng

Sel

f Sou

rced


Advantages are clear?

7

ApplicationSaaS

InfrastructureIaaS

PlatformPaaS

Application Architects

Application

Developers

End

Users


Cloud Pyramid

8

ApplicationSaaS

InfrastructureIaaS

PlatformPaaS

System

Architects

Application

Developers

End

Users


Services

9

ApplicationSaaS

InfrastructureIaaS

PlatformPaaS

System

Architects

Application

Developers

End

Users


Services

9

ApplicationSaaS

InfrastructureIaaS

PlatformPaaS

System

Architects


Focus for Today: Infrastructure

10


Basis of IaaS is Virtualization

• Increases efficiency (cost, consolidation, abstraction, administration)

• Despite the shared hardware / point of failure

11


Availability

• (near) Real-time transfer at failure of physical hardware, or when planned, migration without downtime of running virtual machine and its storage

12

IaaS Cloud Pool


Business Continuity

• Disaster at University of Twente in 2002 increased focus for on-site redundancy

• However for continuity and disaster recovery virtualization is a better solution

13


Cost of Storage

14

Source: Sir Ken Robison


Drivers Cont’d

• Cost reduction- Budget cuts- Rising power costs

• Service improvement- Better service provisioning- Best-of-breed services- Increased agility in software deployment

• ‘Green Computing’ trend- Reduce energy consumption

- Data centers can use >10% of power for an entire campus- IT produces 2% of global carbon dioxide emissions

15


Cloud Models

Community


IaaS Cloud Models (2)

• Private cloud - enterprise owned or leased

• Public cloud- sold to the public, mega-scale infrastructure

• Hybrid cloud- composition of two or more clouds models

• Community cloud- shared infrastructure for specific community

17


Level of Adaptation

• Very gradual migration towards public cloud- First start with a private cloud

• Hybrid operation for years to come (5-10 years)• Local data center is becoming a private cloud, driven by

widespread usage of virtualization• More and more resources in own data center ready for

migration to the cloud• Migration at different levels: currently mostly at IaaS,

moving to PaaS and SaaS later on mostly for generic services (e.g. email, etc.)

18


Community Cloud

• Functional features mostly in line with public cloud- Virtualization / image & instance management- Storage / object & block level- Self-service through management console

• Added value of community dimension- Control — Legal and Innovation- Saves money- Sufficient flexibility to meet the community’s needs- Standardization to prevent lock-in- Network integration

19


Full Control

• Full control over data location• Mechanisms to enforce storage within a single legal

jurisdiction- Only a single (Dutch) legislation is applicable- Reduces the complexity and costs of compliance to a very significant

degree- EU Data Protection Directive specifies that national laws will generally

apply when personal data processing is carried out

• Community controls at which points to innovate- Stronger negotiation position- Easier to swap suppliers

20


Network integration

• Close integration with SURFnet backbone• Close integration with own network• Dedicated lightpaths possible• Low latency• No costs for data communication (depends on billing

model)

21


Saves money

• Combined network and Community Cloud subscription offers benefits (e.g. reduced costs for bandwidth)

• Central support for operation and maintenance• Shared purchasing of IaaS• Reduced power consumption

(at least locally)

22


Community Cloud Models

23

Institution A

IaaS

Institution C

IaaS

Institution B

IaaS

Institution A Institution CInstitution B

IaaS Provider X IaaS Provider Y

IaaS Broker

Federated Cloud Brokered Cloud

Sharing of third party resources via brokerBroker procures third party resources

Sharing of own institutional resources


Federated model

• Sharing of over capacity• Not supported by current products• Difficult to tackle liability issues

- What is the legal impact of a service outage?

• Billing- Who pays for support/maintenance and operational costs?

24

=


Brokered model

• Takes care of trust establishment and contract settlement- just one party to trust and one contract to sign

• Broker can handle disputes in the cloud• More transparent in terms of

- Operation and Accountability- Awareness raising- Guidance on expectations regarding the use of the Community Cloud- Levels of security- Meeting legal obligations (compliance)

• No need to tender

25


Brokered model (2)

• Continuity- Commercial providers may go out of business

• Institutions do not need to test themselves whether a cloud provider is effectively mitigating risks- Broker can do that for the community

• Broker can provide value-adding services- Federated identity management, lightpaths, resource federation

• Supported by various vendors and products

26


Self Service is Essential

• Virtualized environment, component “shopping”• Self-service! Public: pay-as-you-go• Support for Private, Hybrid, Public

Hardware vendors• Quickly up and running:

- Website down? Data available? Recipe!- Extra load (e.g. spam filtering)?- Datacenter loss?- Elasticity also in a private cloud.

• Optional security: VPC, VPN, VLANs

27


Demo Self Service

28


Done deal?

• Licensing?• Security and privacy?• Standardization?

- Data and customer application portability- Common interfaces, semantics, programming models- Federated security services- Provisioning

• Accounting & billing: pay for what you use• Overall SLA of a multi-cloud environment offering may be

hard to predict • Migration not straight forward

29


Current Activities SURFnet

• SURFnet is using external private cloud (SURFcloud) to run their services, but on self-owned hardware- Load balancing experiments with Amazon EC2

• Experimental setup of community cloud- For the moment in-house at SURFnet

• Expected participants- University of Groningen

- To make website redundant- Open University

- For their OTAP environment

30


Community Cloud Proposition

31

Community Cloud

Data Center and IaaS Infrastructure

Client Services

Bulk File Transfer

Personal Storage

Enterprise Services

Endpoint Backup & Restore

Bulk Storage

Virtualization & Storage

Disaster Recovery

Cloud Service Broker

HPC Cloud Private IaaS Institutional IaaS Provider

Research Data

Governance

Commercial IaaS Provider

Cloud Operation

Center (COC)

HBO Universities MBO AMC


We need you!

• You as a community determine if we go ahead with this (and this is a good time to provide feedback)…

• What features or conditions are most important?• What does it take to persuade you to use the Community

Cloud, if it were build?• What do you see as potential obstacles in the adaptation

of a Community Cloud?• Are you interested in participating in the pilot?

32

[email protected] haroldteunissen

mailto:[email protected]

mailto:[email protected]

Technology

Community Clouds - Shared Infrastructure as a Service