Topic 13: Cloud Stacks

13: Cloud Stacks

Zubair Nabi

[email protected]

April 21, 2013

Zubair Nabi 13: Cloud Stacks April 21, 2013 1 / 27

Outline

1 Server-side Stacks

2 Client-side Libraries


Outline




Introduction

Cloud service creation and offering requires an entire ecosystem

Focusing on just the software side, solutions are needed to managecomputation, storage, and networking

A number of open source solutions with a set of pros and cons


Introduction





Introduction





CloudStack1

Console for managing data center resources

Manages virtual machines, networking components, and storageI Enables IaaS

Used by Zynga, Nokia Research, etc.

Possible to convert Amazon EC2 API to the CloudStack one

1http://cloudstack.apache.org/Zubair Nabi 13: Cloud Stacks April 21, 2013 5 / 27

http://cloudstack.apache.org/

CloudStack1

Console for managing data center resourcesManages virtual machines, networking components, and storage

I Enables IaaS





CloudStack1


I Enables IaaS





CloudStack1


I Enables IaaS





CloudStack1


I Enables IaaS





What can it do?

Can be used by both service providers and enterprises

Set up an on-demand, elastic cloud computing serviceI Virtual machine instances, storage volumes, and networking

configurations

Set up a private cloud for internal usage


What can it do?

Can be used by both service providers and enterprisesSet up an on-demand, elastic cloud computing service

I Virtual machine instances, storage volumes, and networkingconfigurations



What can it do?





What can it do?





Features

Multiple Hypervisor Support: Supports Citrix XenServer, VMWarevSphere, KVM, and Xen

Massively Scalable Infrastructure Management: Can manage tensof thousands of geographically distributed datacenters

Automatic Configuration Management: Automatic configuration ofeach guest’s VMs, network, and storage settings


Features





Features





Features (2)

Graphical User Interface: Web interfaces both for the administratoras well as the user

API and Extensibility: Exposes a programmatic interface to allmanagement features

High Availability: Management Server itself can be deployed acrossmultiple nodes, with load balancing


Features (2)





Features (2)





Management Server

All resources such as hosts, storage devices, and IP addresses areprovided to it for management

Runs on a dedicated server or VM

Controls allocation of VMs to hosts and assignment of storage and IPaddresses to the VM instance

Runs within a Tomcat container and uses a MySQL DB for persistence


Management Server






Management Server






Management Server






Cloud Infrastructure

One or more zones (typically datacenters) consisting of various hoststo run VMs

Zone: Consists of one or more pods

Pod: L2 switch and one or more clusters

Cluster: Consists of one or more hosts and primary storage

Host: Single compute node within a cluster to run guest VMs

Primary storage: Associated with a cluster and stores disk volumesfor all VMs

Secondary storage: Associated with a zone and stores ISO imagesand disk volume snapshots
























































Networking Options

Basic: Similar to AWS: guest isolation through L3 mechanisms suchas IP address source filtering

Advanced: Flexibility in defining guest networks


Networking Options

Basic: Similar to AWS: guest isolation through L3 mechanisms suchas IP address source filtering

Advanced: Flexibility in defining guest networks


OpenStack2

Public and private IaaS cloud management software stack

Used by PayPal, Cisco, Intel, HP, Rackspace, AT&T, etc.

Divided into a number of services

The Cloud Controller hosts the databases, message queue,dashboard, and API endpoints

2http://www.openstack.org/Zubair Nabi 13: Cloud Stacks April 21, 2013 12 / 27

http://www.openstack.org/

OpenStack2







OpenStack2







OpenStack2







Compute (Nova)

Manages the lifecycle of VM instances

In charge of scheduling, resource provisioning, live migration, andsecurity

Supports multiple hypervisors including KVM and Xen


Compute (Nova)





Compute (Nova)





Storage

Provides both block and object storage for use by the VM

Users are allowed to create block storage devices

These devices can dynamically be attached and removed from VMinstances

Also provides a distributed object storage, called Swift


Storage






Storage






Storage






Object Storage

Users access binary objects through a RESTful API

Similar to Amazon S3

Useful for storing and managing large datasets

Can also be used by the system to store VM images


Object Storage






Object Storage






Object Storage






Block Storage

Exposes a block device to the user

Users interact with the storage by mounting volumes within their VMinstances

Can be detached from one instance and re-attached to another whileremaining persistent

Implemented internally through the Cinder project which supportsmultiple back-endsSome drivers allow the instance direct access to the underlyingphysical block device

I Improves I/O performance


Block Storage







Block Storage







Block Storage




Implemented internally through the Cinder project which supportsmultiple back-ends

Some drivers allow the instance direct access to the underlyingphysical block device



Block Storage







Block Storage







Networking

API-driven network and IP address management

Users are allowed to create their own networks

VLANs used to provide each allocation its own subnet and segregationfrom other allocations


Networking





Networking





Dashboard (Horizon)

Web interface for administrators and users

Gives access to VM image management, VM instance lifecyclemanagement, and storage


Dashboard (Horizon)

Web interface for administrators and users

Gives access to VM image management, VM instance lifecyclemanagement, and storage


Identity (Keystone)

Centralized user account service with authentication and accesscontrol

Registry of OpenStack services


Identity (Keystone)

Centralized user account service with authentication and accesscontrol

Registry of OpenStack services


Image (Glance)

Various image management capabilities, including registration anddelivery

Supports multiple image formats


Image (Glance)

Various image management capabilities, including registration anddelivery

Supports multiple image formats


Message Queue

Services communicate with each other using the message queue

If the message queue fails, the cluster enters a “read only” state


Message Queue

Services communicate with each other using the message queue

If the message queue fails, the cluster enters a “read only” state


Application Programming Interface (API)

Command line client

Amazon EC2 compatibility APIs


Application Programming Interface (API)

Command line client

Amazon EC2 compatibility APIs


Outline




Libcloud3

Abstracts away the APIs of different cloud vendors

Negates vendor API lock-in

Computation: Such as Amazon EC2 and Rackspace CloudServers

Storage: Such as Amazon S3 and Rackspace CloudFiles

3http://libcloud.apache.org/Zubair Nabi 13: Cloud Stacks April 21, 2013 24 / 27

http://libcloud.apache.org/

Libcloud3







Libcloud3







Libcloud3







Compute

Abstraction for more than 20 providers such as Amazon, Rackspace,Nimbus, etc.

Ability to run deployment scripts on the newly created servers


Compute

Abstraction for more than 20 providers such as Amazon, Rackspace,Nimbus, etc.

Ability to run deployment scripts on the newly created servers


Storage

Abstraction for more than 10 providers such as Amazon, Rackspace,CloudFiles, etc.


References

OpenStack operations guide: http://docs.openstack.org/trunk/openstack-ops/content/


http://docs.openstack.org/trunk/openstack-ops/content/

http://docs.openstack.org/trunk/openstack-ops/content/

Technology

Topic 13: Cloud Stacks