OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

Embed Size (px)

Citation preview

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    1/33

    1

    OpenStack Ecosystemand Xen Cloud

    Platform Amit NaikPrasad Nirantar

    BMC Software

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    2/33

    2

    Agenda

    Introduction

    Rise of OpenStack

    OpenStack Details and Ecosystem

    OpenStack and Xen Cloud Platform -Demo

    Conclusion

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    3/33

    3

    Introduction - Simple Cloud Stack

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    4/33

    4

    Rise of OpenStack IaaS Enabler

    Cloud Services have three main flavors: IaaS

    PaaS

    SaaS

    For early cloud platforms, IaaSenablement was the key focus

    Help organizations build their ownpublic, private, or hybrid clouds

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    5/33

    5

    IaaS Enablement Platforms

    AKA Cloud Management Platforms,Cloud Controllers, Fabric Managers,Cloud Orchestration, IaaS Platforms, etc

    Enablement Platforms turn Physical andVirtual IT assets into elastic cloud entities

    Resulting IaaS can provision and manage

    Compute, Storage, Networking or otherresources in some combination

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    6/33

    6

    OpenStack Precursor Eucalyptus

    Eucalyptus was very popular IaaSPlatform, grew out of project at UCSB

    25,000 installs and big user community

    NASA used to be one of the big vocalsupporters of Eucalyptus

    In May 2010, NASA partnered withRackspace to announce a competing effort!

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    7/33

    7

    Eucalyptus Falters

    NASA had two main issues with Eucalyptus Scalability of Eucalyptus was insufficient -

    Nebula project needed massive scalability

    1 million machines & 60 million VMs Open Core Vs Open Source

    NASA engineers were unable to contribute

    code to some Eucalyptus Modules due tosome parts being closed source

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    8/33

    8

    Nebula Project at NASA

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    9/33

    9

    Birth of OpenStack: Rackspace+NASA

    OpenStack Rackspace+NASA collaborationRackspace Ozone cloud controller and

    NASA Nova cloud fabric on Nebula

    Rackspace Cloud Files storage engine

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    10/33

    10

    Rackspace Motivations

    Needed something to counter Amazonsrapid pace of innovation

    Shift to open source builds rapid

    developer mindshareFocus on their Strengths

    Customer Support

    Heterogeneity

    Support offerings as new revenue stream

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    11/33

    11

    OpenStack Partners

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    12/33

    12

    OpenStack Project Objectives

    Mission: Create an ubiquitous open sourcecloud computing platform that is simple toimplement and massively scalable

    Open - All code is Apache 2 licensedSimple - Architecture is Modular

    Scalable Massive scale Design Goals:

    1 Million Physical machines, 60 Million VMs

    Billions of Objects stored

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    13/33

    13

    OpenStack Flavors

    OpenStack Compute (Nova) service toProvision and Manage millions of VMs(comparable to Amazon EC2)

    OpenStack Storage (Swift) service tolarge-scale, redundant storage of StaticObjects (comparable to Amazon S3)

    OpenStack Image Service (Glance) service to discover and register virtualdisk images for use with Nova

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    14/33

    14

    OpenStack Release Train

    Three quick releases in under a year Nextrelease Diablo expected in Q3 2011

    Diablo focus - Make OpenStack ready forlarge-scale deployments

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    15/33

    15

    Architecture of OpenStack

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    16/33

    16

    Architecture of OpenStack

    Built on a shared-nothing, messaging-basedarchitecture using AMPQ based queues

    nova-api process is the heart of the

    OpenStack Nova its Cloud Controller Provides an endpoint for all API queries

    Initiates most of the orchestration activities

    Enforces some policy - mostly quota checksnova-schedule decides which compute host

    a given VM should be created on

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    17/33

    17

    OpenStack Architecture Contd

    Three Primary Infrastructure Modules

    nova-compute process primarily creates andterminates virtual machine instances.

    nova-volume manages the creation, attach &detach of persistent volumes to VMs

    nova-network manipulate the network e.g.configure VLANs, change iptables rules, etc

    SQL DB stores run time state of cloudinfrastructure such as Instances in use,Networks available, Volumes attached, etc

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    18/33

    18

    OpenStack Component Specifics

    Written almost entirely in PythonAvailable pre-built on Ubuntu and RHEL

    RabbitMQ is the AMPQ product of choice

    Supports MySQL and PostgreSQL

    Libvirt, Xen API used in instance creation

    Support for EC2 API and S3 semanticsSupports wide variety of Hypervisors

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    19/33

    19

    OpenStack Hypervisor Support

    Hypervisor agnostic support for: Hyper-V 2008

    KVM - Kernel-based Virtual Machine

    QEMU User Mode Linux

    VMWare - ESX/ESXi 4.1 update 1

    Xen - XenServer 5.5

    Supports OVF (open virtualization format)

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    20/33

    20

    Competitors and Implementers

    Eucalyptus Still very popular

    OpenNebula Used at FermiLabs, CERN

    CloudStack Cloud.coms IaaS platform

    CloudForms Red Hats IaaS offering (beta)

    OpenStack in the commercial space:

    Ubuntu Enterprise Cloud (UEC) Switched

    from Eucalyptus to OpenStack as base

    Project Oylumpus Citrix branded OpenStack

    Internap Rackspace competitor switching

    O S

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    21/33

    21

    OpenStack Ecosystem

    O S k P E

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    22/33

    22

    OpenStack Partners EcosystemGaps in Stack filled in by Partners:

    Billing - Chargeback and Showback

    Integrated Metering, Capacity Planning

    Full-Spectrum Monitoring, Analytics

    Advanced Networking Capabilities

    Management Systems

    Cisco has come out with a Networking asa Service (NaaS) Proposal for OpenStack

    Zenoss and CloudKick for monitoring

    E F b k O C

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    23/33

    23

    Ecosystem-Facebook OpenCompute

    Facebook recently open sourced theirproprietary datacenter designs underOpenCompute project

    Puts all the secret sauce of theirdatacenter and sever design on the web

    Collaborating with OpenStack to ensure

    seamless deployment on Open ComputePower savings of 38%, cost savings 24%

    E t X Cl d Pl tf

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    24/33

    24

    Ecosystem Xen Cloud Platform

    Xen Cloud PlatformOpen source platform to build clouds

    Virtualization platform including

    Xen hypervisor Network and Storage support

    Originally derived from XenServer GPL2

    XCP A hit t

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    25/33

    25

    XCP Architecture

    O St k d XCP

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    26/33

    26

    OpenStack and XCP

    OpenStack is hypervisor independentDesigned to work with XenServer & XCP

    Xen Cloud Platform (XCP) is the cloud

    optimized and Open source version of XenOpenStack plays the role of cloud

    orchestration platform

    XCP to be the virtualization platform

    O St k d XCP

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    27/33

    27

    OpenStack and XCP

    OpenStack supports XCP through XenAPI

    XenAPI: Management API exposed by XCP

    OpenStack compute interacts with the XCPhypervisor (XEN)

    O St k Li it ti (C t )

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    28/33

    28

    OpenStack Limitations (Cactus)

    Nova codebase = merger of Rackspace &NASACloud controllers Still Maturing

    Swift code base is mature and Ready forprimetime

    HA, fault tolerance support in Cactus Release isin proposal stage

    Lack of good documentation on Setup/usage

    Diablo Release will be recommended for wideadoption

    Conclusions

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    29/33

    29

    Conclusions

    OpenStack is becoming a default opensource cloud fabric in IaaS space

    Ecosystem is an excellent opportunity to

    contribute to this exciting effortWide adoption by Industry heavyweights

    guarantees major traction

    Lots of room for improvement but fastrelease cycles ensure quick fixes

    Q & A

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    30/33

    30

    Q & A

    References

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    31/33

    31

    References

    http://www.xen.org/products/cloudxen.html

    http://www.openstack.org

    http://open.eucalyptus.com/

    http://nebula.nasa.gov/

    http://ken.pepple.info/openstack/2011/04/22/openstack-nova-architecture/

    http://www.laurentluce.com/?p=227

    http://cloudopsmanagement.wordpress.com/2011/06/02/open-source-engine-powering-the-next-gen-cloud-stack-part-1/

    Back-up Slides

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    32/33

    32

    Back-up Slides

    Nova - instance launching

  • 8/2/2019 OpenStack Ecosystem Xen Cloud Platform IndicThreads Cloud Computing Conference 2011

    33/33

    33

    Nova instance launching