33
1 OpenStack Ecosystem and Xen Cloud Platform Amit Naik Prasad Nirantar BMC Software

OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack - indicthreads cloud computing conference 2011

Embed Size (px)

DESCRIPTION

Session presented at the 2nd IndicThreads.com Conference on Cloud Computing held in Pune, India on 3-4 June 2011. http://CloudComputing.IndicThreads.com Abstract: OpenStack is an Initiative by RackSpace and NASA that aims for building an Open cloud platform supported by a vibrant Ecosystem to encourage broad adoption in the market.This is currently a hot favorite of enterprises looking to build an Open cloud. This talk will provide a brief overview of the different OpenStack Modules (Compute and Storage) and explain how to utilize these to build a cloud. We will also explore the newly released Xen Cloud Platform (XCP) and its integration with OpenStack Platform. There will be a hands-on demo (time permitting) where we will show how the integration between the OpenStack Platform and XCP works. Key Takeaways for the audience: 1) Understanding of OpenStack platform. 2) How to get started with OpenStack for building your own cloud. 3) Understanding of XCP 3) How the integration (OpenStack-XCP) is supposed to work 4) What are the opportunities for building different products that add value in the OpenStack Ecosystem Speaker: Amit Naik is an Architect at BMC Software and has 15 years of experience in the IT field with experience in delivering multiple end-to-end projects and Products. Multiple speaking engagements at different venues both in India and Abroad. Experience with blogging, evangelizing etc. Excellent communication and interpersonal skills. Joint Speaker: Prasad Nirantar is a Staff Product Developer at BMC Software. He holds a B.E in Polymer Engineering from the University of Pune and an MS from University of Akron, US. He also holds a diploma in business management from Symbiosis University.

Citation preview

Page 1: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

1

OpenStack Ecosystem and Xen Cloud

Platform Amit Naik Prasad Nirantar

BMC Software

Page 2: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

2

AgendaIntroductionRise of OpenStackOpenStack Details and EcosystemOpenStack and Xen Cloud Platform -

DemoConclusion

Page 3: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

3

Introduction - Simple Cloud Stack

Page 4: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

4

Rise of OpenStack – IaaS EnablerCloud Services have three main flavors:• IaaS• PaaS• SaaS

For early cloud platforms, IaaS enablement was the key focus

Help organizations build their own public, private, or hybrid clouds

Page 5: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

5

IaaS Enablement PlatformsAKA Cloud Management Platforms,

Cloud Controllers, Fabric Managers, Cloud Orchestration, IaaS Platforms, etc

Enablement Platforms turn Physical and Virtual IT assets into elastic cloud entities

Resulting IaaS can provision and manage Compute, Storage, Networking or other resources in some combination

Page 6: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

6

OpenStack Precursor – Eucalyptus

Eucalyptus was very popular IaaS Platform, grew out of project at UCSB

25,000 installs and big user community NASA used to be one of the big vocal

supporters of EucalyptusIn May 2010, NASA partnered with

Rackspace to announce a competing effort!

Page 7: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

7

Eucalyptus Falters NASA had two main issues with Eucalyptus• Scalability of Eucalyptus was insufficient -

Nebula project needed massive scalability 1 million machines & 60 million VMs• Open Core Vs Open Source –

NASA engineers were unable to contribute code to some Eucalyptus Modules due to some parts being closed source

Page 8: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

8

Nebula Project at NASA

Page 9: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

9

Birth of OpenStack: Rackspace+NASA

OpenStack Rackspace+NASA collaborationRackspace “Ozone” cloud controller andNASA “Nova” cloud fabric on NebulaRackspace “Cloud Files” storage engine

Page 10: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

10

Rackspace MotivationsNeeded something to counter Amazon’s

rapid pace of innovationShift to open source builds rapid

developer mindshareFocus on their Strengths – • Customer Support • Heterogeneity

Support offerings as new revenue stream

Page 11: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

11

OpenStack Partners

Page 12: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

12

OpenStack Project ObjectivesMission: Create an ubiquitous open source

cloud computing platform that is simple to implement and massively scalable

Open - All code is Apache 2 licensedSimple - Architecture is ModularScalable – Massive scale Design Goals:• 1 Million Physical machines, 60 Million VMs• Billions of Objects stored

Page 13: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

13

OpenStack FlavorsOpenStack Compute (Nova) – service to

Provision and Manage millions of VMs (comparable to Amazon EC2)

OpenStack Storage (Swift) – service to large-scale, redundant storage of Static Objects (comparable to Amazon S3)

OpenStack Image Service (Glance) – service to discover and register virtual disk images for use with Nova

Page 14: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

14

OpenStack Release Train

Three quick releases in under a year – Next release “Diablo” expected in Q3 2011

Diablo focus - Make OpenStack ready for large-scale deployments

Page 15: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

15

Architecture of OpenStack

Page 16: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

16

Architecture of OpenStackBuilt on a shared-nothing, messaging-based

architecture using AMPQ based queues nova-api process is the heart of the

OpenStack Nova – its “Cloud Controller”• Provides an endpoint for all API queries• Initiates most of the orchestration activities• Enforces some policy - mostly quota checks

nova-schedule decides which compute host a given VM should be created on

Page 17: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

17

OpenStack Architecture Cont’dThree Primary Infrastructure Modules• nova-compute process primarily creates and

terminates virtual machine instances. • nova-volume manages the creation, attach &

detach of persistent volumes to VMs• nova-network manipulate the network e.g.

configure VLANs, change iptables rules, etcSQL DB stores run time state of cloud

infrastructure such as Instances in use, Networks available, Volumes attached, etc

Page 18: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

18

OpenStack Component SpecificsWritten almost entirely in Python Available pre-built on Ubuntu and RHELRabbitMQ is the AMPQ product of choiceSupports MySQL and PostgreSQLLibvirt, Xen API used in instance creationSupport for EC2 API and S3 semanticsSupports wide variety of Hypervisors

Page 19: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

19

OpenStack – Hypervisor Support Hypervisor agnostic – support for:• Hyper-V 2008• KVM - Kernel-based Virtual Machine• QEMU• User Mode Linux• VMWare - ESX/ESXi 4.1 update 1• Xen - XenServer 5.5

Supports OVF (open virtualization format)

Page 20: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

20

Competitors and Implementers Eucalyptus – Still very popular OpenNebula – Used at FermiLabs, CERNCloudStack – Cloud.com’s IaaS platformCloudForms – Red Hat’s IaaS offering (beta)

OpenStack in the commercial space:Ubuntu Enterprise Cloud (UEC) – Switched

from Eucalyptus to OpenStack as baseProject Oylumpus – Citrix branded OpenStack Internap – Rackspace competitor switching

Page 21: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

21

OpenStack Ecosystem

Page 22: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

22

OpenStack Partners EcosystemGaps in Stack filled in by Partners:• Billing - Chargeback and Showback• Integrated Metering, Capacity Planning• Full-Spectrum Monitoring, Analytics• Advanced Networking Capabilities• Management Systems

• Cisco has come out with a Networking as a Service (NaaS) Proposal for OpenStack• Zenoss and CloudKick for monitoring

Page 23: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

23

Ecosystem-Facebook OpenComputeFacebook recently open sourced their

proprietary datacenter designs under OpenCompute project

Puts all the “secret sauce” of their datacenter and sever design on the web

Collaborating with OpenStack to ensure seamless deployment on Open Compute

Power savings of 38%, cost savings 24%

Page 24: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

24

Ecosystem – Xen Cloud PlatformXen Cloud Platform

Open source platform to build cloudsVirtualization platform including• Xen hypervisor• Network and Storage supportOriginally derived from XenServer – GPL2

Page 25: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

25

XCP Architecture

Page 26: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

26

OpenStack and XCPOpenStack is hypervisor independent

Designed to work with XenServer & XCPXen Cloud Platform (XCP) is the cloud

optimized and Open source version of XenOpenStack plays the role of cloud

orchestration platformXCP to be the virtualization platform

Page 27: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

27

OpenStack and XCP

OpenStack supports XCP through XenAPIXenAPI: Management API exposed by XCP

OpenStack compute interacts with the XCP hypervisor (XEN)

Page 28: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

28

OpenStack Limitations (Cactus)Nova codebase = merger of Rackspace &NASA

Cloud controllers – Still MaturingSwift code base is mature and Ready for

primetimeHA, fault tolerance support in Cactus Release is

in proposal stageLack of good documentation on Setup/usage“Diablo” Release will be recommended for wide

adoption

Page 29: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

29

ConclusionsOpenStack is becoming a default open

source cloud fabric in IaaS spaceEcosystem is an excellent opportunity to

contribute to this exciting effortWide adoption by Industry heavyweights

guarantees major tractionLots of room for improvement but fast

release cycles ensure quick fixes

Page 30: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

30

Q & A

Page 31: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

31

Referenceshttp://www.xen.org/products/cloudxen.html

http://www.openstack.org

http://open.eucalyptus.com/

http://nebula.nasa.gov/

http://ken.pepple.info/openstack/2011/04/22/openstack-nova-architecture/

http://www.laurentluce.com/?p=227

http://cloudopsmanagement.wordpress.com/2011/06/02/open-source-engine-powering-the-next-gen-cloud-stack-part-1/

Page 32: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

32

Back-up Slides

Page 33: OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  indicthreads cloud computing conference 2011

33

Nova - instance launching