Upload
mark-voelker
View
405
Download
0
Embed Size (px)
DESCRIPTION
Slides for my talk at All Things Open 2014 OpenStack is widely recognized as a leading open source cloud computing platform and has attracted plenty of attention from developers, end users, IT companies, and media. As OpenStack continue to gain adoption, the audience of potential users continues to expand. Whether you’re building a public cloud service or private clouds for e-commerce, video/collaboration apps, sceintific research, NFV, or are simply looking for a more elastic model of infrastructure, OpenStack is an option to consider. This talk will serve as an extensive introduction for newcomers to OpenStack. We’ll discuss both the software itself and the makeup of the community of developers and users around it. We’ll learn how to contribute to OpenStack, who’s using it today, different deployment scenarios and use cases, and provide both online and local resources for learning more. We’ll also provide an introduction to incubated components, underpinning pieces, and pointers to installers and service providers who can help you get started.
Citation preview
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 1
Mark T. Voelker, Technical Leader @ Cisco
OpenStack ATC/StackForge Puppet Core/Foundation Member #54
All Things Open 2014
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2
@marktvoelker
• Tech Lead at Cisco, StackForge Puppet core developer, OS Foundation Member #54
• Fact: can be bribed with doughnuts
• Currently works in Cisco’s Cloud & Virtualization Group
• In copious (hah!) spare time: OpenStack solutions, Big Data, Massively Scalable Data Centers, Devops, making sawdust with extreme prejudice
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 3
• Tech lead, manager, software developer, architect
• Started in OpenStack in 2011 at the Diablo Design Summit
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 4
The great thing about my job is that I get to have fun exploring a lot of new things…
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 5
….and I get to help build a LOT of clouds.
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 6
Today’s workshop won’t be overly formal….
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 7
…because I tend to get excited by this stuff.
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 8
Fortunately I’m surrounded by really smart people on this project.
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 9
“OpenStack is a global collaboration of developers and cloud computing technologists producing the ubiquitous open source cloud computing platform for public and private clouds. The project aims to deliver solutions for all types of clouds by being simple to implement, massively scalable, and feature rich. The technology consists of a series of interrelated projects delivering various components for a cloud infrastructure solution.”
-- openstack.org
Basically, it’s software to run cloud
services—including compute, network,
storage, and security—and the
community behind that software.
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 10
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
06 07 08 09 10 11 12 13
Datacenter Spending (%) Over Time
Server Spending Standalone Servers - Mgnt & Admin
Virtual Servers - Mgnt & Admin Power & Cooling Expense
Source: IDC, 2011 “New Economic Model for the Datacenter”
• Operating expenses
represent over 80%
of data center spending
• OpEx increase driven by
server virtualization
• New models are needed
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 11
• Founded in July 2010 by Rackspace Hosting, NASA, and partners.• NASA contributed the compute controller (Nova) that it had built to control the NASA Nebula cloud (think: Amazon EC2).
• Rackspace contributed the object storage controller (Swift) that it built to run it’s CloudFiles service offering (think: Amazon S3).
• 10th release (Juno) released Oct. 16
• OpenStack (now) has a 6-month time-based release cycle
• Over 429 companies have now joined the community
• OS/Hypervisor makers: VMWare, Red Hat, Canonical, SuSE
• Public cloud/service providers: Rackspace, NTT, DreamHost, Comcast, AT&T
• Cloud service/tools/SaaS/value-add vendors: Puppet Labs, RightScale, OpsCode, ServiceMesh, New Relic, Scalr
• Equipment Vendors: Cisco, IBM, HP, Intel, NetApp, EMC, Brocade, Dell, Oracle
• OpenStack Software & Services: Piston, Mirantis, CloudScaling, Aptira, Bluebox
• App/Content Providers: Yahoo, eBay, GoDaddy, iWeb
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 12
• The OpenStack Foundation
• Membership is free for individuals
• Platinum, Gold, and Corporate memberships paid for by member companies
• Board of Directors comprised of Platinum, Gold, & elected members (basically a marketing/IP group—does not directly influence the software)
• Technical Committee leads software direction & development
• Elected by active technical contributors (ATC’s) to the OpenStack project
• Some seats were formerly automatically given to PTL’s…now all directly elected
• Program Technical Leads
• Elected to lead individual projects (e.g. Nova, Neutron, etc) by active technical contributors to those projects
• User Committee
• Represents users with the Technical Committee & Board of Directors
• More details here.
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 13
• The OpenStack Foundation
• Membership is free for individuals
• Platinum, Gold, and Corporate memberships paid for by member companies
• Board of Directors comprised of Platinum, Gold, & elected members (basically a marketing/IP group—does not directly influence the software)
• Technical Committee leads software direction & development
• All members elected by active technical contributors
• User Committee represents users with the Technical Committee & Board of Directors
• More details here.
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 14
• Platinum Members: AT&T, Canonical, HP, IBM, Nebula, Rackspace, Red Hat, SuSE
• Gold Members: Aptira, Cloud Computing Association of Taiwan, Cisco, CloudScaling, Dell, Dreamhost, Ericsson, Hitachi, Huawei, Intel, Juniper, Mirantis, NEC, NetApp, Piston, VMWare, Yahoo
• Corporate Members: presently about 89 companies
• Supporting Organizations: presently around 316 companies
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 15
• Over 16,900 members of the OpenStack Foundation spanning 145 countries on almost every continent
• Just about every major IT player, old and new…including some that seem to surprise some people
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 16
(Ok, that’s probably not *completely* true….)
…but a rising tide that lifts all boats is a mighty hard proposition to
resist for most companies.
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 17
IDG Connect Survey:
http://www.redhat.com/infographics/openstack-platform-for-private-cloud/
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 18
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 19
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 20
• IRC Channels and Mailing Lists
• User/Meetup Groups
• Social NetworkingTwitter
Ohloh
• Code in cgit, mirrored on GitHub, Bugs/Milestones in Launchpad• For now…may move to StoryBoard in future
• Over 20 million lines of code by over 1,419 contributors
• Two Annual Design Summit/Conferences (coinciding roughly w/releases)
• Want to contribute? Start here.
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 21
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 22
OpenStack User Survey May 2014
http://www.slideshare.net/ryan-lane/openstack-atlanta-user-survey
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 23
Source: http://www.openstack.org/enterprise/auto/
Top 10 Automaker Turning Customer Insights into
Action with OpenStack at 1/10th the Cost of Legacy
Solution
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 24
“The days of OpenStack being just about Cloud are over. OpenStack has become a platform for all manor of changes that are shaking up the tech industry.”
--Some guy on his soapbox in Raleigh today
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 25
(that’s AT&T AVP Toby Ford telling 4500 people why he thinks OpenStack is the platform for NFV a few months ago in Atlanta)
(and that’s a Red Hat senior principal engineer and the Chief Scientist at Brocade
immediately reacting to it.)
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 26
“OpenStack as an NFV Platform”
http://bit.ly/ZOnLyQ
Panel with guests from AT&T, Cisco, Red Hat, Yahoo!
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 27
Horizon
NovaNeutron
Swift (Object Storage)
Cinder (Block storage)
Glance
(VM Image Service)
Keystone
(Identity Service)
AWS Management Console
EC2VPC
S3
EBS
Ceilometer
(Telemetry Service)
Trove
(Database Service) Heat
(Orchestration Service)
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 28
• A “cloud computing fabric controller”.
• Basically, it’s what takes care of launching VM instances (think Amazon EC2).
• Abstracts hypervisors and hardware pools.
• Most operations can be invoked with a REST API call, a CLI client, or clicking in Horizon (the OpenStack GUI).
• A few features:
• Multiple hypervisors
• Multiple network models
• Distributed and asynchronous architecture
• Security groups
• Resource isolation for large deployments via cell architecture
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 29
• Houses images that can be launched as instances
• Abstracts various image containers and backends.
• Multiple storage backends
• File, Swift, Ceph, etc
• Multiple container formats
• Bare, OVF, AKI, ARI, AMI
• Multiple disk formats
• Qcow2, raw, VHD, AKI/ARI/AMI, ISO, VDI, VMDK
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 30
• Provides a central service for authentication and authorization as well as service catalog (e.g. where API endpoints are).
• Provides management of auth tokens passed in API calls as various components interoperate.
• Provides an abstraction layer above various auth backends such as LDAP or Active Directory.
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 31
• Provides persistent block storage CRUD and attachment/detachment from instances and snapshotting.
• Similar in some respects to Amazon EBS.
• Abstracts several underlying block storage components.
• Coraid, EMC, NetApp, IBM, LVM, Nexenta, NFS, Ceph RBD, SolidFire
• Originally part of OpenStack Nova, but split out into it’s own service in the Folsom release.
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 32
• Provides highly available, distributed, eventually consistent object storage.
• Can be run completely independently of OpenStack Compute.
• Often run on bare metal.
• Similar in many respects to Hadoop HDFS and Amazon S3.
• Replicates objects over multiple machines (usually 3).
• Works best when hypervisor doesn’t bottleneck disk I/O.
• Full API access/manipulation of objects
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 33
• Provides “networking as a service” for OpenStack
• Designed to be capable of running independently of OpenStack
• oVirt has done work to use Neutron for a connectivity service
• Cloudstack has explored the possibility of using Neutron as well
• Is still evolving rapidly
• First (incubated) release: Diablo
• First (core) release: Essex
• First release with L3 functionality: Folsom
• First release with LBaaS functionality: Grizzly
• Now has LBaaS, VPNaaS, FWaaS services, NFV subteams, a Group Based Policy blueprint, an IPv6 subteam, and work commencing on Virtual Distributed Routers
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 34
• Provides usage and performance data for OpenStack
• Initially designed with an eye toward billing, now provides broader insight
• oVirt has done work to use Quantum for a connectivity service
• Cloudstack has been exploring the possibility of using Quantum as well
• Is relatively young
• Still has some blind spots
• Extensible…relatively easy to add new meters in most cases
• Handles a *lot* of data
• Design goal: be able to share collected data with a variety of data consumers
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 35
• Orchestrates ability to launch multiple composite clouds apps based on templates that can be treated like code.
• Templates have native format, but can use AWS CloudFormationformat too
• Frequently used for autoscaling services
• Primarily manages infrastructure, but integrates with tools like Puppet and Chef
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 36
• Provides database services on demand with an elastic, API-driven interface in a multitenant environment
• Developers don’t have to care what the backend is or where it is
• Developers don’t have to go through tedious setup process
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 37
• Hadoop (or Spark) as-a-service (think similar to Amazon Elastic MapReduce)
• Simple, on demand provisioning of Hadoop clusters
• Different distributions of Hadoop available on the backend
• Can be managed via API or Horizon
• Offers integration with management tools like Ambari or ClouderaManagement Console
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 38
Library Projects
Supporting Projects
Documentation
Oslo (common code libraries)
Client libraries
Incubated Projects
(may become core
components in the future)
Designate (DNS service)
Zaqar (queuing service)
Gating Projects
CI & Infrastructure
DevStack (deployment script)
Tempest (integration test)
Barbican (key management)
Manila (shared FS as a
service)
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 39
• It’s a bash script.
• It installs OpenStack from the latest version in trunk on a single (or multiple) node.
• Used by developers to quickly get an environment in which they can work on features or bugfixes.
• Not a good way to deploy in production, but useful for getting your feet wet.
• Arvind Somya and Kyle Mestery did a demo and presentation of DevStack recently for the Triangle OpenStack Meetup a while back. Say, who’s Arvind? Well…
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 40
• A hypervisor• Except when you don’t.
• KVM and Xen are the best supported today. Hyper-V, QEMU, LXC, VMware also work. See hypervisor comparison.
• A database• Most use MySQL, but PostgreSQL and others also work since most code uses the
SQLAlchemy ORM layer.
• Used for persisting operational data.
• A message queue• Most use RabbitMQ, some use Qpid and ZeroMQ works in some components as well.
• Used for fast interprocess communications (ex: nova scheduler talking to nova network controller)
• Hardware• Pools of servers, memory, cpu, disk
• Python Stuff• Most components run under Python 2.6+
• A few major libraries: Django, Eventlet, SQL Alchemy, many more
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 41
• Putting your best foot forward means putting your code where your mouth is.
Ideas are more readily accepted when there’s effort to back them up.
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 42
• Don’t be intimidated.
• HolycrapthingsmovereallyreallyfastinOpenStack
• Jump in feet first: be agile and flexible.
• This is going to feel a little different for some of you.
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 43
Questions?@marktvoelker
http://openstack.org/
http://cisco.com/go/openstack/
(yes, we’re hiring!)