30

OpenStack Technology Overview

Embed Size (px)

Citation preview

Page 1: OpenStack Technology Overview
Page 2: OpenStack Technology Overview

OpenStack Mission

“To produce the ubiquitous open source cloud

computing platform that will meet the needs of

public and private cloud providers regardless

of size, by being simple to implement and

massively scalable.”

Page 3: OpenStack Technology Overview

Enterprises are building clouds to...

Where is your enterprise on the path to cloud?

Meet departmental resource needs & timelinesControl & monitor the entire environment

2. Cloud Data Center 3. Cloud FederationServer Virtualization1. Virtualization

Page 4: OpenStack Technology Overview

Better resource utilization for each server

Datacenters are being virtualized, Servers are firstHYPERVISORS PROVIDE ABSTRACTION BETWEEN APPS AND HARDWARE (SERVERS)

HOST 1 HOST 2 HOST 3 HOST 4, ETC.

VMs

Hypervisor:Turns 1 server into many “virtual machines” (instances or VMs)(VMWare ESX, Citrix XEN Server, KVM, Etc.)

Hardware abstraction for each server

2. Cloud Data Center 3. Cloud FederationServer Virtualization1. Virtualization

Automation & Efficiency

Page 5: OpenStack Technology Overview

Compute Pool Network Pool Storage Pool

Next: Storage, Network…the building blocksABSTRACTION BETWEEN APPS AND HARDWARE

2. Cloud Data Center 3. Cloud FederationServer Virtualization1. Virtualization

Automation & Efficiency

Virtualized Servers Virtualized Networks Virtualized Storage

Resource pools for apps starting to form...

Flexibility, Efficiency are key drivers

Page 6: OpenStack Technology Overview

+

How do you empower employees to self-service?

USERS ADMINS

How do you make your apps cloud aware?

Where should you provision new VMs? How do you keep track of it all?

But questions arise as the environment grows...“VM SPRAWL” CAN MAKE THINGS UNMANAGEABLE VERY QUICKLY

APPS

2. Cloud Data Center 3. Cloud FederationServer Virtualization1. Virtualization

Automation & Efficiency

Page 7: OpenStack Technology Overview

USERS ADMINS

But questions arise as the environment grows...“VM SPRAWL” CAN MAKE THINGS UNMANAGEABLE VERY QUICKLY

A Cloud Management Layer Is Missing

APPS

2. Cloud Data Center 3. Cloud FederationServer Virtualization1. Server Virtualization

Automation & Efficiency

Page 8: OpenStack Technology Overview

APPS

Solution: OpenStack, The Cloud Operating SystemA NEW MANAGEMENT LAYER THAT ADDS AUTOMATION AND CONTROL

Creates Pools of Resources Automates The Network

USERS ADMINS

CLOUD OPERATING SYSTEM

Connects to apps via APIs

Self-service Portals for users

2. Cloud Data Center 3. Cloud FederationServer Virtualization1. Server Virtualization

Automation & Efficiency

Page 9: OpenStack Technology Overview

In Summary, the Cloud Operating System enables enterprises to:

1. Control and automate pools of resources

2. Efficiently allocate resources

3. Empower admins & users via self-service portals

4. Empower developers to make apps cloud-aware via APIs

Page 10: OpenStack Technology Overview

Enterprise Private Clouds run cloud operations systems…

2. Cloud Data Center 3. Cloud FederationServer Virtualization1. Server Virtualization

Automation & Efficiency

What’s next?

Public Clouds run cloud operating systems…

But you can’t interoperate ifpublic clouds are built on proprietary software

Page 11: OpenStack Technology Overview

Common PlatformImagine having a across clouds

2. Cloud Data Center 3. Cloud FederationServer Virtualization1. Virtualization

Automation & Efficiency

Seamlessly transporting workloads

Page 12: OpenStack Technology Overview

2. Cloud Data Center 3. Cloud FederationServer Virtualization1. Virtualization

Automation & Efficiency

A common platform is here.OPENSTACK IS OPEN SOURCE SOFTWARE POWERING PUBLIC AND PRIVATE CLOUDS.

Public Cloud:OpenStack powers someof the worlds largest publiccloud deployments.

Private Cloud:Run OpenStack software

in your own corporatedata centers

Page 13: OpenStack Technology Overview

1. Easy to migrate data and applications to public clouds when conditions are right

- based on security policies, economics, and other key business criteria

2. No longer locked in with major investment in one provider

3. Disaster recovery

2. Cloud Data Center 3. Cloud FederationServer Virtualization1. Virtualization

Automation & Efficiency

Top 3 Benefits of a Common Platform

Page 14: OpenStack Technology Overview

CONNECTING CLOUDS TO CREATE GLOBAL RESOURCE POOLS

OpenStack enables cloud federation

Run applications on aprivate cloud in your owndata center.

Mirror content to a private cloud in a colo facility for disaster recovery

Cloudburst into multiple public clouds around the world when demand surges

Washington

EuropeCaliforniaTexasPrivate Cloud Private Cloud

Public Cloud

Public Cloud

2. Cloud Data Center 3. Cloud FederationServer Virtualization1. Virtualization

Automation & Efficiency

Common software platform making

Federation possible

Page 15: OpenStack Technology Overview

Another definition …

“OpenStack is a Cloud Operating System, that takes resources such as compute, storage, network, virtualization technologies and controls those resources at a data center level”

What is OpenStack? OpenStack is a community of open source

developers, participating organizations and users who are building and running the open source cloud operating system.

Page 16: OpenStack Technology Overview

OpenStack Projects

• OpenStack Compute: Provision OpenStack Compute: provision and manage large networks of virtual machines

• OpenStack Object Store: Create petabytes of reliable storage using standard servers

• OpenStack Image Service: Catalog and manage large libraries of server images

• Other components: Dashboard, Load Balancing, Authentication...

Page 17: OpenStack Technology Overview

OpenStack Compute Key Features

2. Cloud Data Center 3. Cloud FederationServer Virtualization1. Server Virtualization

Automation & Efficiency

2. Horizontally and massively scalable

1. REST-based API

3. Hardware agnostic: supports a variety of standard hardware

4. Hypervisor agnostic: support for Xen ,Citrix XenServer, Microsoft Hyper-V, KVM, UML, LXC and ESX

Page 18: OpenStack Technology Overview

Feature BenefitManage virtualized commodity server

resourcesCPU, memory, disk, and network interfaces

Racks of commodity servers as pools of computingImproved utilization and automation of resources for greater cost efficiencies

Manage Local Area Networks (LAN)Flat, Flat DHCP, VLAN DHCP, IPv6

Programmatically allocate IPs and VLANs VLANs (for rapid provisioning of network capabilities and security features)Flexible networking models to suit needs of each application and/or user group

API with rate limiting and authentication

Designed for automation and security (to make it easy for you to manage who has access to compute resources and prevents users from impacting each other with excessive API utilization)

Distributed and asynchronous architecture

Massively scalable and highly available system(for increased assurance of system uptime)

Virtual Machine (VM) image management

Easily store, import, share, and query images(to make it easy for you to spin up new standardized VMs)

Live VM management (Instance)Run, reboot, suspend, resize, terminate instances

Increase productivity with lifecycle management(from a single user interface and using the APIs)

Create and manage Instance Types (Flavors)

Define sizes of VMs for CPU, RAM & Disk

Build a menu of options for users to select from(to enable self service and greater efficiency)Flavors make it easy to size VMs for workloads

iSCSI storage volume managementCreate, delete, attach and transfer volumes

Enables data to be managed separate from VMs for fault-tolerance and added flexibility

Live migration of instances Minimize downtime with planned maintenance

Floating IP addresses Keep IPs & DNS correct when managing VMs

Security GroupsFlexibility to assign and control access to VM instances by creating separation between resource pools

Role Based Access Control (RBAC) Ensure security by user, role and project

Projects & Quotas Ability to allocate, track and limit resource utilization

VNC Proxy through web browser Quick and easy CLI administration

OpenStack

Compute Detailed

Features

…click here for Compute Roadmap…

Page 19: OpenStack Technology Overview

Feature BenefitOpen vSwitch in Xen

(Diablo v1 06/02 – Implemented)Allows for more granular network control and flexibility, including protection for IPv6

Multi-Nic support(Diablo v2 06/30 –

Code Review)Offers more flexible networking options

Event Notification(Diablo v2 06/30 –

Implemented)

Pro-active alerting(e.g.: notification of instance builds, deletions and migrations are useful for monitoring and billing applications.)

Distributed scheduler(Diablo v2 06/30 –

Implemented)

Robust scheduler for scalability and high availability(for large scale deployments potentially spanning across DCs)

System usage(Diablo v2 06/30 – Started) Provides metrics for billing, chargeback, or monitoring purposes

Boot with volume(Diablo v3 07/28 –

Code Review)shorter boot time, persistent root partition

Virtual storage arrays(Diablo v2 06/30 –

In Progress)

Allows to emulates Enterprise class storage arrays, offer better capabilities than Amazon-S3

Global firewall rules(Diablo v2 06/30 –

Implemented)

DDOS preventionDrops all traffic from blacklisted IPs before it reaches instances

Advanced Scheduler(Diablo v3 07/28 – Started) Scheduler decision framework for more efficient mgmt./provisioning

Federated Auth with Zones(Diablo v4 08/25 – TBD) Allows to control permissions b/w public and private zones

Diablo

Release

OpenStack Compute – Roadmap

<Release Name> <Version> <Release Date> - < Status>

Page 20: OpenStack Technology Overview

OpenStack Storage Key Features

2. Cloud Data Center 3. Cloud FederationServer Virtualization1. Server Virtualization

Automation & Efficiency

4. Scalable to multiple petabytes, billions of objects

1. REST-based API

6. Account/Container/Object structure (not file system, no nesting) plus Replication (N copies of accounts, containers, objects) 

5. No central database required

2. Data distributed evenly throughout system

3. Runs on standard hardware

Page 21: OpenStack Technology Overview

Feature BenefitStore and Manage files

programmatically via APIAutomates resource management/provisioning

Create Public or Private containers Better control. Allows to share data publicly or keep it private

Leverages Commodity hardware No lock-in, lower price/GB

HDD/node failure agnosticSelf healingReliability, Data redundancy protecting from failures

Unlimited StorageHuge & flat namespace, highly scalable read/write accessAbility to serve content directly from storage system

Multi-dimensional scalability (scale out architecture)

Allows to scale vertically and horizontally-Distributed storageBackup/Archive large amounts of data with linear performance

Account/Container/Object structure no nesting, not a traditional file system

Optimized for scaleAllows to scale to multiples Peta-bytes, billions of objects

Built-in Replication (N copies of accounts, container, objects)

3x+ data redundancy compared to 2x on RAIDHigh Availability

Easily add capacity unlike RAID resize Elastic data scaling with ease

No central database Higher performance, No bottlenecks

RAID not requiredAllows to handle lots of small, random reads and writes efficiently

Built-in Mgmt. utilitiesAcct. Management: Create, add, verify, delete usersContainer Management: upload, download, verifyMonitoring: Capacity, Host, Network, Log trawling, cluster health

Drive auditing Allows to detect drive failures preempting data corruption

VNC Proxy through web browser Quick and easy CLI administration

OpenStack Object Storage: Detailed Features

…click here for Storage Roadmap…

Page 22: OpenStack Technology Overview

Feature BenefitImproved Client IP Logging (Diablo v1.4.0 05/31- Implemented)

Allows granular tracking and auditing for Intrusion detection and protection

Transaction ID headers (Diablo v1.4.0 05/31 – Implemented) Better control over data handling

Auto Account Create (Diablo 1.4.1 06/20 - Implemented)

Option to automate account creation for authorized requests…saving time

Option for Replication (Diablo Approved TBD) no replica will be in the same zone as another replica unless there is no other choice

Multi cluster container syncing (Diablo v1.4.2 TBD – In progress)

High availabilityAllows to synchronize container contents across clusters

Multi-region support (Future – Not Started)True High availabilityAllows to register and cross replicate b/w physically isolated external Object store clusters

Multi-tenant accounting (Pending Approval)Helps service providers support, track, audit, authorize customer resources

Client Bindings (Pending Approval) Higher performance and less data footprint

Compression options (Pending Approval) Faster Access/transfer, Reduced disk space

Large Single Uploads (Pending Approval) Allows to upload/store files greater than 5GB

Self-destructing files (Pending Approval) Policy based file management

Native Tiny URLs (Pending Approval)Easy addressing, Great for links on the go, Bookmarking, reduces friction from customers to click external links

Search Service (Pending Approval) Allows to search objects and containers by names and metadata

Improved Ring-Builder (Pending Approval) Allows to automate addition of large capacity to a storage cluster

SNIA CDMI Support (Pending Approval) Offers compatibility SNIA standard

Diablo

Release

OpenStack Object Storage – Roadmap

<Release Name> <Version> <Release Date> - < Status>

Page 23: OpenStack Technology Overview

OpenStack Image Service Key Features

2. Cloud Data Center 3. Cloud FederationServer Virtualization1. Virtualization

Automation & Efficiency

2. REST-based API1. Store & retrieve VM images

3. Compatible with all common image formats

4. Storage agnostic: Store images locally, or use OpenStack Object

Storage, HTTP, or S3

Page 24: OpenStack Technology Overview

Feature Benefit

Image-as-a-service Store and retrieve virtual machine images at scale

Multi-format/container support Compatible with all common image formats

Image status Provides visibility and availability structure

Scalable API Image Services scales with OpenStack

Metadata Store and retrieve information about the image

Image Checksum Ensure data integrity

Extensive Logging Provide audit and debugging capability

Integrated testing Verify functionality of the virtual machine

Back-end store options Greater flexibility with Swift, Local, S3 or HTTP

Version control Provides structure and control

CLI access Administrative options

OpenStack Image Service: Detailed Features

…click here for Image Service Roadmap…

Page 25: OpenStack Technology Overview

Feature Benefit

Auth. System integration

(Diablo v3 07/28 – In Progress)Allows for specific ownership vs public/private

Open metadata fields(Diablo v3 07/28 – In

Progress)Additional key pairs for custom association

API improvements(Diablo v1 06/02 –

Implemented)Results limiting, filtering, sorting, and version support

Shared image groups(Diablo v3 07/28 – Blocked

)Capability to allow image sharing and access by groups

HTTPS(Diablo v3 07/28 – Blocked

)Secure query and transfer

XML Support(Diablo TBD – TBD) Broader system integration capabilities

GZIP compression(Diablo TBD – Blocked) Increase speed and decrease bandwidth for large queries

ISO format support(Diablo v1 06/02 –

Implemented)Extend format types

Diablo

Release

OpenStack Image Service – Roadmap

<Release Name> <Version> <Release Date> - < Status>

Page 26: OpenStack Technology Overview

Feature Description

Block storage service(Unknown TBD – TBD)

An API-fronted iSCSI-based block storage service that aims to offer moderate performance with a very low cost/GB of capacity

Identity Service (Diablo v2 06/30 – Beta Available)

Provides common identity components (user store, authentication service, endpoint management) and middleware to integrate with services.

Load Balancing API( Available)

ReSTful API allowing customized solutions to automate load balancer management

Database-as-a-Service(TBD– Needs Approval)

Scalable relational database service that allows users to quickly and easily utilize the features of a relational database without the burden of handling complex administrative tasks

Clustering-as-a-Service(TBD – Started)

Allows service providers to manage multiple OpenStack clouds and share physical resource among these cloud infrastructures and platforms

Address Management and Discovery

(TBD– Unknown)

Provide network information services for use across OpenStack services. Initial focus for this project will be on IP address management (IPAM) and address discovery (DHCP/dnsmasq) functionality

Network Connectivity-as-a-Service(TBD– TBD)

Provide network connectivity between devices managed by other OpenStack services such as nova• Provide flexibility in creating networks + associating devices to support

interesting network topologies between VMs from the same Tenant• Example: create multi-tier applications

• Provide way to connect interconnect multiple Openstack services (*-aaS).

• Example: Nova VM + Atlas LB on same private network.• Open the floodgates to let anyone build services (open or closed) that

plug into Openstack networks.• Examples: VPN-aaS, firewall-aaS, IDS-aaS.

OpenStack dev. Pipeline…incubating…draft…pending approval - status

Contd…

<Release Name> <Version> <Release Date> - < Status>

Page 27: OpenStack Technology Overview

Feature Description

Distributed Message Queuing Service

(Diablo Needs Approval – Available)

Message queue that can be used in a variety of environments, from simple in-process queues to multi-tenant cloud services. In addition it provides fan-out event notification mechanism so a single message may be read by multiple readers.

Topology Service(TBD– TBD)

Inventory service that allows to gather cloud wide node estate information in-order to implement intelligent resource placement mechanism for efficient utilization of DC resources (hardware, networking, etc.)

Container Service(TBD– TBD)

Simplified management of complex resources. Logical grouping of resources (network, compute, storage) created/managed as one unit. Network containers…initial focus

Multi-Cluster Zones(Cactus– Available)

Allows for multiple root nodes (top-level Zones) so business units can partition the hosts in different ways for different purposes (i.e. geographical zones vs. functional zones). (Zones are logical groupings of Nova Services and VM Hosts)

Cloud Gateway(TBD– TBD)

Common interface to manage multiple cloud. Users will will be able to design their cloud application environments once and use it on any cloud type

OpenStack dev. Pipeline…incubating…draft…pending approval - status

<Release Name> <Version> <Release Date> - < Status>

Page 28: OpenStack Technology Overview
Page 29: OpenStack Technology Overview

Why OpenStack?‣ Control and Flexibility. Open source platform means

you’re never locked to a proprietary vendor, and modular design can integrate with legacy or third-party technologies to meet  your business needs.

‣ Industry Standard.  More than 60 leading companies from over a dozen countries are participating in OpenStack, including Cisco, Citrix, Dell, Intel and Microsoft, and new OpenStack clouds are coming online across the globe.

‣ Proven Software.  Run the same software that today powers some of the largest public and private clouds in the world.

‣ Compatible and Connected. Compatibility with public OpenStack clouds means enterprises are prepared for the future—making it easy to migrate data and applications to public clouds when conditions are right—based on security policies, economics, and other key business criteria.

Page 30: OpenStack Technology Overview

• What is it: Open source cloud operating system

• Who’s building it: worldwide community of developers

• Who’s backing it: Over 80 companies, including leaders like Cisco, NTT, Dell, Citrix, & Canonical

More About OpenStack

“OpenStack is a Cloud Operating System, that takes resources such as compute, storage, network, virtualization technologies and controls those resources at a data center level”