Montreal Linux MeetUp - OpenStack Overview (2017.10.03)

cloudops.com @cloudops_

OpenStack OverviewOctober 3rd 2017

Stacy Véronneau● Director of OpenStack Solutions and Lead OpenStack

Architect at CloudOps.● Using public cloud resources since 2007● Started ‘exploring’ OpenStack at Folsom and using at

Grizzly● OpenStack MeetUp organizer

○ Montreal, Ottawa, Edmonton and Toronto(Co-Org)

● Speaker at OpenStack Days and Summit○ Austin, Montreal, Barcelona, Boston, Ottawa

● OpenStack Mentor since August 2017

cloudops.com @cloudops_Page

About CloudOps

We enable our customers to own their destiny in a cloudy world by

leveraging open source cloud orchestration and best of breed technologies.

Our team has built and continues to support dozens of regional clouds for

telco and community cloud service providers around the world.

We’ve helped hundreds of software companies migrate to and scale their

businesses on regional cloud platforms such as cloud.ca and public clouds

such as Google Cloud Platform and Amazon Web Services.

What is OpenStack?

As described by Wikipedia

“OpenStack is a cloud computing project aimed at providing an infrastructure as a service (IaaS).”

The software platform consists of interrelated components that control hardware pools of processing, storage and networking”

What is OpenStack?

● What it is○ Abstraction Layer

○ A group of interrelated projects

○ IaaS Solution

○ Community Driven

● What it isn’t○ Interdependent project (Exceptions Apply)

○ A complete standalone solution, extra components are needed

○ Standalone Virtualisation solution

OpenStack Capabilities

● Virtual machines (VMs) on demand○ Provisioning

○ Snapshotting

● Networks○ Provisioning

○ Isolation

● Storage for VMs and arbitrary files

● Multi-tenancy○ Quotas for different projects, users

○ User can be associated with multiple projects

History and a High Level Recap

History

● Started in 2010 by and

● Foundation created in 2012

● Latest release was on August 30th 2017 and is named Pike

The Mission:

“To produce the ubiquitous Open Source Cloud Computing platform that

will meet the needs of public and private clouds regardless of size, by being

simple to implement and massively scalable”.

History - Release Naming

Only single words with a maximum of 10 characters are good candidates for a name. Bonus points for sounding cool.

● Austin: The first design summit took place in Austin, TX

● Bexar: The second design summit took place in San Antonio, TX (Bexar county).

● Cactus: Cactus is a city in Texas

● Diablo: Diablo is a city in the bay area near Santa Clara, CA

● Essex: Essex is a city near Boston, MA

● Folsom: Folsom is a city near San Francisco, CA

● Grizzly: Grizzly is an element of the state flag of California (design summit takes place in San Diego, CA)

● Havana: Havana is an unincorporated community in Oregon

● Icehouse: Ice House is a street in Hong Kong

● Juno: Juno is a locality in Georgia

● Kilo: Paris (Sèvres, actually, but that's close enough) is home to the Kilogram, the only remaining SI unit tied to an artifact

● Liberty: Liberty is a village in the Canadian province of Saskatchewan

● Mitaka: It’s named after the town located in the Tokyo metro area, known for Inokashira park and the Ghibli museum,

● Newton (Austin, Texas): The "Newton House", located at 1013 E. Ninth St., Austin, TX, is listed on the National Register of Historic Places

● 2017.1 Ocata (Barcelona, Spain): Ocata is a beach about 20 minutes north of Barcelona by train

● 2017.2 Pike, the Massachusetts Turnpike, also the Mass Pike (Boston)

● 2018.1 Queens, Queens Pound river in the Souther Coast region of NSW (Australia)

● 2018.2 Rocky (British Columbia, Canada)

History - Architecture @ Cactus

Source: docs.openstack.org

History - Architecture Now

Source: docs.openstack.org

High LevelatHigh Speed

OpenStack - Is NOT VMware

OpenStack - Is more an In-House AWS

OpenStack vs AWS

Project Name Description AWS Equiv. Codename(s)

Compute Provision and manage large pools of on-demand computing resources EC2 Nova

Block Storage Volumes on commodity storage gear, and drivers for turn-key block storage solutions EBS Cinder

Object Storage Petabytes of reliable storage on standard gear S3 Swift

Networking L2-focused on-demand networking with some L3 capabilities VPC Neutron

Dashboard Self-service, role-based web interface for users and administrators Console Horizon

Metering Centralized metering data for all services for integration to external billing CloudWatch Ceilometer

Identity Multi-tenant authentication system that ties to existing stores (e.g. LDAP) and Image Service IAM Keystone

Image Management Upload, download, and manage VM images for the compute service VM Import/Export Glance

Orchestration Application orchestration layer that runs on top of and manages OpenStack Compute

CloudFormation, CloudWatch Heat

OpenStack - Is NOT a Product

OpenStack - Is an AWESOME platform

OpenStack - High Level & High Speed

Let’s Talk DistrosOpenStack Overview

OpenStack - Let’s Talk Distros

Core ServicesOpenStack Overview

OpenStack - Core Services

OpenStack embraces a modular architecture to provide a set of core services that facilitates

scalability and elasticity as core design tenets.

OpenStack - Core Services

Each service:

● Is also a “top-level” OpenStack component

● Has an elected “Project Technical Lead” (PTL)

● Has separate developers and design teams

● Has a well defined public API

○ With the exception of Horizon, which is the Web GUI, all other

projects have a RESTful (JSON/HTTP) API

● Has a separate database and an isolated persistent layer

OpenStack Programs Relationships

ProvidesNetwork connectivity

Glance

Stores disk files in

NeutronNetwork

Block Storage

CinderProvides

volumes for

NovaCompute

Poll data from

CeilometerMetering

Poll data from

Object Storage

SwiftStores images in

HeatOrchestrate

Arranges and directsProvidesUI for

ProvidesUI for

Common UIHorizonDashboard

KeystoneIdentity

ProvidesAuth for

Access Control

ProvidesAuth for

ProvidesUI for

ProvidesAuth for

Not a program, but important to understand the relationship

Database

Not a program, but important to understand the relationship

Message Queue

OpenStack Deployment Topology

Control Cluster

Horizon Keystone

GlanceNeutron

CinderNova

Compute Cluster

computenode

Storage Cluster (Cinder Volume, Swift)

storagenode

Heavy CPU and RAM Heavy Disk and I/O

CeilometerHeat

KeystoneProvides Identity, Token, Catalog and Policy services for use specifically by projects in the OpenStack family

OpenStack Overview

Nova APIA RESTful API web service which is used to interact with Nova Compute

OpenStack Overview

Nova SchedulerA daemon, which determines, on which compute host the request should run

OpenStack Overview

NeutronNetwork as a Service

OpenStack Overview

CinderBlock Storage as a Service

OpenStack Overview

GlanceProvides services for discovering, registering, and retrieving virtual machine images

OpenStack Overview

SwiftSwift is a highly available, distributed, eventually consistent object/blob store

OpenStack Overview

CephThe all-in-one storage service that is not an OpenStack project

OpenStack Overview

CeilometerThe Telemetry Service

OpenStack Overview

HeatThe Orchestrator

OpenStack Overview

HorizonProvides a baseline UI for managing OpenStack services

OpenStack Overview

MagnumContainer Infrastructure Management Service(Big Tent Project)

OpenStack Overview

DependenciesThe bare minimum components outside of Openstack

OpenStack Overview

Provisioning of a VMThe most common and complex process in OpenStack and involves interaction of most of OpenStack components

OpenStack Overview

OpenStack - Provisioning of a VM

● Users log into Horizon and initiate a VM create

● Keystone authorizes

● Nova API initiates provisioning and saves state to DB

● Nova Scheduler finds appropriate host

● Neutron configures networking

● Cinder provides block device

● Image URI is looked up through Glance

● Image is retrieved via Swift

● VM is rendered by Hypervisor

● VM now accessible by the users

Deployment ToolsOpenStack Overview

OpenStack - Deployment Tools

The deployment tools for OpenStack are like Baskin Robbins.

It’s a 31 flavors buffet.

● OpenStack Ansible

● Puppet / Chef / Salt OpenStack

● Fuel

● JuJu + Charms

● Triple-O / Kolla / OpenStack Helm / Conjur-Up / PackStack / DevStack ...

What About That Magical Thing Called Kubernetes

OpenStack Overview

OpenStack - Kubernetes

There are many ways to use Kubernetes when it comes to OpenStack. You can use it to deploy

OpenStack or you can use it within OpenStack. It’s been called the infrastructure club sandwich.

● K8s to deploy OpenStack○ OpenStack Helm

○ Kolla

● K8s in OpenStack○ Kubespray / OpenShift

○ Magnum / Rancher

○ KubeAdm

What Else is Needed?OpenStack Overview

OpenStack - What else is needed?

You now have a shiny new OpenStack Cloud but beside spinning instances,

what can you do to maximize utilisation and ROI?

● CI/CD Systems

● External AAA (Authentication, Authorization, Accounting) Integration

● Logging, Monitoring and Alerting (Day 2)

● Plan WorkLoad Onboarding

OpenStack - What else is needed?

● Workshops

○ Architecture Design Assessment

○ Knowledge leveling sessions

○ Hands-on labs

○ Day 2 troubleshooting scenarios

○ SDN and OpenStack

○ OpenStack and Containers

○ OpenStack and Ceph

cloudops.com @cloudops_Page 49

Open Source Magic In OpenStack

Open Source is what makes OpenStack an AWESOME platform!

OpenStack Days Canada● October 19th 2017 - Nature Museum● https://www.openstackcanada.com/

Reach out on Slack if you have more questionshttp://openstack-canada-slack-invite.herokuapp.com/

Thank you for your time

sveronneau@cloudops.comhttps://www.linkedin.com/in/stacyveronneau/ https://www.meetup.com/preview/Montreal-OpenStack

Montreal Linux MeetUp - OpenStack Overview (2017.10.03)

Technology

Containers #101 Meetup: Containers & OpenStack

OpenStack Boston meetup 12 4-2014

Hybrid cloud openstack meetup

Openstack Global Meetup

Austin OpenStack Meetup: Chef and OpenStack

OpenStack and DevOps - DevOps Meetup

Openstack India May Meetup

Quantum (OpenStack Meetup Feb 9th, 2012)

Introduction openstack-meetup-nov-28

OpenStack Austin Meetup January 2014: Chef + OpenStack

Nairobi OpenStack Meetup - July 2013

Midokura OpenStack Meetup Taipei

Docker Introduction - DevOps Montreal Meetup

Jumpstart - LOA Montreal Meetup

OpenStack : Linux User Group meetup

Openstack meetup: NFV and Openstack

May Triangle OpenStack Meetup

Manchester OpenStack Meetup: I have an OpenStack Cloud, now what? OpenStack 101

OpenStack Meetup - SDN

BigData Meetup - OpenStack Sahara