45
Prepared for: Austin Cloud Users Group Date: August 20 th , 2012 Craig Vyvial https://github.com/hub-cap/reddwarf_lite OpenStack & Reddwarf

Openstack and Reddwarf Overview

Embed Size (px)

DESCRIPTION

Overview of the Openstack architecture and the Reddwarf Architecture.

Citation preview

Page 1: Openstack and Reddwarf Overview

Prepared for: Austin Cloud Users Group

Date: August 20th, 2012

Craig Vyvial

https://github.com/hub-cap/reddwarf_lite

OpenStack& Reddwarf

Page 2: Openstack and Reddwarf Overview

Agenda

‣ Overview

‣ OpenStack Architecture

‣ Reddwarf Architecture

‣ Developer vs Deployer

‣ Demo?

‣ Questions

Page 3: Openstack and Reddwarf Overview

Overview

Page 4: Openstack and Reddwarf Overview

OpenStack Founding Principles

‣ Apache 2.0 license (OSI), open development process

‣ Open design process, 2x year public Design Summits

‣ Publically available open source code repository

‣ Open community processes documented and transparent

‣ Commitment to drive and adopt open standards

‣ Modular design for deployment flexibility via APIs

Page 5: Openstack and Reddwarf Overview

OpenStack Community

‣ User groups across the world

‣ Events

‣ Design Summit, Conference, and Meetups

‣ Contribute

‣ Documentation, Design, or Code

‣ Over 180 Companies

Page 6: Openstack and Reddwarf Overview

OpenStack Contributions

‣ Launchpad.net (Bugs/Blueprints)

‣ Code reviews (gerrit)

‣ Unit Tests

‣ Integration Tests

‣ Jenkins jobs with gates

Page 7: Openstack and Reddwarf Overview

Benefits of a Common Platform

‣ Common API contract for public/private cloud

‣ Easy to migrate to public when needed

‣ No vendor lock in with a single provider

‣ Run on commodity hardware

Page 8: Openstack and Reddwarf Overview

OpenStack Platform

‣ Python

‣ Did I mention open source?

‣ github.com/openstack

Page 9: Openstack and Reddwarf Overview

OpenStack Architecture

Page 10: Openstack and Reddwarf Overview
Page 11: Openstack and Reddwarf Overview
Page 12: Openstack and Reddwarf Overview

Keystone Identity Service

‣ Provides Identity, Token, Catalog, and Policy Services

‣ Authentication / Authorization

‣ Validation

‣ User management

‣ Project / Tenant management

‣ Service management

Page 13: Openstack and Reddwarf Overview
Page 14: Openstack and Reddwarf Overview

Glance Service

‣ VM Image Service for nova-compute

‣ Manage and deploy images

‣ Backend storage of images can be anything

‣ File based

‣ Swift

‣ S3

‣ Multiple Image Formats

‣ AMI / raw / iso / qcow / etc.

Page 15: Openstack and Reddwarf Overview
Page 16: Openstack and Reddwarf Overview

Nova APIs

‣ Rest based

‣ json/xml

‣ OpenStack Compute API

‣ Management API

‣ EC2 API

‣ Dashboard (Horizon)

Page 17: Openstack and Reddwarf Overview
Page 18: Openstack and Reddwarf Overview
Page 19: Openstack and Reddwarf Overview

Message Bus

‣ Backbone of system

‣ Message routing between services

‣ Generic API to send messages

‣ Multiple drivers supported

‣ RabbitMQ

‣ ZeroMQ

‣ Qpid

Page 20: Openstack and Reddwarf Overview
Page 21: Openstack and Reddwarf Overview

Nova Database‣ MySQL Server

‣ Stores all OS system data

‣ Instance info

‣ Network info

‣ Node info

‣ Python library SQL-Alchemy ORM

‣ SQLite for unit testing

‣ Other relational databases

Page 22: Openstack and Reddwarf Overview
Page 23: Openstack and Reddwarf Overview

Nova-Scheduler Service

‣ Determines the placement of new resources requested via the API

‣ Modular architecture to allow for optimization

‣ Base Schedulers include

‣ Round Robin

‣ Filter Scheduler

‣ Spread First

‣ Fill First

‣ Chance (random)

Page 24: Openstack and Reddwarf Overview
Page 25: Openstack and Reddwarf Overview

Nova-Compute Service

‣ KVM

‣ QEMU

‣ Xen/Xen Server

‣ VMWare ESX/ESXi

‣ LXC

‣ OpenVZ

‣ HyperV

Page 26: Openstack and Reddwarf Overview
Page 27: Openstack and Reddwarf Overview

Nova-Network Service (Quantum)

‣Provides network connectivity as a service

‣ Programmable networking

‣ Open vSwitch

‣ Nicira Network Virtualization Platform (NVP)

‣ Linux Bridge

‣ Ryu OpenFlow Controller

‣ On Demand creation of rich L2 + L3 topologies

‣ Quantum is the core project that came from this service

Page 28: Openstack and Reddwarf Overview
Page 29: Openstack and Reddwarf Overview

Nova-Volume Service (Cinder)

‣ Provide a Block Storage Service

‣ Create / Delete / Connect volumes to running instances via iSCSI

‣ Drivers available

‣ LVM / iSCSI

‣ Multiple SAN drivers

‣ Ceph

‣ Cinder is newly formed core project

Page 30: Openstack and Reddwarf Overview

Reddwarf Architecture

Platform as a Service

Page 31: Openstack and Reddwarf Overview

Reddwarf Architecture

Page 32: Openstack and Reddwarf Overview

Reddwarf Architecture

Page 33: Openstack and Reddwarf Overview

Reddwarf API

‣ Rest Based

‣ Json/xml

‣ Create / Delete / Actions on Instance

‣ Extendable API

‣ Communication to the Guest Agent

‣ Keep API response fast (async)

Page 34: Openstack and Reddwarf Overview

Reddwarf Architecture

Page 35: Openstack and Reddwarf Overview

Reddwarf Task Manager

‣ Long running processes

‣ Create / Delete / Resize Instance

‣ Setting status when ACTIVE

‣ Synchronous process

Page 36: Openstack and Reddwarf Overview

Reddwarf Architecture

Page 37: Openstack and Reddwarf Overview

Guest Agent (Sneaky-Pete)

‣ Reference Agent (python)

‣ Listens on the Message Bus

‣ Updates MySQL Status to DB

‣ Sets up and secures the MySQL instance

‣ Controls and manages the MySQL instance

‣ Low memory footprint

Page 38: Openstack and Reddwarf Overview

Developer vs Deployer

Page 39: Openstack and Reddwarf Overview

Developers

‣ Devstack is documented shell script to build a complete OpenStack development environment.

‣ http://devstack.org

‣ Setup a fresh Ubuntu Precise (12.04) or Fedora 16 installation (VM)

‣ VMware/Virtual Box/etc.

‣ Clone devstack

‣ Deploy your OpenStack Cloud

Page 41: Openstack and Reddwarf Overview

We are hiring! RACKERTALENT.COM

• California• Austin• San Antonio• Virginia• London• Hong Kong• Many other places

Page 42: Openstack and Reddwarf Overview

Questions?

Page 43: Openstack and Reddwarf Overview
Page 44: Openstack and Reddwarf Overview