Road to Private Cloud mit OpenStack - DOAG

Road to Private Cloud mit OpenStack Projekterfahrungen

Andreas Kress Enterprise Architect Oracle Sales Consulting DOAG Regio Nürnberg/Franken 20. April 2017

Copyright © 2016, Oracle and/or its affiliates. All rights reserved.

Safe Harbor Statement

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

3 DOAG Regio Nürnberg/Franken

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |

OpenStack Short Introduction



Cloud Computing: State of the Enterprise What’s Driving Enterprises to Cloud Systems?

• Cloud Benefits IT Consumers

– Agility through self-service automation

–On-demand provides OpEx vs. CapEx options

• Cloud Benefits IT Providers – Better capacity planning and asset utilization

– Centralized monitoring and reporting

–Manage IT as a collection of provided services

• Not surprising: Many Enterprises have, or are looking to either deploy new clouds, or shift to cloud based management for existing infrastructure

DOAG Regio Nürnberg/Franken 5


OpenStack Overview

• Open source cloud software

– Generic solution for IaaS, PaaS and SaaS

–Modular architecture • Web portal for cloud admins and self-service users

• Cloud services exposed through APIs

• CLI, Python libraries, ...

• Combines compute, network and storage resources – Self-service dashboard

– Services exposed through REST APIs

What is OpenStack?

Single Management Pane

VM VM VM

Virtualized Data Center Resources


Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 7

OpenStack in Action

DOAG Regio Nürnberg/Franken


OpenStack in Action



Drivers for OpenStack Cloud Infrastructure What’s exciting customers about OpenStack?

• Broad Industry Adoption and Participation in the Community

–Over 400 companies involved!

• Rich technology Ecosystem

– Provides choice / freedom to leverage underlying Compute, Storage, Networking Infrastructure

• “Standardized” Cloud API layer

– Abstracts higher level Cloud Software & Services from Undercloud infrastructure specifics



OpenStack Use Cases – Heterogeneous IaaS

• Oracle Solaris Zones Based Compute

– SPARC and x86

– Centralized management

10

Consolidate Oracle Solaris and SPARC in existing OpenStack cloud



• Out-of-the-Box Ready to Use

– Lots of work to configure underlying infrastructure • Overall Integration

• Lots of moving parts

• Dependent on expertise, experience, vendors, maturing technology

• Mature

– Aggressive release cycle; short support lifespan

– Update capability is limited, often “rip and replace”

– However, it is improving

• Free

–OpenSource does not mean free

– Large investment to set up and support environment

11

What OpenStack is not…



Overview of Core Components

OpenStack Services

Component Description

Nova Compute virtualization

Cinder Block storage

Neutron Software defined networking

Keystone Authentication between cloud services

Glance Image management and deployment

Horizon Web based dashboard

Swift Object storage

Heat OpenStack Orchestration



OpenStack Logical Architecture with Service Names

Neutron

Cinder

Nova Glance Swift

Keystone

Horizon



Horizon

Cloud Management

Nova Compute Virtualization

Neutron Cloud Networking

Cinder/Swift Cloud Storage

Glance Image Deployment

14

OpenStack Basic Picture



Agenda

Motivation

Road to the Cloud

– Technical Architecture

– Solution Design

– Challenges

Exemplary Project Plan

Lessons Learned

1

2

3

4

A 15 DOAG Regio Nürnberg/Franken


Motivation

• Reduce Deployment Time and Efforts

• Enable Self-Service

• Standardization and Reduce of Complexity

• Provisioning of Multiple Heterogenous Clouds

• One Management Tool for Multiple Clouds

• Unified Application Deployment Model

• Reduce Costs

Multiple Cloud Strategy

16 A DOAG Regio Nürnberg/Franken


Further Requirements

• Standardize API Interfaces

• Complete. Pre-Assembled. Preconfigured.

• Vendor Certified and Guaranteed Interoperability

• One Support Contract for all Components

• Secure by Default

• Isolated Cloud with Dedicated Secured Entry Points

• Optimized for Oracle Workload

17 A DOAG Regio Nürnberg/Franken


Private Cloud Vision – DBaaS Example

Target Design

Self-Provision

Database Service

Private Cloud

Converged

Infrastructure

Monitor

Dedicated Cloud for

Oracle DBaaS €€€

Public/

Hybrid Cloud Future

Option

Cost Allocation

& Chargeback

Create, Clone/

Snap, Terminate



Private Clouds with Oracle

19

Engineered Systems

Best-of-Breed

• Standardized Cloud Mgmt SW • Common API • DIY Infrastructure

• DIY Infrastructure • DIY Cloud Mgmt SW • DIY API

• Ready-Made Stack • Purpose-Built System • Best Performance

OpenStack



Road to the Cloud

• Planning the Cloud (Architecture)

• Designing the HW Infrastructure

• Orchestration

• HA-/DR-Konzept

• Performance

• Other Challenges and more



Use Cases

• User Access

– Cloud Networking

– Flat Networking

• Ressource Assignment - Example: Storage – Shared Storage

– Local Storage (Segregation)

• Workload Type

– Data Driven (High IOPS Demand) – e.g. Database

– Compute Intensive (High CPU Demand) – e.g. HPC

– Transactional Workload (High Memory Demand) - e.g. Application Server



Cloud Networking with Shared Storage

Converged Cloud Architecture

22

Network Node

Storage Network

Cloud Network

Compute Node

Compute Node

Compute Node

Compute Node

Compute Node

Shared Storage

Public Network

D DOAG Regio Nürnberg/Franken




23

Network Node

Storage Network

Cloud Network

Compute Node

Compute Node

Compute Node

Compute Node

Compute Node

Shared Storage

Public Network

Op

enSt

ack

Net

wo

rk

Utilities Controller

OpenStack Controller

and Cloud Controller





24

Network Node

Storage Network

Cloud Network

Compute Node

Compute Node

Compute Node

Compute Node

Compute Node

Shared Storage

Public Network



Flat Networking with Shared Storage

Flat Cloud Architecture

Storage Network

Compute Node

Compute Node

Compute Node

Compute Node

Compute Node

Shared Storage

Public Network

Cloud Network

D

Public and Cloud Network



Flat Networking with Local Storage

Flat Cloud Architecture

Compute Node

Compute Node

Compute Node

Compute Node

Compute Node

Storage Network

Shared Storage

D 26




Road to the Cloud



• Orchestration

• HA-/DR-Konzept

• Performance




Converged Infrastructure

• Grouping Multiple Information Technology Components

• One Single, Optimized Computing Package

• Components may include

–Networking Equipment

– Data-Storage Devices

– Servers

– IT Infrastructure Management

– Automation

–Orchestration

Source: https://en.wikipedia.org/wiki/Converged_infrastructure



Patch Panel Patch Panel Patch Panel

CCI Infrastructure with Oracle Design Decisions

10

20

30

40

Patch Panel

Server • SPARC Server • x86 Server

Operating System • Oracle Solaris • Oracle Linux

Storage • DAS • NAS • SAN

Network • 10 GbE • Infiniband

Cloud Mgnt Package



CCI Infrastructure Logical View Flat Cloud Architecture

Compute Nodes

Shared Storage

Storage Nodes

...

Storage NW Op

enSt

ack

Net

wo

rk

VM

Mgnt Nodes

Pu

blic

& C

lou

d N

W

Cloud Mgnt Pack


CCI Rack

* System Management Network not shown

A 30

VM



Private Cloud Appliance Integrated Hardware Accelerates Time to Value

Compute Infrastructure

• Scalable from 2-25 nodes

• Up to 19.2TB aggregate memory drives VM density

• Optimized for Oracle Applications

• Supports any Linux, Oracle Solaris and Windows applications

Network Infrastructure

• High speed low latency networking between all components

• Fully configured fabric networking, no setup required

• Integrates with existing Ethernet and Storage networks

Management Infrastructure

• Pre-configured, redundant management servers

• Oracle VM templates downloadable

• ZFS storage system for Management Storage

Networking

Management

31

Fabric Interconnect

Fabric Interconnect

Compute Nodes

Compute Nodes

Management Nodes

Management Storage

Ethernet Switch

Infiniband Expansion




• Expansion with Identical Racks • Expansion with Compute and Storage Racks

Multi-Rack Scaling

32

Base Rack

Rack 4 Rack 2 Rack 3 Base Rack

Compute Expansion

Compute Expansion

Storage Expansion

Com-pute

Stor-age

Net-work

Com-pute

Stor-age

Net-work

Com-pute

Stor-age

Net-work

Com-pute

Stor-age

Net-work

Com-pute

Stor-age

Net-work

Com-pute

Com-pute

Stor-age



Design Considerations

• Build a Cloud with Oracle Solaris OpenStack

– Fully Supported, Enterprise Ready Software Stack

–Optimized for Oracle Database Workload

• Lock-Down the Cloud – Public Network Access Restricted to OpenStack Instances

– Separated Access to Infrastructure Components and Control Logic (The Undercloud)

• Virtualize the Workload. Virtualize the Control Logic

– Power the Infrastructure and the Workloads with Solaris Zones

Make it Secure and Easy to Maintain

D 33 DOAG Regio Nürnberg/Franken


A Short Recap

OpenStack Logical Architecture

Neutron

Cinder

Nova Glance Swift

Keystone

Horizon



Havana (11.2), Juno (11.2 SRU10), Kilo (11.3 SRU9)

Oracle OpenStack for Oracle Solaris

Zones & Kernel Zones

Nova

Compute Virtualization

Elastic Virtual Switch

Neutron

Cloud Networking

ZFS File System

Cinder/Swift

Cloud Storage

Glance

Image Deployment

Unified Archives

Heat

Orchestration

Unified Archives

Ironic Bare Metal

Deployment SPARC/x86

Horizon

Cloud Management



Road to the Cloud



• Orchestration

• HA-/DR-Konzept

• Performance




Orchestration of an Oracle Solaris OpenStack Cloud

• Automate the "Undercloud" Infrastructure Creation (AI)

• Automate and Standardize the "Undercloud" (= OpenStack) Configuration

• Enable Cloud LifeCycyle Management with Boot Environments (BE)

Setup and Configure the Cloud in Minutes not Days

Creating a Replicable Setup

37 D DOAG Regio Nürnberg/Franken


Road to the Cloud



• Orchestration

• HA-/DR-Konzept

• HA-/DR-Concepts • Cloud Control Pane

• Application



High Availabilty of the Undercloud

• Failover Cluster

– Clustered Services

– Solaris Kernel Zones

– Failover Zones with Oracle Solaris Cluster

• Scalable Services

– Distributed Services

– Solaris Kernel Zones

– Client Driven Service Selection

Make the Infrastructure High Available

39

Management Node



Management Node

Oracle Solaris Cluster

Failover Cluster

Failover Cluster



A

Management Node



Management Node

Loadbalancer





High Availabilty of the Application

• Run Multiple Independent Clouds

• Example: Oracle Database

– Replication via Oracle Active Data Guard

• Example: Oracle Weblogic

–Weblogic internal Cluster Functionality

Make the Service High Available

40 A

Data Guard

Primary Data Center

Failover Data Center DB

Prod Cloud

DB DR

Cloud

Replication

Primary Data Center

Failover Data Center

Web Web Web Web Web

Traffic Manager

Web



Road to the Cloud



• Orchestration

• HA-/DR-Concepts

• Performance


• Performance • Network Access Concept

• Storage Access Concept



Cloud Networking Flat Networking

Performance Aspects of Cloud Architectures

42 D

Cloud Network Access



Shared Storage Local Storage

Performance Aspects of Cloud Architectures

43 D

Cloud Storage Access



Further Performance Aspects

• Network Virtualization

– VxLAN or Tagged VLAN

• Virtualization Type for Guests

–Non-Global Zones, Kernel Zones, LDoms

• Storage Considerations – iSCSI or NFS

– Shared Storage Access

– DIY or Buy Storage Node

Networking and Storage



Road to the Cloud



• Orchestration

• HA-/DR-Concepts

• Performance

• Further Challenges to Consider



Exemplary Project Plan

• Schedule Depends on:

– Knowledge Level: Customer, Vendor, Partner

– Target Design (Technology)

– Level of Corporate IT Maturity

– Commitment and Engagement of the Users

– Ability to Adapt Changes

46

PoC Test/Dev PreProd Production

Learning Learning Learning Learning



Lessons Learned

• Start with a Clear Vision

• Establish a Team

– Project Sponsor, Customer (IT Dept & Users), Vendor and Partner

• Proof of Concept Matters

– Check what Really Works and Constantly Rethink and Rework Concepts

–Match Expectations, Requirements and Cloud Features

• The Road to Cloud is more than just Creating the Cloud Infrastructure

– Creating Images, Defining Flavors/Shapes, Software Deployment

– "Cloudifying" Internal Processes

• Engage and Convince the Prospective Users Early

47

Teamwork



Backup Slides

DOAG Regio Nürnberg/Franken 48


Private Cloud: Deploy with Engineered Systems

Integrated Platform Systems

(Exadata, Exalogic, Exalytics)

• High-Performance Middleware, Database, Apps

Integrated Infrastructure Systems (Private Cloud Appliance)

• General-Purpose Distributed Workloads

Management SW

Servers

Network

Storage

Apps/Middleware

Integrated Server/Storage/Network/Management

Single Vendor Sale and Support

Single SKU/Complete System/Support



Private Cloud Appliance Integrated Hardware Accelerates Time to Value

Compute Infrastructure

• Scalable from 2-25 nodes

• Up to 19.2TB aggregate memory drives VM density

• Optimized for Oracle Applications

• Supports any Linux, Oracle Solaris and Windows applications

Network Infrastructure

• High speed low latency networking between all components

• Fully configured fabric networking, no setup required

• Integrates with existing Ethernet and Storage networks

Management Infrastructure

• Pre-configured, redundant management servers

• Oracle VM templates downloadable

• ZFS storage system for Management Storage

Networking

Management

50

Fabric Interconnect

Fabric Interconnect

Compute Nodes

Compute Nodes

Management Nodes

Management Storage

Ethernet Switch





Elastic Infrastructure for Multi-Tenancy

Wire Once Infrastructure • Connect any VM dynamically to any IO resource

• Prewired for simplicity, add compute nodes on demand

• Dynamically create up to 8 networks per Tenant-Group

Increased Flexibility • Deploy and grow applications as your needs change

• Create isolated groups for applications

• Improve app to app communication

Software Upgradable System • Appliance features added as SW, no HW changes needed

• System managed as a single resource to patch and upgrade

Integrated Software Defined Networking

Software Defined Network



Private Cloud Appliance Orchestration

52

Fabric Interconnect

Fabric Interconnect

Compute Nodes

Compute Nodes

Management Nodes

Management Storage

Ethernet Switch

Networking

Management



• Orchestrated Hardware Bringup • Inserts all servers in an Oracle VM

Manager server pool • Configures external networking

(set IP address, etc.) • Performs periodic back-up of

Private Cloud Appliance

OVM Manager

• VM and hypervisor (Xen) resource management

• VM network / storage configuration

Dual, redundant PCA management nodes with automatic failover PCA

Controller

• Cloud management (self service, metering and chargeback, etc.) for one or multiple PCAs

• Hardware resource management • Database, middleware, apps

management • Software management,

configuration and compliance management

• Plugin with Oracle VM Manager for full stack management

Enterprise Manager

Compute

Compute


Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 53 DOAG Regio Nürnberg/Franken

Documents

Road to Private Cloud mit OpenStack - DOAG