Understanding OpenStack-leveraged

Service Realization from SDN/NV

Viewpoint

OpenStack Day in Korea

Dr. JongWon Kim

Networked Computing Systems Laboratory

School of Information and Communications

Gwangju Institute of Science & Technology (GIST)

Date: 2014. 2.18 Place: Sejong University, Seoul

Future

Landscape

GE Industrial Internet

Open Platform (Tool)

Service Software

Open Computing + Networking for

Future Internet Service Realization

Open

Infrastructure (Resource)

Big

Data

IoT /

Social

Contents

Open

Computing

+ Networking

Cloud

Open Innovation

Platform

Open Networking

Testbed R&D

Open Networking

Software R&D

산학연 R&D Consortium

FI Arch.

Services DevOps

with Testbed

CCN & DTN

Open Networking Research R&D

Services over

Software-Driven Infrastructure

Balanced Service Composition based on

Programmable (and Virtualized) Resources

- 5 -

Workload

Fluidity

Workload

Abstraction

Application-centric

Virtual Playground

Templates

Software-Defined Data Center: Unified, Programmable & Virtualized Rsources

Configuration/Control/Visibility Challenges

for Software-Defined Infrastructure

Application-centric Virtual Playground with

SmartX Boxes (vNetworking/vCompute/vStorage Capabilities)

Compute

Storage

Networking X

Virtual Playground (Box, Role, Topology) Templates

Zero-touch Configuration

Flexible Control

(forwarding, …)

Instant Visibility

Collective Analysis

DevOps

Testbed: Wild &

Organized Playground

- 8 -

Play (Experiment) • Configuration • Control • Visibility

(Power User)

(Provider)

Provide Playground with Resources

DevOps

Testbed: DevOps + Key Components

Open SW Community

Meta-Operation

Programmable & Virtualized Resource Pool

Control Framework Instrumentation & Measurement

Experiment Control

Federation

F3 Racing Team = TB Center

White (=Dummy) Box SmartX Box

Cloud + SDN/NV

Network

Networking vNetworking

SDN & NfV (Network functions Virtualization)

Deployment Targets (v0.6)

Network Service Providers

(+ Multi-campus Enterprises)

Content/Application Service Providers

Cloud Data Center Networking

vSwitch

Networking Mobile / Wireless

Networking

Network functions Virtualization

Inter-DC / Multi-layer Optical Networking

Overlay Virtual

Networking

Last modified: 11/04/2013

Secure

Networking

Cloud WAN Fabric

(IP+Optical Integration)

Wireless +

Mobile

Wireless +

Mobile Wireless

+ Mobile

Futuristic Multilayer-integrated &

Convergent Networks (Cloud WAN Fabric + Service-aware Edge)

Cloud Data

Centers

Cloud Data

Centers

Service-aware Edge (MiddleBox, …)

Cloud DC

Cloud DC

Cloud Data

Centers

IP??, More Switching + Simpler Routing?

Last

Modified

11/02/2013

• Amazon AWS

• Microsoft Azure

• OpenStack

Cloud DC Traffic

Cisco Global Cloud Index

Cloud Market Trends

- 14 -

Infrastructure with

Unified Resource

Pools

NFV PoC VM

ONF’s SDN Architecture (2013 Dec)

- 15 -

NFV Architecture Framework & Use Cases

Cloud, SDN, NFV: Ericsson

- 17 -

3-Tier

Application

Pattern @ DC

CLOS-based DC

Networking

Overlay

vNetworking for

Cloud DC

Software-Defined Resource Convergence

• Toward Software-defined Data Center (Computing / Storaging) ⁞

– MicroServers

– Hyper-convergence boxes

⁞

– Networking specialized (with in-network processing) boxes

⁞

• Toward SDN-coordinated MiddleBox (Networking)

SmartX Box: Design and Prototyping with

OpenStack Leverage Simplified SmartX Rack

SmartX Box

Pools of SmartX Boxes: Massive scalability and pay-as-

you-grow flexibility

CPUs / GPUs

SSD / HDDs

Open vSwitch / NICs

VM VM VM VM VM

COMPUTE NETWORKING

STORAGE

OF@TEIN with SmartX Box vs ON.Lab’s

OpenCloud Pilot

VMVM

VM

L2

A Virtual PlaygroundFor Experiment A

L2

L3

VM

OF@TEIN Underlay Network

VMVM

VM

L2

A Virtual PlaygroundFor Experiment B

L2

L3

VMVM

VM

VM

L2

A Virtual PlaygroundFor Experiment Z

L2

L3

VM∙∙∙Service layer

(experiment layer)

Virtual Resourcelayer

Physical resource layer

VCPU

Memory

VM#1

Kernel OSKVM(Hypervisor)

Opnestack

Storage(SSD/HDD) Memory CPU NIC

SmartX Box #1

NovaVCPU Vmemory

Cindervstorage

Neutronvswitch

VCPU

Memory

VM#2

VCPU

Memory

VM#3

∙∙∙

VCPU

Memory

VM#1

Kernel OSKVM(Hypervisor)

Opnestack

Storage(SSD/HDD) Memory CPU NIC

SmartX Box #2

NovaVCPU Vmemory

Cindervstorage

Neutronvswitch

VCPU

Memory

VM#2

VCPU

Memory

VM#1

Kernel OSKVM(Hypervisor)

Opnestack

Storage(SSD/HDD) Memory CPU NIC

SmartX Box #K

NovaVCPU Vmemory

Cindervstorage

Neutronvswitch

VCPU

Memory

VM#2

VCPU

Memory

VM#3

ON.Lab OpenCloud Pilot

DevOps-based Templates for Virtual Playground

+ OpenStack Convergent Service APIs

+ SDN-Coordinated vNetworking

Representing Service Realization

Data Service

Engine

Data Model

OpenStack-leveraged Service

Realization

OF@TEIN - 25 -

Narinet OFS

NIA(Seoul)

OF@TEIN Infrastructure (2012~2013)

Indonesia

Malaysia

Vietnam

Philippines

Networked

Tiled Display

SmartX

Racks

(Type B)

EU (SmartFIRE)

Japan or USA

OF@TEIN OpenFlow Switch

Exp. Node (with HD camera)

Exp. Node (traffic generator)

Exp. Node

OpenFlow Production Switch

OpenFlow FlowVisor

OpenFlow Controller

OF@TEIN Portal

OF@TEIN SDN Tools

SmartX Rack

Jeju (Jeju)

26

Thailand

GIST (Gwangju)

VoD

Korea U

(Seoul)

Postech

(Pohang)

OF@KOREN

SmartX

Racks

(Type C)

Last Update: 2013-08-18

[Part 1] OF@TEIN Infrastructure: System

& Network Resources

27

VM

VM

VM

SmartX Racks

Networking &

FlowSpace

Resources

User Experiment

Software

OF@TEIN

Portal

User Experiment

Visibility

[Part 2] Supporting OF@TEIN SDN

Experiments

System, Network,

FlowSpace

Monitoring

FlowSpace

Management

Computing

Resource

FlowVisor

Configuration, Control, Visibility

L2 L3

A Virtual Playgroud

for

L2

VM VM VM VM

Resource Provisioning

for

Admin. Slice

PowerUser Slice

OF@TEIN SmartX Rack (Type B & B+)

Worker VM #1

Monitoring

Agent

Worker VM #2

Worker VM #3

Remote Power Mng.

NF/OVS Capsulator

Node

VM

#2

OpenFlow

Agent

SmartX-

Rack Agent

MediaX-VT

Agent

VM

#1

Dataplane OF Switch

Data Manag.

Management

VM (SmartX-Rack

/ OpenStack /

Monitoring Agents)

Worker VM #1

Worker VM #2

Worker VM #3 O

pe

n

vS

wit

ch

Management Switch

Remote Power Management

Storage

Manage

ment

• 3 Tier Nodes (Capsulator, OF Switch, Worker) • 3 Network Planes: Power + Management / Control / Data

SmartX Rack (Type B)

VM

VM

VM

OFS

VM

VM

VM

OFS

SmartX Rack (Type B+)

VM

VM

VM

OVS

VM

VM

VM

OVS

DevOps wth Chef: Automatic Installation + Configuration (+Verification) …

Box

Role (Function)

OF@TEIN SmartX Box (SmartX Rack Type C):

Site Installation

Postech KOREN NOC

GIST

Korea U Jeju Univ

Internet

SmartX Box C13

Br-int Br-tun

Worker nodes

SmartX Coordinator Box

Br-int

Br-ex Br-tun

Gateway Node OpenStack Orche-stration Node

Power / Management

Control Data

SmartX Box C14

Br-int Br-tun

Worker nodes

SmartX Box C15

Br-int Br-tun

Worker nodes

SmartX Box C12

Br-int Br-tun

Worker nodes

SmartX Box C11

Br-int Br-tun

Worker nodes

GIST

Last Update: 2013-11-01

VLAN ID = 602

VLAN ID = 603

VLAN ID = 601

P M C D

Provisioning Center Node

SmartX Control Box

SmartX SandBox

KOREN Network

Intel ONP

IBM M4

Unified and Virtualized Resources for

OF@TEIN Virtual Playground

VM VM

VM

L2

A Virtual Playground For Experiment A

L2

L3

VM

OF@TEIN Underlay Network

VM VM

VM

L2

A Virtual Playground For Experiment B

L2

L3

VM VM

VM

VM

L2

A Virtual Playground For Experiment Z

L2

L3

VM ∙∙∙ Service layer

(experiment layer)

Virtual Resource layer

Physical resource layer

VCPU

Memory

VM#1

Kernel OS KVM(Hypervisor)

Opnestack

Storage

(SSD/HDD) Memory CPU NIC

SmartX Box #1

Nova VCPU Vmemory

Cinder vstorage

Neutron vswitch

VCPU

Memory

VM#2

VCPU

Memory

VM#3

∙∙∙

VCPU

Memory

VM#1

Kernel OS KVM(Hypervisor)

Opnestack

Storage

(SSD/HDD) Memory CPU NIC

SmartX Box #2

Nova VCPU Vmemory

Cinder vstorage

Neutron vswitch

VCPU

Memory

VM#2

VCPU

Memory

VM#1

Kernel OS KVM(Hypervisor)

Opnestack

Storage

(SSD/HDD) Memory CPU NIC

SmartX Box #K

Nova VCPU Vmemory

Cinder vstorage

Neutron vswitch

VCPU

Memory

VM#2

VCPU

Memory

VM#3

KVM KVM

Open vSwitch

KVM

Open vSwitch Open vSwitch

L2

A Virtual Playground

L2

L3

Overlay Tunnels

Hardware

Software

Configuration

Narinet Open vSwitch

Control

Open vSwitch

VM VM VM

Neutron Swift Cinder

NOVA Glance

OF@TEIN Virtual Playground Creation: Autonomic Installation & Configuration with Templates

SmartX Box (Type C)

SSD/ HDDs

CPUs/ GPUs

Box Template A

Open vSwitch

VM VM

Neutron Swift Cinder

NOVA Glance

SSD/ HDDs

CPUs/ GPUs

Box Template B

VM

VM

Box

Coord

inator

Com

puting

Default

Role

CCN

X

Web

S

erve

r

Traffic

gene

rator

Topology

VM Images

Node Graphs

Visibility

VM VM VM VM

VP Template G-A’’

VP Template G-A’ VP Template G-A

Dynamic Virtual Playgrounds for SmartX

Box (Preliminary for Box/Role/Topology Templates)

13min 25min

13 min

13 min

25 min

25 min *Installation time은 추가 설치 내용에 따라서 변경

Connecting SmartX Racks (Type A*/B/B+)

for Static/Multi-user Playground

Site Overlay vNetworking: NVGRE Tunneling

& Tagging/Steering/Mapping

WAN

NVGRE

Tunnels * An OpenFlow Network

Island

HP

OF

Switch

HP

OF Switch

OVS Capsulator

OVS OF

Switch

Narinet

Capsulator

VM

VM

VM

VM

VM

VM

Gateway

Router

Flow Mapping with

Admin SDN Controller

Flow Steering with

User SDN Controllers

HP

OF Switch

Flow VLAN-ID Tagging for Hypervisor VMs

Embedding Virtual Nodes into SmartX Box (Partially for Role/Box/Topology Templates)

SmartX Rack (Type B+)

Overlay vNetworking: Automatic Site Tunnel

Configuration & FlowSpace Management (Partially for Topology/Box/Role Templates)

VM

VM

VM

VM

HP5400

VM

VM

VM

VM

VM

VM

VM

VM

HP3500

Admin SDN Controller

Current Bridge state Current Tunnel state

Add_gre_tunnel() Add_flow_table() Clear_site()

Set_DPID() Set_controller()

Configuration Controller list DPID list Site-Capsulator list (IP, PORT) Allowed flows-tunnel mapping list

Management OVS-Bridge information Capsulator Flow table GRE Tunnel information Tunnel list

OpenStack Neutron ML2 (Modular Layer 2)

Plugin

Open DayLight Project OVSDB Integration

Open Software and Demo

Running OF@TEIN Experiments

Demo

Visual

OF@TEIN Network

Monitoring

39

OF@TEIN System

Monitoring

User Experiment

Console

User Experiment

Visibility

OF@TEIN FlowSpace Monitoring

OF@TEIN Portal

OF@TEIN (SmartX Rack

A*/B/B+)

OF@TEIN (SmartX Box

= SmartX Rack Type C)

Play SDN (+ Cloud Computing) experiments with your own controller!

FlowVisor (v1.4) OF@TEIN

Admin Script

VL

AN

-ba

sed

Flo

wR

an

ge

VL

AN

-ba

sed

Flo

wR

an

ge

VL

AN

-ba

sed

Flo

wR

an

ge

VL

AN

-ba

sed

Flo

wR

an

ge

NOX Controller

Floodlight Controller

Open Daylight

Controller

FlowSpace

Management Floodlight Controller

OF Switch

OF Switch

OF Switch

DPID-PortRanges FlowRanges

OF@TEIN Networking & FlowSpace Resources

VLAN ID

Supporting Multiple SDN Users with their

own Controllers via FlowVisor

Preliminary OF@TEIN Experiment LifeCycle

Design

Execute Finish

Note: Based on simple

PING experiment

FlowSpace Register

(FlowVisor)

Design Experiment

Experiment Credential

(SU Key Exchange)

Remote Access

(SU account)

Establish Management Environment

Custom Images

(Linux+SSH)

Data and Image Replication

(FTP)

Box Inst. &

Conf. Templates (SSH + Chefs)

Topology (Datapath & Tunnel )

Templates (OVS+BASH)

Resources Allocation

Configure & Initialize Services

Role

(function) Inst. & Conf. Templates (SSH +Chefs)

Script (BASH)

Log Files (BASH File I/O)

Experiment Output/ Status

(BASH stdout)

Monitor & Analyze

Experiment

Experiment UI Display

(Java Script)

Experiment Analysis

Display Management (Java Script)

Script (BASH

Clean Up Output or Status

(BASH stdout)

Draft Script

(BASH)

Check & Execute

Experiment

Resource Clean Up

Host/IP Resolution

(Hostname file)

Box Register (Horizon)

Provision

OF@TEIN Demonstration @ HSN 2014

Thank you!

Send Inquiry to jongwon@gist.ac.kr

http://netmedia.gist.ac.kr

Gwangju Institute of

Science & Technology

Thank you!

jongwon@gist.ac.kr

43