Innovation in SDN Tools and Platforms

Innovation in SDN Tools and PlatformsUmesh [email protected]

1

Exponential Interest

Jul 2012 Oct 2012 Nov 2012 Dec 2012 Feb 2013

ACQUISITIONS

Oct 2011 Apr 2013

EVENTS

400

AttendeesMARKET

Feb 2012 Feb 2013

$2

$3.7

Billions

May 2012 Dec 2012

STANDARDIZATION

51

90Members

400

1500

More Products AnnouncedAnd Available

More Start-Ups and VC investment too!

What is the problem?

Problem with Internet Infrastructure

Tens of Millions of lines of codeClosed, proprietary, outdated

Hundreds of protocols6,500 RFCs

Billions of gatesPower hungry and bloated

Vertically integrated, complex, closed, proprietary

Not good for network owners and users

Specialized Packet Forwarding Hardware

Specialized Control Plane

Specialized Features

Problem: No Abstraction for Control Plane

Adding new feature or service highly complex

Network too difficult to program, operate or troubleshoot

Forwarding

OS

Forwarding

OS

Forwarding

OS

Router/Switch/Appliance



Distributed

Network Functions

State Distribution Mechanism

Problem: How to Support Virtual Infrastructure on Demand

Forwarding

OS

Forwarding

OS

Forwarding

OS

Everyone needs their own infrastructure on demand

VM

VM

VM

VM

How to support dynamic virtual infrastructure on physical networks that are not programmable

SDN paradigm shift

PacketForwarding

PacketForwarding

PacketForwarding

PacketForwarding

PacketForwarding

Network OS

Software Defined Network (SDN): Fundamental Elements

Control plane physically separate from data plane

Routing TE Mobility

Single control plane controls several forwarding devices

Global Network View

Network Virtualization

PacketForwarding

PacketForwarding

PacketForwarding

PacketForwarding

PacketForwarding

Network OS

Abstract Network View

ControlPrograms

ControlPrograms

ControlPrograms

Software Defined Network (SDN): Virtualization

How far has SDN come?

Openflow @ Google

Urs Hölzle, SVP, Google at ONS 2012

Openflow is ready for real-world use

SDN is ready for real-world use Enables rapid rich feature development

Simplifies network management

Google’s datacenter WAN successfully runs on Openflow Largest production network at Google

Improved manageability

Improved cost (too early to have exact numbers)

Google’s Openflow WAN Conclusions

SDN in Public Cloud: Windows Azure

Windows Azure supports virtual networks, rich load balancing, tenant ACLs, and more – for hundreds of thousands of servers, via software No Hardware per tenant ACLs

No Hardware NAT

No Hardware VPN / overlay

No Vendor-specific control, management or data plane

All policy is in software – and everything’s a VM!

Network services deployed like all other services

We bet our infrastructure on SDN, and it paid off

Albert Greenberg, Microsoft at ONS 2013

Southbound API

Azure Frontend(VM)

Controller(VM)

Northbound API

Red VM Gateway VM

VMSwitch

Load Balancer

(VM)

Agility and Scale

Openflow/SDN Activities of NTT Communications

Done: Enterprise Cloud with Openflow/SDN. Advantages: Integrated provisioning for cloud and

network

Easy and topology-free design

4K VLAN limitation overcome using Openflow technology

Doing: Automated VPN connection from customer portal

Will do: Expand to all layers of network

Aggressively working on SDN controller development to realize use cases

Yukio Ito, SVP, NTT Communications at ONS 2013

Activities

Come with us to change the world!!

Nippon Express Use Case of SDN

Limited network and virtualization flexibility

Need a new paradigm in networking to reduce service delivery time and cost reduction

Message from customer: Although this was a big challenge for us, we are happy that we believed in the potential of ProgrammableFlow

Nippon Express Benefits from ProgrammableFlow

Kaoro Yano, Chairman, NEC at ONS 2012

ONRC and ON.LAB

Early SDN Activities

Platform Development

2007 – Ethane2008 – OpenFlow2009 – FlowVisor, Mininet, NOX 2010 – Beacon

2009 – Stanford2010 – GENI started and grew to 20 universities2013 – 20 more campuses to be added

Deployments

Demonstrations

2008-2011 – SIGCOMM2011 – Open Networking Summit, Interop

2012 –Define SDN research agenda for the coming years

And Beyond

Invention

2007 – Creation of SDN Concept

ON.LAB Role

IDEAS BROADERADOPTION

Early stage ideas and prototypes from the research community

Leveraged by organizations and users for commercial usage

DevelopmentDistributionDeployment

SupportDemonstrations

Proven applicability by the ON.LAB community

OUR VISIONOpen The Cloud Infrastructure For Innovation

OUR MISSIONDevelop, distribute, deploy, and support open source Software-Defined Networking (SDN) tools and platforms

SponsorsChip vendors Equipment vendors Software vendorsVendors

UsersResearchComputer science R&E community

Service providers Cloud providers

R&E network operators

Scalability

Reliability

Debuggability

Flow Space

Network Map

Virtual Network

Logical Crossbar

Systems

Abstraction

Capabilities

Feature

Network OS

OFSwitch

OFSwitch

OFSwitch

OFSwitch

Network HyperVisor

Programming System/Tools

Feature Feature

OpenRadio

ONRC Research Agenda

VirtueVM

Placement

OptimizedOF Switch

OpenRadio

STSNetworkOS

Hassel NetSight

(SDN Troubleshooting)

ON.LAB Tools and Platforms

3rd partycomponents

Network OS

Apps Apps

Network OS

Apps Apps

Open Interfaces

Open Interfaces

Network Hypervisor

Forwarding

FlowVisor

Mininet

ONOS

SDN-IP Peering

TestO

N

Tools and Platforms

Tools and Platforms

3rd partycomponents

Network OS

Apps Apps

Network OS

Apps Apps

Open Interfaces

Open Interfaces

Network Hypervisor

Forwarding

FlowVisor

MININET

ONOS

SDN-IP Peering

TestO

N

Mininet At A Glance

Build a realistic Openflow network on your laptop or EC2

1.0 – realistic behavior, functional emulation

2.0 – performance emulation via link and CPU bandwidth limits

CONVENIENT REALISTIC EMULATOR FOR SDN

Ubuntu, Github27k downloads

Reproducing network researchStart-ups, SEs, bloggers, 6 courses

Mailing list - 601 members, 184 domainsExtensive documentation

Demonstrations Support

Usage

More information at mininet.org

Distribution

ONS, SIGCOMM, Interop to demonstrate SDN capabilities

Tools and Platforms

3rd partycomponents

Network OS

Apps Apps

Network OS

Apps Apps

Open Interfaces

Open Interfaces

Network Hypervisor

Forwarding Mininet

ONOS

SDN-IP Peering

FLOWVISOR

TestO

N

FlowVisor At A Glance

FlowVisor creates network slices with data path and control isolation per slice

Not full network virtualization (more on that later)

NETWORK HYPERVISOR FOR OPENFLOW SWITCHES

More information at github.com/OPENNETWORKINGLAB/flowvisor

Github, Debian/Ubuntu, Red Hat/CentOS900 downloads per quarter

Stanford production network GENI – Multi-tenancyNEC & Ericsson research labs

3 releases per year (Release 1.2.0 in May)OpenFlow discussion forum

Demonstrations Support

Usage Distribution

Best demo at SIGCOMM’09GENI GEC9 in 2010ONS 2012

GENI with ON.LABUse Case for Mininet & FlowVisor

o Prototype/debug application on Mininet emulating real networko Use FlowVisor to run multiple experiments simultaneously o Change slice definition in FlowVisor to switch from Mininet to real network

NOX Beacon Floodlight Trema POX

FlowVisor

PhysicalNetworke.g. GENI

MininetEmulated Network on PC

Tools and Platforms

3rd partycomponents

Network OS

Apps Apps

Network OS

Apps Apps

Open Interfaces

Open Interfaces

Network Hypervisor

Forwarding Mininet

FlowVisor

SDN-IP Peering

TestO

N

ONOSOpen Network

Operating System

Motivation for ONOS

Network OS

Routing TEMobilit

y

Instance 1

Instance 3

Instance 2

Instance …

Distributed Network OS

Routing TE Mobility

Community needs an open source distributed SDN OS

Approaches: distributed, hierarchical, federated

Related work: ONIX, Midokura, Helios, Maestro, Hyperflow, Kandoo

ONOS High Level Architecture

Host

Host

Host

Titan Graph DB

Cassandra In-Memory DHT

Instance 1 Instance 2 Instance 3

Network GraphEventually consistent

Distributed RegistryStrongly Consistent Zookeeper

ONOS core

Floodlight

ONOS core

Floodlight

ONOS core

Floodlight

ONOS Network Graph Abstraction

Cassandra In-memory DHT

Id: 1A

Id: 101, Label

Id: 103, Label

Id: 2C

Id: 3B

Id: 102, Label

Id: 104, Label

Id: 106, Label

Id: 105, Label

Network Graph

Titan Graph DB

Network Graph and Switches

Switch Manager Switch ManagerSwitch Manager

Network Graph: Switches

OFOF

OFOF

OFOF

Network Graph and Link Discovery

SM

Network Graph: Links

SM SM

Link Discovery Link Discovery Link Discovery

LLDP LLDP

Devices and Network Graph

Network Graph: Devices

SM SM SMLD LD LD

Device Manager Device Manager Device Manager

PKTIN

PKTIN

PKTINHost

Host

Host

Path Computation with Network Graph

SM SM SMLD LD LD

Host

Host

Host

DM DM DM

Path Computation Path Computation Path Computation

Network Graph: Flow Paths

Flow 1

Flow 4

Flow 7

Flow 2

Flow 5

Flow 3

Flow 6

Flow 8

Flow entriesFlow entriesFlow entries








Network Graph and Flow Manager

SM SM SMLD LD LD

Host

Host

Host

DM DM DM

Flow Manager

Network Graph: FlowsPC PC PC

Flow Manager Flow ManagerFlowmod Flowmod

Flowmod

Flow 1

Flow 4

Flow 7

Flow 2

Flow 5

Flow 3

Flow 6

Flow 8









Distributed Registry: Master Election

SM SM SMLD LD LD

Host

Host

Host

DM DM DM

Network Graph

FM FM FM

DistributedRegistry

A

B

C

D

E

F

Flow 1

Flow 4

Flow 7

Flow 2

Flow 5

Flow 3

Flow 6

Flow 8









Master Election A: ONOS 1 C: ONOS 2 E: ONOS 3

B: ONOS 1 D: ONOS 2 F: ONOS 3ONOS Instance 1 ONOS Instance 2 ONOS Instance 3

Distributed Registry: Instance Failover

SM SM SMLD LD LD

Host

Host

Host

DM DM DM

Network Graph

FM FM FM

DistributedRegistry

A

B

C

D

E

F


B: ONOS 1 D: ONOS 2 F: ONOS 3ONOS Instance 1 ONOS Instance 2 ONOS Instance 3

Flow 1

Flow 4

Flow 7

Flow 2

Flow 5

Flow 3

Flow 6

Flow 8










SM SMLD LD

Host

Host

Host

DM DM

Network Graph

FM FM

DistributedRegistry

A

B

C

D

E

F

Master Election A: C: ONOS 2 E: ONOS 3

B: D: ONOS 2 F: ONOS 3ONOS Instance 2 ONOS Instance 3

Flow 1

Flow 4

Flow 7

Flow 2

Flow 5

Flow 3

Flow 6

Flow 8










SM SMLD LD

Host

Host

Host

DM DM

Network Graph

FM FM

DistributedRegistry

A

B

C

D

E

F


B: ONOS 3 D: ONOS 2 F: ONOS 3 ONOS Instance 2 ONOS Instance 3

Flow 1

Flow 4

Flow 7

Flow 2

Flow 5

Flow 3

Flow 6

Flow 8









Video clip of demo from ONS 2013

Tools and Platforms

3rd partycomponents

Network OS

Apps Apps

Network OS

Apps Apps

Open Interfaces

Open Interfaces

Network Hypervisor

Forwarding Mininet

FlowVisor

ONOS

TestO

N

SDN-IP Peering

IP

IP

IP

IP

IP

IP

IP

IP

IP

IP

IP

IP

SDNSDN

SDN

How can we seamlessly peer between SDN and IP networks?

eBGP

eBGP

eBGP

eBGP

eBGP

eBGP

eBGP

SDNIP

IP

IP

IP

ONOSBGP

Daemon

RIB RoutingRIB

Sync

BGP routing updates

IP Routing in SDN

Current Implementation

Proactive Flow Installer

Prepopulate flows based on BGP

updates

ZebOSBGPd

RIBRIB

pusher

External BGP peers

Prefix, Nexthop, Attributes

BGP Route

RIBRIB

Syncer

ONOS

Path Computation

Discovery

Openflow

Demonstration of SDN-IP on ONOS

192.168.20.1/24

AS4

AS2 172.16.20.1/24

AS3172.16.30.1/24 172.16.40.1/24

172.16.10.1/24

192.168.10.1/24

192.168.30.1/24

192.168.40.1/24

192.168.50.1/24

IPI ZebOS BGPd

Quagga BGPd

SDN AS emulatedusing Mininet

LAX

CHI

IAH

NYC

ATL

SLC

BGP

BGP BGPB

GP

ONOSBGPD

Routing GUI

Host

BG

P

SDN AS1

Tools and Platforms

3rd partycomponents

Network OS

Apps Apps

Network OS

Apps Apps

Open Interfaces

Open Interfaces

Network Hypervisor

Forwarding Mininet

FlowVisor

ONOS

TestO

N

SDN-IP Peering

TestON

An open source automation infrastructure for SDN

Drag and drop topology creation

Pause, debug, and resume capability

Implementation: Automation harness in Python Rich GUI developed in JavaFX Plug and play driver library

What is Next: Integrate with network

debugging research from Berkeley and Stanford

What is next?

New Projects

Next version of FlowVisor

Generalized network slicing for SDN

Mapping topology, address space, control functions

Performance isolation

NetVisor

ONOS

Reactive flows and low-latency forwarding

Events, callbacks and publish/subscribe API

Expand graph abstraction for more types of network

state

ONOS Northbound API and port applications to ONOS

SDN Trouble-shooting

NetSight packet history

Interactive network debugger

SDN troubleshooting simulator

Supporting the Community

Software

Releases

Deployments

Build and assist development community

FlowVisor GENI release 5/30, 7/30

ONOS release Q3

SDN-IP release Q3

Support deployments in R&E networks

Internet2

GENI

Stanford

REANZ

Crossing the SDN Chasm

BROADERADOPTION

2009 2012

Number of OrganizationsAdopting SDN

Time

You are our Community

o Vendoro Network

Operatoro Research Lab

Organizations

Users

Contributors

Please Join Us

Learn Collaborate

Contribute

Try out your innovative ideas with our tools

Improve our tools and platforms

Stay informed about SDN

Users and contributors

Keep track of latest SDN research and innovations

Demonstrate early stage SDN ideas with ON.LAB

Co-develop platforms and use cases

Organizations

www.onlab.us

Technology

Innovation in SDN Tools and Platforms