Applying Operating System Principles to SDN Controller Design

Oliver Michel, Matthew Monaco, Eric Keller

Invited Talk University of Illinois at Urbana-Champaign April 11th, 2014.

Applying Operating System Principles to SDN Controller Design 2

“What we clearly need is an “operating system” for networks, one that provides a uniform and centralized programmatic interface to the entire network.”

[Gude et.al. ‘08]

Extend an existing operating system and its user space software ecosystem

in order to serve as a practical network operating system

Distributions4

Software Projects5

$ grep$ find$ sed$ sort$ cat

$ cd /var/log$ grep that_annoying_problem syslog

$ ps -A | sort -k3nr | head -10$ kill -TERM 12345

#!/bin/bash!procs=( ps -A | sort -k3nr | head -$1 | tr -s ’ ’ \ | cut -d’ ’ -f9)!for p in "${procs[@]}"; do printf "%d is misbehaving\n" "$p" >&2 kill -TERM "$p" sleep 3 kill -KILL "$p"done

Controller Framework

Controller App Routing Firewall Virtualizer

Python

Ruby/C

yet another network controller

/net�� hosts�� switches� �� sw1� �� sw2�� views �� http �� management-net �� hosts �� switches �� views

App 1 App 2

Driver

App 1 App 2

Why a filesystem?

Filesystem

Logically Distinct Applications

Independent Development15

# apt-get install yanc-learning-switch# apt-get install yanc-router

$ git clone git@github.com/yanc/yanc-fw$ cd yanc-fw$ make# make install

Any Programming Language16

Filesystem

C++ C++bash Python

Yanc Components

‣The Yanc Filesystem

‣Hardware Decoupling

‣Operating System Integration

‣Dynamic Application Composition

‣Distribution

The Yanc Filesystem18

$ echo 1 > port_1.port_down

$ mkdir -p switches/00:01:02:0a:0b:0c/flows/my_flow

$ find /net -name tp_dst -exec grep 22 {} +

#!/bin/bashflowdir=/net/switches/"$1"/flows/"$2"mkdir "$flowdir"echo ff:ff:ff:ff:ff:ff > "$flowdir"/match.dl_dstecho 0x0806 > "$flowdir"/match.dl_typeecho FLOOD > "$flowdir"/action.out

Hardware Decoupling and Middleboxes

‣Support for different physical devices and device classes

• Device Drivers

• Schema-based filesystem

Device Drivers26

ApplicationApplication

Application

Applications

Device Drivers26

Application

Applications

/net/switch1/flow1/…

/net/firewall1/rule1/…

/net/ids/alerts/…

Filesystem

Device Drivers26

Application

Applications

/net/ids/alerts/…

Filesystem

iptables

Drivers

Device Drivers26

Application

Applications

/net/ids/alerts/…

Filesystem

iptables

Drivers

HP OF Switch

NEC OFSwitch

Linux Server

BroAppliance

CiscoASA 5505

CiscoASA 5510

Physical Boxes

Schema-based Filesystem27

Operating System Integration

‣ Integrate tightly with Linux

‣Use off-the-shelf technologies

‣Encourage active ecosystem

Operating System Integration29

What can we use from a traditional operating system?

Operating System Integration29

Operating System Integration

‣ Inotify

‣File Permissions and ACLs

‣Namespaces and Control Groups

‣Layered Filesystem

Application Composition

‣Today’s controllers show mostly monolithic design

‣Distinct applications must be composed

Composition in Yanc

‣Frenetic/Pyretic introduced Parallel/Sequential Composition

• per packet abstraction

• compiled into single application

‣Yanc controls read/writes to the network state

‣Yanc provides dynamic composition

Motivating Example32

Fast Router

Route Optimizer

Fast Router

Route Optimizer

Link Tapper

Fast Router Route Optimizer

Link Tapper

Fast Router Route Optimizer Link Tapper

Optimizing a flow33

Adding a Linktapper34

Distribution

‣Filesystem representation allows layering

• Distributed filesystem on top of yancfs ‣Yanc may run on multiple servers or even switches

Layered Filesystem36

Linux Linux Linux Linux

yancfs yancfs yancfs yancfs

Distributed Filesystem

Router Monitor Router Firewall local app

DedicatedSDN Controllers

SoftwareSwitch

End hostEnd host

SDN Switches

Locking37

Controller A

ControllerB

ControllerC

Locking37

Controller A

ControllerB

ControllerC

Locking37

Controller A

ControllerB

ControllerC

Locking37

Controller A

ControllerB

ControllerC

Locking37

Controller A

ControllerB

ControllerC

Locking37

Controller A

ControllerB

ControllerC

Locking37

Controller A

ControllerB

ControllerC

Locking37

Controller A

ControllerB

ControllerC

Locking37

Controller A

ControllerB

ControllerC

Locking37

Controller A

ControllerB

ControllerC

Locking37

Controller A

ControllerB

ControllerC

Locking37

Controller A

ControllerB

ControllerC

Locking37

Controller A

ControllerB

ControllerC

Prototype

‣Filesystem implemented using FUSE (C) ‣OpenFlow Driver (C++) ‣Applications (Python and Ruby)

• Topology Discovery

• Learning Switch

• Fast Router

• Route Optimizer

• Link Tapper ‣several Bash management scripts and static flow pusher

Conclusion

‣Defined a Universal Interface for Network Control

‣Allow Control Applications as Separate Processes

‣ Implemented Interface

‣Leveraging Existing OS Technologies

‣Built Functional Applications on top of Interface

Matthew Monaco, Oliver Michel, and Eric Keller. Applying operating system principles to SDN controller design. In Proceedings of the Twelfth ACM Workshop on Hot Topics in

Networks (HotNets-XII). 2013.

Thank you!

Backup Slides

Programmability42

#!/usr/bin/env python3!def new_switch(id, n_tables=1): pass!def write_flow(switch, matches=[], actions=[]): pass

#ifndef _YANC_H_#define _YANC_H_!int new_switch(uint64_t, uint8_t);int write_flow(const char* path, match_t*, action_t*);!#endif/*_YANC_H_*/

Architecture43

Composer

Topology Discovery

Learning Switch Firewall …

driver driver

distributed fs

yanc file system

Performance44

Shared Library45

shared memory

/run/yanc_db

libyanc.so

app app

Applying Operating System Principles to SDN Controller Design

Documents

Carrier/WAN SDN - Open Networking Foundation · Carrier/WAN SDN Multi-Layer SDN Apps . Carrier/WAN SDN ... Multi-Layer App Platform (MAP) ALU Huawei SDN Controller ALU ALU Huawei

NorthStar Controller—Multilayer SDN Coordination and ... · NorthStar Controller—Multilayer SDN Coordination and ptimization hite Paper ©2015, uniper Networks, Inc. Executive

SDN lecture 1hy490-31/slides/SDN-lecture1.pdf · Control Path OpenFlow OpenFlowOpenFlowController Controller OpenFlow Protocol (SSL/TCP) 39 Controller PC Hardware Layer Software Layer

Bring Your Own Controller: Enabling Tenant-deﬁned SDN Apps ...faculty.cs.tamu.edu/guofei//paper/BYOCVisor_INFOCOM17.pdf · Bring Your Own Controller: Enabling Tenant-deﬁned SDN

2016 SDN Controller Landscape Is there a Winner?

DEVNET-1166Open SDN Controller APIs

Composing SDN Controller Enhancements with Mozartcs.brown.edu/~tab/papers/SoCC19.pdf · 2019-11-21 · Composing SDN Controller Enhancements with Mozart SoCC ’19, November 20-23,

Lumina SDN Controller€¦ · Lumina SDN Controller Commercial Edition is a quality-assured version of the industry-leading OpenDaylight controller licensed for production networks

SDN Architecture 1.0 Overview - Open Networking Foundation · The controller plane interface (CPI) between SDN controller and network element is defined in such a way that the SDN

PF6800 ProgrammableFlow® SDN Controller Software …...for dynamic, policy-based network management featuring advanced automation ... Integrated into the NEC SDN controller software

Software Defined Networking - Tel Aviv Universitymsagiv/courses/rsdn/SDN-TAU-1.pdf · Outline •Floodlight SDN controller •Indigo OpenFlow Switch •Problems in controller development

Enabling Dynamic Network Access Control with Anomaly …hongdal/papers/sdn-nfv sec19.pdfbe sent to the SDN controller via a network control framework [8]. The SDN controller finally

SDN Controller and Implementation

SONA: ONOS SDN Controller based OpenStack/Kubernetes ...enog.jp/wp-content/uploads/2018/12/07_ONOSSONA-Intro.pdf · SONA: ONOS SDN Controller based OpenStack/Kubernetes Network Management

An Optical SDN Controller for Transport Network ...chesteve/pubs/globecom_2013_optical_sdn... · An Optical SDN Controller for Transport Network Virtualization and Autonomic Operation

Installation of the OpenDaylight SDN controller

Supporting composed SDN applications and controller ... composed SDN applications and controller independence with NetIDE Alec Leckey Intel Labs. SDN Application Development Java Python

Ravana: Controller Fault-Tolerance in SDN

SDN Controller Design for Dynamic Chaining of Virtual ... · SDN Controller Design for Dynamic Chaining of Virtual Network Functions. Franco Callegati, Walter Cerroni, Chiara Contoli,

ElastiCon: An Elastic Distributed SDN Controller › courses › cps296.4 › fall14 › ... · ElastiCon: An Elastic Distributed SDN Controller ... tributed controller architecture