Upload
nuage-networks
View
938
Download
1
Embed Size (px)
Citation preview
© 2017 NETRONOME SYSTEMS, INC.
Netronome Agilio OVS Offload Acceleration Architecture
Agilio® SmartNIC Platform Accelerates Virtual
Switching Performance 5X
Nuage Networks from NokiaVirtual Services Platform
Mark Iskra, Nuage Networks
Edwin Peer, Netronome
© 2016 Nokia. All rights reserved. Nuage Networks is a Nokia venture.
CONFIDENTIAL - SOLELY FOR AUTHORIZED PERSONS HAVING A NEED TO KNOW PROPRIETARY – USE PURSUANT TO COMPANY INSTRUCTION
Nokia Venture
Headquartered in Mountain View, CA
Additional R&D in Raleigh, NC and Antwerp, BE
Global Nuage technical organization
Global sales and support through NOKIA
Staffed by IP Routing and Virtualization Experts
Leading SDN/Network Virtualization market share
VPN
VPN
VPN
VPN
NetworkVirtualization
Internet
IP RoutingPolicy-based
Endpoint Attachment
SOFTWARE DEFINED NETWORKING
Introducing Nuage Networks
© 2016 Nokia. All rights reserved. Nuage Networks is a Nokia venture.
CONFIDENTIAL - SOLELY FOR AUTHORIZED PERSONS HAVING A NEED TO KNOW PROPRIETARY – USE PURSUANT TO COMPANY INSTRUCTION
3
Nuage Networks EcoSystem
© 2016 Nokia. All rights reserved. Nuage Networks is a Nokia venture.
CONFIDENTIAL - SOLELY FOR AUTHORIZED PERSONS HAVING A NEED TO KNOW PROPRIETARY – USE PURSUANT TO COMPANY INSTRUCTION
Nuage connects applications according to business policies
App 1 can only communicate with App 2 via a firewall
Nuage SDN
Faster time to deploy
Increase security
Freedom of workload, location and vendor
App 1 App 2
BranchBare Metal
Containers
Public
CloudsHypervisors
Nuage Networks Virtualized Services Platform (VSP)
© 2016 Nokia. All rights reserved. Nuage Networks is a Nokia venture.
CONFIDENTIAL - SOLELY FOR AUTHORIZED PERSONS HAVING A NEED TO KNOW PROPRIETARY – USE PURSUANT TO COMPANY INSTRUCTION
Virtualized Services Directory (VSD)• Interface with orchestration platforms• Declarative Network Policies
Virtualized Services Controller (VSC)• Convert policies into networking protocols• Dynamically build SDN tunnels
Virtual Routing & Switching (VRS)• Open Source distributed switch and router• Nuage application for any workloads type
App 1 App 2
IP config,
TCP port,
etc.
BranchBare Metal Containers Public CloudsHypervisors
Nuage Networks Virtualized Services Platform (VSP)
© 2016 Nokia. All rights reserved. Nuage Networks is a Nokia venture.
CONFIDENTIAL - SOLELY FOR AUTHORIZED PERSONS HAVING A NEED TO KNOW PROPRIETARY – USE PURSUANT TO COMPANY INSTRUCTION
Device model
Overlay model (used in Nuage Networks)
Based on VXLAN Overlay SDN Model
Virtual Overlay Subnet
Nuage Networks Virtualized Services Platform (VSP)
© 2017 NETRONOME SYSTEMS, INC. 7
Netronome Offers NFV Acceleration for COTS Servers
Delivers compelling TCO in NFV, public, private and hybrid cloud infrastructures
Low profile, less than 25W PCIe Gen3x8 Adapters
2 x 10/25/40GbE solutions
Agilio® CX SmartNICs
Relieving the NFV Performance Bottleneck and Reclaiming Server CPU Cycles
Brings the speed of software innovation to hardware
OpenStack-managed Open vSwitch, OVS Firewall and Contrail vRouter
Agilio® Server-Based
Networking Software
© 2017 NETRONOME SYSTEMS, INC. 8
Nuage Data Plane with Netronome Agilio CX OVS Offload
Netronome Agilio CX SmartNICs available in 10GbE,
25GbE and 40GbE with OVS kernel acceleration
Nuage Virtual Routing and Switching (VRS) uses
OVS kernel
▶ Nuage VRS control plane - features
▶ OVS offload - performance without DPDK per-
core penalty
Offloads
▶ classification (OVS table match)
▶ packet processing (ACL, QoS, switch, route,
VXLAN tunnel header processing)
SR-IOV or XVIO (Virtio) VM connectivity
Any CMS
User
Kernel
SoftwareVSC
VSD
Agilio CX SmartNIC
Acceleration
OVS-vswitchd
OVS-kernel module
Offloaded vSwitchHardware
© 2017 NETRONOME SYSTEMS, INC. 9
Netronome XVIO Technology Simplifies Deployment
Combines the best of open source technologies and server networking hardware
VM
Virtio
VM
Virtio
XVIO
Vhost-User Interface
Hardware Offload DPDK and SR-IOV
Networking
Applicatione.g. vSwitch,
vRouter
Hardware Datapath in SmartNIC
Agilio Hardware and Software
XVIO
SR-IOV DPDKVirtio • VM always sees standard Virtio interface
• MultiQ Architecture for High Performance
Complete VM Workload Mobility and Hardware Independence with Express Virtio (XVIO)
© 2017 NETRONOME SYSTEMS, INC. 10
Netronome Datapath Offload of Nuage Networks VRS
Open vSwitch (VRS)
x86 User Space
x86 Kernel
Nuage
vSwitchd
Apps
Virtual Machine
Self
Learning
Exact Match
Flow Tracker
OVS
Kernel DP
Match/Act
Execute
Action
Agilio SmartNIC
Any CMS
OVS
Kernel DP
Match
OVS
Kernel DP
Match/Act
offloaded OVS Datapath
Miss
Hit
Miss
Miss
PCIe
Fast Path
VSD VSC
Open Flow
Virtio
4
1 2
3
5
XVIO
6
7
▶ Arriving VXLAN packets are matched against known flows in the SmartNIC
▶ Packets with known destination are Fast Path on the SmartNIC
▶ Payload is delivered to destination via XVIO
▶ Unmatched flows are resolved by OVS kernel module cache
▶ OVS kernel module contacts vSwitchd
▶ vSwitchd contacts VSC
▶ SmartNIC caches newly learned flows
© 2016 Nokia. All rights reserved. Nuage Networks is a Nokia venture.
CONFIDENTIAL - SOLELY FOR AUTHORIZED PERSONS HAVING A NEED TO KNOW PROPRIETARY – USE PURSUANT TO COMPANY INSTRUCTION
Baseline DemoNo OVS Offloading
© 2016 Nokia. All rights reserved. Nuage Networks is a Nokia venture.
CONFIDENTIAL - SOLELY FOR AUTHORIZED PERSONS HAVING A NEED TO KNOW PROPRIETARY – USE PURSUANT TO COMPANY INSTRUCTION
Bi-Directional Throughput Test Setup
KVM
VM11 VM12
KVM
VM21 VM22
Data/Mgmt Plane (192.168.50.0/24)
.201 .202V1 (Centos 7.2) V2 (Centos 7.2)
VXLANalubr0alubr0
NIC
VRSVRS
NICCPU
Load Generation (tx):Trafgen-DPDK
CPU
Listener (rx):Trafgen-DPDKOverlay
Throughput (Gbps)
© 2016 Nokia. All rights reserved. Nuage Networks is a Nokia venture.
CONFIDENTIAL - SOLELY FOR AUTHORIZED PERSONS HAVING A NEED TO KNOW PROPRIETARY – USE PURSUANT TO COMPANY INSTRUCTION
KVM
VM11 VM12
KVM
VM21 VM22
Data/Mgmt Plane (192.168.50.0/24)
.201 .202V1 (Centos 7.2) V2 (Centos 7.2)
VXLANalubr0alubr0
NIC
VRSVRS
NIC
Load Generation (tx):Trafgen-DPDK Load Generator
Listener (rx):DPDK Packet MirrorLatency
(microsec)
Round Trip Latency Test SetupTrafgen samples timestamp change of returning packets
© 2016 Nokia. All rights reserved. Nuage Networks is a Nokia venture.
CONFIDENTIAL - SOLELY FOR AUTHORIZED PERSONS HAVING A NEED TO KNOW PROPRIETARY – USE PURSUANT TO COMPANY INSTRUCTION
Stateless NIC Offloads:
Inner/outer checksum computation
Segmentation of large write requests
Some Encap/Decap
Line speed is achievable with iperf or netperf type load generators to 40Gbps and beyond
Small packets present a new challenge
4/27/2017
14
DPDK Application (trafgen) sending UDP datagramsbetween a pair of VMs.
Note: 80Gbps is the max bi-directional line speed
VXLAN With Only Stateless OffloadsLatency Non-Offloaded = 20-30 millisec
© 2016 Nokia. All rights reserved. Nuage Networks is a Nokia venture.
CONFIDENTIAL - SOLELY FOR AUTHORIZED PERSONS HAVING A NEED TO KNOW PROPRIETARY – USE PURSUANT TO COMPANY INSTRUCTION
OVS Offload Demo
© 2016 Nokia. All rights reserved. Nuage Networks is a Nokia venture.
CONFIDENTIAL - SOLELY FOR AUTHORIZED PERSONS HAVING A NEED TO KNOW PROPRIETARY – USE PURSUANT TO COMPANY INSTRUCTION 4/27/2017
16
Test Cases:
• Baseline—virtio with stateless
VXLAN offloads only
• VIRTIO--XVIO and OVS flows fully
offloaded
• SRIOV--VF to the VM and OVS
flows fully offloaded
Results:
• 5x-50x higher throughput with Agilio
• 18Mpps from 1 VM at 64B (CX)
• No CPU load with SRIOV and
minimal impact with XVIO (virtio)
Smart NIC VXLAN Offload for Nuage Networks VSP SDNLatency is 0.2 millisec (50-100x lower)
© 2016 Nokia. All rights reserved. Nuage Networks is a Nokia venture.
CONFIDENTIAL - SOLELY FOR AUTHORIZED PERSONS HAVING A NEED TO KNOW PROPRIETARY – USE PURSUANT TO COMPANY INSTRUCTION 4/27/2017
17
Test Cases:
• Baseline—virtio with stateless
VXLAN offloads only
• VIRTIO--XVIO and OVS flows fully
offloaded
• SRIOV--VF to the VM and OVS
flows fully offloaded
Results:
• 5x-50x higher throughput with Agilio
• 18Mpps from 1 VM at 64B (CX)
• No CPU load with SRIOV and
minimal impact with XVIO (virtio)
Smart NIC VXLAN Offload for Nuage Networks VSP SDNThroughput increases with larger packet sizes even though PPS is lower
© 2016 Nokia. All rights reserved. Nuage Networks is a Nokia venture.
CONFIDENTIAL - SOLELY FOR AUTHORIZED PERSONS HAVING A NEED TO KNOW PROPRIETARY – USE PURSUANT TO COMPANY INSTRUCTION
Active Flows Throughput Test Setup
KVM
VM11 VM12
KVM
VM21 VM22
Data/Mgmt Plane (192.168.50.0/24)
.201 .202V1 (Centos 7.2) V2 (Centos 7.2)
VXLANalubr0alubr0
NIC
VRSVRS
NICCPU
Load Generation (tx/rx):Trafgen-DPDKUsing N Ports
CPU
Listener (tx/rx):Trafgen-DPDKUsing N Port
OverlayThroughput (Gbps)
© 2016 Nokia. All rights reserved. Nuage Networks is a Nokia venture.
CONFIDENTIAL - SOLELY FOR AUTHORIZED PERSONS HAVING A NEED TO KNOW PROPRIETARY – USE PURSUANT TO COMPANY INSTRUCTION 4/27/2017
19
Nuage-OVS-vswitchd
OVS-kernel module
Netronome vSwitch NIC
Any CMS
User
Kernel
Software
HardwareVSC
VSD
1
2
3
1 2 3
VXLAN Performance vs Active Flows Single virtio VM pair, SRIOV VMs would be higher throughput
© 2016 Nokia. All rights reserved. Nuage Networks is a Nokia venture.
CONFIDENTIAL - SOLELY FOR AUTHORIZED PERSONS HAVING A NEED TO KNOW PROPRIETARY – USE PURSUANT TO COMPANY INSTRUCTION
Live MigrationTestbed
KVM
VM11
KVM
VM22
Data/Mgmt Plane (192.168.50.0/24)
.201 .202V1 (Centos 7.2) V2 (Centos 7.2)
VXLANalubr0alubr0
NIC
VRSVRS
NICCPU
Load Generation (tx):Trafgen-DPDK
CPU
Listener (rx):Trafgen-DPDK
VMOBI
Throughput (Gbps)
SSH
© 2017 NETRONOME SYSTEMS, INC.
Thank you