16
Prakash Suthar, Principal Architect Cisco Systems Inc. August 23, 2016 Deploying Virtual Mobile Infrastructures on Openstack

LinuxCon-suthar-Deploying Virtual Mobile Infrastructures ...schd.ws/hosted_files/lcccna2016/b8/LinuxCon-suthar-Deploying... · Deploying Virtual Mobile Infrastructures on Openstack

  • Upload
    buihanh

  • View
    221

  • Download
    2

Embed Size (px)

Citation preview

Prakash Suthar, Principal ArchitectCisco Systems Inc.August 23, 2016

Deploying Virtual Mobile Infrastructures on Openstack

AbstractMobile SP are transforming their existing purpose built-hardware based mobile packet coreto virtualized NFV based solutions to reduce complexities and lower TCO. The biggestchallenge is to decide right NFV technology which is SP grade, agile and capable ofscaling at lower cost. We have put together SP grade NFV solution which is being deployedby mobile operators across the globe. The speaker will share their experience aboutdesign, optimization and performance fine tuning at various layer. The solution uses at NFVinfrastructures and orchestration layers using technologies from Cisco (VIM, VNF Managerand NFVO), Redhat (NFVI), Openstack and block storage using CEPH technology.Participants will be able to understand complexities of mobile packet core, evolution NFVbased solution which is framework for 5G mobile packet core.

Agenda

▪ Why Virtualize Mobile Networks

▪ Deploying Virtualized Mobile Infrastructure

▪ Performance Characterization and Use Cases

▪ Summary

OldNormal NewNormal

User

Access

Services

Usage

Architecture

People

Homogeneous

Voice & Data

Predictable

Static

People & Things

Heterogeneous

Experiences

Unpredictable

Elastic

Changing Dynamics in Mobile Network

Introducing Virtualization in Mobile Network

Management and Orchestration

Managem

ent

Service Resource ControlVNFMVNFM VNFMVNFM

NFV OrchestrationCatalog Workflow

SystemMgmt.

NetworkControl

ComputeControl

StorageControl

Virtual Infrastructure Manager

Data CenterIntelligent Transport AccessUser

Orchestrated Virtualized Infrastructure

VNF VNFVNFVNFFuncFunc

Virtualized Infrastructure

StorageCompute

Network

Network Function Virtualization

User Plane

Policy/Charging

Data Center

Internet

Other PDN

Core Network Slices

Man

agem

ent a

nd

Orc

hest

ratio

n

Sub DB Exposure to PartnersVirtualization in Next-Gen 5G

Architecture

VASGi-LAN

Control Plane IP SvcIP Svc

IP Svc

Unified Ethernet x-Haul (Transport virtualization)

Fronthaul

BackhaulRAN

Backhaul

C-RAN

MBB

Residential at mm-wave

Connected Car

Video Cameras

multi-RATRAN

RG

Things

mm-wave

NB-IoT/ LPWA

Low Band

Wi-Fi

Multiple Radios

Multi-RAT Aggregation

LTE/ LTE-A

Cisco Virtualization Framework

ETSIGSNFV002V1.1.1(2013-10)

NFVReferenceArchitecturalFramework

Cisco® VNFMElastic Service Controller

(ESC)

Cisco®

Network Services Orchestrator(NSO)

VIMCisco® UCS/Nexus

Cisco® NFVI

GiLAN VNF

PCRF VNF

FW VNF

Cisco® Element Manager

VPCVNF …

Cisco Mobile Packet Core

MMES11 ControlPlane

GTPDemux

SessionManager

IPAddressManager

AAAManager

PolicyandCharging

AAA PCRF OCS

Diameter (Gx, Gy, S6b)

eNB

S1-C

UserPlaneForwarder

S1-U

OpenFlow

SGiUE

SessionRequest

ProfileRequestPolicyRequestIPAddrRequestQuotaRequestProgramUPF

SessionCreated

Scaling Workloads in Different Dimensions

CPU – Intel x86

I/O

Memory

VideoPolicyControl

VM VM

VM

M2MIOT

VoLTE

Unified FabricSDN Technologies

Virtualized Adapter

Industry Trend▪ Increased core countBig Data

Analytics

Detailed Billing

High Density BladesSession Disk CachingVirtualization

Small Packets requireMore I/O capacity

M2M solutions require massive amounts of sessions with minimal throughput-requiring additional memory

Operations like Deep Packet Inspection, Advanced Analytics, Policy controlled sessions etc.Require additional CPU capacity

Packet Core CharacteristicsCritical Parameters Values

Number of sessions ~ 1 to 10 Millions

Gateway total bandwidth ~ 10 to 100 Gbps

Bandwidth/users 10-50 Mbps

Packet loss ~ 1%

Jitter 10 – 30 ms

Data Plane Latency for critical Apps

~50 ms

Initial session attach ~500 ms

Critical Parameters Values

Encryption support Desired in hardware

Control plane events/sec

~ 5000/sec

User plane packet/ sec

~5 Million Packet/sec

Packet size Varies ( typically 64 to 1500)

QoS classes to support different traffic types

>5 (3GPP defines 9 classes)

https://support.ixiacom.com/sites/default/files/resources/whitepaper/mobile-broadband-networks-breakingpoint.pdf

Virtual Packet Core Architecture (1)

vPC Network – Internal network (Private L2 VLAN) interconnecting all VMs in an instance

2 CF VMs act as 1:1

Up to 48 SF VMs: User I/O for service context ports, Protocol Signaling and Session Processing tasks

VPC VNF - Group of VMs acting as a single manageable unit with single service address

Standby

Virtual Packet Core Architecture (2)

• Management/Provisioning also used for PXE booting servers• API network for Openstack (Best Practice)

• Horizon Dashboard• Externally routable

• Tenant Networks• VM to VM traffic• Uses VXLAN

• Storage Network• Needed for optimal access to storage

Cisco Server Profile● UCS B200 M4 Blade Servers● 2 Intel Xeon processors EF-2680 v3 (or better)

○ 12 cores per processor, 24 cores per server○ 2 threads per core, 24 threads per processor

● 16 strips of 16GB DDR4 RAM● Cisco 1340 VIC

○ Dual 20GE ports○ Supports up to 256 vNICs○ Supports SR-IOV

● 2 x 300 GB HDD

VPC per VM Server Requirements

CPU 8 to 24 vCPU

Memory 16 to 64GB RAM

NIC ~4 vNIC

Disk 16 GB vHDD (Min)

SR-IOV Yes

CPU Pinning Yes

Host Profile

HardwareCisco Servers (UCS) Cisco NFVI Installer Bare metal/Docker Container

Non-Cisco Servers Red Hat Openstack Director Bare metal

Host OS RHEL

Openstack OSP Cisco NFVi uses Docker containers

….

....

Virtual packet Core Performance Optimization

Performance Optimization:§ Huge Page§ NUMA nodes§ CPU Pinning§ SR-IOV§ Jumbo packets support§ for Network (Internal communication)

High Availability:§ Single chassis (active and standby

control function/module§ Multi-chassis (one control

function/module per chassis to accommodate chassis failure

§ Infrastructure§ Multi-chassis§ Geo-redundancya§ BFD (Failure detection)

§ Application Level§ Inter-chassis session recovery

(stateful redundancy)§ Load balancing (ECMP using BGP

sessions over each SF)HA to be built at every layer

Summary▪ Linux is a foundation for Robust and Scalable Virtualized Solution▪ Virtualization Benefits

▪ Enabling new Uses Cases to support New Normal▪ Improving TCO by optimizing Operations

▪ Virtualization Growing Trends▪ E2E Mobile Infrastructure▪ Mobile Operator Services Chaining▪ Cloud Radio Access Network ▪ Next-Gen 5G Architecture

▪ Key Learnings▪ Maturity and interoperability of Virtual Infrastructure Manager, VNF Manager▪ Infrastructure Performance tuning need automation