Upload
buihanh
View
221
Download
2
Embed Size (px)
Citation preview
Prakash Suthar, Principal ArchitectCisco Systems Inc.August 23, 2016
Deploying Virtual Mobile Infrastructures on Openstack
AbstractMobile SP are transforming their existing purpose built-hardware based mobile packet coreto virtualized NFV based solutions to reduce complexities and lower TCO. The biggestchallenge is to decide right NFV technology which is SP grade, agile and capable ofscaling at lower cost. We have put together SP grade NFV solution which is being deployedby mobile operators across the globe. The speaker will share their experience aboutdesign, optimization and performance fine tuning at various layer. The solution uses at NFVinfrastructures and orchestration layers using technologies from Cisco (VIM, VNF Managerand NFVO), Redhat (NFVI), Openstack and block storage using CEPH technology.Participants will be able to understand complexities of mobile packet core, evolution NFVbased solution which is framework for 5G mobile packet core.
Agenda
▪ Why Virtualize Mobile Networks
▪ Deploying Virtualized Mobile Infrastructure
▪ Performance Characterization and Use Cases
▪ Summary
OldNormal NewNormal
User
Access
Services
Usage
Architecture
People
Homogeneous
Voice & Data
Predictable
Static
People & Things
Heterogeneous
Experiences
Unpredictable
Elastic
Changing Dynamics in Mobile Network
Introducing Virtualization in Mobile Network
Management and Orchestration
Managem
ent
Service Resource ControlVNFMVNFM VNFMVNFM
NFV OrchestrationCatalog Workflow
SystemMgmt.
NetworkControl
ComputeControl
StorageControl
Virtual Infrastructure Manager
Data CenterIntelligent Transport AccessUser
Orchestrated Virtualized Infrastructure
VNF VNFVNFVNFFuncFunc
Virtualized Infrastructure
StorageCompute
Network
Network Function Virtualization
User Plane
Policy/Charging
Data Center
Internet
Other PDN
Core Network Slices
Man
agem
ent a
nd
Orc
hest
ratio
n
Sub DB Exposure to PartnersVirtualization in Next-Gen 5G
Architecture
VASGi-LAN
Control Plane IP SvcIP Svc
IP Svc
Unified Ethernet x-Haul (Transport virtualization)
Fronthaul
BackhaulRAN
Backhaul
C-RAN
MBB
Residential at mm-wave
Connected Car
Video Cameras
multi-RATRAN
RG
Things
mm-wave
NB-IoT/ LPWA
Low Band
Wi-Fi
Multiple Radios
Multi-RAT Aggregation
LTE/ LTE-A
Cisco Virtualization Framework
ETSIGSNFV002V1.1.1(2013-10)
NFVReferenceArchitecturalFramework
Cisco® VNFMElastic Service Controller
(ESC)
Cisco®
Network Services Orchestrator(NSO)
VIMCisco® UCS/Nexus
Cisco® NFVI
GiLAN VNF
PCRF VNF
FW VNF
Cisco® Element Manager
VPCVNF …
Cisco Mobile Packet Core
MMES11 ControlPlane
GTPDemux
SessionManager
IPAddressManager
AAAManager
PolicyandCharging
AAA PCRF OCS
Diameter (Gx, Gy, S6b)
eNB
S1-C
UserPlaneForwarder
S1-U
OpenFlow
SGiUE
SessionRequest
ProfileRequestPolicyRequestIPAddrRequestQuotaRequestProgramUPF
✔
SessionCreated
Scaling Workloads in Different Dimensions
CPU – Intel x86
I/O
Memory
VideoPolicyControl
VM VM
VM
M2MIOT
VoLTE
Unified FabricSDN Technologies
Virtualized Adapter
Industry Trend▪ Increased core countBig Data
Analytics
Detailed Billing
High Density BladesSession Disk CachingVirtualization
Small Packets requireMore I/O capacity
M2M solutions require massive amounts of sessions with minimal throughput-requiring additional memory
Operations like Deep Packet Inspection, Advanced Analytics, Policy controlled sessions etc.Require additional CPU capacity
Packet Core CharacteristicsCritical Parameters Values
Number of sessions ~ 1 to 10 Millions
Gateway total bandwidth ~ 10 to 100 Gbps
Bandwidth/users 10-50 Mbps
Packet loss ~ 1%
Jitter 10 – 30 ms
Data Plane Latency for critical Apps
~50 ms
Initial session attach ~500 ms
Critical Parameters Values
Encryption support Desired in hardware
Control plane events/sec
~ 5000/sec
User plane packet/ sec
~5 Million Packet/sec
Packet size Varies ( typically 64 to 1500)
QoS classes to support different traffic types
>5 (3GPP defines 9 classes)
https://support.ixiacom.com/sites/default/files/resources/whitepaper/mobile-broadband-networks-breakingpoint.pdf
Virtual Packet Core Architecture (1)
vPC Network – Internal network (Private L2 VLAN) interconnecting all VMs in an instance
2 CF VMs act as 1:1
Up to 48 SF VMs: User I/O for service context ports, Protocol Signaling and Session Processing tasks
VPC VNF - Group of VMs acting as a single manageable unit with single service address
Standby
Virtual Packet Core Architecture (2)
• Management/Provisioning also used for PXE booting servers• API network for Openstack (Best Practice)
• Horizon Dashboard• Externally routable
• Tenant Networks• VM to VM traffic• Uses VXLAN
• Storage Network• Needed for optimal access to storage
Cisco Server Profile● UCS B200 M4 Blade Servers● 2 Intel Xeon processors EF-2680 v3 (or better)
○ 12 cores per processor, 24 cores per server○ 2 threads per core, 24 threads per processor
● 16 strips of 16GB DDR4 RAM● Cisco 1340 VIC
○ Dual 20GE ports○ Supports up to 256 vNICs○ Supports SR-IOV
● 2 x 300 GB HDD
VPC per VM Server Requirements
CPU 8 to 24 vCPU
Memory 16 to 64GB RAM
NIC ~4 vNIC
Disk 16 GB vHDD (Min)
SR-IOV Yes
CPU Pinning Yes
Host Profile
HardwareCisco Servers (UCS) Cisco NFVI Installer Bare metal/Docker Container
Non-Cisco Servers Red Hat Openstack Director Bare metal
Host OS RHEL
Openstack OSP Cisco NFVi uses Docker containers
….
....
Virtual packet Core Performance Optimization
Performance Optimization:§ Huge Page§ NUMA nodes§ CPU Pinning§ SR-IOV§ Jumbo packets support§ for Network (Internal communication)
High Availability:§ Single chassis (active and standby
control function/module§ Multi-chassis (one control
function/module per chassis to accommodate chassis failure
§ Infrastructure§ Multi-chassis§ Geo-redundancya§ BFD (Failure detection)
§ Application Level§ Inter-chassis session recovery
(stateful redundancy)§ Load balancing (ECMP using BGP
sessions over each SF)HA to be built at every layer
Summary▪ Linux is a foundation for Robust and Scalable Virtualized Solution▪ Virtualization Benefits
▪ Enabling new Uses Cases to support New Normal▪ Improving TCO by optimizing Operations
▪ Virtualization Growing Trends▪ E2E Mobile Infrastructure▪ Mobile Operator Services Chaining▪ Cloud Radio Access Network ▪ Next-Gen 5G Architecture
▪ Key Learnings▪ Maturity and interoperability of Virtual Infrastructure Manager, VNF Manager▪ Infrastructure Performance tuning need automation