Upload
constance-clark
View
230
Download
7
Tags:
Embed Size (px)
Citation preview
End-to-End QoS Implementation and Operation with Cisco Nexus
Rohan Grover
@mountainviewer
Technical Marketing Manager
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346 3
Session Objectives• Provide a refresh of QoS and Queuing Basics
• Understand the basic hardware architecture for the Nexus Platforms
• Provide a detailed understanding of QoS on Nexus platforms
• Examine real-world configuration examples
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346 4
Session Non-Objectives• Data Center QoS Methodology
• Nexus hardware architecture deep-dive
• Application Centric Infrastructure (ACI) QOS
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Related Sessions
5
Session Id Session Name
BRKARC-3470 Cisco Nexus 7000/7700 Switch Architecture
BRKARC-3452 Cisco Nexus 5600 and 6000 Architecture
BRKDCT-1980 Advanced Analytics in Nexus Switches
BRKRST-2509 Mastering Data Center QoS
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation ID
Agenda• Introduction
• QoS and Queuing Basics
• QoS Implementation on Nexus
• Nexus 7000/7700 QoS
• Nexus 5600/6000 QoS
• Nexus 2000 QoS
• Real World Configuration Examples
• Conclusion
6
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation ID 7
Introduction
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Wikipedia.org
“Quality of service (QoS) is the overall performance of a telephony or computer network, particularly the performance seen by the users of the network.”
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Margaret RouseWhatis.com
“On the Internet and in other networks, QoS (Quality of Service) is the idea that transmission rates, error rates, and other characteristics can be measured, improved, and, to some extent, guaranteed in advance.”
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346 10
Congestion Happens Everyday!
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Why QoS in the Data Center?
11
Assign Color to Traffic
Maximize Throughput
ManageCongestion
Maximize Throughput and Manage Congestion!
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation ID
Agenda• Introduction
• QoS and Queuing Basics
• QoS Implementation on Nexus
• Nexus 7000/7700 QoS
• Nexus 5600/6000 QoS
• Nexus 2000 QoS
• Real World Configuration Examples
• Conclusion
12
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation ID 13
QoS and Queuing Basics
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
The QoS Toolset
14
Classification
Identify and Split Traffic
into Different Classes
Queuing &Scheduling
Prioritize, Protect and
Isolate Traffic Based on Markings
Marking
Mark Traffic According to Behavior and
Business Policies
Policing
Discard Misbehaving
Traffic to Maintain Network Integrity
Shaping
Control Bursts and Conform Traffic
22nd Anniversary
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346 15
Traffic Management Tools
• Classification• Traffic Categorization
• Marking• Traffic Re-categorization
• Policing• Limit misbehaving flows
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Classification and Marking – Two sides of a coin
16
Mad Max (1979)
HTTPVoIPemail
Videop2p
App1vmotion
mgmtlync
backup
Before:
Uncontrolled Bandwidth
VoIP/Lync
Email/HTTP
SAP
Backup
After:
Controlled Bandwidth
• Identify traffic• DSCP• CoS• ACLs• IP PREC
• Remap Traffic• Like to Like (i.e CoS to CoS)• Like to Unlike (i.e DSCP to COS)
• Needs mapping tables• Also called Mutation
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Policing – limit misbehaving traffic
17
Mad Max (1979)
• Single rate Two Color Policer• Conform Action (permit)• Exceed Action (drop)
Tokens
Burst Limit
Conforming Traffic
Excess Traffic
• Two rate Three Color Policer• Conform Action (permit)• Exceed Action (markdown)• Violate Action (drop)
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346 18
Congestion Management Tools
• Buffering• Storing packets in memory
• Queuing• Buffering packets according to traffic class
• Scheduling• Order of transmission of buffered packets
• Shaping• Smooth bursty traffic
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Buffering – Why do we need it?
• Speed Mismatch• Client to WAN to Server
19
• Many to One Conversations• Client to Server• Server to Storage• Aggregation Points
1 GE
1 GE
1 GE
1 GE
10 GE10 GE
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Scheduling – Who goes first• Defines Order of transmission
• The Priority-Queue always serviced first
• Normal Queues serviced only after Priority Queue empty
• Different Scheduling algorithms for normal queues
20
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346 21
Common Scheduling Algorithms
• Round Robin (RR)• Simple and Easy to implement• Starvation-free
• Weighted Round Robin (WRR)• Serves n packets per non-empty
queue• Assumes a mean packet size
• Deficit Weighted Round Robin– Variable sized packets– Uses a deficit counter
• Shaped Round Robin– More even distributed ordering– Weighted interleaving of flows
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
4 Class Queuing Model example
Class CoS Queues
Priority 5-7 PQ
No-Drop 3, 4 Q2
Better than Best-Effort 2 Q1
Best-Effort 0, 1 Default-Q
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346 24
Congestion Avoidance Tools
• Tail Drop (TD)• Drop packets at tail of the queue• Single threshold per queue
• Weighted Random Early Drop (WRED)• One or more thresholds per queue• Threshold associated with DSCP or COS
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Putting it all together!
25
Egress Port
PQ1
Q2
Q3
Q-Default
Sch
edu
ler
DW
RR
Drop Threshold 4
Drop Threshold 3
Drop Threshold 2
Drop Threshold 1
Normal Queue
Packet is placed in the Egress Queue according to CoS/DSCP value.
1
Normal Queues have Threshold and drop packet accordingly
4
Priority Queue always served first
2
Normal Queues served after PQ is empty according to Scheduler
3
dataL2
CoS [3]L3
DSCP [24]
COS Queue
5, 6, 7 PQ1
3, 4 Q3
2 Q2
0, 1 Q-Default
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Congestion could result in…..
26
Head Line Blockingof
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Head of Line BlockingWhat is the Problem?
27
No CongestionRed Cars blocked!
congestion
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Head of Line BlockingSolution – Create Separate Lanes but…
28
Cars turned back
Stadium Full
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Head of Line BlockingSolution – Have an arbiter
29
Supermarket Not Full
Stadium Full
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Head of Line BlockingWhat is the Problem?
30
Ingress Module Egress Module
Ingress Module Egress Module
Ingress Module Egress Module
CrossbarFabric
congestion
buffer
backpressure
for all Traffic
drop
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Virtual Output QueuesAvoid Head of Line Blocking
31
Ingress Module Egress Module
Ingress Module Egress Module
Ingress Module Egress Module
CrossbarFabric
IngressVOQ
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Virtual Output QueuesAvoid Head of Line Blocking
32
Ingress Module Egress Module
Ingress Module Egress Module
Ingress Module Egress Module
CrossbarFabric
IngressVOQ
congestion
drop
buffer
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation ID
Agenda• Introduction
• QoS and Queuing Basics
• QoS Implementation on Nexus
• Nexus 7000/7700 QoS
• Nexus 5600/6000 QoS
• Nexus 2000 QoS
• Real World Configuration Examples
• Conclusion
33
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation ID 34
QoS Implementation on Nexus
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
3 Block Construct
Nexus uses Modular QOS CLI (MQC)
35
What Traffic do we care about?• DSCP• CoS• IPPREC• ACLs
Class-Map
Where do I apply this policy?• System Wide• Vlan• Interface (in/out)• Port-channels
Service-Policy
What action do I take on these classes?• Policing• Marking• Scheduling
Policy-Map
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
New QoS CapabilitiesPriority Flow Control (802.1Qbb)
• Enables Lossless Ethernet using per COS pause
• During congestion, no-drop COS is paused
• Primarily for FCoE (COS 3)
36
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
New QoS Capabilities• DCBXP (802.1Qaz)
• LLDP with new TLV Values• Negotiates capabilities (like PFC) with other
devices
• ECN (Explicit Congestion Notification)• Congestion Notification without dropping
packets• Uses two LSB bits in DiffServ field in IP header
37
DiffServ Field Values
0x00 – Non ECN Capable
0x10 – ECN Capable Transport (0)
0x01 – ECN Capable Transport (1)
0x11- Congestion Encountered
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Network-QoS Policy • Should be consistent across all switches in network
• Supported on F-cards on Nexus 7x00 and Nexus 5x00,6000,9000
• Applied on the system-qos target in admin (or default) vdc
• Configures the following• Pause Behavior (PFC)• MTU (per VL)• Congestion Control (TD or WRED)
38
Nexus(config)# system qos Nexus(config-sys-qos)# service-policy type network-qos my_template
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Three Different Types
39
Network-QoS•Congestion-Control•Pause / MTU per VL
QoS•Marking•Policing•Mutation
Queuing•Buffering•Queuing•Scheduling
Policy-map
QoS•CoS•DSCP•PREC•ACLs
Queuing•CoS•DSCP
Class-map Service-policy
QoS•Interfaces•Vlans•Port-channel•System-qos
Queuing•Interfaces•Port-channels•System-qos
Network-QoS•System-qos
Network-QoS•CoS•Protocol (fcoe)
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
To Trust or Not To Trust?
• Data Centre architecture provides a new set of trust boundaries
• Virtual Switch extends the trust boundary into the Hypervisor
• Nexus Switches always trust CoS and DSCP
43
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation ID
Agenda• Introduction
• QoS and Queuing Basics
• QoS Implementation on Nexus
• Nexus 7000/7700 QoS
• Nexus 5600/6000 QoS
• Nexus 2000 QoS
• Real World Configuration Examples
• Conclusion
44
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation ID 45
Nexus 7000/7700 QoS
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
M Series Modules
Nexus 7000 / 7700 I/O Module Families
M1 1G and 10GM2 10G / 40G / 100G
F Series Modules
NEXUS 7000
NEXUS 7000
NEXUS 7700
F1 10G F2 10GF2E 10G F3 40G
F2E 10G
L2/L3/L4 with large forwarding tables and rich feature set
High performance, low latency with streamlined feature setF3 10G / 40G / 100G
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
12 X 10G MAC / LinkSec
ForwardingEngine
VOQs
Fabric 2 ASIC
To Fabric Modules
ReplicationEngine
ReplicationEngine
Front Panel Ports
LCCPU
EOBC
VOQs
1 2 3 4 5 6 7 8 9 10 11 12
12 X 10G MAC / LinkSec
ForwardingEngine
VOQs
ReplicationEngine
ReplicationEngine
VOQs
242322212019181716151413
To Central Arbiters
ArbitrationAggregator
…
M2 I/O Module Architecture
47
BRKARC-3470Cisco Nexus 7000 / 7700 Switch Architecture
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Ingress Module Egress ModuleCrossbarFabric
M2 I/O QoS Packet-Flow (10G)
48
Ingress VoQ-ASIC
1p3q1t
1 2 3 4 VOQIngress port-ASIC
Ingress1 2 3 4 5 6 7 8
8q2t
Egress port-ASIC
Egress
1p7q4t
1 2 3 4 5 6 7 8
Egress VoQ-ASIC
Egress
FIFO
1
Arbiter
8
3
8
1
ForwardingEngine
CoS to Queue-Mapping>Policy Type “queuing”(Scheduling, Buffering)
1
Default CoS-to-Queue map:CoS [2] to Default-Q (8)
2
>Policy Type “qos”(Mutation, Classification, Marking, Policing)
3
VoQ gets assigned based on Dest + CoS value
4
Credit Grant for Fabric Access
5
Traffic gets forwarded over
Fabric
6
Return Credit to Pool
8
Traffic gets Received on Egress VoQ
7
CoS to Queue-Mapping>Policy Type “queuing”(Scheduling, Buffering)
9
Default CoS-to-Queue map:CoS [2] to Default-Q (8)
10
dataL2
CoS [2]L3
DSCP [24]data
L2CoS [2]
L3DSCP [24]
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
8 X 10GSoC 1
Nexus 7700 F3 48-Port 1G/10G Module ArchitectureTo Fabric Modules
FSACPU
EOBC To Central Arbiters
ArbitrationAggregator
8 X 10GSoC 2
8 X 10GSoC 3
8 X 10GSoC 4
8 X 10GSoC 5
8 X 10GSoC 6
55Gbps
6 X 110Gbps
Fabric ASIC Fabric ASIC
6 X 110Gbps
55Gbps
LC Inband
1G per SOC … x 6
1
Front Panel Ports (SFP/SFP+)2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
LinkSec-capable
to LCCPU
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Decision Engine
Ingress Parser
F3 SoC
VirtualQueuing
IngressBuffer
Port Logic
Egress Buffer
F3 SoC Architecture
Egress Parser
Layer 2 LookupsLayer 3 Lookups
ClassificationMarking / Policing
Front Panel Ports8x10G2x40G1x100G
To CentralArbiter
To LocalFabric
From LocalFabric
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Decision Engine
Ingress Parser
CL TCAM
F2E/F3 SoC
Port Logic
VirtualQueuing
IngressBuffer
Layer 2 LookupsLayer 3 Lookups
ClassificationMarking / Policing
F2E/ F3 SoC
Port Logic
Egress Buffer
Module 2
e2/1
Fabric ASIC
Fabric Module 1
Fabric ASIC
Supervisor Engine
Central Arbiter
Module 1
e1/1
Fabric Module 2
Fabric ASIC
Fabric Module 3
Fabric ASIC
Fabric Module 4
Fabric ASIC
Fabric Module 5
Fabric ASIC
Fabric ASIC
e1/1
e2/1
e2/1
DWRRSP
F2E/F3 QoS Packet Walk
PKT HDR
HDRPKT
Req
Credit
Credit
PKT HDR
Receive packet from wire
Ingress packet parsing
Packet headers sent to DE
Payload queued in port buffer based on
COS / DSCP
Buffer credit granted
Check VQ drop
thresholds
All L2 + L3 lookups /Ingress + egress QoS classification /
Ingress + egress marking and policing
CL TCAM contains QoS classification
rules
Final lookup result: destination + priority
Transmit to fabric
Receive from fabric
Schedule and transmit
on wire
Buffer on egress based on dest+ priority
Queue packet descriptor in VOQ
(dest + priority)
Return buffer credit (dest + priority)
Request buffer credit for dest +
priority
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Ingress Queuing – Logical View
60
CoS 0-4(Q-Default)
CoS 5-7(Q1)
8e Template
CoS 3(Q4)
CoS 5-7(Q1)
7e Template
CoS 0,1(Q-Default)
CoS 2,4(Q3)
CoS 0-2(Q-Default)
CoS 5-7(Q1)
6e Template
CoS 4(Q3)
CoS 3(Q4)
CoS 0(Q-Default)
CoS 5-7(Q1)
4e Template
CoS 4(Q3)
CoS 1-3(Q4)
High (Pause) Threshold
Low (Resume) Threshold
8e-4q4q Template
CoS 3-4(Q3)
CoS 5-7(Q1)
CoS 2(Q4)
CoS 0-1(Q-Default)
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Egress Queuing – Logical View
61
Egr
ess
Por
t
Q2
PQ
1
Q3
Q-D
ef
default-4q-7e-out-policy
Q-Def.(0,1)
PQ1(5,6,7)
Q3(2,4)
Q2(3)
DWRR
Priority
DWRR
50% 50%
Egr
ess
Por
t
PQ
2 (
H)
PQ
3 (
L)
PQ
1
Q-D
ef
default-4q-6e-out-policy
Q-Def.(0-2)
PQ3(3)
PQ1(5,6,7)
PQ2.(4)
DWRR
PrioPrio
DWRR
100%
Egr
ess
Por
t
PQ
1 (
H)
Q-D
ef
PQ
2 (
L)
Q3
default-4q-4e-out-policy
Q3(1,2,3)
Q-Def.(0)
PQ2(4)
PQ1(5,6,7)
DWRR DWRR
PrioPrio
DWRR
100% 100%
red indicates no-drop
Egr
ess
Por
t
PQ
1
Q2
Q3
Q-D
ef
DWRR
default-4q-8e-out-policy
Q-Def.(0,1)
Q2(3,4)
Q3(2)
PQ1(5,6,7)
Priority
33%33%33%
Egr
ess
Por
t
PQ
1
Q2
Q3
Q-D
ef
DWRR
default-4q4q-8e-out-policy
Q-Def.(0,1)
Q2(3,4)
Q3(2)
PQ1(5,6,7)
Priority
33%33%33%
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
CoS or DSCP to Queue Mapping• Default CoS to Queue Mapping for Nexus 7000/7700 (F- and M-Series I/O
Module)• Ingress: CoS to Queue• Egress: CoS to Queue
• DSCP to Queue Mapping for Nexus 7000/7700 (F- and M-Series I/O Module)• Ingress: DSCP to Queue• Egress: CoS to Queue
• Global Configuration (Admin/Default VDC) required to enable DSCP to Queue Mapping:
64
N7k(config)# hardware qos dscp-to-queue ingress module type {all | f-series | m-series}
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Changing the Default Trust
65
802.1q Trunk / Access Port
Ingress Queues
Egress Queues
routed/bridged
CoS
CoSq-1
q-n
Note: CoS is used for egress queue selection, even if the egress interface does NOT carry CoS in the frame
q-default
Set CoS 0(will only set CoS to 0) data
L2CoS [0]
L3DSCP [24]
Set DSCP 0(will set DSCP + CoS to 0)
L3DSCP [0]
dataL2
CoS [0]L3
DSCP [0]data
L2CoS [2]
L3DSCP [24]
802.1q Trunk
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346 68
Nexus 7000 QoS Golden Rules• QoS is enabled by default and cannot be disabled
• CoS and DSCP are TRUSTED by default
• Default Queuing and QoS policies are applied to all physical interfaces across all VDCs
• For bridged traffic, CoS is preserved, DSCP is unmodified
• For routed traffic, DSCP is copied to CoS (first 3 bits)• Ex: DSCP 40 (b101000) becomes CoS 5 (b101)
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation ID
Agenda• Introduction
• QoS and Queuing Basics
• QoS Implementation on Nexus
• Nexus 7000/7700 QoS
• Nexus 5600/6000 QoS
• Nexus 2000 QoS
• Real World Configuration Examples
• Conclusion
69
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation ID 70
Nexus 5600/6000 QoS
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Cisco Nexus 5600/6000 Overview
71
High Performance High Scalability Feature-Rich Visibility and Analytics
• Line rate L2 and L3 • 1-us port-to-port
latency • 25-MB buffer per port
ASIC
• 10 GE and true 40 GE
• Up to 224,000 MAC
• Up to 128,000 ARP
• L2 and L3 features
• vPC and FabricPath
• FC and FCOE
• VXLAN Bridging and Routing
• Line-rate SPAN
• Sampled NetFlow
• Micro-burst monitoring
• Latency monitoring
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
EgressVOQ buffer
IngressVOQ buffer
Ingress Module Egress Module
Ingress Module
Ingress Module
CrossbarFabric
Ingress Buffering ModelNexus 5600/6000 compared to Nexus 7000 F-Series I/O Module
72
Ingress VOQ buffer – Manages congestion toward egress destinations
Egress VOQ buffer – Receives frames from fabric; also buffers multi-destination frames
EgressVOQ buffer
IngressVOQ buffer
Nexus 7000F-Series I/O Module
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Key Concepts – Common Points
• Nexus 5000/6000 & Nexus 7000 F-Series I/O Modules share the Ingress Buffer Model
• Ingress buffering and queuing occur at VOQ of each ingress port
• Egress scheduling enforced by egress port
• No Egress QOS Policies
Nexus 7000 compared to Nexus 5000/6000 QoS
73
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Cisco Nexus 5600/6000 QoS Features• Traffic classification
‒ DSCP, CoS, IP Precedence and ACL
• Packet marking
‒ DSCP, CoS, and ECN
• Strict Priority Queuing and DWRR
‒ Priority Flow Control
‒ DCBX 802.1Qaz
• Ingress policing (No egress policing)
‒ 4096 policers per ASIC
• Flexible buffer management
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Unified Ports
Nexus 5672UP Architecture Overview
UPC 1
24xSFP+
Fabric
6xQSFP+ CPU
Supervisor
UPC-0UPC 2 UPC 3 UPC 4 UPC 5 UPC 6
24xSFP+
Slot 1 Slot 2
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Packet Buffering• 25MB packet buffer is shared by every three 40 GE ports or twelve 10 GE ports.
• Buffer is 16MB at ingress and 9MB at egress.
• Unicast packet can be buffered at both ingress and egress.
448Gbps
224Gbps
Ingress UPC
Egress UPC
Un
ica
st
VO
QM
ult
ica
st
VO
Q
Unified Crossbar
Fabric
16MB 9MB
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Nexus 5600 QoS Packet Walk C
rossb
arF
abric
MAC TrafficClassification
IngressCos/DSCP
MarkingForwarding
VoQs(8 per egress port)
Egress Queues
Trust CoS/DSCP andMatch on COS/DSCP/ACL
Make a forwarding decision
If Buffer Usage Crosses Threshold:• Tail drop for drop class• Assert Pause for no-drop COS
Strict Priority +DWRR Scheduling
MAC
Ingress UPC
IngressPolicing
WRED/ECNMarking
EgressScheduling
Egress UPC
Per-classBuffer Usage
Monitoring
Ingress Buffer
Egress Buffer
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Flexible Buffer ManagementIngress Buffer
• Shared buffer is good for burst absorption.
• Dedicated buffer is good for predictable performance for each port.
• On by default, no configuration needed
• Long-distance FCoE, video editing (i.e., AVID), Big Data, and distributed storage
Port 1 Dedicated
Port 2 Dedicated
Port 3 Dedicated
Shared Packet Buffer
SPAN Control
UPC Ingress Buffer (16MB)
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
WRED/ ECN Configuration
• ECN parameters are configurable only at system level.
• ECN is enabled by default along with WRED
• Packet Threshold below minimum – Transmit
• Packet Threshold between minimum and maximum – Mark ECN bits
• Packet Threshold above maximum – Drop
switch(config)# hardware random-detect min-thresh 10g 10g-min-threshold 40g 40g-min-threshold max-thresh 10g 10g-max-threshold 40g 40g-max-threshold ecn qos-group qos-group-number
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Nexus 5600/6000 QoS Configuration Model
• Uses QOS-Groups to tie together QoS, Queuing and Network-QoS policies
• QoS-Group has no direct relation with CoS value
• QoS-Groups defined (set) in policy-map type qos.
• QoS-groups referenced (match) in policy type queuing and policy-map type network-qos
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Putting it all together
class-map type qos class_foo match cos 3-4
policy-map type qos pm1 class type qos class_foo set qos-group 1 police cir 20 mbytes conform transmit violate drop class type qos class-default set qos-group 0
interface ethernet 1/1 service-policy type qos input pm1
class-map type queuing class-foo match qos-group 1
policy-map type queuing policy-foo class type queuing class-foo bandwidth percent 20 class type queuing class-default bandwidth percent 80
interface ethernet 1/3 service-policy type queuing input policy-foo
Create class-map type qos and
match on cos/dscp/acls
Create policy-map type qos and set qos-group and/or add policing rule
Attach policy-map type qos as input to
an interface
Attach policy-map queuing to interface
Create policy-map type queuing and
create actions
Create class-map type queuing and
match on qos-group
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346 85
Nexus 5600/6000 QoS Golden Rules• ECN/WRED is enabled by default and cannot be disabled
• CoS and DSCP are TRUSTED by default
• Use QoS-Groups to tie policies together
• No Egress QOS policies
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation ID
Agenda• Introduction
• QoS and Queuing Basics
• QoS Implementation on Nexus
• Nexus 7000/7700 QoS
• Nexus 5600/6000 QoS
• Nexus 2000 QoS
• Real World Configuration Examples
• Conclusion
86
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation ID 87
Nexus 2000 QoS
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
FEX Overview• Scalable and Extensible Fabric
• Single point of management
• Homogeneous and consistent policies
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Cisco Nexus 2000 QoS Features• Traffic classification
‒ DSCP, CoS
‒ ACL classification (FEX offload) –only on 5600/6000
• Strict Priority Queuing and DWRR
‒ Priority Flow Control
• Queue-limit Carving
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Nexus Parent
FEX QoS Policies• Support for ingress port-based QoS policies on FEX HIF ports
• Support for ingress/egress VLAN-based QoS policies on FEX VLANs
• FEX QoS policies applied at ingress module of parent switch• No support for remarking, policing policies
FEXModule
/PortModule
/PortFEX
Ingress port-based QoS
policy
Ingress/egress VLAN-based QoS
policy
Ingress FEX Egress FEXIngress Module Egress Module
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Nexus ParentFEX Module Module FEX
Ingress queue / egress schedule based on COS 0
Ingress FEX(FEX 101)
Egress FEXIngress Module Egress Module
FabricPKT DSCP 0 COS 0
Ingress queue at input port based on
COS 0
Egress schedule based on COS 0
Ingress queue / egress schedule based on COS 0
1Q trunk
FEX QoS Packet Flow Example (CoS2Q)
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Nexus Parent
FEX QoS Packet Flow Example (DSCP2Q)
FEX Module Module FEX
Ingress queue / egress schedule based on DSCP 0
Ingress FEX(FEX 101)
Egress FEXIngress Module Egress Module
Fabric
Ingress queue at input port based on
DSCP 0
Egress schedule based on COS 0
Ingress queue / egress schedule based on DSCP 0
PKT DSCP 0 COS 0
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Ingress QoS policy:policy-map type qos marker class ClassA set dscp cs3!interface ethernet 101/1/1 service-policy type qos input marker
Nexus 7000
FEX QoS Packet Flow Example (With Ingress Marking Policy and DSCP-to-Queue)
FEX Module Module FEX
Ingress queue / egress schedule based on DSCP 0
Ingress FEX(FEX 101)
Egress FEXIngress Module Egress Module
FabricPKT DSCP 0 COS 0 PKT DSCP CS3 COS 3
Ingress queue at input port based on
DSCP 0
Classify and remark to DSCP CS3/COS 3 at
ingress Decision Engine
Egress schedule based on COS 3
Ingress queue / egress schedule
based on DSCP CS3
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Ingress QoS policy:policy-map type qos marker class ClassA set dscp cs3!interface ethernet 101/1/1 service-policy type qos input marker
Nexus 7000
FEX QoS Packet Flow Example (With Ingress Marking Policy and DSCP-to-Queue)
FEX Module Module FEX
Ingress queue / egress schedule based on DSCP 0
Ingress FEX(FEX 101)
Egress FEXIngress Module Egress Module
FabricPKT DSCP 0 COS 0 PKT DSCP CS3 COS 3
Ingress queue at input port based on
DSCP 0
Classify and remark to DSCP CS3/COS 3 at
ingress Decision Engine
Egress schedule based on COS 3
Ingress queue / egress schedule
based on DSCP CS3
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
FEX Policy Offload (Nexus 5600/6000 only) • TCAM resources on a FEX to perform ACL-based classification
• The feature is disabled by default
• By default, a FEX classifies packets on CoS value
• Both system level and interface level policies are offloaded to the FEX
switch# configure terminalfex chassis_IDhardware card-type qos-policy-offload
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
FEX Queuing Policies• FEX queuing driven implicitly by parent switch queuing configuration
• Network QoS template drives:• Number of queues• MTU
• Ingress queuing class-maps drive:• BOTH ingress and egress COS/DSCP-to-queue mapping
• On Nexus 7000 with FEX + M-Series parent modules, network-qos and F-series ingress queuing class-maps still drive FEX queuing configuration
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
DSCP-to-Queue on FEX• Enabling DSCP-to-queue on parent switch enables DSCP-to-queue on FEX
• Currently active DSCP mappings pushed to FEX when enabled
• DSCP-to-queue only active in the HIF→NIF direction• NIF→HIF direction always uses COS-to-queue mapping, based on COS transmitted by
parent switch to FEX
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
FEX Queue-Limit• Provides FEX queue-limit configuration option
• Manages buffer thresholds on FEX based on platform capabilities
• Default has queue-limit disabled
• Configuration applied per-VDC (on Nexus 7000/7700)
• Different FEX models have different capabilities
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Nexus 2000 QoS Golden Rules• FEX QOS classification on COS or DSCP unless FEX offload enabled
• FEX queuing driven implicitly by parent switch queuing configuration
• No support for per-queue shaping, policing or marking
• Drop thresholds are tail-drop only, no WRED support
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation ID
Agenda• Introduction
• QoS and Queuing Basics
• QoS Implementation on Nexus
• Nexus 7000/7700 QoS
• Nexus 5600/6000 QoS
• Nexus 2000 QoS
• Real World Configuration Examples
• Conclusion
100
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation ID 101
Real World Configuration Examples
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
What do we want to achieve?Company Foobar’s Business Goals
102
• Make sure no disruption in network services
• Put control traffic in priority queue
• Video/voice hosting also an business objective
• Put voice traffic in priority queue
• Dedicated bandwidth to video traffic
• Flexibility in moving applications across servers
• Dedicated bandwidth to vmotion/mobility
• Everything else best-effort
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Translating to the language of QoS
103
Application CoSQueuing
(Scheduling)Queue-Limit
(Buffer)Character
Best Effort 0, 1BW remaining
50%60%
High Volume / Less Important
vMotion / Live Migration
2BW remaining
20%10%
Medium Volume / Important
Multimedia 3, 4BW remaining
30%20%
Medium VolumeVery Important
Strict Priority 5
Priority Queue 10%
Low Volume / Important /
Delay Sensitive
Network Control 6,7Low Volume / Very important
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Topology
104
vpc peer-link
vpc peer-link vpc peer-link vpc peer-link
Core
Nexus 7000
Nexus 5000 Nexus 5000 Nexus 5000Nexus 5000 Nexus 5000Nexus 5000
Nexus 2000
Nexus 7000
Nexus 2000 Nexus 2000 Nexus 2000Nexus 2000Nexus 2000
M2 cards facing core and F2/F3
cards facing access
VPC from access to
aggregation
Host VPC, Straight-through
FEX
Enhanced VPC (evPC)
Straight-through FEX, No VPC
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Classification, Marking & Trust on Nexus 5000/7000
105
vpc peer-link
vpc peer-link vpc peer-link vpc peer-link
Between the different Tiers, all ports are TRUSTED
Type:QoS
Mark Traffic from Core
(policy-map type qos)or just TRUST
(default)
Core
Mark Traffic from Servers(policy-map type qos)
or just TRUST (default)
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Classification & Marking: Nexus 7000ip access-list ACL_QOS_LOWPRIO 10 permit …ip access-list ACL_QOS_VMOTION 10 permit …ip access-list ACL_QOS_MULTIMEDIA 10 permit …ip access-list ACL_QOS_SCRICTPRIO 10 permit …!class-map type qos match-any CM_QOS_LOWPRIO_COS1 match access-group name ACL_QOS_LOWPRIO!class-map type qos match-any CM_QOS_VMOTION_COS2 match access-group name ACL_QOS_VMOTION!class-map type qos match-any CM_QOS_MULTIMEDIA_COS4 match access-group name ACL_QOS_MULTIMEDIA!class-map type qos match-any CM_QOS_STRICTPRIO_COS5 match access-group name ACL_QOS_STRICTPRIO
policy-map type qos PM_QOS_MARK_COS_IN class CM_QOS_STRICTPRIO_COS5 set cos 5 class CM_QOS_MULTIMEDIA_COS4 set cos 4 class CM_QOS_VMOTION_COS2 set cos 2 class CM_QOS_LOWPRIO_COS1 set cos 1!interface Ethernet1/1 service-policy type qos input PM_QOS_MARK_COS_IN!vlan configuration 100 service-policy input PM_QOS_MARK_COS_IN
106
Type:QoS
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Classification & Marking: Nexus 5600/6000 (1)ip access-list ACL_QOS_LOWPRIO 10 permit …ip access-list ACL_QOS_VMOTION 10 permit …ip access-list ACL_QOS_MULTIMEDIA 10 permit …!class-map type qos match-any CM_QOS_LOWPRIO_COS1 match access-group name ACL_QOS_LOWPRIO!class-map type qos match-any CM_QOS_VMOTION_COS2 match access-group name ACL_QOS_VMOTION!class-map type qos match-any CM_QOS_MULTIMEDIA_COS4 match access-group name ACL_QOS_MULTIMEDIA!class-map type qos match-any CM_QOS_STRICTPRIO_COS5 match cos 5
policy-map type qos PM_QOS_MARK_COS_IN class CM_QOS_STRICTPRIO_COS5 set qos-group 5 class CM_QOS_MULTIMEDIA_COS4 set qos-group 4 class CM_QOS_VMOTION_COS2 set qos-group 3 class CM_QOS_LOWPRIO_COS1 set qos-group 2!system qos service-policy type qos input PM_QOS_MARK_COS_IN
107
Type:
Network-QoS
QoS
QoS-Group # is mapping between Slide 1 & Slide 2
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Classification & Marking: Nexus 5500/6000 (2)class-map type network-qos CM_N-QOS_MATCH_QG2_COS1 match qos-group 2class-map type network-qos CM_N-QOS_MATCH_QG3_COS2 match qos-group 3class-map type network-qos CM_N-QOS_MATCH_QG4_COS4 match qos-group 4class-map type network-qos CM_N-QOS_MATCH_QG5_COS5 match qos-group 5
policy-map type network-qos PM_N-QOS_SYSTEM class type network-qos CM_N-QOS_MATCH_QG2_COS1 set cos 1 class type network-qos CM_N-QOS_MATCH_QG3_COS2 set cos 2 class type network-qos CM_N-QOS_MATCH_QG4_COS4 set cos 4 class type network-qos CM_N-QOS_MATCH_QG5_COS5 set cos 5 queue-limit 20480 bytes!system qos service-policy type network-qos PM_N-QOS_SYSTEM
108
Type:
Network-QoS
QoS
QoS-Group # is mapping between Slide 1 & Slide 2
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Classification & Marking (Nexus 2000)
109
vpc peer-link
vpc peer-link vpc peer-link vpc peer-link
Type:Queuing
Traffic Classification based on ACL happens here!
Core
Traffic Classification based on CoS happens here!
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Queuing (M2-cards)
110
vpc peer-link
vpc peer-link vpc peer-link vpc peer-link
Modify CoS to Queue mapping
in Admin-/Default-
VDC
Assign a egress policy-map to each interface with priority, bandwidth and queue-limit to alter default queuing policy
Type:Queuing
Assign ingress policy-map to each
interface with bandwidth and
queue-limit
Core
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
CoS to Queue Mapping – M2 I/O ModuleExample
111
Application CoSQueuing
(Scheduling)Queue-Limit
(Buffer)Queue
(8q2t / 1p7q4t)Character
Best Effort 0, 1BW remaining
50%60%
8q2t-in-q-default / 1p7q4t-out-q-default
High Volume / Less Important
vMotion / Live Migration
2BW remaining
20%10%
8q2t-in-q6 / 1p7q4t-out-q6
Medium Volume / Important
Multimedia 3, 4BW remaining
30%20%
8q2t-in-q2 / 1p7q4t-out-q2
Medium VolumeVery Important
Strict Priority 5
Priority Queue 10%8q2t-in-q1 /
1p7q4t-out-pq1
Low Volume / Important /
Delay Sensitive
Network Control 6,7Low Volume / Very important
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
CoS to Queue Mapping (on M2 cards)Exmple (Admin- / Default-VDC)
112
Core class-map type queuing match-any 8q2t-in-q1 match cos 5-7 class-map type queuing match-any 8q2t-in-q2 match cos 3-4 class-map type queuing match-any 8q2t-in-q6 match cos 2 class-map type queuing match-any 8q2t-in-q-default match cos 0-1 ! class-map type queuing match-any 1p7q4t-out-pq1 match cos 5-7 class-map type queuing match-any 1p7q4t-out-q2 match cos 3-4 class-map type queuing match-any 1p7q4t-out-q6 match cos 2 class-map type queuing match-any 1p7q4t-out-q-default match cos 0-1
Type:Queuing
Admin-VDC
Admin-VDC
Changes apply to ALL ports of specified type in ALL VDCsChanges are traffic disruptive for ports of specified type
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Ingress Queuing Configuration on M2 cardsExample (Payload-VDC)
113
Core policy-map type queuing PM_QUEUE_10G-40G-100G_IN class type queuing 8q2t-in-q1 queue-limit 10 bandwidth remaining percent 10 class type queuing 8q2t-in-q2 queue-limit 20 bandwidth remaining percent 30 class type queuing 8q2t-in-q6 queue-limit 10 bandwidth remaining percent 10 class type queuing 8q2t-in-q-default queue-limit percent 50 bandwidth percent 50 ! interface Ethernet1/1 service-policy type queuing input PM_QUEUE_10G-40G-100G_IN
Type:Queuing
All Policy-Map and Service-Policy are done in relevant Payload-VDC and only affect the interface to which they get applied
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Egress Queuing Configuration on M2 cardsExample (Payload-VDC)
114
Core policy-map type queuing PM_QUEUE_10G-40G-100G_OUT class type queuing 1p7q4t-out-pq1 priority level 1 queue-limit percent 10 class type queuing 1p7q4t-out-q2 queue-limit percent 20 bandwidth remaining percent 30 class type queuing 1p7q4t-out-q6 queue-limit percent 10 bandwidth remaining percent 20 class type queuing 1p7q4t-out-q-default queue-limit percent 50 bandwidth remaining percent 40 ! interface Ethernet1/1 service-policy type queuing output PM_QUEUE_10G-40G-100G_OUT
Type:Queuing
All Policy-Map and Service-Policy are done in relevant Payload-VDC and only affect the interface to which they get applied
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Network-QoS Configuration on F2/F3-Series
115
vpc peer-link
vpc peer-link vpc peer-link vpc peer-link
Use the network-qos policy for 8e-4q4q i.e 4 ingress
queues
Type:
Network-QoS
Core
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Network-QoS Configuration –F2/F3 cardsExample (Admin- / Default-VDC)
116
Core
system qos service-policy type network-qos default-nq-8e-4q4q-policy policy-map type network-qos default-nq-8e-4q4q-policy template 8e-4q4q class type network-qos c-nq-8e-4q4q match cos 0-7 congestion-control tail-drop mtu 1500
Type:
Network-qos
Admin-VDC
Admin-VDC
Changes apply to ALL ports of specified type in ALL VDCsChanges are traffic disruptive for ports of specified type
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Queuing (F2/F3 cards)
117
vpc peer-link
vpc peer-link vpc peer-link vpc peer-link
Modify CoS to Queue mapping in
Admin-/Default-VDC
Type:Queuing
Assign a ingress policy-map for buffer allocation, no ingress
scheduling
Core
Assign a egress policy-map to each interface with priority, bandwidth and
queue-limit to alter default queuing policy
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
CoS to Queue Mapping – F2/F3 I/O ModuleExample
118
Application CoSQueuing
(Scheduling)-egress
Queue-Limit(Buffer)-ingress
Queue(Ingress/Egress)
Character
Best Effort 0,1 BW remaining
50%50%
4q1t-8e-4q4q-in-q-default / 1p3q1t-8e-4q4q-out-q-default
High Volume / Less Important
vMotion / Live Migration
2BW remaining
20%10%
4q1t-8e-4q4q-in-q4 / 1p3q1t-8e-4q4q-out-q3
Medium Volume / Important
Multimedia 3, 4BW remaining
30%30%
4q1t-8e-4q4q-in-q3 / 1p3q1t-8e-4q4q-out-q2
Medium VolumeVery Important
Strict Priority 5
Priority Queue 10%4q1t-8e-4q4q-in-q1 /
1p3q1t-8e-4q4q-out-pq1
Low Volume / Important /
Delay Sensitive
Network Control 6/7Low Volume / Very important
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
CoS to Queue Configuration –F2/F3 slidesExample (Admin- / Default-VDC)
119
Coreclass-map type queuing match-any 4q1t-8e-4q4q-in-q1 match cos 5-7class-map type queuing match-any 4q1t-8e-4q4q-in-q-default match cos 0-1class-map type queuing match-any 4q1t-8e-4q4q-in-q3 match cos 3-4class-map type queuing match-any 4q1t-8e-4q4q-in-q4 match cos 2
class-map type queuing match-any 1p3q1t-8e-4q4q-out-pq1 match cos 5-7class-map type queuing match-any 1p3q1t-8e-4q4q-out-q2 match cos 3-4class-map type queuing match-any 1p3q1t-8e-4q4q-out-q3 match cos 2class-map type queuing match-any 1p3q1t-8e-4q4q-out-q-default match cos 0-1
Type:Queuing
Admin-VDC
Admin-VDC
Changes apply to ALL ports of specified type in ALL VDCsChanges are traffic disruptive for ports of specified type
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Ingress Queuing Configuration for F2/F3 cardsExample (Payload-VDC)
120
Coreqos copy policy-map type queuing default-8e-4q4q-in-policy prefix Custom-
policy-map type queuing Custom-8e-4q4q-in class type queuing 4q1t-8e-4q4q-in-q1 queue-limit percent 10 bandwidth percent 25 class type queuing 4q1t-8e-4q4q-in-q-default queue-limit percent 50 bandwidth percent 25 class type queuing 4q1t-8e-4q4q-in-q3 queue-limit percent 30 bandwidth percent 25 class type queuing 4q1t-8e-4q4q-in-q4 queue-limit percent 10 bandwidth percent 25
interface Ethernet1/1 service-policy type queuing input Custom-8e-4q4q-in
Type:Queuing
All Policy-Map and Service-Policy are done in relevant Payload-VDC and only affect the interface to which they get applied
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Egress Queuing Configuration for F2/F3 cards Example (Payload-VDC)
121
Core
qos copy policy-map type queuing default-8e-4q4q-out-policy prefix Custom-
policy-map type queuing Custom-8e-4q4q-out class type queuing 1p3q1t-8e-4q4q-out-pq1 priority level 1 class type queuing 1p3q1t-8e-4q4q-out-q2 bandwidth remaining percent 30 class type queuing 1p3q1t-8e-4q4q-out-q3 bandwidth remaining percent 20 class type queuing 1p3q1t-8e-4q4q-out-q-default bandwidth remaining percent 50 !
interface Ethernet1/1 service-policy type queuing output Custom-8e-4q4q-out
Type:Queuing
All Policy-Map and Service-Policy are done in relevant Payload-VDC and only affect the interface to which they get applied
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
CoS to Queue Mapping - Nexus 5600/6000Example
122
Application CoSQueuing
(Scheduling)Queue-Limit
(Buffer)Queue
(6q1t / 1p6q0t)Character
Best Effort 0,1BW percent
40%remaining(226kByte)
qos-group 0 (default)High Volume / Less Important
vMotion / Live Migration
2,3BW percent
20%41kByte qos-group 3
Medium Volume / Important
Multimedia 4BW percent
30%41kByte qos-group 4
Medium VolumeVery Important
Strict Priority 5BW percent
10%20kByte
(min)qos-group5 / priority
Low Volume / Important /
Delay Sensitive
Network Control 6,7Low Volume / Very important
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Egress Queuing Configuration: Nexus5600Example
123
Core class-map type queuing CM_Q_MATCH_QG3_COS2 match qos-group 3 class-map type queuing CM_Q_MATCH_QG4_COS4 match qos-group 4 class-map type queuing CM_Q_MATCH_QG5_COS5 match qos-group 5 ! policy-map type queuing PM_QUEUING_SYSTEM_OUT class type queuing CM_Q_MATCH_QG3_COS2 bandwidth percent 20 class type queuing CM_Q_MATCH_QG4_COS4 bandwidth percent 30 class type queuing CM_Q_MATCH_QG5_COS5 priority bandwidth percent 10 class type queuing class-default bandwidth percent 40
Type:Queuing
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Queue-Limit (Buffer) ConfigurationExample
124
Core policy-map type network-qos PM_N-QOS_SYSTEM class type network-qos CM_N-QOS_MATCH_QG3_COS2 set cos 2 queue-limit 40960 bytes class type network-qos CM_N-QOS_MATCH_QG4_COS4 set cos 4 queue-limit 40960 bytes class type network-qos CM_N-QOS_MATCH_QG5_COS5 set cos 5 queue-limit 20480 bytes class type network-qos class-default
system qos service-policy type network-qos PM_N-QOS_SYSTEM
Type:
Network-QoS
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Queuing: Nexus 2000
125
vpc peer-link
vpc peer-link vpc peer-link vpc peer-link
Type:Queuing
Queuing on NIF controlled by Fabric
Interface INPUT policy
Core
Queuing on NIF (multiple no-drop queues) only
available with CoS based marking on HIF
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Queuing Configuration (Nexus 2000)Example
126
Core class-map type queuing CM_Q_MATCH_QG3_COS2 match qos-group 3 class-map type queuing CM_Q_MATCH_QG4_COS4 match qos-group 4 class-map type queuing CM_Q_MATCH_QG5_COS5 match qos-group 5 ! policy-map type queuing PM_QUEUING_SYSTEM_N2K class type queuing CM_Q_MATCH_QG3_COS2 bandwidth percent 20 class type queuing CM_Q_MATCH_QG4_COS4 bandwidth percent 30 class type queuing CM_Q_MATCH_QG5_COS5 priority bandwidth percent 10 class type queuing class-default bandwidth percent 40
Type:Queuing
Amount of Queues depend on FEX (Nexus 2000) Model
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation ID
Agenda• Introduction
• QoS and Queuing Basics
• QoS Implementation on Nexus
• Nexus 7000/7700 QoS
• Nexus 5600/6000 QoS
• Nexus 2000 QoS
• Real World Configuration Examples
• Conclusion
127
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation ID 128
Conclusion
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Why QoS in the Data Center?
129
Assign Color to Traffic
Maximize Throughput
ManageCongestion
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346 130
Maximize Throughput and Manage Congestion!
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346 157
Participate in the “My Favorite Speaker” Contest
• Promote your favorite speaker through Twitter and you could win $200 of Cisco Press products (@CiscoPress)
• Send a tweet and include • Your favorite speaker’s Twitter handle <Speaker—enter your Twitter handle here>• Two hashtags: #CLUS #MyFavoriteSpeaker
• You can submit an entry for more than one of your “favorite” speakers
• Don’t forget to follow @CiscoLive and @CiscoPress
• View the official rules at http://bit.ly/CLUSwin
Promote Your Favorite Speaker and You Could Be a Winner
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346
Complete Your Online Session Evaluation
Don’t forget: Cisco Live sessions will be available for viewing on-demand after the event at CiscoLive.com/Online
• Give us your feedback to be entered into a Daily Survey Drawing. A daily winner will receive a $750 Amazon gift card.
• Complete your session surveys though the Cisco Live mobile app or your computer on Cisco Live Connect.
158
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346 159
Continue Your Education• Demos in the Cisco campus
• Walk-in Self-Paced Labs
• Table Topics
• Meet the Engineer 1:1 meetings
• Related sessions
Thank you
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation ID 160
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346 162
Internet of Things (IoT) Cisco Education OfferingsCourse Description Cisco Certification
NEW! CCNA Industrial An associate level instructor led training course designed to prepare you for the CCNA Industrial certification
CCNA® Industrial
Managing Industrial Networks with Cisco Networking Technologies (IMINS)
This curriculum addresses foundational skills needed to manage and administer networked industrial control systems. It provides plant administrators, control system engineers and traditional network engineers with an understanding of the networking technologies needed in today's connected plants and enterprises
Cisco Industrial Networking Specialist
Control Systems Fundamentals for Industrial Networking (ICINS)
For IT and Network Engineers, covers basic concepts in Industrial Control systems including an introduction to automation industry verticals, automation environment and an overview of industrial control networks
Networking Fundamentals for Industrial Control Systems (INICS)
For Industrial Engineers and Control System Technicians, covers basic IP and networking concepts, and introductory overview of Automation industry Protocols.
For more details, please visit: http://learningnetwork.cisco.comQuestions? Visit the Learning@Cisco Booth or contact [email protected]
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346 163
Business Transformation Cisco Education OfferingsCourse Description Cisco Certification
For IT and Network Professionals:
Building Business Specialist Skills • Builds non-technical skills key to ensure business impact and influence. Topics include: business analysis, finance, technology adoption and effective communications.
• Bridges IT and business impacts of mature and emerging solutions including cloud plus Internet of Everything
Cisco Enterprise IT Business Specialist
For Technology Sellers:
Applying Cisco Specialized Business Value Analysis Skills
Builds skills to discover and address technology needs using a business-focused, consultative sales approach
Cisco Business Value Specialist
Executing Advanced Cisco Business Value Analysis and Design Techniques
Enables customer transformation through business architecture and solution selling expertise
Cisco Certified Business Value Practitioner
Performing Cisco Business-Focused Transformative Architecture Engagements
Provides skills and an approach to build a strategic roadmap of IT initiatives, aligned to business priorities
Cisco Transformative Architecture Specialist
For more details, please visit: http://learningnetwork.cisco.comQuestions? Visit the Learning@Cisco Booth or contact [email protected]
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346 164
Security Cisco Education OfferingsCourse Description Cisco Certification
Implementing Cisco IOS Network Security (IINS)
Implementing Cisco Edge Network Security Solutions (SENSS)
Implementing Cisco Threat Control Solutions (SITCS)
Implementing Cisco Secure Access Solutions (SISAS)
Implementing Cisco Secure Mobility Solutions (SIMOS)
Focuses on the design, implementation, and monitoring of a comprehensive security policy, using Cisco IOS security features
Configure Cisco perimeter edge security solutions utilizing Cisco Switches, Cisco Routers, and Cisco Adaptive Security Appliance (ASA) Firewalls
Deploy Cisco’s Next Generation Firewall (NGFW) as well as Web Security, Email Security and Cloud Web Security
Deploy Cisco’s Identity Services Engine and 802.1X secure network access
Protect data traversing a public or shared infrastructure such as the Internet by implementing and maintaining Cisco VPN solutions
CCNA® Security
Securing Cisco Networks with Threat Detection and Analysis (SCYBER)
Designed for professional security analysts, the course covers essential areas of competency including event monitoring, security event/alarm/traffic analysis, and incident response
Cisco Cybersecurity Specialist
Network Security Product and Solutions Training For official product training on Cisco’s latest security products, including Adaptive Security Appliances, NGIPS, Advanced Malware Protection, Identity Services Engine, Email and Web Security Appliances see www.cisco.com/go/securitytraining
For more details, please visit: http://learningnetwork.cisco.comQuestions? Visit the Learning@Cisco Booth or contact [email protected]
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346 165
R&S Related Cisco Education OfferingsCourse Description Cisco Certification
CCIE R&S Advanced Workshops (CIERS-1 & CIERS-2) plus Self Assessments, Workbooks & Labs
Expert level trainings including: instructor led workshops, self assessments, practice labs and CCIE Lab Builder to prepare candidates for the CCIE R&S practical exam.
CCIE® Routing & Switching
• Implementing Cisco IP Routing v2.0• Implementing Cisco IP Switched
Networks V2.0• Troubleshooting and Maintaining
Cisco IP Networks v2.0
Professional level instructor led trainings to prepare candidates for the CCNP R&S exams (ROUTE, SWITCH and TSHOOT). Also available in self study eLearning formats with Cisco Learning Labs.
CCNP® Routing & Switching
Interconnecting Cisco Networking Devices: Part 2 (or combined)
Configure, implement and troubleshoot local and wide-area IPv4 and IPv6 networks. Also available in self study eLearning format with Cisco Learning Lab.
CCNA® Routing & Switching
Interconnecting Cisco Networking Devices: Part 1
Installation, configuration, and basic support of a branch network. Also available in self study eLearning format with Cisco Learning Lab.
CCENT® Routing & Switching
For more details, please visit: http://learningnetwork.cisco.comQuestions? Visit the Learning@Cisco Booth or contact [email protected]
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346 166
Wireless Cisco Education OfferingsCourse Description Cisco Certification
• Conducting Cisco Unified Wireless Site Survey
• Implementing Cisco Unified Wireless Voice Networks
• Implementing Cisco Unified Wireless Mobility Services
• Implementing Cisco Unified Wireless Security Services
Professional level instructor led trainings to prepare candidates to conduct site surveys, implement, configure and support APs and controllers in converged Enterprise networks. Focused on 802.11 and related technologies to deploy voice networks, mobility services, and wireless security.
CCNP® Wireless
Implementing Cisco Unified Wireless Network Essential
Prepares candidates to design, install, configure, monitor and conduct basic troubleshooting tasks of a Cisco WLAN in Enterprise installations.
CCNA® Wireless
For more details, please visit: http://learningnetwork.cisco.comQuestions? Visit the Learning@Cisco Booth or contact [email protected]
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346 167
Design Cisco Education OfferingsCourse Description Cisco Certification
Designing Cisco Network Service Architectures (ARCH)
Provides learner with the ability to perform conceptual, intermediate, and detailed design of a network infrastructure that supports desired capacity, performance, availability required for converged Enterprise network services and applications.
CCDP® (Design Professional)
Designing for Cisco Internetwork Solutions (DESGN)
Instructor led training focused on fundamental design methodologies used to determine requirements for network performance, security, voice, and wireless solutions. Prepares candidates for the CCDA certification exam.
CCDA® (Design Associate)
For more details, please visit: http://learningnetwork.cisco.comQuestions? Visit the Learning@Cisco Booth or contact [email protected]
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346 168
Service Provider Cisco Education OfferingsCourse Description Cisco Certification
Deploying Cisco Service Provider Network Routing (SPROUTE) & Advanced (SPADVROUTE) Implementing Cisco Service Provider Next-Generation Core Network Services (SPCORE) Edge Network Services (SPEDGE)
SPROUTE covers the implementation of routing protocols (OSPF, IS-IS, BGP), route manipulations, and HA routing features; SPADVROUTE covers advanced routing topics in BGP, multicast services including PIM-SM, and IPv6;
SPCORE covers network services, including MPLS-LDP, MPLS traffic engineering, QoS mechanisms, and transport technologies;
SPEDGE covers network services, including MPLS Layer 3 VPNs, Layer 2 VPNs, and Carrier Ethernet services; all within SP IP NGN environments.
CCNP Service Provider®
Building Cisco Service Provider Next-Generation Networks, Part 1&2 (SPNGN1), (SPNGN2)
The two courses introduce networking technologies and solutions, including OSI and TCP/IP models, IPv4/v6, switching, routing, transport types, security, network management, and Cisco OS (IOS and IOS XR).
CCNA Service Provider®
Implementing Cisco Service Provider Mobility UMTS Networks (SPUMTS);Implementing Cisco Service Provider Mobility CDMA Networks (SPCDMA);Implementing Cisco Service Provider Mobility LTE Networks (SPLTE)
The three courses (SPUMTS, SPCDMA, SPLTE) cover knowledge and skills required to understand products, technologies, and architectures that are found in Universal Mobile Telecommunications Systems (UMTS) and Code Division Multiple Access (CDMA) packet core networks, plus their migration to Long-Term Evolution (LTE) Evolved Packet Systems (EPS), including Evolved Packet Core (EPC) and Radio Access Networks (RANs).
Cisco Service Provider Mobility CDMA to LTE Specialist;Cisco Service Provider Mobility UMTS to LTE Specialist
Implementing and Maintaining Cisco Technologies Using IOS XR (IMTXR)
Service Provider/Enterprise engineers to implement, verification-test, and optimize core/edge technologies in a Cisco IOS XR environment.
Cisco IOS XR Specialist
For more details, please visit: http://learningnetwork.cisco.comQuestions? Visit the Learning@Cisco Booth or contact [email protected]
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346 169
Collaboration Cisco Education OfferingsCourse Description Cisco Certification
CCIE Collaboration Advanced Workshop (CIEC) Gain expert-level skills to integrate, configure, and troubleshoot complex collaboration networks
CCIE® Collaboration
Implementing Cisco Collaboration Applications (CAPPS)
Understand how to implement the full suite of Cisco collaboration applications including Jabber, Cisco Unified IM and Presence, and Cisco Unity Connection.
CCNP® Collaboration
Implementing Cisco IP Telephony and Video Part 1 (CIPTV1)
Implementing Cisco IP Telephony and Video Part 2 (CIPTV2)
Troubleshooting Cisco IP Telephony and Video (CTCOLLAB)
Learn how to implement Cisco Unified Communications Manager, CUBE, and audio and videoconferences in a single-site voice and video network.
Obtain the skills to implement Cisco Unified Communications Manager in a modern, multisite collaboration environment.
Troubleshoot complex integrated voice and video infrastructures
CCNP® Collaboration
Implementing Cisco Collaboration Devices (CICD)
Implementing Cisco Video Network Devices (CIVND)
Acquire a basic understanding of collaboration technologies like Cisco Call Manager and Cisco Unified Communications Manager.
Learn how to evaluate requirements for video deployments, and implement Cisco Collaboration endpoints in converged Cisco infrastructures.
CCNA® Collaboration
For more details, please visit: http://learningnetwork.cisco.comQuestions? Visit the Learning@Cisco Booth or contact [email protected]
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346 170
Data Center / Virtualization Cisco Education OfferingsCourse Description Cisco Certification
Cisco Data Center CCIE Unified Fabric Workshop (DCXUF); Cisco Data Center CCIE Unified Computing Workshop (DCXUC)
Prepare for your CCIE Data Center practical exam with hands on lab exercises running on a dedicated comprehensive topology
CCIE® Data Center
Implementing Cisco Data Center Unified Fabric (DCUFI);Implementing Cisco Data Center Unified Computing (DCUCI)
Obtain the skills to deploy complex virtualized Data Center Fabric and Computing environments with Nexus and Cisco UCS.
CCNP® Data Center
Introducing Cisco Data Center Networking (DCICN); Introducing Cisco Data Center Technologies (DCICT)
Learn basic data center technologies and how to build a data center infrastructure.
CCNA® Data Center
Product Training Portfolio: DCAC9k, DCINX9k, DCMDS, DCUCS, DCNX1K, DCNX5K, DCNX7K
Get a deep understanding of the Cisco data center product line including the Cisco Nexus9K in ACI and NexusOS modes
For more details, please visit: http://learningnetwork.cisco.comQuestions? Visit the Learning@Cisco Booth or contact [email protected]
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346 171
Network Programmability Cisco Education OfferingsCourse Description Cisco Certification
Integrating Business Applications with Network Programmability (NIPBA);Integrating Business Applications with Network Programmability for Cisco ACI (NPIBAACI)
Learn networking concepts, and how to deploy and troubleshoot programmable network architectures with these self-paced courses.
Cisco Business Application Engineer Specialist Certification
Developing with Cisco Network Programmability (NPDEV); Developing with Cisco Network Programmability for Cisco ACI (NPDEVACI)
Learn how to build applications for network environments and effectively bridge the gap between IT professionals and software developers.
Cisco Network Programmability Developer Specialist Certification
Designing with Cisco Network Programmability (NPDES); Designing with Cisco Network Programmability for Cisco ACI (NPDESACI)
Learn how to expand your skill set from traditional IT infrastructure to application integration through programmability.
Cisco Network Programmability Design Specialist Certification
Implementing Cisco Network Programmability (NPENG); Implementing Cisco Network Programmability for Cisco ACI (NPENGACI)
Learn how to implement and troubleshoot open IT infrastructure technologies.
Cisco Network Programmability Engineer Specialist Certification
For more details, please visit: http://learningnetwork.cisco.comQuestions? Visit the Learning@Cisco Booth or contact [email protected]
© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-3346 172
Cloud Cisco Education OfferingsCourse Description Cisco Certification
Designing the FlexPod Solution (FPDESIGN); Implementing and Administering the FlexPod Solution (FPIMPADM)
Learn how to design, implement and administer FlexPod solutions FlexPod Design Specialist; FlexPod Implementation & Administration Specialist
UCS Director (UCSDF) Learn how to manage physical and virtual infrastructure using orchestration and automation functions of UCS Director.
Cisco Prime Service Catalog Learn how to deliver data center, workplace, and application services in an on-demand, automated, and repeatable method.
Cisco Intercloud Fabric Learn how to implement end-to-end hybrid clouds with Intercloud Fabric for Business and Intercloud Fabric for Providers.
Cisco Intelligent Automation for Cloud Learn how to implement and manage cloud deployments with Cisco Intelligent Automation for Cloud
For more details, please visit: http://learningnetwork.cisco.comQuestions? Visit the Learning@Cisco Booth or contact [email protected]