Upload
thanh-hung-quach
View
241
Download
1
Embed Size (px)
DESCRIPTION
Cisco ASR 9000 Platform Architechure
Citation preview
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external no softcopy)lwigley Viking 81
Lane Wigley ([email protected])Service Provider Group Technical Marketing Engineering
ASR 9000 Quick Start
Platform Architecture
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 82
ASR 9000 IntroductionEthernet Optimized Aggregation Routers
6 and 10 slot chassis
40 & 80 Gbps line cards
Path to 400 Gbps LCs w/o forklift
Highly Available Hardware
IOS XR Operating System
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 83
Platform Architecture Agenda
Chassis
Route Switch Processor
Line Cards
Switch Fabric
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 84
ASR 9000 - 10 Slot Chassis1/2 Rack 8 Line Cards
Power Power PowerPower Power Power
FansFans
Fabric
Fabric
Fabric
RSP0
RSP18xTenGE(4:3 Oversub)
4xTenGE
40xGE
SIP-700
8xTenGE
16xTenGE(4:3 Oversub)
LineCards
20xGE +2xTenGE
Fabric
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 85
ASR 9000 - 6 Slot Chassis 1/4 Rack 4 Line Cards
Power Power Power
Fans
FabricFabric
FabricFabric
RSP0
RSP1
LineCards
LineCards
LineCards
LineCards
Fans
Rear view showing exhaustand AC power connections
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 86
ASR 9010 Power and Cooling
Power Power PowerPower Power Power
FansFans
Fabric
Fabric
Fabric
Fabric
RSP0
RSP18xTenGE(Oversub)
4xTenGE
40xGE
20GSIP-700
20xGE +2xTenGE8xTenGELine Rate
LineCards
FutureLCs
2.1 kW
2.1 kW
3 kW
DC Supplies
AC Supplies
AB
AB
3 kW
A
B
Fans unique to chassisVariable speed for:
Ambient temperature variationRedundancy
6 & 10 slot use same power suppliesAny supply can power any card
Power draw shared evenlyPlan for both power feed and PS redundancy
1.5kW DC supply also availableAllows reduced breaker rating
AC is 220V Single PhasePower & Fans will support 400G cards
ASR 9010
ASR 9010 Fan Tray
Power Supply
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 87
ASR 9006 Power and Cooling
2.1 kW
2.1 kW
3 kW
DC Supplies
AC Supplies
AB
AB
3 kW
A
B
Power Power Power
Fans
FabricFabric
FabricFabric
RSP0
RSP1
LineCards
LineCards
LineCards
LineCards
Fans
ASR 9006
Fans unique to chassisVariable speed for:
Ambient temperature variationRedundancy
Modular Power Architecture (9006 & 9010)Number of Power Supplies based on
Number of line cardsType of line cardsPower redundancy requirements
Base system is ~1500W40G LCs are max 375W80G Line Rate LC is max 765WTools available for power planning
ASR 9006 Fan Tray
Power Supply
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 88
Path to 400 GbpsInfrastructure designed to support 400 Gbps
Chassis 400G Ready
Power Supplies 400G Ready
Cooling 400G Ready
Fabric RSP3 required
40/80G Line Cards Work in 400G System
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 89
Route Switch Processor
Dual core PowerPC CPU w/ 4GB memory
RP is logically separate from fabric but physically on same board
Main Memory4 GB
Fabric 0
Fabric 1
Fabric 0
Fabric 1
RSP1
Mgmt Eth
Mgmt Eth
Console
Aux
Flash
Hard Drive
Flash
Flash
NVRAM
FabricInterface
ASIC
ControlEthernetSwitch
RSP0
Performs control plane functionsRoutingCreating forwarding tablesNetwork management
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 90
ASR 9000Line Card Architecture
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 91
Line Card Architecture - Big PictureHigh Level Packet Flow
Network Processors perform lookups and features on Ingress and Egress
FabricInterface
ASIC
Network Processor 0PHY
NP2PHY
NP3PHY
BRIDGENP1PHY
BRIDGE
Fabric 0
Fabric 1
Fabric 0
Fabric 1
RSP0
RSP1FabricInterface
ASIC
NP0PHY
NP2PHY
NP3PHY
BRIDGENP1PHY
BRIDGE
All traffic passes through switch fabric
Ingress CEF, ACL, QoS, & Stats
Egress CEF, ACL, QoS, & Stats
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 92
40G Line Card Family
FIA
NP0PHY 3
NP2PHY 1
NP3PHY 0
NP1PHY 2
FIA
NP0PHY 3
NP2
NP3
NP1
PHY 7
PHY 2PHY 6
PHY 1PHY 5
PHY 0PHY 4
FIA
NP0
NP2
NP3
NP1
FIA
NP0PHY
NP2
NP3
NP1PHY
Oversubscribed 8xTenGE
4xTenGE 2xTenGE + 20xGE
40xGE
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 93
80G Line Rate & 160G OS Line Cards
FabricInterface
ASICPHY
PHY
PHY
PHY
PHY
PHY
PHY
FabricInterface
ASIC
NP2
NP1
NP0
NP6
NP5
NP4
NP7
NP3PHY
Line Rate 8xTenGE
FabricInterface
ASIC
FabricInterface
ASIC
NP2
NP1
NP0
NP6
NP5
NP4
NP7
NP3
Oversubscribed 16xTenGE
PHYPHY
PHYPHY
PHYPHY
PHYPHY
PHYPHY
PHYPHY
PHYPHY
PHYPHY
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 94
20G SPA Carrier High Touch Line Card
FIA
NPEgress
NPIngress
New High Touch NP for additional feature capabilitiesNPs mapped to Ingress & Egress (vs. per port)
SPA
SPA
SPA
SPA
SPAMgr
SPAMgr
20G SPA Carrier (XR 4.0)
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 95
Line Card Scale Options
Line Card High Medium Low40xGE All SW All SW 3.94xTenGE All SW All SW 3.98xTenGE Oversubscribed All SW All SW 3.92xTenGE+20xGE 3.9 3.9 Future8xTenGE Line Rate 3.9 Future 3.916xTenGE Oversubscribed Future 3.9.1 Future20G SPA Carrier Future
Software support for line cards
3 options for line card scalability
High (-E), Medium (-B), & Low (-L) Queue CardsDifferent LC hardware not sw license
High queue cards have additional memory
Details in QoS Architecture presentation Low
Medium
High
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 96
Line Card Family Photo
8xTenGE4xTenGE 2xTenGE+ 20xGE40xGE 16xTenGE
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 97
Optics
TenGE XFP OpticsLR, ZR, & ER
GE - SFP OpticsT, S, L, & Z
Standard, CWDM, & DWDM XFPs/SFPs available
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 98
ASR 9000Switch Fabric
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 99
Switch Fabric Data Plane
NP PHY
NP PHY
NP PHY
NP PHY
FIANP PHY
NP PHY
NP PHY
NP PHY
FIANP PHY
NP PHY
NP PHY
NP PHY
FIA
FIA
FIA RP0
RP1
NPPHY
NPPHY
NPPHY
NPPHY
FIANPPHY
NPPHY
NPPHY
NPPHY
FIANPPHY
NPPHY
NPPHY
NPPHY
FIANPPHY
NPPHY
NPPHY
NPPHYFIA
FIARP0
RP1
RSP0
SFA0
SFA1
RSP1
SFA0
SFA1
LCs & RPs have FabricInterface ASICs (FIA)
80G Line Rate Cardshave 2 FIAs
2 Fabric planes x2 SFAs per plane = 4 SFAs4 x 23 = 92 Gbps in/out per FIA
Switch Fabric ASIC provides crossbar23 Gbps data path
FIA
FIA
FIA
SFANP
NP
NP
NP
PHY
PHY
PHY
PHY
Ingress Egress (same card as left side)
FIA
FIA
FIA
FIA
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 100
Switch Fabric Control Plane
NP PHY
NP PHY
NP PHY
NP PHY
FIANP PHY
NP PHY
NP PHY
NP PHY
FIANP PHY
NP PHY
NP PHY
NP PHY
FIA
FIA
FIA RP0
RP1
NPPHY
NPPHY
NPPHY
NPPHY
FIANPPHY
NPPHY
NPPHY
NPPHY
FIANPPHY
NPPHY
NPPHY
NPPHY
FIA
FIA
FIARP0
RP1
RSP0
Arbiter
RSP1
Arbiter
NPPHY
NPPHY
NPPHY
NPPHY
NP
NP
NP
NP
PHY
PHY
PHY
PHY
SFA0
SFA1
SFA0
SFA1
Each fabric planehas 1 Arbiter
Arbiter fairly allocates fabricBandwidth to and from each NP
ArbiterFIA
FIA
FIA
FIA
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 101
FIANP PHY
NP PHY
NP PHY
NP PHY
FIANP PHY
NP PHY
NP PHY
NP PHY
FIANP PHY
NP PHY
NP PHY
NP PHY
FIA
FIA
FIA RP0
FIA RP1
FIANPPHY
NPPHY
NPPHY
NPPHY
FIANPPHY
NPPHY
NPPHY
NPPHY
FIANPPHY
NPPHY
NPPHY
NPPHY
FIA
FIA
FIARP0
FIARP1
RSP0
Arbiter
RSP1
Arbiter
NPPHY
NPPHY
NPPHY
NPPHY
NP
NP
NP
NP
PHY
PHY
PHY
PHY
SFA0
SFA1
SFA0
SFA1
Data plane providesActive/Active redundancy
Control Plane providesActive/Standby redundancy
Both Arbiters work in parallel both answer all requestsFIAs follow active ArbiterFIAs switch to backup if needed
Both planes and all 4 SFAsare used under normal operation
All available paths are used under failure conditions
SFA
Arbiter Arbiter
SFA
SFA
SFASwitch Fabric Redundancy
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 102
Switch Fabric Multicast
NP PHY
NP PHY
NP PHY
NP PHY
FIANP PHY
NP PHY
NP PHY
NP PHY
FIANP PHY
NP PHY
NP PHY
NP PHY
FIA
FIA
FIA RP0
RP1
NPPHY
NPPHY
NPPHY
NPPHY
FIANPPHY
NPPHY
NPPHY
NPPHY
FIANPPHY
NPPHY
NPPHY
NPPHY
FIA
FIA
FIARP0
RP1
RSP0
Arbiter
RSP1
Arbiter
NPPHY
NPPHY
NPPHY
NPPHY
NP
NP
NP
NP
PHY
PHY
PHY
PHY
SFA0
SFA1
SFA0
SFA1
Fabric supports multicast replication
Multicast packets queued andscheduled separately
Additional replication performed byegress LC (FIAs & NPs)
Fabric Group IDs (FGIDs) areprogrammed into fabric by controlplane
FGIDs provide a set of egress NPsfor each multicast group
FIA
FIA
FIA
FIA
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 103
ASR 9000 Platform Strengths
Optimized Aggregation Routers
Best in Class Infrastructure400G LC Ready
Flexible Forwarding Architecture
Advanced Switch Fabric
Flexible Optics options
© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 104