Cisco Confidential © 2010 Cisco and/or its affiliates. All rights reserved. 1
Cisco Catalyst Instant Access
Jaromír Pilař, Consulting Systems Engineer CCIE #2910
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2
Catalyst 3850
Catalyst 2960-X
Catalyst 3650
Catalyst 4500
Sup8-E
Catalyst 6800 &
Catalyst Instant Access
Cisco Prime Infrastructure
Cisco Identity Services Engine
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 4
• Focus on reducing complexity in the Campus LAN Simplified Ordering Simplified Configuration Simplified Management
• Reduced number of touch points (reduced OPEX!) Treated as one device for the distribution and access layer One device for configuration and image upgrade Consistent CLI across the distribution and access layer
• Investment Protection – Can leverage existing 6500 distribution deployment
For more details see whitepaper at http://www.cisco.com/en/US/prod/collateral/switches/ps10902/ps715/ps13198/white_paper_c11-728265.html
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 5
• Distribution Pair of 6500/6807 with Sup2T or 6880 in VSS Mode • Requires 6904 Line card with 4X Adapter and SFP+ • Requires IP Services License or greater • Minimal Parent configuration single 6500 in VSS mode
• 10G Fabric Links • Can be SR, LR, LRM, ER, Twinax • Up to 60G MEC between Client stack and Parent • 1G mode supported as well but not recommended
• Catalyst 6848ia Client Switches • 6848ia supports Stacking up to 3 clients in Phase 1 • 144 ports per stack in Phase 1
• Can Support Switches off of the Client Ports • These would be treated as standalone switches, not managed by 6500 • No support for cascaded IA Clients
Instant Access Parent
Instant Access Clients
6848ia
6848ia
6848ia
Fabric Links
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 6
• Two available SKUs: 48p of 10/100/1000 Ethernet with PoE+ and 2 x 10GbE SFP+ Uplink Ports 48p of 10/100/1000 Ethernet (non-PoE) and 2 x 10GbE SFP+ Uplink Ports
• Stackable up to 3 clients in Phase 1
• 80G Bidirectional Stack Bandwidth
• Includes Stack Module, no licensing required
• Single Fixed Power Supply and Fixed Fans
• All ports 802.3at capable. PSU capable of 30W on 24 ports/15.4W on all 48 Ports
• Operates in Client Mode ONLY (no local switching – traffic between local ports goes through parent switch), not convertible to standalone switch
Shipping
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 7
IA client dual homed to VSS Pair
SiSi SiSi
IA client dual homed to VSS Pair across stack members
SiSi SiSi
Up to 6 uplinks (60G) MEC from client to parent
SiSi SiSi
Recommended Design
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 8
SiSi SiSi
IA client single homed with up to 6 links in MEC across stack members
SiSi SiSi
IA client single homed to VSS pair
Possible but “Not Recommended”
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 9
SiSi
IA client single homed to single switch in VSS mode
SiSi
IA client dual homed to single switch in VSS mode
SiSi
Up to 6 links in MEC single homed to single switch in VSS mode
Possible but “Not Recommended”
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 10
Maximum Client Switch User Ports
1008
Maximum Client Switch ID’s 12 Maximum Client Switches 21 Maximum Clients in Stack 3 Maximum User Ports in Stack 144
Client Switch ID is a single client or a stack. If using individual clients max of
12 clients supported.
In order to reach this number, you must use stacks
# of IDFs
# of Ports/IDF
# of Clients in a Stack
# of Access Ports
7 144 3 1008 10 96 2 960 12 48 0 576
Most cost effective where IDF has 96 ports or greater
Single Client IDF’s (no stacking) support fewer overall ports
Sample Configurations
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 11
12 Individual Clients – No Stacks
Client Node IDs: 12 Total Clients: 12 User Ports: 576
VSS
VSS
Client Node IDs: 7 Total Clients: 21 User Ports: 1008
7 Stacks of 3 Clients
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 12
DA[6] SA[6] VNTAG[6] 802.1Q[4] Frame Payload …. CRC[4]
VNTAG ETHER TYPE (0X8926) D[1] P[1] DVIF [12] L[1] R[1] R[1] R[1] SVIF[12]
Destination bit
Pointer bit (multicast)
Destination VIF Source VIF
Loopback bit Reserved
Unicast D=1 Unicast to FEX Host Port
Multicast P=1 Pointer to Multicast Table on FEX Client
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 13
IF1 IF2
F102/2 F102/1
SiSiSiSi
(VIF1) (VIF2)
<Interface-type>/<fex-id>/<module>/<submode>/<port>
interface GigabitEthernet 102/1/0/1
FEX ID 101-199 Stack Sub Module FEX Port
Controller
IA
Hosts Host-1 Host-2
VSS
FEX 102
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 14
CFEX1#conf t Enter configuration commands, one per line. End with CNTL/Z. CFEX1(config)#int GigabitEthernet 102/1/0/1 CFEX1(config-if)#switchport CFEX1(config-if)#switchport mode access CFEX1(config-if)#switchport access vlan 2
L2, L3 Features of Cat6k at Access.
CFEX1(config-if)#int gig 102/1/0/2 CFEX1(config-if)#ip address 1.1.1.1 255.255.255.0 CFEX1(config-if)#mpls ip
MPLS IP at Campus FEX
CFEX1(config-if)#int gig 102/1/0/3 CFEX1(config-if)#xconnect 10.10.10.2 100 encapsulation mpls
EoMPLS/VPLS/AVPLS from Campus FEX Port
• All configuration tasks performed at parent switch • Functionality inherited at IA client ports
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 15
Core
Building 1 Building 2 Building 3 Building 4
NO Routing Protocols or Spanning-Tree configuration between Access and Distribution
NO Configuration or Image Management at Access Switches
5 Total Devices for Image and Configuration Management Automated Trunk Configuration 4032 User Ports Considerations: STP Loop Prevention FHRP Tuning CAM/ARP Tunings PIM Tuning/DR priority Routing Protocol Tuning Dual Active Detection Method 5 Separate Configurations of SNMP, NTP, TACACS, Banner, vty, VLAN DB, Mgmt IP/GW, Hostname,
VSS
VSS VSS VSS VSS
NO Trunks to Configure from Access to Distribution
Combines the benefits of Collapsed Control Plane and Reduction of Devices to Manage
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 16
Common Access Features IA FCS Support Notes
NAC/802.1x/SGT/SGACL *See whitepaper for 802.1x/SGT details
Downloadable ACLs
VRF assignment
QoS (ingress classifier, and egress queuing policy) Ingress classification happens at parent, CoS trusted on fabric link. Static egress Queue policy at client
Netflow/Flexible Netflow
Data/voice VLANs for IP Phone deployments
Private VLANs
BPDUGuard
Bridge Assurance Edge or Portfast
DHCP relay
Security features: IP Source Guard, DHCP snooping, DAI etc
For more information look into whitepaper at http://www.cisco.com/en/US/prod/collateral/switches/ps10902/ps715/ps13198/white_paper_c11-728265.html
1. Switch Discovery Protocol (SDP) • Fabric Link Discovery
switchport mode fex-fabric • Switch Discovery
fex associate <FEX-ID> • EtherChannel Link Aggregation
2. Switch Registration Protocol (SRP) • Exchange Compatibility information • IA Client Registration
IA Client image management IA Client OIR
• Stack Member Identification & mgmt 3. Switch Configuration Protocol
• Configuration • Status • Statistics
4. Inter Card Communication (ICC) for Syslog, QoS, Remote login.
Instant Access Parent
2
Client ID Image Check
VIF ID
2
1
1 1
3
Configuration Interface Stats
3
Remote Login Syslog QoS
4
4
“No User Configuration” All Happens in background Instantly
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 19
• SDP : Switch Discovery Protocol ü The first protocol to send Hello’s (keep alive) and establish communication between Parent Switch and Client Switch ü Is a link based protocol, runs on every link between Controller and FEX. ü Communicates all attributes to/from each IA Client (Client ID, VIFs, SKU…)
• SRP : Switch Registration Protocol ü Completes the OIR and registration of IA Client on a Parent Switch.
• SCP : Switch Configuration Protocol ü Configuration and management protocol established between Parent and IA Client Switch. ü Lightweight L2 based protocol.
• ICC : Inter Card Communication ü Protocol for heavyweight features running over Cisco IPC.
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 20
Instant Access Parent
• IA Control Plane • IA Client VIF association • VNTAG Assignment
• IA Data Plane • MAC Learning and Switching • L2 & L3 Features
IA Client Switch
• VNTAG Encapsulation • QoS
Instant Access Parent
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 21
TAG FEX Interface VIF1 IF1
VIF2 IF2
Ingress Mapping IA Parent
IA client
Hosts
Host-1 Host-2
Switch-3
VSS
IF1 IF2
F101
TAG: Virtual NIC Tag VIF – Virtual Interface
(VIF1) (VIF2)
• Automatically assigned • One VIF to each host port • One VIF to each Etherchannel • One VIF to FEX CPU for Control Channel • FEX Controller VIF = 0 • Multicast: Pointer to Replication Table in FEX
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 22
IA Parent
IA Client
Hosts
Host-1 Host-2
Switch-3
VSS
IF1 IF2
F101
VNTAG: Virtual NIC Tag VIF – Virtual Interface
(VIF1) (VIF2)
MAC + Payload
VNTAG SVIF = VIF1 DVIF = 0
MAC + Payload
MAC + Payload
VNTAG SVIF = VIF1 DVIF = 0
MAC + Payload
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 23
IA Parent
IA Client
Hosts
Host-1 Host-2
Switch-3
VSS
IF1 IF2
F101
VNTAG: Virtual NIC Tag VIF – Virtual Interface
(VIF1) (VIF2)
MAC + Payload
VNTAG SVIF = 0, DVIF = VIF1
MAC + Payload
MAC + Payload
VNTAG SVIF = 0, DVIF = VIF1
MAC + Payload
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 24
Host-1 MAC1
Host-2 MAC2
Switch-3
VSS
IF2
F101
VNTAG: Virtual NIC Tag
(VIF2)
SA=MAC1, DA=MAC2+ Payload
IF1 (VIF1)
SA=MAC1, DA=MAC2+ Payload
VNTAG SVIF = 0, DVIF = VIF2
SA=MAC1, DA=MAC2+ Payload
VNTAG SVIF = 0, DVIF = VIF2
SA=MAC1, DA=MAC2+ Payload
SA=MAC1, DA=MAC2+ Payload
SA=MAC1, DA=MAC2+ Payload
SA=MAC1, DA=MAC2+ Payload
VNTAG SVIF = VIF1 DVIF = 0
VNTAG SVIF = VIF1 DVIF = 0
SA=MAC1, DA=MAC2+ Payload
SA=MAC1, DA=MAC2+ Payload
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 25
IA Parent
IA Client
Hosts
Host-1 Host-2
Switch-3
VSS
IF1 IF2
F101
VNTAG: Virtual NIC Tag VIF – Virtual Interface
(VIF1) (VIF2)
MAC + Payload
VNTAG, P=1 SVIF =0, DVIF = Group VIF
MAC + Payload
Outgoing Interface
IF1, IF2
192.168.1.100, 224.0.255.1 Incoming Interface: FortyGig 5/1 RPF Neighbor 210.20.37.33 Outgoing interface list: Gigabitethernet 101/1/0/1, Forward/Dense, 0:57:31/0:02:52 Gigabitethernet 101/1/0/2, Forward/Dense, 0:56:55/0:01:28
MAC + Payload
Group VIF
MAC + Payload
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 26
Host-1 IA Client
Host
Switch-3
VSL
Switch-1 Switch-2
IF1 (VIF1)
IA Parent
Fabric Link
access-‐list 100 permit ip any 10.0.0.0 0.255.255.255 Interface Gig 103/1/0/24 ip access-‐group 100 in
To -10.1.1.1 VNTAG
ACL TCAM
0X0001 X X X X X X X
0X0002 Y Y Y Y Y Y Y
0XNNNN Z Z Z Z Z Z Z
To -172.16.0.1 VNTAG
To -10.1.1.1
To -172.16.0.1 To -10.1.1.1
To -172.16.0.1
When an Ingress ACL is applied on the IA Client host port, the packet entering that IA Client port will get to the IA Parent via the fabric link. Once the packet reaches the IA Parent, the relevant ACLs will get applied.
SiSi SiSi
#
#
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 27
Host-1 IA Client
Host
Switch-3
VSL
Switch-1 Switch-2
IF1 (VIF1)
IA Parent Fabric Link
access-‐list 101 deny ip 192.168.1.0 0.255.255.255 any Access-‐list 101 permit ip any any interface Gig 103/1/0/24 ip access-‐group 101 out
Src -10.1.1.1 VNTAG
ACL TCAM
0X0001 X X X X X X X
0X0002 Y Y Y Y Y Y Y
0XNNNN Z Z Z Z Z Z Z
Src -10.1.1.1 Src -10.1.1.1
Src -192.168.1.1
Egress ACLs are applied on the IA Parent and If the packet is to be permitted, the packet will be sent down the fabric link to the IA Client. If the packet is to be dropped, the packet will not be sent to the IA Host Port
SiSi SiSi
#
#
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 28
Traffic from IA Client to Parent Traffic from IA Parent to Client
1
• Trust DSCP at A Client host ports
1
• Default DSCP/COS to Queue map – 4 (1P3QT3) Queues
• shared weights: 1 30 35 5 • IA Control traffic on to 2 addiUonal Queues 2
2
• No Policing/Marking/Shaping on Fabric links (Phase 1)
• DSCP or COS to Queue Map • Queues – 1P7Q4T • 6 Queues on Fabric link for IA Client data, • 2 Queues for IA control Traffic
4
• 4 Egress queues (1P3QT3) • shared weights: 1 30 35 5 • Control Traffic to IA Queues
4
• ClassificaUon, ReMarking, Poiicing on IA host Virtual Interface
3
3
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 29
Priority Q (1)
Standard Q (2)
Standard Q (3)
Standard Q (4)
Queues (1P3Q3T)
BPDU IA Control Traffic
COS 5 Data
COS 3 Data
• Trust DSCP at IA Host Port • DSCP/COS to Output Q Map • 1 Priority Queue • 3 Standard Queue • Shared Queue 1 30 35 5 • Marking/Re-Marking at IA Parent • Policing at IA Parent
IA Client IA Parent
Fabric Link
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 30
Priority (1)
Standard Q (2)
Standard Q (3)
Standard Q (4)
Standard Q (5)
Standard Q (6)
Standard Q (7)
Queues 1P7Q4T
DSCP 40 Data
DSCP 16 Data
BPDU IA Control Traffic
IA Client IA Parent
Fabric Link
Dscp-outputq-threshold map: DSCP = d1d2! d1: 0 1 2 3 4 5 6 7 8 9 ! -------------------------------------------------------------------------------------------! 0 : 08-03 08-03 07-03 07-03 06-03 06-03 06-03 06-03 05-01 05-02 ! 1 : 05-02 05-02 04-02 04-02 04-02 04-02 03-03 03-03 03-03 03-03 ! 2 : 03-03 03-03 03-03 03-03 02-03 02-03 02-03 02-03 02-03 02-03 ! 3 : 02-03 02-03 03-03 03-03 03-03 03-03 03-03 03-03 03-03 03-03 ! 4 : 01-03 01-03 01-03 01-03 01-03 01-03 01-03 01-03 02-03 02-03 ! 5: 02-03 02-03 02-03 02-03 02-03 02-03 02-03 02-03 02-03 02-03 ! 6 : 02-03 02-03 02-03 02-03 !!!
DSCP 40: d1 = 4, d2 = 0 DSCP 16: d1 = 1, d2 = 6
Trust DSCP/COS Map Table at IA Parent
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 31
Priority (1)
Standard Q (2)
Standard Q (3)
Standard Q (4)
Standard Q (5)
Standard Q (6)
Standard Q (7)
Queues 1P7Q4T
IA Client IA Parent
Fabric Link
Priority (1)
Standard Q (2)
Standard Q (3)
Standard Q (4)
Queues 1P3Q3T
DSCP 40 Data
DSCP 16 Data
Trust DSCP/COS 1P3QT3 Egress Host Port Shared 1 30 35 5
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 32
SDP – Satellite Discover Protocol
Enhanced PAgP
Hot Standby Active
Switch 1 Switch 2
• Requires ePagP capable neighbor: • 3750: 12.2(46)SE • 4500: 12.2(44)SE • 6500: 12.2(33)SXH1
• Sub-second convergence
Enhanced SDP (Fabric Link Discovery Protocol)
• Sub-second convergence
• Requires eSDP Neighbor: • Catalyst 6800ia: 15.1(2)SY
Hot Standby Active
Switch 1 Switch 2
Cat6500-VSS#show fex dual-active !FEX dual-active detection enabled: Yes!!Channel Group 16 (FEX 132)! Dual Active detection capable: Yes! switch 1 member port state:! Te1/2/5 - Interface Up. state: bound ! Te1/2/13 - Interface Up. state: bound ! switch 2 member port state:! Te2/2/5 - Interface Up. state: bound ! Te2/2/13 - Interface Up. state: bound !
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 33
redundancy!
mode sso!
!!
switch virtual domain 100 !
switch 1!
!!interface Port-channel1!switch virtual link 1!interface ten 1/5/4 !channel-group 1 mode on!interface ten 1/1/1 !channel-group 1 mode on!!!switch convert mode virtual!
VSS Configurations Guide http://www.cisco.com/en/US/docs/switches/lan/catalyst6500/ios/12.2SX/configuration/guide/vss.html
SiSi SiSi
Switch 1 Switch 2
Switch 1 Configuration Switch 2 Configuration redundancy!
mode sso!
!!
switch virtual domain 100 !
switch 2!
!!interface Port-channel2!switch virtual link 2!interface ten 2/5/4 !Channel-group 2 mode on! interface ten 2/1/1 !channel-group 2 mode on!!!switch convert mode virtual!
Cat6500-VSS#show switch virtual !
Switch mode : Virtual Switch!
Virtual switch domain number : 100!
Local switch number : 1!
Local switch operational role: Virtual Switch Active!
Peer switch number : 2!
Peer switch operational role : Virtual Switch Standby!
VSS Verification
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 34
Step 1 interface Port-channel20!
switchport!
switchport mode fex-fabric!
fex associate 118!
!
Step 2 interface range TenGig1/2/5, TenGig2/2/5! switchport! channel-group 20 mode on!
SiSi SiSi
No Console Access Required to Instant Access Client Provisioning
The Discovery process starts automatically once the FEX-Fabric is configured on downlinks to IA Client
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 35
SiSi SiSi
Cat6500-VSS#show fex 118 detail !FEX: 118 Description: FEX0118 state: online! FEX version: 15.0(2.0.51)UCP! Extender Model: WS-C2960X-48FPD-L, Extender Serial: FHH1707P00S! FCP ready: yes! Image Version Check: overridden! Fabric Portchannel Ports: 2! Fabric port for control traffic: Te1/2/5 ! Fabric interface state:! Po20 - Interface Up. ! Te1/2/5 - Interface Up. state: bound ! Te2/2/5 - Interface Up. state: bound !!Cat6500-VSS#show run fex 118 Current configuration : 11123 bytes ! interface GigabitEthernet118/1/0/1 …
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 36
SiSi SiSi
Cat6500-VSS#mod provision create fex 121 type WS-XC6800IA-48FPD!FEX 121 slot 1 module provisioning entry added.!
Pre-Provisioning of IA Client
Cat6500-VSS#mod provision create fex 121 type WS-XC6800IA-48FPD slot 2!FEX 121 slot 2 module provisioning entry added.!
Pre-Provisioning a Stack Member to Existing FEX-ID
Pre-Provisioning Switch and host port configuration before the IA Switch is physically connected can be done very similar to a line card Pre Provisioning
Cat6500-VSS#show switch virtual slot-map !Virtual Slot to Remote Switch/Physical Slot Mapping Table:!!Virtual Remote Physical Module!Slot No Switch No Slot No Uptime!---------+-----------+----------+----------! 68 121 1 ! 69 121 2 !
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 37
SiSi SiSiCat6500-VSS# show run fex 121!Building configuration...!!Current configuration : 5564 bytes!!!interface GigabitEthernet121/1/0/1! switchport mode access!.....!
FEX 121
Once the FEX-ID is provisioned, the Host Port Interface can be configured like any regular interface in Cat6500
Cat6500-VSS# conf t!Enter configuration commands, one per line. End with CNTL/Z.!Cat6500-VSS(config)# int Gig 121/1/0/24!Cat6500-VSS(config-if)# description To Printer Bldg3,4th Floor.!Cat6500-VSS(config-if)# switchport access vlan 110!
Pre Provision any IA Client Host Port like a regular port ahead.
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 38
SiSi SiSi
Cat6500-VSS#show mod fex 118! Switch Number: 118 Role: FEX!---------------------- -----------------------------!Mod Ports Card Type Model Serial No.!------ ----- -------------------------------------- ------------------ -----------! 1 48 C6800IA 48GFPwr 2SFP Fullers_48FullPwr FHH1707P00S!!Cat6500-VSS# !*Apr 3 19:37:58.026: %SATMGR-SW1-5-FEX_MODULE_ONLINE: FEX 118, module 2 online!Cat6500-VSS#!*Apr 3 19:37:58.030: %OIR-SW1-6-INSREM: Switch 118 Physical Slot 2 - Module Type LINE_CARD inserted ! Fex 118 Module 2: Passed Online Diagnostics!*Apr 3 19:38:12.178: %OIR-SW1-6-SP_INSCARD: Card inserted in Switch_number = 118, physical slot 2, interfaces are now online!Cat6500-VSS#show mod fex 118! Switch Number: 118 Role: FEX!---------------------- -----------------------------!Mod Ports Card Type Model Serial No.! --- ----- -------------------------------------- ------------------ -----------! 1 48 C6800IA 48GFPwr 2SFP Fullers_48FullPwr FHH1707P00S! 2 48 C6800IA 48GFPwr 2SFP Fullers_48FullPwr FHH1707P010!
Stack Member automatically Discovered and associated to
FEX like a Line Card
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 39
SiSi SiSi
Cat6500-VSS# show fex 118 detail !FEX: 118 Description: FEX0118 state: online!<Snip>…! Fabric Portchannel Ports: 2! Fabric port for control traffic: Te1/2/5 ! Fabric interface state:! Po20 - Interface Up. ! Te1/2/5 - Interface Up. state: bound ! Te2/2/5 - Interface Up. state: bound !Cat6500-VSS(config)#int range TenGig1/2/13, TenGig2/2/13!Cat6500-VSS(config-if-range)#channel-group 20 mode on!
Cat6500-VSS#show fex 118 detail !FEX: 118 Description: FEX0118 state: online! <Snip>…! Fabric Portchannel Ports: 4! Fabric port for control traffic: Te1/2/5 ! Fabric interface state:! Po20 - Interface Up. ! Te1/2/5 - Interface Up. state: bound ! Te1/2/13 - Interface Up. state: bound ! Te2/2/5 - Interface Up. state: bound ! Te2/2/13 - Interface Up. state: bound!
Just Bundling to “fex-fabric” Port Channel on Parent,
No Configuration at IA Client
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 40
Interface range command Cat6500-VSS(config)# int range Gig 132/1/0/1-48, Gig132/2/0/1-48!Cat6500-VSS(config-if-range)#!
Show run for IA Client Cat6500-VSS# show run fex 132!
Building configuration...!
!
Current configuration : 11103 bytes!
!!
interface GigabitEthernet132/1/0/1!
switchport access vlan 10!
!!
interface GigabitEthernet132/1/0/2!
switchport access vlan 10!
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 41
Cat6500-VSS#show module fex ! Switch Number: 132 Role: FEX!---------------------- -----------------------------!Mod Ports Card Type Model Serial No.!--- ----- -------------------------------------- ------------------ -----------! 1 48 C6800IA 48GFPwr 2SFP Fullers_48FullPwr FHH1707P00S! 2 48 C6800IA 48GFPwr 2SFP Fullers_48FullPwr FHH1707P010!
Cat6500-VSS# show environment status fex all!Fex 132 Fan 1! FEX 132 Fan 1 type: 33-0752-01 ! FEX 132 Fan 1 mode: Auto !Fex 132 fan-tray 1 fan-fail: OK!Fex 132 Fan 2! FEX 132 Fan 2 type: 33-0752-01 ! FEX 132 Fan 2 mode: Auto !Fex 132 fan-tray 2 fan-fail: OK! FEX 132 module 1 cooling requirement: 84 cfm! FEX 132 module 2 cooling requirement: 84 cfm!Fex 132 module 1 outlet temperature: 45C!Fex 132 module 2 outlet temperature: 52C!
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 42
Cat6500-VSS#attach fex 132!Open!FEX-132#!FEX-132#show int tenGigabitEthernet 1/0/1!TenGigabitEthernet1/0/1 is up, line protocol is up (connected) ! Hardware is Ten Gigabit Ethernet, address is 0022.bdf4.6633 (bia 0022.bdf4.6633)! MTU 9198 bytes, BW 10000000 Kbit/sec, DLY 10 usec, ! reliability 255/255, txload 1/255, rxload 1/255! Encapsulation ARPA, loopback not set! Keepalive not set! Full-duplex, 10Gb/s, link type is auto, media type is SFP-10GBase-SR! input flow-control is off, output flow-control is unsupported ! ARP type: ARPA, ARP Timeout 04:00:00! Last input never, output never, output hang never! Last clearing of "show interface" counters never! Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0! Queueing strategy: fifo! Output queue: 0/40 (size/max)! 5 minute input rate 4000 bits/sec, 3 packets/sec! 5 minute output rate 0 bits/sec, 0 packets/sec! 13031 packets input, 2591153 bytes, 0 no buffer!
To troubleshoot on IA Client Uplink - interface stats, transceiver details - Attach to IA Client “attach <fex-id>”
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 43
FEX-132#show int ten 1/0/2 transceiver !ITU Channel not available (Wavelength not available),!Transceiver is internally calibrated.!If device is externally calibrated, only calibrated values are printed.!++ : high alarm, + : high warning, - : low warning, -- : low alarm.!NA or N/A: not applicable, Tx: transmit, Rx: receive.!mA: milliamperes, dBm: decibels (milliwatts).!! Optical Optical! Temperature Voltage Tx Power Rx Power!Port (Celsius) (Volts) (dBm) (dBm)!---------- --------------- --------- ------------ --------------!Te1/0/2 40.7 3.32 -2.0 -1.1 !!
S LC1 LC2 LC3
F 102 101 F 103
A LC1 LC2 LC3
S LC1 LC2 LC3
F 102 F 101 F 103
A LC1 LC2 LC3
A LC1 LC2 LC3
F 102 F 101 F 103
S LC1
LC2 LC3
A LC1 LC2 LC3
F 102 F 101 F 103
S LC1 LC2 LC3
A LC1 LC2 LC3
F 102 F 101 F 103
S LC1 LC2 LC3
A LC1 LC2 LC3
F 102 F 101 F 103
S LC1 LC2 LC3
issu load
version
issu run
version
issu accept version
issu commit version
S LC1 LC2 LC3
A LC1 LC2 LC3
F 102 F 101 F 103
S LC1
LC2 LC3
issu run version fex 103
issu run version fex 102, 101
Rolling upgrade across FEX-ID’s
A = Active S=Standby LC=Line Card
Old Code
Newer Code
© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 46
• Single point of management & simplified configuration and deployment and operations reducing TCO
• Consistent features across distribution and access • Unified application visibility and control for complete
distribution block • Simplified network virtualization with EVN/MPLS-VRF at
access • Simplified network security with complete support of SGT/
SGACL/NDAC/802.1x across distribution block • Maintain existing L2//L3 Designs, Smooth Migration
Simplifying Networks Reducing TCO