6500overview

1 © 2004, Cisco Systems, Inc. All rights reserved.

Catalyst 6500 Technical Training

Carl Solder

Technical Marketing Engineer

Internetworking Systems Business Unit

Catalyst 6500 Supervisor 720 using Native IOS 12.2SX



January 2004

CHAPTER 1: Introduction to the Catalyst 6500

3 3 © 2004, Cisco Systems, Inc. All rights reserved.

Cisco Systems

CHAPTER 1.1 – Introduction to the Catalyst 6500


Cisco Systems

Catalyst 6500 Family

Catalyst 6503

3 slot chassis Catalyst 6506

6 slot chassis

Catalyst 6509

9 slot chassis

Catalyst 6509-NEBS

NEBS Compliant 9 slot chassis

Catalyst 6513

13 slot chassis

Catalyst 6509-NEBS-A

9 slot chassis


Cisco Systems

Catalyst 6500 Supervisors

The Catalyst 6500 has three Supervisor options on offer

with each providing a different architectural backplane

configuration for line cards to connect into…

Supervisor 1A Supervisor 2 Supervisor 720 (NEW)

256Gb backplane supporting

hardware accelerated Layer 2

and 3, QoS and Security

policies up to 210Mpps…









Supervisor Options for the Catalyst 6500


Cisco Systems

Catalyst 6500 Linecards

The Catalyst 6500 has a family of linecards to suit all network needs…

10/100 TX and 100 Fiber 10/100/1000 TX GE SFP

GE GBIC 10GE WAN

Optical Switch Modules Inline Power ATM

C

A

T

6

5

0

0

L

I

N

E

C

A

R

D

S


Cisco Systems

Catalyst 6500 Service Modules

Content Services Communications Media MWAN

Firewall Module VPN Module Intrusion Detection

Content Switching SSL Network Management

Service Modules represent the next generation of intelligent modules for the Catalyst 6500. Each

module provides a high performance option, scalable and feature rich deployment options…


Cisco Systems

Supervisor 720

Advanced Features

IPV4 and IPV6 CEF Based Switching

IPV6 Tunneling

IPV4 NAT and PAT in hardware

MPLS P/PE, VPN and TE

GRE and IP in IP Tunneling

WCCP V2

Supports 256K+ IPV4 routes

Supports 128K+ IPV6 routes

Ingress/Egress Policing

User Based Rate Limiting

Hardware based classification

Multipath URPF

Bi-Directional PIM

Port Access Control lists

and more…

SUPERVISOR 720 Hardware Features

Integrated 720-Gbps Switch Fabric

Integrated Policy Feature Card

Integrated Multilayer Switch Feature Card

Supports two external compact flash slots

Supports three external GE ports (2 active)

Supports Classic, Fabric and High Capacity modules


Cisco Systems

Supervisor 720 MSFC3

Multilayer Switch Feature Card (MSFC) is a standard daughter card on the Supervisor 720

MSFC3

RP supports..

Running routing protocols

Address Resolution

Running ICMP

Manage Virtual interfaces

IOS configuration

and more…

SP supports…

Spanning Tree

VLAN Trunking Protocol

CDP

Pushing FIB to PFC,DFC

and more…

The MSFC3 supports both the Switch Processor (SP) and

Route Processor (RP)…

Component Route Proc Switch Proc

SDRAM (Default/Max)

Bootflash

NVRAM

512Mb/1Gb 512Mb/1Gb

64Mb 64Mb

2Mb 2Mb


Cisco Systems

Supervisor 720 PFC3

Policy Feature Card (PFC) is a standard daughter card on the Supervisor 720

PFC3

IPV4 CEF

IPV6 CEF

IPV6 Tunneling

IPV4 NAT and PAT

MPLS VPN

MPLS P/PE

MPLS TE

GRE Tunneling

IP in IP Tunneling

WCCP V2

256K IPV4 Routes

128K IPV6 Routes

User Based Microflow Policing

Ingress and Egress Policing

Port Access Control Lists

Multipath URPF

Bi Directional PIM

Feature PFC3a PFC3b

Routes (IPV4)

Number of ACL‟s

ACE Counters

256Kb 800K

512 4000

No Yes

MPLS Baseline Adds EoMPLS, IP

options, etc…


Cisco Systems

Supervisor 720 Switch Fabric

Switch Fabric

Integrated 720-Gbps Switch

Fabric on the Supervisor 720

Clocks Fabric Channels at

either 20-Gbps or 8-Gbps

depending on connected

linecard

CEF256 and dCEF256

connect in at 8-Gbps per

fabric channel

CEF720 and dCEF720

connect in at 20-Gbps per

fabric channel

Slot Fabric Channels on 6503, 6506,

6509, 6509-NEBS, 6509-NEBSA

6513 Fabric

Channels

3 slot 6 slot 9 slot

Slot 1-3 2 per slot

13 Slot

2 per slot 2 per slot 1 per slot

Slot 4-6 - 2 per slot 2 per slot 1 per slot

Slot 7-8 - - 2 per slot 1 per slot

Slot 9 - - 2 per slot 2 per slot

Slot 9-13 - - - 2 per slot


Cisco Systems

Supervisor 720 Performance

L2/L3/L4 Switching 30Mpps

ACL‟s 30Mpps

Netflow 30Mpps

Policing 30Mpps

Marking 30Mpps

GRE 10Mpps

NAT 20Mpps

PAT 12Mpps

IPV4 Centralized Forwarding

V6 to V6 20Mpps

V4 to V6 Tunneling 10Mpps



V6 to V6 25Mpps



IPV6 dCEF Forwarding

MPLS 20-30Mpps


48Mpps

25Mpps

25Mpps

dCEF (Up to)

48Mpps

48Mpps

48Mpps

48Mpps

48Mpps

Performance numbers relate to

the Supervisor 720 for IPV4 and

IPV6 where displayed…


Cisco Systems

Supervisor 720 Hardware Features IPV6

IPV6 HARDWARE FEATURES

128K FIB entries

IPV6 Load Sharing up to 16 paths

Etherchannel hash across 48 bits

IPV6 Policing/Netflow/Classification

STD and EXT V6 ACL‟s

IPV6 QoS lookups

IPV6 Multicast

V6 to V4 Tunneling

IPV6 Edge over MPLS (6PE)

IPV6 SOFTWARE FEATURES

IPV6 Addressing

ICMP for IPV6

DNS for IPV6

V6 MTU Path Discovery

SSH for IPV6

IPV6 Telnet

IPV6 Traceroute

dCEF for IPV6

RIP for IPV6

IS-IS for IPV6

OSPF V3 for IPV6

BGP for IPV6

IPV6 function located

on PFC3


Cisco Systems

Supervisor 720 Hardware Features Route Processor Rate Limiters

While switching in hardware operates at millions of

pps, the Route Processor supports processing rates

in the „000‟s packets per second,. RP Rate limiters

have been introduced to limit the impact of traffic

flooding to the RP and swamping the CPU….

Rate Limiters applied to…

Input and Output ACL traffic

CEF Receive Traffic

CEF Glean Traffic

MTU Failures

ICMP Redirect

VACL Logging

L3 Security Feature traffic

TTF failures

RPF Failures Supervisor 720

MSFC

Data


Cisco Systems

Supervisor 720 Hardware Features Generic Route Encapsulation

Generic Route Encapsulation and IP-in-IP Tunneling

is now supported in the PFC3 at hardware

accelerated speeds….

GRE Tunnel

GRE Performance is up to

10Mpps centralized and

up to 25Mpps de-centralized


Cisco Systems

Supervisor 720 Hardware Features Egress Policing

Egress Policing is now supported on egress….

Application of egress policer can be performed on a

routed (layer 3 port) or a VLAN switched Virtual

interface (SVI) – cannot be applied to a layer 2 port…

Data

Data

Data

Data

Data Data

Data

Data

Data

I

N

P

U

T

O

U

T

P

U

T

Policing

Engine

Egress Policer

Data

Data


Cisco Systems

Supervisor 720 Hardware Features Network/Port Address Translation (NAT/PAT)

L3 Addressing information

changed

L4 Addressing

information changed

NAT

PAT

10.1.1.1 203.16.10.1 Data 201.1.14.22 Data 203.16.10.1

Sup720 Supports..

Software Translation setup, then

Hardware-based IPV4 NAT & PAT

Up to 20 Mpps on the Sup720

10.1.1.1 203.16.10.1 Data 3010 80 194.1.20.3 203.16.10.1 Data 2001 80


Cisco Systems

Supervisor 720 Hardware Features Multipath Unicast RPF (URPF)

6500 Routing Table Prefix Next Hop Interface

10.1.0.0/16 10.1.1.1 gig 3/1

10.2.0.0/16 10.2.1.1 gig 3/2

Source IP: 10.1.10.5

Destination: 10.2.20.34

Source IP: 10.200.1.64

Destination: 10.2.20.34

Unicast Reverse Path Forwarding (uRPF) Check mitigates problems caused by spoofed or

malformed IP source addresses. uRPF will drop packets whose source address is not in the

local forwarding tables.


Cisco Systems

Supervisor 720 Hardware Features User Based Rate Limiting (UBRL)

Three types of Global Flow Masks that can be stored on Sup1a/2 in the Netflow table…

Destination-Only IP (default)

Source-Destination IP

Full-flow (Src IP, Dst IP, Protocol, Src Port, Dst Port) Microflow policing uses full flow

NOW… Sup720 supports

1. Up to 2 flow masks in the system

2. Source only and destination only flow

masks in the PFC3

This new facility increases the capacity of Sup720 to store more entries in its Netflow

table… Allows different features that use the Netflow table to use different masks (i.e. IOS

SLB, NDE, TCP Intercept, Reflexive ACL‟s, WCCP and CBAC)

BUT ONLY ONE GLOBAL FLOWMASK CAN BE INSTALLED IN THE

SYSTEM AT ANY ONE TIME


Cisco Systems

Traffic from Dorms Ingress Microflow policer

Applied to user ports(s)

Source-only Flow mask

Use ACL to limit the scope of source IP addresses to intended users

Traffic from Internet Ingress Microflow policer

Applied to uplink ports

Dest-only Flow mask

Use ACL to limit the scope of destination IP addresses to intended

users

Traffic Management User-Based Rate Limiting

Only Available

with a Sup720


Cisco Systems

Supervisor 720 Hardware Features Bi Directional PIM

Support for Bi-Directional PIM in Hardware was announced on the Supervisor 720 and is available

on IOS. This feature adds the same capability on CatOS…

RP (*,G)

(*,G)

(*,G)

(*,G)

(*,G)

Source

Receiver

Bidir-PIM has unconditional forwarding of source traffic

toward the RP upstream on the shared tree, but no

registering process for sources as in PIM-SM. These

modifications are necessary and sufficient to allow

forwarding of traffic in all routers solely based on the (*,

G) multicast routing entries. This feature eliminates any

source-specific state and allows scaling capability to an

arbitrary number of sources.


Cisco Systems

Supervisor 720 Hardware Features MPLS

MPLS HARDWARE FEATURES

Up to 1000 MPLS VPN‟s

MPLS VPN (RFC2457) on ANY Ethernet

port

MPLS Multicast VPN

MPLS Label Switch Router (LSR)

MPLS Label Edge Router (LER)

MPLS Traffic Engineering (TE)

MPLS Ethernet over MPLS (EoMPLS)

on PFC3b

DSCP to EXP Mapping MPLS function located

on PFC3

MPLS applies to any Ethernet port on

the following linecards…

Classic Ethernet Line Cards

CEF256 Ethernet Line Cards

dCEF256 Ethernet Line Cards

aCEF720 Ethernet Line Cards

dCEF720 Ethernet Line Cards


Cisco Systems

CHAPTER 1.2 – Catalyst 6500 Architecture


Cisco Systems

Module Terminology Update

Classic 6000, 6100, 6200, 6300, 6400, & 6600 Series Modules; CSM, IDS/NAM (Original), FlexWAN

CEF256 (Single Fabric Channel) (Ethernet-based CEF256 can be upgrade to DFCx)

6500 Series, Optical Services Modules, Firewall, SSL, VPN, CMM, NAM-1, NAM-2, IDS-2

dCEF256 (Dual Fabric Channels) 6816 Module

aCEF720 (Dual Fabric Channels*)

6704 Module (*some future modules will a single fabric channel)

dCEF720 (Dual Fabric Channels)

6802 Module


Cisco Systems

Catalyst 6500 Architecture with Supervisor 720

Classic

Linecard

CEF256

Linecard

dCEF256

Linecard

dCEF720

Linecard

MSFC

PFC

32-Gbps Switch Bus Forwarding

Tables

Fabric

Arbitration

Net MGMT

NMP

Crossbar

Supervisor

32 32

8 8 8

20 20

aCEF720

Linecard

20

32

20

CEF720

Linecard

32

20 20


Cisco Systems

Processors Component Comparison

Component Sup720/ MSFC3

CPU Speed SP 250 MHz

Sup2/ MSFC2

RP 300 MHz

SP 600 MHz

RP 600 MHz

ECC SDRAM default/maximum

SP 128MB/512MB

RP 128MB/512MB

SP 512MB/1GB

RP 512MB/1GB

Bootflash SP 32MB

RP 16MB

SP 64MB

RP 64MB

NVRAM SP 512KB

RP 512KB

SP 2MB

RP 2MB


Cisco Systems

Supervisor 720 Slot Requirements – 3 Slot Chassis

Supervisor 720 or Module


Module Slot 3

Slot 2

Slot 1

Now dCEF

modules

are

supported

in the 3 slot

chassis!


Cisco Systems


Module

Module

Module

Module



Slot 6

Slot 5

Slot 4

Slot 3

Slot 2

Slot 1


Cisco Systems


Slot 6

Slot 5

Slot 4

Slot 3

Slot 2

Slot 1

Slot 8

Slot 7

Slot 9

Module

Module

Module

Module



Module

Module

Module


Cisco Systems


Module

Module

Module


Module


Module

Module

Module

Module

Module

Module

Module

Slot 6

Slot 5

Slot 4

Slot 3

Slot 2

Slot 1

Slot 8

Slot 7

Slot 9

Slot 13

Slot 12

Slot 11

Slot 10


Cisco Systems

交换矩阵

Slot 1

Slot 7

Slot 6

Slot 2

Slot 3

Slot 4

Slot 8

Slot 9

• Integrated Fabric

A SFM must be removed when using a Sup720

• Fabric channels run at 20 Gbps

Full Duplex, so 20 Gbps in / 20 Gbps out per channel

Two fabric channels allocated to each slot

40 Gbps/slot with dual fabric channels

• Total Switching Capacity = 720 Gbps (Full Duplex Operation)

9-slot


Cisco Systems

Supervisor 720 Switch Fabric - Channel Allocation

Slot 1

Slot 11

Slot 10

Slot 2

Slot 3

Slot 4 Slot 12

Slot 13

• Two Channels per slot:

3 slot chassis (6503, 7603)



• 13 Slot chassis fabric channel allocation is the same as the SFM2

Slots 1 thru 8 receive a single fabric channel

Slots 9 thru 13 receive dual fabric channels

• Fabric channels for xCEF256 modules will auto-sync to 8 Gbps

Slot 5

Slot 6

Slot 7

Slot 8

6513


Cisco Systems

Routing Table

Catalyst 6500 Architecture With Supervisor 720

MSFC3 Supervisor

Engine 720

CEF256 Series Classic Series

16 Gbps Switching Bus

PFC3

20

20

20

20

aCEF720 Series

aCEF Engines

8 8

8

30–400 Mpps

Forwarding

Performance

dCEF720 Series

Integrated DFC3

Integrated DFC3

dCEF256 Series

Hardware Fwd Tables

20

Optional DFC3

Integrated

Switch Fabric

All numbers are presented

in non-full duplex math

(engineering math) for

consistency



January 2004

CHAPTER 2: IOS Architecture on the Supervisor 720


Cisco Systems

CHAPTER 2.1 – IOS Architecture


Cisco Systems

IOS Architecture

Route Processor

Switch Processor

SP Bootflash RP Bootflash

The Multilayer Switch Feature Card (MSFC3) on the Supervisor 720 contains both the Route

Processor (RP) and the Switch Processor (SP)…

Both the RP and the SP have their

own set of Flash memory

(referred to as bootflash)


Cisco Systems

IOS Architecture Switch Processor (SP)

MSFC3

Route

Processor

(RP)

Switch

Processor

(SP)

Both the RP and SP perform distinct functions during both the booting of the operating system

and the ongoing operation of the switch…

- The SP owns the switch at initial boot up

before handing over to the RP

- The SP runs all layer 2 operations like VTP,

Spanning Tree, Chassis and Power

Management, etc

- Supports other Layer 2 features like CDP,

SPAN, Broadcast Suppression,

Etherchannel, etc

The Switch Processor is physically located

on the MSFC

Logically considered as the Network

Management Processor (NMP)

Dedicated CPU, DRAM, Flash and NVRAM


Cisco Systems

IOS Architecture Route Processor (RP)

MSFC3

Route

Processor

(RP)

Switch

Processor

(SP)

Both the RP and SP perform distinct functions during both the booting of the operating system

and the ongoing operation of the switch…

The Route Processor is physically located on

the MSFC

Logically considered as the MSFC

Dedicated CPU, DRAM, Flash and NVRAM

-The RP runs the Layer 3 routing protocols

like OSPF, EIGRP, BGP, etc

- Other layer 3 features like IPX and

Appletalk

- Manages the user interface (CLI)

- All show and configuration commands are

processed on the RP then sent to the SP for

execution


Cisco Systems

IOS Architecture RP and SP Bootflash

MSFC3

RP SP

RP BOOTFLASH SP BOOTFLASH

The RP and the SP both have their own set of Bootflash…

SP Bootflash (64Mb) is used to store the boot image and is referred to as SUP-BOOTFLASH

during normal operation

RP Bootflash (64Mb) is referred to as BOOTFLASH during normal operation

6500# dir sup-bootflash:

Directory of sup-bootflash:/

1 -rw- 26672876 Sep 09 2003 23:13:50 s72033-ps-mz.122-14.SX1.bin

256417792 bytes total (229744640 bytes free)


Cisco Systems

IOS Architecture RP and SP DRAM

MSFC3

RP SP

RP DRAM SP DRAM

The RP and the SP both have their own set of DRAM…

SP Bootflash (512Mb) is used to store the running configuration, the running IOS image, the

routing table, etc – the amount of SP and RP DRAM available can be seen using the following

commands…

6500# show version

<snip>

cisco Catalyst 6000 (R7000) processor with 458752K/65536K bytes of memory.

6500# remote command switch show version

<snip>

cisco Catalyst 6000 (R7000) processor with 458752K/65536K bytes of memory.


Cisco Systems

CHAPTER 2.2 – File Management


Cisco Systems

File Management

The IOS File System (IFS) provides for a single interface into all of the file systems on the

switch… The Supervisor 720 supports a number of those file systems and they can be seen in

the output of the following command…

6500# show file systems

File Systems:

Size(b) Free(b) Type Flags Prefixes

* 256417792 229744640 disk rw disk0:

- - disk rw disk1:

65536000 38191028 flash rw sup-bootflash:

24871548 0 opaque ro sup-microcode:

0 242043808 opaque wo sup-image:

129004 128388 nvram rw const_nvram:

1964024 1960429 nvram rw nvram:

- - opaque rw null:

- - opaque rw system:

- - network rw tftp:

65536000 65536000 flash rw bootflash:

- - network rw rcp:

- - network rw ftp:


Cisco Systems

File Management

Some of the major file systems that are used on the Supervisor 720 include…

FILESYSTEM DESCRIPTION

bootflash: Flash that is owned by the RP

sup-bootflash: Flash that is owned by the SP

disk0: The first compact flash slot on the Supervisor

slavedisk0: 1st CF slot on redundant Supervisor

nvram: The second compact flash slot on the Supervisor

slavebootflash: Flash memory owned by a redundant supervisor

slavenvram: NVRAM on a Redundant Supervisor

disk1: The second compact flash slot on the Supervisor

slavedisk1: 2nd CF slot on a Redundant Supervisor

startup-config: Startup configuration located in NVRAM

running-config: Running configuration located in DRAM


Cisco Systems

File Management Commands

Files stored on the file subsystems can be viewed using the “DIR” command…



1 -rw- 27344844 Jul 31 2003 10:03:54 s72033-pk9s-mz.122-14.SX.bin


The current default file system can be seen using the following …

6500# pwd

disk0:

The current default file system can be changed to another file system as follows …

6500# cd sup-bootflash:

6500# pwd

sup-bootflash:/


Cisco Systems

File Management Commands

Information on specific files can be viewed as follows (filename of IOS shown in the

example)…

6500# show file info disk0:s72033-ps-mz.122-14.SX1.bin

disk0:s72033-ps-mz.122-14.SX1.bin:

type is image (elf) []

file size is 26672876 bytes, run size is 26837656 bytes

Runnable image, entry point 0x80020000, run from ram

6500#

6500# dir disk0:

Directory of disk0:/

1 -rw- 26672876 Sep 09 2003 23:13:50 s72033-ps-mz.122-14.SX1.bin



Cisco Systems

File Management Commands Delete Command

Files can be deleted by using the delete command and referencing the file system/filename …




2 -rw- 2553 Nov 06 2003 01:30:17 config1


6500# delete sup-bootflash:config1

Delete filename [config1]?

Delete sup-bootflash:config1? [confirm]





DELETE COMMAND


Cisco Systems

File Management Commands Undelete Command

Files can also be UNDELETED by using the undelete command and referencing the file index

number on that file subsystem …

6500# dir /all sup-bootflash:



2 -rw- 2553 Nov 06 2003 01:30:17 [config1]


6500# undelete 2 sup-bootflash:




2 -rw- 2553 Nov 06 2003 01:30:17 config1


UNDELETE COMMAND

File is undeleted

Shows deleted file in brackets [ ]


Cisco Systems

File Management Commands Squeeze Command

To permanently remove a deleted file from the file subsystem, the SQUEEZE command must

be used …

6500# delete sup-bootflash:config1

Delete filename [config1]?

Delete sup-bootflash:config1? [confirm]

6500# squeeze sup-bootflash:

All deleted files will be removed. Continue? [confirm]

Squeeze operation may take a while. Continue? [confirm]

Squeeze of sup-bootflash complete

6500# dir /all sup-bootflash:




SQUEEZE COMMAND

As can be seen in the final dir /all command, the config1 file is no longer located in this file

system…


Cisco Systems

File Management Commands Boot Command

To boot a native IOS image, the image can be loaded from one of two locations – either the

SUP-Bootflash, or from one of the two compact flash slots on the front panel of the

supervisor…

64Mb of SUP-Bootflash is

provided to hold IOS

images…

Two CF type II slots are

provided to hold CF cards

– these slots hold CF

cards up to 512Mb in size

and can also support the

IBM Microdrive


Cisco Systems

File Management Commands Boot Command

Multiple boot commands can appear in the configuration file – the system will attempt to

load the image identified by the first “boot” command and move through the list until it finds

an image it can load…

6500# show running

Building configuration...

<snip>

boot system flash disk0:s72033-psv-mz.122-17a.SX1.bin

boot system flash sup-bootflash:s72033-psv-mz.122-17a.SX.bin

boot system flash disk0:s72033-ps-mz.122-14.SX1.bin

boot system flash sup-bootflash:s72033-pk9s-mz.122-14.SX.bin

<snip>

NOTE – If the system fails to find a

valid image from the “BOOT” list it

will revert to ROMMON mode


Cisco Systems

Configuring a Supervisor 720 Boot Command

IOS images can be stored on the compact flash and used to boot the switch,.. The command to

allow the switch to boot from compact flash is the “boot” command shown below…

6500# show running

Building configuration...

<snip>

boot system flash disk0:s72033-ps-mz.122-14.SX1.bin

boot system flash sup-bootflash:s72033-pk9s-mz.122-14.SX.bin

The “BOOT SYSTEM FLASH” command can be used to identify the IOS image on the

compact flash slot that the switch should use to boot… on switch bootup you should see

the following…

System Bootstrap, Version 7.7(1)

Copyright (c) 1994-2003 by cisco Systems, Inc.

Cat6k-Sup720/SP processor with 524288 Kbytes of main memory

Autoboot executing command: "boot disk0:s72033-ps-mz.122-14.SX1.bin"

Self decompressing the image :

################################################]

Should be the first boot

statement in the list

Technology

6500overview