Cisco Nexus 5548UP Switch Configuration Guide.pdf

8/10/2019 Cisco Nexus 5548UP Switch Configuration Guide.pdf

1/14

Cisco Nexus 5548UP

Switch Configuration Guide

Dell Product Group

February 2013

[email protected]
mailto:[email protected]?subject=Cisco%20Nexus%205548UP%20SCGmailto:[email protected]?subject=Cisco%20Nexus%205548UP%20SCGmailto:[email protected]?subject=Cisco%20Nexus%205548UP%20SCGmailto:[email protected]?subject=Insert%20paper%20title%20heremailto:[email protected]?subject=Cisco%20Nexus%205548UP%20SCG


2/14

2 SCG1006 Cisco Nexus 5548UP Switch Configuration Guide

2013 Dell Inc. All rights reserved. Reproduction of this material in any manner whatsoever without the express

written permission of Dell Inc. is strictly forbidden. For more information, contact Dell.

Dell, the Dell logo, and the Dell badge, PowerConnect, EqualLogic, and Force10 are trademarks of Dell Inc. Cisco is

a registered trademark of Cisco Systems, Inc. and/or its affiliates in the U.S. and other countries.


3/14


Table of contents1 Introduction ................................................................................................................................................................................ 4

1.1 Audience ........................................................................................................................................................................... 4

1.2 Switch details ................................................................................................................................................................... 4

1.3

Cabling diagram .............................................................................................................................................................. 5

2 Dell recommended switch configuration ............................................................................................................................. 6

2.1 Hardware configuration ................................................................................................................................................. 6

2.2 Delete startup configuration ......................................................................................................................................... 6

2.3 Running the basic system configuration .................................................................................................................... 6

2.4 Configure the vPC domain ............................................................................................................................................ 8

2.5

Enable link level flow control (802.3x) ........................................................................................................................ 8

2.6 Configure Port Channel ................................................................................................................................................. 8

2.7

Configure portfast on edge ports ................................................................................................................................ 9

2.8 Enable VLAN ..................................................................................................................................................................... 9

2.9 Enable switch ports ...................................................................................................................................................... 10

2.10 Configure the Nexus policy engine ........................................................................................................................... 10

2.10.1Configure CoS for iSCSI ............................................................................................................................................... 10

2.10.2 Define a QoS map for iSCSI ................................................................................................................................... 10

2.10.3

Define a QoS policy map for iSCSI ........... .......... ........... .......... ........... .......... ........... .......... ........... ........... .......... .... 10

2.10.4

Define a Network QoS class map....... ........... ........... .......... ........... .......... ........... .......... ........... .......... ........... .......... 11

2.10.5

Define a no-drop policy map and enable jumbo frames .......... ........... .......... ........... .......... ........... .......... ......... 11

2.10.6 Define a queuing class-map .......... ........... .......... ........... .......... ........... .......... ........... .......... ........... ........... .......... ..... 11

2.10.7Define a queuing policy-map ...................................................................................................................................... 11

2.11 Apply the Nexus policies .............................................................................................................................................. 12

2.12 Save configuration ........................................................................................................................................................ 12

2.13 Configure additional switch ........................................................................................................................................ 12

2.14

Disabling DCB ................................................................................................................................................................ 12

Additional resources ....................................................................................................................................................................... 13


4/14


1 IntroductionThis document illustrates how to configure Cisco Nexus 5548UP switches for use with EqualLogic PS

Series storage using Dell best practices. The recommended configuration uses link aggregation groups

(LAGs) and Virtual Port Channel (vPC) for inter-switch connections.

Note: Cisco currently does not support iSCSI TLV, which is required by EqualLogic to support Data

Center Bridging (DCB). The configuration presented in this guide is for use as a dedicated iSCSI SAN

switch environment only and should not be used for converged or mixed traffic types.

For more information on EqualLogic SAN design recommendations, see the EqualLogic Configuration

Guide at:www.delltechcenter.com/page/equallogic+configuration+guide.

1.1 AudienceThis switch configuration guide describes a verified configuration following Dell best practices for an

EqualLogic iSCSI SAN and is intended for storage or network administrators and deployment personnel.

1.2 Switch detailsThe table below provides an overview of the switch configuration.

Table 1 Switch specifications

Cisco Nexus 5548UP

Switch vendor Cisco

Switch model Nexus 5548UP

Switch firmware 5.2(1)N1(1)

The latest firmware updates and documentation can be found at:www.cisco.com.This site requires a

login.
http://www.delltechcenter.com/page/equallogic+configuration+guidehttp://www.delltechcenter.com/page/equallogic+configuration+guidehttp://www.delltechcenter.com/page/equallogic+configuration+guidehttp://www.cisco.com/http://www.cisco.com/http://www.cisco.com/http://www.cisco.com/http://www.delltechcenter.com/page/equallogic+configuration+guide


5/14


1.3

Cabling diagramThe cabling diagram shown below represents the Dell recommend method for deploying your servers and

EqualLogic arrays.

Figure 1 Cabling diagram


6/14


2 Dell recommended switch configurationThese steps show you how to configure two Cisco Nexus 5548UP switches with a vPC interconnect. The

switches are interconnected using four of the 10Gb ports configured as the vPC link.

2.1

Hardware configuration1. Power on both switches

2. Connect a serial cable to the management port.

3. Using Putty or another terminal utility, open a serial connection session to the switch.

4. Open your terminal emulator and configure it to use the serial port (usually COM1 but this may vary

depending on your system). Configure serial communications for 9600,N,8,1 and no flow control.

5. Connect the cables between switch 1 and switch 2 as shown in Figure 1, for ports 1-4. This will be

used as your vPC link.

2.2

Delete startup configuration

WARNING:All previous configuration settings will be deleted.

swi t ch>enable

swi t ch#write erase

War ni ng: Thi s command wi l l er ase t he st ar t up- conf i gur at i on

Do you wi sh t o proceed anyway ? ( y/ n) [ n]y

swi t ch# reload

WARNI NG: t hi s command wi l l r eboot t he syst em

Do you want t o cont i nue? ( y/ n) [ n]y

Note:The switch will reboot.

2.3

Running the basic system configurationThe following steps use the setup utility to configure connectivity for basic management of the system.

After the switch fully reboots, the following prompts will appear:

Abort Power On Aut o Provi si oni ng and cont i nue wi t h normal set up ?( yes/ no) [ n] : y

- - - - System Admi n Account Set up - - - -

Do you want t o enf orce secure password st andar d ( yes/ no) : yes

Ent er t he password f or "admi n" : my password


7/14


Conf i r m t he password f or " admi n" : my password

- - - - Basi c SystemConf i gurati on Di al og - - - -

Thi s set up ut i l i t y wi l l gui de you t hrough t he basi c conf i gurat i on oft he syst em. Set up conf i gur es onl y enough connect i vi t y f or managementof t he syst em.

Pl ease regi st er Ci sco Nexus 5000 Fami l y devi ces pr ompt l y wi t h yoursuppl i er . Fai l ur e t o r egi st er may af f ect r esponse t i mes f or i ni t i alser vi ce cal l s. Nexus devi ces must be r egi st er ed t o r ecei ve ent i t l edsuppor t ser vi ces.

Pr ess Ent er at anyti me t o ski p a di al og. Use ct r l - c at anyti met o ski p t he r emai ni ng di al ogs.

Woul d you l i ke t o ent er t he basi c conf i gur at i on di al og ( yes/ no) : yes

Cr eat e another l ogi n account ( yes/ no) [ n] : n

Conf i gur e r ead- onl y SNMP communi t y st r i ng ( yes/ no) [ n] : n

Conf i gur e read- wr i t e SNMP communi t y st r i ng (yes/ no) [ n] : n

Ent er t he swi t ch name : my switch name

Cont i nue wi t h Out - of - band (mgmt 0) management conf i gur at i on? ( yes/ no) [ y] : y

Mgmt 0 I Pv4 addr ess : my IP address

Mgmt 0 I Pv4 netmask : my netmask

Conf i gur e the def aul t gat eway? ( yes/ no) [ y] : y

I Pv4 addr ess of t he def aul t gat eway : my gateway

Enabl e t he t el net ser vi ce? ( yes/ no) [ n] : y

Enabl e the ssh ser vi ce? ( yes/ no) [ y] : n

Conf i gur e t he nt p ser ver ? ( yes/ no) [ n] : n

Ent er basi c FC conf i gur at i ons ( yes/ no) [ n] : n

The f ol l owi ng conf i gurat i on wi l l be appl i ed:swi t chname my switch namei nter f ace mgmt 0i p addr ess my ip address my netmaskno shut downexi tvr f cont ext managementi p r out e 0. 0. 0. 0/ 0 my gateway


8/14


exi tt el net ser ver enabl eno ssh ser ver enabl e

Woul d you l i ke t o edi t t he conf i gur at i on? ( yes/ no) [ n] : n

Use t hi s conf i gur at i on and save i t ? ( yes/ no) [ y] : y

[ ########################################] 100%Copy compl et e, now savi ng t o di sk ( pl ease wai t ) . . .

Log in with the credentials created in the previous steps.

2.4

Configure the vPC domainswi t ch# configure

swi t ch( conf i g) #feature lacp

swi t ch( conf i g) #feature vpc

swi t ch( conf i g) #vpc domain 1

swi t ch( conf i g- vpc- domai n) #peer-keepalive destinationpeer IP address

- - - - - - - - : : Management VRF wi l l be used as t he def aul t VRF : : - - - - - - - -

Note: For the , use the management IP address of the partner switch.

swi t ch( conf i g- vpc- domai n) #exit

2.5

Enable link level flow control (802.3x)You must perform this step for each individual port that is connected to a storage controller or a host

interface port, or you can specify a range of ports to configure.

swi t ch( conf i g) #interface ethernet 1/1-32

swi t ch( conf i g- i f - r ange) #priority-flow-control mode off

swi t ch( conf i g- i f - r ange) #flowcontrol send on

swi t ch( conf i g- i f - r ange) #flowcontrol receive on

swi t ch( conf i g- i f - r ange) #exit

2.6

Configure Port Channelswi t ch( conf i g) # interface port channel 1


9/14


swi t ch( conf i g- i f ) # switchport mode trunk

swi t ch( conf i g- i f ) # spanning-tree port type network

swi t ch( conf i g- i f ) #priority-flow-control mode off

swi t ch( conf i g- i f ) # flowcontrol send on

swi t ch( conf i g- i f ) # flowcontrol receive on

swi t ch( conf i g- i f ) # vpc peer-link

Pl ease not e t hat spanni ng t r ee port t ype i s changed t o network por t t ype on

vPC peer - l i nk. Thi s wi l l enabl e spanni ng t r ee Br i dge Assurance on vPC peer - l i nk

pr ovi ded the STP Br i dge Assurance ( whi ch i s enabl ed by def aul t ) i s not di sabl ed.

swi t ch( conf i g- i f ) # exit


swi t ch( conf i g- i f - r ange) # switchport mode trunk

swi t ch( conf i g- i f - r ange) # channel-group 1 mode active

swi t ch( conf i g- i f - r ange) # exit

2.7

Configure portfast on edge portsswi t ch( conf i g) #interface ethernet 1/5-32

swi t ch( conf i g- i f - r ange) #spanning-tree port type edge

Warni ng: edge por t t ype ( por t f ast ) shoul d onl y be enabl ed on por t s connected t o

a si ngl e host . Connect i ng hubs, concent r at or s, swi t ches, br i dges, et ct o t hi si nt er f ace when edge port t ype ( port f ast ) i s enabl ed, can cause t emporar y

br i dgi ng l oops. Use wi t h CAUTI ON.

Edge Por t Type (Port f ast ) wi l l be conf i gur ed i n 28 i nt er f aces due to the range

commend but wi l l onl y have ef f ect when t he i nt er f aces are i n a non- t r unki ng

mode.

swi t ch( conf i g- i f - range) #exit

2.8 Enable VLANThe following example uses VLAN 101 and configures a range of ports. Any valid VLAN (between 2-4094)

may be substituted.

swi t ch( conf i g) # vlan 101

swi t ch( conf i g- vl an) # exit


10/14


swi t ch( conf i g) # interface ethernet 1/5-32

Note:Switch ports 1-4 are part of port-channel 1 so are not included in the above range.

swi t ch( conf i g- i f - r ange) # switchport access vlan 101


2.9

Enable switch portsThe following example enables a range of ports. If preferred, you may enable individual ports as needed.


swi t ch( conf i g- i f - r ange) # no shutdown

swi t ch ( conf i g- i f - range) #exit

2.10 Configure the Nexus policy engineThe following example configures iSCSi traffic for Class of Service (CoS) 4 and Quality of Service (QoS)

group 3.

2.10.1 Configure CoS for iSCSIRepeat this step for each individual interface connected to host and array controller ports, or specify a

range of ports to configure.


swi t ch( conf i g- i f - r ange) # untagged cos 4


2.10.2

Define a QoS map for iSCSIswi t ch( conf i g) # class-map type qos class-iscsi

swi t ch( conf i g- cmap- qos) #match cos 4

swi t ch( conf i g- cmap- qos) # exit

2.10.3

Define a QoS policy map for iSCSIswi t ch( conf i g) #policy-map type qos policy-qos

swi t ch( conf i g- pmap- qos) # class type qos class-iscsi

swi t ch( conf i g- pmap- c- qos)#set qos-group 3


11/14


swi t ch( conf i g- pmap- c- qos) # exit

swi t ch(conf i g- pmap- qos) # exit

2.10.4

Define a Network QoS class mapswi t ch( conf i g) # class-map type network-qos class-iscsi

swi t ch(conf i g- cmap- nq) #match qos-group 3

swi t ch( conf i g- cmap- nq) #exit

2.10.5 Define a no-drop policy map and enable jumbo framesswi t ch( conf i g) #policy-map type network-qos policy-nq

swi t ch( conf i g- pmap- nq) # class type network-qos class-iscsi

swi t ch( conf i g- pmap- nq- c) #mtu 9216

swi t ch( conf i g- pmap- nq- c) #pause no-drop

swi t ch( conf i g- pmap- nq- c) #exit

swi t ch( conf i g- pmap- nq) #exit

2.10.6 Define a queuing class-mapswi t ch( conf i g) # class-map type queuing class-iscsi

swi t ch(conf i g- cmap- que)#match qos-group 3

2.10.7

Define a queuing policy-mapswi t ch(conf i g- cmap- que)#policy-map type queuing policy-queuing

swi t ch(conf i g- pmap- que)# class type queuing class-default

swi t ch(conf i g- pmap- c- que#bandwidth percent 5

swi t ch(conf i g- pmap- c- que)# class type queuing class-fcoe

swi t ch( conf i g- pmap- c- que) ) #bandwidth percent 0

swi t ch(conf i g- pmap- c- que)# class type queuing class-iscsi

swi t ch( conf i g- pmap- c- que) #bandwidth percent 95

swi t ch( conf i g- pmap- c- que) # exit

swi t ch( conf i g- pmap- que)# exit


12/14


2.11

Apply the Nexus policiesswi t ch( conf i g) # system qos

swi t ch( conf i g- sys- qos) # service-policy type qos input policy-qos

swi t ch( conf i g- sys- qos) # service-policy type queuing output policy-queuing

swi t ch( conf i g- sys- qos) # service-policy type network-qos policy-nq

swi t ch( conf i g- sys- qos) #exit

swi t ch( conf i g) #exit

2.12

Save configurationswi t ch#copy running-config startup-config

2.13

Configure additional switchRepeat the commands from sections2.1 through2.12 to configure the second switch.

2.14

Disabling DCB

Note: With Cisco Nexus family products, there is no command to fully disable DCB functionality. Using

the configuration steps in this document results in a proper non-DCB environment. However disabling

LLDP support can effectively prevent the negotiation of DCB by preventing the transmission of DCBx

frames. It is not necessary to disable LLDP unless instructed by Dell support. The following example

disables LLDP support on ports 1 through 32.

swi t ch#configure


swi t ch( conf i g- i f - r ange) # no lldp receive

swi t ch( conf i g- i f - r ange) # no lldp transmit


13/14


Additional resources

Support.dell.comis focused on meeting your needs with proven services and support.

Support.cisco.comfor support and information regarding Cisco networking products.

DellTechCenter.comis an IT Community where you can connect with Dell Customers and Dell employees

for the purpose of sharing knowledge, best practices, and information about Dell products and your

installations.

Referenced or recommended Dell publications:

Dell EqualLogic Configuration Guide:

http://en.community.dell.com/techcenter/storage/w/wiki/equallogic-configuration-guide.aspx

Dell EqualLogic Compatibility Matrix:

http://en.community.dell.com/techcenter/storage/w/wiki/2661.equallogic-compatibility-

matrix.aspx

For EqualLogic best practices white papers, reference architectures, and sizing guidelines for enterprise

applications and SANs, refer to Storage Infrastructure and Solutions Team Publications at:

http://dell.to/sM4hJT
http://www.support.dell.com/http://www.support.dell.com/http://www.cisco.com/http://www.cisco.com/http://www.delltechcenter.com/http://www.delltechcenter.com/http://en.community.dell.com/techcenter/storage/w/wiki/equallogic-configuration-guide.aspxhttp://en.community.dell.com/techcenter/storage/w/wiki/equallogic-configuration-guide.aspxhttp://en.community.dell.com/techcenter/storage/w/wiki/2661.equallogic-compatibility-matrix.aspxhttp://en.community.dell.com/techcenter/storage/w/wiki/2661.equallogic-compatibility-matrix.aspxhttp://en.community.dell.com/techcenter/storage/w/wiki/2661.equallogic-compatibility-matrix.aspxhttp://dell.to/sM4hJThttp://dell.to/sM4hJThttp://en.community.dell.com/techcenter/storage/w/wiki/2661.equallogic-compatibility-matrix.aspxhttp://en.community.dell.com/techcenter/storage/w/wiki/2661.equallogic-compatibility-matrix.aspxhttp://en.community.dell.com/techcenter/storage/w/wiki/equallogic-configuration-guide.aspxhttp://www.delltechcenter.com/http://www.cisco.com/http://www.support.dell.com/


14/14

This white paper is for informational purposes only. The content is provided as is, without express or implied

warranties of any kind.

Documents

Cisco Nexus 5548UP Switch Configuration Guide.pdf