NetApp Cabling Diagrams (PDF) v2.3

Contents

Page 2 Cabling Rules

Page 3 Controller and Shelf Layout

Page 4 DSxxxx (IOMx) – FAS2040 – Single Stack

Page 5 DSxxxx (IOMx) – One HBA per Controller – Single Stack

Page 6 DSxxxx (IOMx) – One HBA per Controller – Two Stacks

Page 7 DSxxxx (IOMx) – Two HBAs per Controller – Two Stacks

Page 8 DSxxxx (IOMx) – Two HBAs per Controller – Three / Four Stacks

Page 9 DSxxxx (IOMx) – Two HBAs per Controller – Three / Four Stacks ACP Cabling

Page 10 DS14 – On-board Ports – One or Two Stacks

Page 11 DS14 – On-board + One HBA – Two Stacks

Page 12 DS14 – Two HBAs – Two Stacks

Page 13 DS14 – Two HBAs – Four Stacks

WireGuage Link: http://communities.netapp.com/community/netapp_partners_network/ps/

service/tools/wiregauge?view=documents

NetApp Cabling Diagrams

◆ Controller 2 always connects to the top disk shelf IOM B and the bottom disk shelf IOM A in a stack of disk shelves; ideally to the IOM B square port and to the IOM A circle port, as shown in the following illustration.

Always connect circle ports to square ports and square ports to circle ports.

Always cable the SAS connections first and then the ACP connections so that the storage system quickly initiates the ACP discovery.

Dual-port SAS HBA rules:◆ Dual-port SAS HBAs are only supported on FAS2050 storage systems.◆ QSFP to mini-SAS passive copper cables are used to connect from the disk shelf to the dual-port HBA. QSFP to QSFP cables are used to connect shelf-to-shelf.◆ HBA port A always connects to the top disk shelf in a stack of disk shelves.◆ HBA port B always connects to the bottom disk shelf in a stack of disk

In a storage system (single-controller or active/active) with a single-shelf stack, HBA port A connects to IOM A and HBA port B connects to IOM B.

Quad-port SAS HBA rules:◆ Quad-port SAS HBAs are only supported on certain storage systems. See the System Configuration Guide for supported storage systems on the NOW site at http://now.netapp.com/.◆ HBA port A and port C always connect to the top disk shelf in a stack of disk shelves.◆ HBA port B and port D always connect to the bottom disk shelf in a stack of disk shelves.Think of the four HBA ports as two units of ports. Port A and port C are the top connection unit, and port B and port D are the bottom connection unit.Each unit (A/C and B/D) connects to each of the two ASIC chips on the HBA. If one chip fails, the HBA maintains connectivity to the stack of disk shelves.

Top and bottom connections:SAS cabling is based on the rule that each controller is connected to the top disk shelf and the bottom disk shelf in a stack of disk shelves:

◆ Controller 1 always connects to the top disk shelf IOM A and the bottom disk shelf IOM B in a stack of disk shelves; ideally to the IOM A square port and to the IOM B circle port, as shown in the following illustration.

A unit of HBA ports, A/B or C/D, never connects to the same stack of disk shelves if there is more than one stack of disk shelves in a storage system.

Cable Labels Explained

1a / N1

A / S1

Port number on

the controller.

The controller or Node

this cable plugs in to.

Either Node1 (N1) or

Node 2 (N2).

Combinations of either

module A or B on DS4243

shelves, then Circle or

Square indicating the port.

Squares are always IN on

shelf 1, and circles OUT

on the last shelf in a loop.

Indicates shelf stacks.

S1 is stack 1, S2 stack

2, etc. A stack is a

collections of shelves

from the same loop –

up to 6 DS14's and 10

DS4243's.

Note. Yellow labels

are OUT ports.

Always cable HBA ports in the following sequence:a. Cable top connections first.Cable all A ports and then all C ports in increasing order of HBAs within a controller.For example, a controller with three HBAs (HBA 1, 2, 3) has its A ports and C ports cabled in the following order: 1a, 2a, 3a, 1c, 2c, 3c.b. Cable bottom connections second.- For controllers with one HBA, cable D port and then B port.- For controllers with more than one HBA, offset the cabling so that you begin on HBA 2. Cable B ports and D ports in increasing order ofHBAs, ending on HBA 1.For example, a controller with three HBAs has its B ports and D ports cabled in this order: 2b, 3b, 1d, 2d, 3d, 1b.

0a 0b 0c 0de0be0a

0a 0b 0c 0de0be0a

0a 0b 0c 0de0be0a

0a 0b 0c 0de0be0a

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2

Disconnect allsupply power forcomplete isolation.




IOM3

IOM3

LIN

K

LIN

K

IOM3

IOM3

LIN

K

LIN

K

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2





IOM3

IOM3

LIN

K

LIN

K

IOM3

IOM3

LIN

K

LIN

K

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2





IOM3

IOM3

LIN

K

LIN

K

IOM3

IOM3

LIN

K

LIN

K

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2





IOM3

IOM3

LIN

K

LIN

K

IOM3

IOM3

LIN

K

LIN

K

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2





IOM3

IOM3

LIN

K

LIN

K

IOM3

IOM3

LIN

K

LIN

K

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2





IOM3

IOM3

LIN

K

LIN

K

IOM3

IOM3

LIN

K

LIN

K

A - S1

A - S1

B - S1

B - S1

A - S2

B - S2

A - S2

B - S2

Shelf IDs for DS4243 Shelves are

unique throughout the whole HA-Pair.

Stack 1 (S1) is numbered 01 to 10




Shelf IDs for DS14 Shelves are

numbered 1 to 6 for each stack.

S1 is 1 to 6

S2 is 1 to 6

Etc.

Square symbols are always the first shelf in a

stack.

Circle symbols are always the last shelf in a

stack, identified by the yellow colour.

Useful Hints

Unpack all shelf cables (FC and QSFPs) and

stick the labels on in one go before connecting

to shelves. You will then be able to connect

cables quickly and easily without referring to the

diagram.

Consider cable lengths before applying labels.

NOTE – Please remember to run WireGuage

after each installation

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2





IOM3

IOM3

LIN

K

LIN

K

IOM3

IOM3

LIN

K

LIN

K

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2





IOM3

IOM3

LIN

K

LIN

K

IOM3

IOM3

LIN

K

LIN

K

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2





IOM3

IOM3

LIN

K

LIN

K

IOM3

IOM3

LIN

K

LIN

K

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2





IOM3

IOM3

LIN

K

LIN

K

IOM3

IOM3

LIN

K

LIN

K

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2





IOM3

IOM3

LIN

K

LIN

K

IOM3

IOM3

LIN

K

LIN

K

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2





IOM3

IOM3

LIN

K

LIN

K

IOM3

IOM3

LIN

K

LIN

K

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2





IOM3

IOM3

LIN

K

LIN

K

IOM3

IOM3

LIN

K

LIN

K

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2





IOM3

IOM3

LIN

K

LIN

K

IOM3

IOM3

LIN

K

LIN

K

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2





IOM3

IOM3

LIN

K

LIN

K

IOM3

IOM3

LIN

K

LIN

K

Two stack, HA Pair Layout Example for Future

Expansion

Sh

elv

es 1

1-2

0

Sh

elv

es 0

1-1

0

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2

CAUTION

3

1

4

2





IOM3

IOM3

LIN

K

LIN

K

IOM3

IOM3

LIN

K

LIN

KS

he

lf 1

1S

he

lf 0

1

Document Name

Drawing Title Drawn By

Date

Page

Associated Label Document Name

Revision

Paul Moyne / Brett Pickering 4 of 13

Labels – DSxxxx Euro Label vx.x - FAS2040-1Stk.docx

2.3

DSxxxx & DS14 Cabling Diagrams

DSxxxx (IOMx) – FAS2040 - Single Stack

FAS2040 (N1)

FAS2040 (N2)

0d

0d

0d / N1

A / S1

0d / N2

B / S1

0d / N1

A / S1

0d / N2

B / S1

Two of each

label required

0d / N1

A / S1

0d / N2

B / S1

IOM A

IOM B

IOM A

IOM B

IOM A

IOM B

Shelf ID 01

Shelf ID 10

Shelf ID 02-09

e0P

e0P

ACP SAS

Stack 1

(S1)

DSxxxx (IOMx) – FAS2040 - Single Stack

October 2010

SAS

Shelf ID 01

Shelf ID 10

1a / N1

A / S1

1a / N1

A / S1

ACP

Stack 1

(S1)

1a / N1

A / S1

1d / N1

B / S1

1a / N2

B / S1

1d / N2

A / S1

1d / N1

B / S1

1d / N2

A / S1

1a / N2

B / S1

HBA 1A

B

C

D

Controller 1 (N1)

e0a /

ACP

HBA 1A

B

C

D

Controller 2 (N2)

e0a /

ACP

1a / N2

B / S1

1d / N2

A / S1

1d / N1

B / S1

Two of each

label required

Document Name


Date

PageRevision



DSxxxx (IOMx) – One HBA SAS Card – Single Stack

Shelf ID 02-09

IOM A

IOM B

IOM A

IOM B

IOM A

IOM B

DSxxxx (IOMx) – One HBA SAS Card per Controller – Single Stack

Associated Label Document NameLabels - DSxxxx Euro Label vx.x - 1HBA-1Stk.docx

2.3

October 2010

SAS SASACP

Shelf ID 01

Shelf ID 10

Shelf ID 11

Shelf ID 20

1a / N1

A / S1

1a / N1

A / S1

ACP

Stack 1

(S1)

1a / N1

A / S1

1b / N2

A / S2

1b / N1

B / S2

1c / N1

A / S2

1d / N1

B / S1

1a / N2

B / S1

1c / N2

B / S2

1d / N2

A / S1

1c / N1

A / S2

1c / N2

B / S2

1b / N2

A / S2

1b / N1

B / S2

1d / N1

B / S1

1d / N2

A / S1

1a / N2

B / S1

1c / N2

B / S2

HBA 1A

B

C

D

Controller 1 (N1)

e0a /

ACP

HBA 1A

B

C

D

Controller 2 (N2)

e0a /

ACP

1a / N2

B / S1

1b / N2

A / S2

1d / N2

A / S1

1c / N1

A / S2

1b / N1

B / S2

1d / N1

B / S1

Stack 2

(S2)

ACP

Two of each

label required

Document Name


Date

PageRevision



DSxxxx (IOMx) - One HBA SAS Card - Two Stacks

Shelf ID 02-09 Shelf ID 12-19

IOM A

IOM B

IOM A

IOM B

IOM A

IOM B

IOM A

IOM B

IOM A

IOM B

IOM A

IOM B

DSxxxx (IOMx) - One HBA SAS Card per Controller - Two Stacks

Associated Label Document NameLabels - DSxxxx Euro Label vx.x - 1HBA-2Stk.docx

2.3

October 2010

SAS SASACP

Shelf ID 01

Shelf ID 10

Shelf ID 11

Shelf ID 20

1a / N1

A / S1

1a / N1

A / S1

ACP

Stack 1

(S1)

1a / N1

A / S1

1d / N2

A / S21d / N1

B / S2

2a / N1

A / S2

2b / N1

B / S1

1a / N2

B / S1

2a / N2

B / S2

2b / N2

A / S1

2a / N1

A / S2

2a / N2

B / S2

1d / N2

A / S2

1d / N1

B / S2

2b / N1

B / S1

2b / N2

A / S1

1a / N2

B / S1

2a / N2

B / S2

HBA 1 HBA 2A

B

C

D

A

B

C

D

Controller 1 (N1)

e0a /

ACP

HBA 1 HBA 2A

B

C

D

A

B

C

D

Controller 2 (N2)

e0a /

ACP

1a / N2

B / S1

1d / N2

A / S2

2b / N2

A / S1

2a / N1

A / S2

1d / N1

B / S2

2b / N1

B / S1

Stack 2

(S2)

ACP

Two of each

label required

Document Name


Date

PageRevision

Paul Moyne / Brett Pickering 7 of 13DSxxxx (IOMx) - Two HBA SAS Cards - Two Stacks


IOM A

IOM B

IOM A

IOM B

IOM A

IOM B

IOM A

IOM B

IOM A

IOM B

IOM A

IOM B

DSxxxx (IOMx) - Two HBA SAS Cards per Controller - Two Stacks

Associated Label Document NameLabels - DSxxxx Euro Label vx.x - 2HBA-2Stk.docxDSxxxx & DS14 Cabling Diagrams

2.3

October 2010

Document Name


Date

PageRevision

Paul Moyne / Brett Pickering 8 of 13DSxxxx (IOMx) - Two HBA SAS Cards - Four Stacks

HBA 1 HBA 2A

B

C

D

A

B

C

D

Controller 1 (N1)

e0a /

ACP

HBA 1 HBA 2A

B

C

D

A

B

C

D

Controller 2 (N2)

e0a /

ACP

Stack 1 (S1)

Sh

elf

ID

01

Sh

elf

ID

10

Stack 2 (S2)

IOM A

IOM B

IOM A

IOM B

Sh

elf

ID

11

Sh

elf

ID

20

Stack 3 (S3)

IOM A

IOM B

IOM A

IOM B

Sh

elf

ID

21

Sh

elf

ID

30

Stack 4 (S4)

IOM A

IOM B

IOM A

IOM B

Sh

elf

ID

31

Sh

elf

ID

40

1a / N1

A / S1

1a / N1

A / S1

1a / N2

B / S1

2b / N1

B / S1

2b / N1

B / S1

1a / N2

B / S1

2a / N1

A / S2

2a / N1

A / S2

2b / N2

A / S1

2b / N2

A / S1

2a / N2

B / S2

2a / N2

B / S2

1d / N2

A / S2

1d / N2

A / S2

1d / N1

B / S2

1d / N1

B / S2

1c / N1

A / S3

1c / N1

A / S3

1b / N1

B / S4

1b / N1

B / S4

1c / N2

B / S3

1c / N2

B / S3

2c / N2

B / S4

2c / N2

B / S4

2c / N1

A / S4

2c / N1

A / S4

2d / N1

B / S3

2d / N1

B / S3

2d / N2

A / S3

2d / N2

A / S3

1b / N2

A / S4

1b / N2

A / S4

1a / N1

A / S1

2a / N1

A / S2

1c / N1

A / S3

2c / N1

A / S4

1a / N2

B / S1

2a / N2

B / S2

1c / N2

B / S3

2c / N2

B / S4

1b / N1

B / S4

2b / N1

B / S1

1d / N1

B / S2

2d / N1

B / S3

1b / N2

A / S4

2b / N2

A / S1

1d / N2

A / S2

2d / N2

A / S3

Two of each

label required

IOM A

IOM B

IOM A

IOM B

DSxxxx (IOMx) - Two HBA SAS Cards per Controller - Four Stacks

Associated Label Document NameLabels - DSxxxx Euro Label vx.x - 2HBA-4Stk-Pt1/2.docxDSxxxx & DS14 Cabling Diagrams

2.3

October 2010

Document Name


Date

PageRevision

Paul Moyne / Brett Pickering 9 of 13DSxxxx (IOMx) - Two HBA SAS Cards per Controller - ACP

HBA 1 HBA 2A

B

C

D

A

B

C

D

Controller 1 (N1)

e0a /

ACP

HBA 1 HBA 2A

B

C

D

A

B

C

D

Controller 2 (N2)

e0a /

ACP

Stack 1 (S1)

Sh

elf

ID

01

Sh

elf

ID

10

Stack 2 (S2)

IOM A

IOM B

IOM A

IOM B

Sh

elf

ID

11

Sh

elf

ID

20

Stack 3 (S3)

IOM A

IOM B

IOM A

IOM B

Sh

elf

ID

21

Sh

elf

ID

30

Stack 4 (S4)

IOM A

IOM B

IOM A

IOM B

Sh

elf

ID

31

Sh

elf

ID

40

IOM A

IOM B

IOM A

IOM B

DSxxxx (IOMx) - Two HBA SAS Cards per Controller - ACP

Associated Label Document NameN/ADSxxxx & DS14 Cabling Diagrams

2.3

October 2010

Shelf ID 6

Shelf ID 1

Shelf ID 6

Stack 1 (S1)

0a

0b

0c

0d

Controller 1 (N1) Controller 2 (N2)

Stack 2 (S2)

Two of each

label required

Shelf ID 1

0a

0b

0c

0d

FAS 3xxx FAS 3xxx

0a / N1

Ain / S1

0a / N1

Ain / S1

0d / N1

Bin / S2

0d / N1

Bin / S2

0c / N2

Bin / S1

0c / N2

Bin / S1

0b / N2

Ain / S2

0b / N2

Ain / S2

0b / N1

Aout / S2

0b / N1

Aout / S2

0c / N1

Bout / S1

0c / N1

Bout / S1

0a / N2

Aout / S1

0a / N2

Aout / S1

0d / N2

Bout / S2

0d / N2

Bout / S2

0a / N1

Ain / S1

0d / N1

Bin / S2

0b / N2

Ain / S2

0c / N2

Bin / S1

0b / N1

Aout / S2

0c / N1

Bout / S1

0a / N2

Aout / S1

0d / N2

Bout / S2

Document Name


Date

PageRevision

Paul Moyne / Brett Pickering 10 of 13DS14 (ESH#) – On-board Ports – One or Two Stacks


DS14 (ESH#) – On-board Ports – One or Two Stacks

Associated Label Document NameLabels - DS14 Euro Label vx.x - Onboard-2Stk.docxDSxxxx & DS14 Cabling Diagrams

2.3

October 2010

Shelf ID 6

Shelf ID 1

Shelf ID 6

Stack 1 (S1)

0a

0b

0c

0d


Stack 2 (S2)

Two of each

label required

Shelf ID 1

0a

0b

0c

0d

FAS 3xxx FAS 3xxx

0a / N1

Ain / S1

0a / N1

Ain / S1

1b / N1

Bin / S2

1b / N1

Bin / S2

1a / N2

Bin / S1

1a / N2

Bin / S1

0b / N2

Ain / S2

0b / N2

Ain / S2

0b / N1

Aout / S2

0b / N1

Aout / S2

1a / N1

Bout / S1

1a / N1

Bout / S1

0a / N2

Aout / S1

0a / N2

Aout / S1

1b / N2

Bout / S2

1b / N2

Bout / S2

0a / N1

Ain / S1

1b / N1

Bin / S2

0b / N2

Ain / S2

1a / N2

Bin / S1

0b / N1

Aout / S2

1a / N1

Bout / S1

0a / N2

Aout / S1

1b / N2

Bout / S2

1a

1b

1c

1d

1a

1b

1c

1d

Document Name


Date

PageRevision

Paul Moyne / Brett Pickering 11 of 13DS14 (ESH#) – On-board + One HBA – Two Stacks


DS14 (ESH#) – On-board + One HBA – Two Stacks

Associated Label Document NameLabels - DS14 Euro Label vx.x - Onboard+1HBA-2Stk.docxDSxxxx & DS14 Cabling Diagrams

2.3

October 2010

Shelf ID 6

Shelf ID 1

Shelf ID 6

Stack 1 (S1)

1a

1b

1c

1d


Stack 2 (S2)

Two of each

label required

Shelf ID 1

1a

1b

1c

1d

FAS 3xxx FAS 3xxx

1a / N1

Ain / S1

1a / N1

Ain / S1

2b / N1

Bin / S2

2b / N1

Bin / S2

2a / N2

Bin / S1

2a / N2

Bin / S1

1b / N2

Ain / S2

1b / N2

Ain / S2

1b / N1

Aout / S2

1b / N1

Aout / S2

2a / N1

Bout / S1

2a / N1

Bout / S1

1a / N2

Aout / S1

1a / N2

Aout / S1

2b / N2

Bout / S2

2b / N2

Bout / S2

1a / N1

Ain / S1

2b / N1

Bin / S2

1b / N2

Ain / S2

2a / N2

Bin / S1

1b / N1

Aout / S2

2a / N1

Bout / S1

1a / N2

Aout / S1

2b / N2

Bout / S2

2a

2b

2c

2d

2a

2b

2c

2d

Document Name


Date

PageRevision

Paul Moyne / Brett Pickering 12 of 13DS14 (ESH#) – Two HBAs – Two Stacks


DS14 (ESH#) – Two HBAs – Two Stacks

Associated Label Document NameLabels - DS14 Euro Label vx.x - 2HBA-2Stk.docxDSxxxx & DS14 Cabling Diagrams

2.3

October 2010

Document Name


Date

PageRevision

Paul Moyne / Brett Pickering 13 of 13DS14 (ESH#) - Two HBA FC Cards - Four Stacks

1a

1b

1c

1d

2a

2b

2c

2d

1a

1b

1c

1d

2a

2b

2c

2d

Stack 1 (S1)

Stack 2 (S2)

Stack 3 (S3)

Stack 4 (S4)

Two of each

label required

1a / N1

Ain / S1

Shelf ID 1 Shelf ID 1




2b / N1

Bin / S2

1b / N1

Aout / S2

2c / N1

Bin / S3

2d / N1

Bout / S4

2a / N1

Bout / S1

1d / N1

Ain / S4

1a / N2

Aout / S1

1d / N2

Aout / S4

1c / N2

Ain / S3

1b / N2

Ain / S2

2b / N2

Bout / S2

2a / N2

Bin / S1

2c / N2

Bout / S3

2d / N2

Bin / S4

1a / N1

Ain / S1

2a / N1

Bout / S1

1a / N2

Aout / S1

2a / N2

Bin / S1

1c / N1

Aout / S3

1b / N1

Aout / S2

2b / N1

Bin / S2

1b / N2

Ain / S2

2b / N2

Bout / S2

1c / N1

Aout / S3

2c / N1

Bin / S3

1c / N2

Ain / S3

2c / N2

Bout / S3

1d / N1

Ain / S4

2d / N1

Bout / S4

1d / N2

Aout / S4

2d / N2

Bin / S4

1a / N1

Ain / S1

Controller 1 (N1)

FAS 3xxx

Controller 2 (N2)

FAS 3xxx

2a / N2

Bin / S1

1a / N2

Aout / S1

2a / N1

Bout / S1

2b / N1

Bin / S2

1b / N2

Ain / S2

1b / N1

Aout / S2

2b / N2

Bout / S2

1c / N2

Ain / S3

2c / N1

Bin / S3

1c / N1

Aout / S3

2c / N2

Bout / S3

1d / N1

Ain / S4

2d / N2

Bin / S4

1d / N2

Aout / S4

2d / N1

Bout / S4

DS14 (ESH#) - Two HBA FC Cards per Controller - Four Stacks

Associated Label Document NameLabels - DS14 Euro Label vx.x - 2HBA-4Stk-Pt1/2.docxDSxxxx & DS14 Cabling Diagrams

2.3

October 2010

Documents

NetApp Cabling Diagrams (PDF) v2.3