PRIMERGY DuplexDataManager - Fujitsu Technology …manuals.ts.fujitsu.com/file/8274/ddm-config-fc-cx-iscsi... · · 2011-10-06PRIMERGY XXX internal disks for SYSTEM,... Ethernet

Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS

PRIMERGY

DuplexDataManager ®

Configuration Examples for

FibreCAT CXx-xx iSCSI

Windows Server 2003 / 2008

June 5, 2009

Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS1

MultiPath

I/O Fault Tolerance by Redundant Fibre Channel Paths


MultiPath handles Path Redundancy

MultiPath

PRIMERGY

standby

active

FC CXxxx

Storage Array


Load Balancing Option

MultiPath

LUN 0,2,...

Channel = 1

Channel = 0

LUN 1,3,...

Load Balancing Algorithms:

a) AutoBalance load balancing algorithm

b) Per LUN selectable path


standard configuration

MultiPath

Subnet B

Subnet A

PRIMERGY XXX

internal disks

for

SYSTEM,...

NIC #1

Ethernet

LAN

NIC #2

MultiPath

LAN

P0 P1 P0 P1

1st RAID

Disk Array

Controller

Cntrl A

2nd RAID

Disk Array

Controller

Cntrl B

FibreCAT CXxxx iSCSI

Subnet B Subnet A

LAN #2

LAN #1


one switch configuration

MultiPath

Subnet B

Subnet A

PRIMERGY XXX

internal disks

for

SYSTEM,...

NIC #1

Ethernet

LAN

NIC #2

MultiPath

LAN

P0 P1 P0 P1

1st RAID

Disk Array

Controller

Cntrl A

2nd RAID

Disk Array

Controller

Cntrl B


Subnet B Subnet A

! not recommended !

Switch is single point of failure

LAN


direct attached

MultiPath

P0 P1 P0 P1

1st RAID

Disk Array

Controller

Cntrl A

2nd RAID

Disk Array

Controller

Cntrl B


LAN

Subnet B

Subnet A

PRIMERGY XXX

internal disks

for

SYSTEM,...

NIC #1

Ethernet

LAN

MultiPath

NIC #2

Subnet B Subnet A


Tips and Tricks

General Recommendations for MultiPath

IPv4 should be selected (IPv6 not supported)

Do not establish multiple connections to one target before MultiPath installation

For iSCSI boot "spanning tree" must be disabled at the boot NIC's switch port

Check presence and status of all MultiPath Groups

MultiPath status must show Active / Standby

Check Acknowledge Configuration to enable the monitoring of missing paths

MultiPath


DuplexWrite

Highest Data Availability by Mirroring


DuplexWrite mirrors Data

DuplexWrite

original

mirror

FC CXxxx

Storage Array

PRIMERGY


Diskload Balancing Option

DuplexWrite

block# > boundary

block# < boundary

Diskload Balancing Algorithm:

read channel depends on block number

boundary dynamically adjusted


direct attached

DuplexWrite

P0 P1

1st RAID

Disk Array

Controller

Cntrl A


P0 P1

1st RAID

Disk Array

Controller

Cntrl A


LAN

PRIMERGY XXX

internal disks

for

SYSTEM,...

NIC #1

Ethernet

LAN

MultiPath

NIC #2


one switch configuration

DuplexWrite

P0 P1

1st RAID

Disk Array

Controller

Cntrl A


P0 P1

1st RAID

Disk Array

Controller

Cntrl A


LAN

PRIMERGY XXX

internal disks

for

SYSTEM,...

NIC #1

Ethernet

LAN

MultiPath

LAN

! not recommended !

Switch is single point of failure


Tips and Tricks

General Recommendations for DuplexWrite

IPv4 should be selected (IPv6 not supported)

For iSCSI boot "spanning tree" must be disabled at the boot NIC's switch port

Configure DuplexWrite first

Install DDM

Build all DuplexWrite groups and start recovery

...configure your system and applications

Check presence and status of all DuplexWrite groups

DuplexWrite status must show Online for all (partner) disks

Be careful using Disk Administrator

Never delete a COD partition, delete DuplexWrite group first

DuplexWrite


DuplexDataManager

Highest Storage Availability by DuplexWrite & MultiPath


DuplexWrite & MultiPath

DuplexDataManager

Location1 Location2




P0 P1 P0 P1

1st RAID

Disk Array

Controller

Cntrl A

2nd RAID

Disk Array

Controller

Cntrl B


P0 P1 P0 P1

1st RAID

Disk Array

Controller

Cntrl A

2nd RAID

Disk Array

Controller

Cntrl B


LAN

PRIMERGY XXX

internal disks

for

SYSTEM,...

NIC #1

Ethernet

LAN

MultiPath

NIC #2Subnet B

Subnet A

LAN #2

LAN #1


reduced connection costs (partial MultiPath)


P0 P1 P0 P1

1st RAID

Disk Array

Controller

Cntrl A

2nd RAID

Disk Array

Controller

Cntrl B


P0 P1 P0 P1

1st RAID

Disk Array

Controller

Cntrl A

2nd RAID

Disk Array

Controller

Cntrl B


LAN

PRIMERGY XXX

internal disks

for

SYSTEM,...

NIC #1

Ethernet

LAN

MultiPath

NIC #2Subnet B

Subnet A

LAN #2

LAN #1

! not recommended !

No failover when host attached

LAN connection breaks


DuplexDataManager

Disaster Resilient Solution


MS Cluster & DuplexWrite & MultiPath


Location1 Location2

Cluster Interconnect


MS Cluster handles Server Redundancy


Location1 Location2



MultiPath handles Path Redundancy


Location1 Location2



DuplexWrite mirrors Data


Location1 Location2




MS Cluster & MultiPath

Subnet B

Subnet A

PRIMERGY XXX

internal disks

for

SYSTEM,...

NIC #1

Ethernet

LAN

NIC #2

MultiPath

P0 P1 P0 P1

1st RAID

Disk Array

Controller

Cntrl A

2nd RAID

Disk Array

Controller

Cntrl B


Subnet A

LAN

PRIMERGY XXX

internal disks

for

SYSTEM,...

Ethernet

LAN

ScsiPort2NIC #1

NIC #2

MultiPath

Subnet B

LAN #2

LAN #1




Subnet B

Subnet A

PRIMERGY XXX

internal disks

for

SYSTEM,...

NIC #1

Ethernet

LAN

NIC #2

MultiPath

P0 P1 P0 P1

1st RAID

Disk Array

Controller

Cntrl A

2nd RAID

Disk Array

Controller

Cntrl B


Subnet A

LAN

PRIMERGY XXX

internal disks

for

SYSTEM,...

Ethernet

LAN

ScsiPort2NIC #1

NIC #2

MultiPath

Subnet B

P0 P1 P0 P1

1st RAID

Disk Array

Controller

Cntrl A

2nd RAID

Disk Array

Controller

Cntrl B


LAN #2

LAN #1


using switch interconnects


Subnet B

Subnet A

PRIMERGY XXX

internal disks

for

SYSTEM,...

NIC #1

Ethernet

LAN

NIC #2

MultiPath

P0 P1 P0 P1

1st RAID

Disk Array

Controller

Cntrl A

2nd RAID

Disk Array

Controller

Cntrl B


Subnet B

LAN

PRIMERGY XXX

internal disks

for

SYSTEM,...

Ethernet

LAN

ScsiPort2NIC #1

NIC #2

MultiPath

Subnet A

P0 P1 P0 P1

1st RAID

Disk Array

Controller

Cntrl A

2nd RAID

Disk Array

Controller

Cntrl B


LAN #2.1

LAN #1.1

LAN #2.2

LAN #1.2

switch

interconn.


2 switch solution


Subnet B

Subnet A

PRIMERGY XXX

internal disks

for

SYSTEM,...

NIC #1

Ethernet

LAN

NIC #2

MultiPath

P0 P1 P0 P1

1st RAID

Disk Array

Controller

Cntrl A

2nd RAID

Disk Array

Controller

Cntrl B


Subnet A

LAN

PRIMERGY XXX

internal disks

for

SYSTEM,...

Ethernet

LAN

ScsiPort2NIC #1

NIC #2

MultiPath

Subnet B

P0 P1 P0 P1

1st RAID

Disk Array

Controller

Cntrl A

2nd RAID

Disk Array

Controller

Cntrl B


switch

interconn.

! configuration not recommended !

switch failure would cause outage of

the dedicated storage

Subnet A/B Subnet A/B

LAN #1/2 LAN #1/2


! Avoid Split Brain Situations !

DuplexDataManager

Subnet B

Subnet A

PRIMERGY XXX

internal disks

for

SYSTEM,...

NIC #1

Ethernet

LAN

NIC #2

MultiPath

P0 P1 P0 P1

1st RAID

Disk Array

Controller

Cntrl A

2nd RAID

Disk Array

Controller

Cntrl B


Subnet B

LAN

PRIMERGY XXX

internal disks

for

SYSTEM,...

Ethernet

LAN

ScsiPort2NIC #1

NIC #2

MultiPath

Subnet A

P0 P1 P0 P1

1st RAID

Disk Array

Controller

Cntrl A

2nd RAID

Disk Array

Controller

Cntrl B


LAN #2.1

LAN #1.1

LAN #2.2

LAN #1.2

single point of failure


Bringup nodeA, and nodeB separately (use ServerStart) Install Windows Server 2003 including latest update & hotfixes

Install DuplexDataManager on all nodes

Install and configure all LAN connections Configure NICs and switches

Configure the iSCSI SW target

Configure the Storages Shut down all but nodeA

Configure LUNs pairwise on both storages (DuplexWrite groups)

Register all nodes for each path

Create DuplexWrite groups Shut down all but nodeA

Create all DuplexWrite groups on storageA (no mirror disks)

Add second disks at storageB and start recover

Reboot this node (nodeA)

Install Microsoft Cluster Services Install MSCS on nodeA (nodeB off)

Install MSCS on nodeB (cluster installation - join)

Check DDM and cluster functionality

Setting up MS Cluster & DDM (WS 2003)

Prim Prim

Prim Prim

Prim Prim


Bringup all nodes separately (use ServerStart) Install Windows Server 2008 including latest update & hotfixes

Install DuplexDataManager on all nodes

Install and configure all LAN connections Configure NICs and switches

Configure the iSCSI SW target

Configure the Storages Configure LUNs pairwise on both storages (DuplexWrite groups)

Register all nodes for each path

Create DuplexWrite groups Shut down all but one node

Create all DuplexWrite groups

Add second disks (do not start recover, status is Online - Error)

Reboot this node, start all other nodes

Add the feature Failover Clustering Start the Failover Cluster Management, select Validate a Configuration

Evaluate the cluster validation log (do not proceed until it is error free)

Create the Failover Cluster Recover all DuplexWrite groups on the node which owns the disk resource

Create all partitions on the cluster disk resources (DuplexWrite groups)

Acknowledge the MultiPath configuration on all nodes

If all DuplexWrite groups are Online test the functionality(e.g. Path failover, moving resources to other nodes, ... )

Install the Failover Clustering applications.

Setting up MS Cluster & DDM (WS 2008)

Prim Prim

Prim Prim

Prim Prim


Documentation General hint: read the related documents !

Contained on DDM-CD:

Readme

Online help ( newest / best reference ! )

Configuration slides

DDM related links:

DDM's home (Intranet)http://synergy.pdb.fsc.net/> DuplexDataManager

Partners (Corporate Extranet)https://partners.ts.fujitsu.com/com/products/servers/primergy/haproducts/> Product catalog > Server products > Industry standard > High availabiliy products

Online Manuals (Internet)http://manuals.ts.fujitsu.com/> Industry Standard Servers > Software > Select High Availability > Select PRIMERGY DuplexDataManager

PRIMERGY clustering and disaster tolerance (Internet)http://ts.fujitsu.com/products/software/cluster_technology/primergycluster.html> Business > Products > Software > High Availability > PRIMERGY cluster

DuplexDataManager updates (Internet)http://support.ts.fujitsu.com/com/support/index.html> SUPPORT > Driver & Downloads > Full text search Software; Search: DuplexDataManager, MultiPath or MPIO

PRIMERGY servers (Internet)http://ts.fujitsu.com/products/standard_servers/

Disk storage systems (Internet)http://ts.fujitsu.com/products/storage/disk/

MS Cluster documentation

DuplexDataManager

http://synergy.pdb.fsc.net/

https://partners.ts.fujitsu.com/com/products/servers/primergy/haproducts/

http://manuals.ts.fujitsu.com/

http://ts.fujitsu.com/products/software/cluster_technology/primergycluster.html

http://support.ts.fujitsu.com/com/support/index.html

http://support.ts.fujitsu.com/com/support/

http://ts.fujitsu.com/products/standard_servers/

http://ts.fujitsu.com/products/storage/disk/


FibreCAT CX3-x0

Appendix

B Po

rt 0

Po

rt 1

A Po

rt 0

Po

rt 1

P0 P1 P0 P1

1st RAID

Disk Array

Controller

Cntrl A

2nd RAID

Disk Array

Controller

Cntrl B



FibreCAT CX4-120/240

Appendix

B

Port 0

Port 1

A

Port 0

Port 1

P0 P1 P0 P1

1st RAID

Disk Array

Controller

Cntrl A

2nd RAID

Disk Array

Controller

Cntrl B



Documents

PRIMERGY DuplexDataManager - Fujitsu Technology …manuals.ts.fujitsu.com/file/8274/ddm-config-fc-cx-iscsi... · · 2011-10-06PRIMERGY XXX internal disks for SYSTEM,... Ethernet