Extended ServiceGuard/Oracle 9iRAC

a high availability cluster solution with

DWDM and Dark Fiber

Mai Cutler

HP Oracle Alliance Lab

Sandy Gruver

HP Oracle Advanced Technology Center

Stefan Pommerenk

Cluster and Parallel Storage Technology/Oracle

•Why “stretch” RAC cluster………….•what are the business drivers

•Review of 9iRAC architecture………•short review of RAC on HPUX

•What is DWDM and Dark Fiber?…...•Use Joe’s ideas and pictures

•Architecture used for the tests………•include mention of other partners - ATT and Nortel?

•Description of tests and results……..•Oracle tests……………………………………………………..•I/O tests…………………………………………………………•Failover tests……………………………………………………•?? Other testing - aka Bob Sauers suggestions (in support of customer-LCH)………………………………………………….

Agenda

Sandy

Sandy

Sandy

Mai

Mai

MaiMaiSandy

Sandy

•Why “stretch” RAC cluster

•Review of 9iRAC architecture

•What is DWDM and Dark Fiber?

•Architecture used for the tests

•Description of tests and results

Agenda

Why a “stretch” RAC cluster?what are the business drivers

A need for a single RAC solution which can span an extended distance (up to 100km)

This solution:• Is simpler than maintaining a standby

– Disaster site is “built-in” to the solution• Provides data protection in case of a local

disaster• Allows having a single RAC database spanning

two geographically distant sites• Ensures no data loss in case of a failure at one

site

Single Oracle Database

HP Server

Log filesDB System files

Rollback files

Temp files

Control files

Data files

Index files

Raw Device and File System Files

Archive Redo Logs

Review of 9iRAC architecture on HP-UXSingle Instance Oracle

HP Server

Redo Log filesInstance A

DB Systemfile(s)

Rollback/Undo files

Temp files

Control files

Data files

Index files

Redo Log filesInstance B

Raw Devices

System A System B

Archive Redo Logs Instance B

Oracle Real Application Cluster Database

Archive Redo Logs Instance A

Per instance

mirrored

Review of 9iRAC architecture on HP-UXOracle 9iRAC

Global Cache Service

USERUSER

SGA

Node 1, Instance A

USERUSERUSERUSER DBWRDBWR LGWRLGWR

DatabaseDatabaseBufferBufferCacheCache

Redo LogRedo LogBuffersBuffers

LCK0LCK0

DataDataDataData

USERUSER

SGA

Node 2, Instance B

USERUSERUSERUSER DBWRDBWR LGWRLGWR

DatabaseDatabaseBufferBufferCacheCache

Redo LogRedo LogBuffersBuffers

LCK0LCK0

RedoRedoRedoRedo RedoRedo

Control

9i Cache Fusion

Review of 9iRAC architecture on HP-UXCache services

Dense Wavelength Division Multiplexing

– Optoelectronic technology– Single optical fiber– Simultaneous transmission of signals– Wavelength of incoming signals changed – Similar to radio or TV broadcasting

What is DWDM and Dark FiberDWDM

What is DWDM

WavelengthConverter

WavelengthConverter

Ch 2

WavelengthConverter Ch 3

Ch 1

Ch 3Ch 2Ch 1

ESCON

100BaseFX

WavelengthConverter

WavelengthConverter

Ch 2

WavelengthConverter

Ch 3

Ch 1 ESCON

Fibre Channel

100BaseFX

Passive OpticalMultiplexer

Passive OpticalMultiplexer

Fibre Channel

1300 nm

1300 nm

1300 nm

1300 nm

1300 nm

1300 nm

Dark fiber

– fiber optic cable– sold by telecom provider– has no light or signal (is “dark”) until customer puts

a signal on it.

Commonly today, telecom providers sell dark fiber over DWDM

What is DWDM and Dark FiberDark Fiber

Common Carrier Dark Fiber

LOCAL CPUSITE A

REMOTE CPUSITE B

What is DWDM and Dark FiberClassic Dark Fiber

Common Carrier Dark Fiber

LOCAL CPUSITE A

REMOTE CPUSITE B

DWDM Device DWDM Device

What is DWDM and Dark FiberDark Fiber with DWDM

• Original tests

* Extended Distance Clusters (new name) allows distances up to 100 km using DWDM technology* Dense Wave Division Multiplexing (DWDM) technology provides the capability to extend the Fibre Channel link distance. * Network and disk communication sharing DWDM links.* Two and three site configurations.* VERITAS VxVM or CVM mirroring (supported up to 100 km)* Quorum Server, arbitrator nodes or dual cluster locks for arbitration.* Extended Distance ServiceGuard eRAC cluster configurations of 2 or 4 nodes using VERITAS CVM, for distances of up to 10 km

• Current tests* Extended Distance ServiceGuard eRAC cluster configurations of 2 nodes using VERITAS CVM, for distances of up to 100 km

Previous testing Extended ServiceGuard Cluster with DWDM

Architecture used for the tests Local ServiceGuard Cluster with 9iRAC

nova101 nova102

FibreChannel

VA7410

C L A SS

C L A SS

VA7410

H

Pr o C ur ve

Sw i t ch 4000 M

100 / 10B T 100 / 10B T 100 / 10B T 100 / 10B T100 / 10B T

H

Pr o C ur ve

Sw i t ch 4000 M

100 / 10B T 100 / 10B T 100 / 10B T 100 / 10B T100 / 10B T

HProCurveSwitch 4000M 100/10BT 100/10BT 100/10BT 100/10BT100/10BT

H

Pr o C ur ve

Sw i t ch 4000 M

100 / 10B T 100 / 10B T 100 / 10B T 100 / 10B T100 / 10B T

FibreChannel

GiGEthernet

Architecture used for the tests Extended ServiceGuard Cluster and 9i RAC with DWDM

100KmFibre

Nortel OPTeraNetwork

Nortel OPTeraNetwork

nova101 nova102

FibreChannel

VA7410100KmFibre

100KM

C L A SS

C L A SS

VA7410

H

Pr o C ur ve

Sw i t ch 4000 M

100 / 10B T 100 / 10B T 100 / 10B T 100 / 10B T100 / 10B T

H

Pr o C ur ve

Sw i t ch 4000 M

100 / 10B T 100 / 10B T 100 / 10B T 100 / 10B T100 / 10B T

HProCurveSwitch 4000M 100/10BT 100/10BT 100/10BT 100/10BT100/10BT

H

Pr o C ur ve

Sw i t ch 4000 M

100 / 10B T 100 / 10B T 100 / 10B T 100 / 10B T100 / 10B T

FibreChannel

GigEthernetGigEthernet

• 2 rp7410s (8 CPUs, 32GB RAM)• 2 Tachyon XL2 FibreChannel HBAs.• 4 ULTRA SCSI internal disks(73GB)• 4 Fibre-based GB Ethernet interfaces

• HP-UX B.11.11 and September 2002 bundle• ServiceGuard A.11.14.14• ServiceGuard Extension A.11.14• Veritas VxVM 3.5• Veritas CVM 3.5• Oracle 9.2.0.3 with RAC option, UDP/IPC

Description of tests Test Configuration

• CR-Test micro-level benchmark.• TPCC-like workload.• I/O performance tests• Failover Tests

Description of tests Test Scenarios

More information