OptIPuter Networks

Overview of Initial Stages to Include

OptIPuter Nodes

OptIPuter Networks

OptIPuter Expansion

OPtIPuter All Hands Meeting

February 6-7

UCSD

Compute + Data + Viz Grid: Building Block

• Generic OptIPuter node is one or more of:– Cluster: 16 – 128 nodes (160GF – 1.2 TF)– Storage: 0.5TB – 10 TB– Visualization: Desktop, Wall, Immersive– Specialized data source/sink instruments

• Connected to other nodes via the OptIPuter Network

Commodity GigE Switch

switch switch

switchswitch

• Cluster – Disk

• Disk – Disk

• Viz – Disk

• DB – Cluster

• Cluster – Cluster

School of Med

Chemistry, Preuss, 6th College, Engineering, Arts

SDSCSIO, SDSU

High-end

DB

S

erver

switch

ChiaroRouter

Nodes Connected by Optical Routers or Switches

UCSD OptIPuter

½ Mile

Initial UCSD OptIPuter Deployment

SIO

SDSC

CRCA

Phys. Sci -Keck

SOM

JSOE Preuss

6th College

Phase I, Fall/Winter 2002-03

Phase II, 2003

SDSCAnnex

To Other OptIPuter Sites

Central hub/router

Node M

UCSD OptIPuter Fiber and Nodes

SDSC90 Nodes

JSOE24 Nodes

Keck Chem39 Nodes

SIO IGPP Viz

BIRN SOM32 Nodes + EM

SDSC Annex16 Nodes

Preuss Viz

SDSU Viz

CRCA Viz

6th College Viz

4

4

4

4 BondedGigE Linksover fiberpairs

4

4

4

4

4

UCI

CalREN-HPRNational Light Rail

OptIPuter UCSD / San Diego Network

1/12/03 -grh

Chiaro

4 GigE

GigE

Teraburst

Teraburst

1

OC-48/192

Future

4

UCSD OptIPuter Network Expansions

• Initial anticipated network deployments (Fall 2002, Winter 2003)– 4 GigE connections (using 4 fiber pairs) to high performance nodes– 1 GigE connections (using 1 fiber pair) to other nodes– Each node's OPPP (OptIPuter Point of Presence) is initially a local GigE

switch with 4 bondable GigE (GBIC) uplinks– Above nodes uplinks connected to a central GigE aggregate switch– Above is a separate research network (not connected to campus network)

• During 2003, upgrade OptIPuter network as required …– N x 10 GigE (over existing fiber pairs?, N could be up to 4) ... and/or– Add lambda gear to conserve fiber (supporting 1 or 10 GigE x N lambdas) – Add management to support dynamic lambda allocation – Add edge (of OptIPuter) router for connecting to campus or remote

OptIPuter sites

• Late 2003 and 2004– Interconnect multiple OptIPuter sites (NU, EVL, USC/ISI, UCI, …)– Expand network/lambda management to span sites

[Inter]-National OptIPuter Expansion

Internet 2Abilene(today)

SDSC90 Nodes

JSOE24 Nodes

Keck Chem39 Nodes

SIO IGPP Viz

BIRN SOM32 Nodes + EM

SDSC Annex16 Nodes

Preuss Viz

SDSU Viz

CRCA Viz

6th College Viz

4 Bonded GigELinks each

Cluster[s]

NWU32 Nodes

EVL32 Nodes

Cisco 6509

Foundry

Juniper

GlimmerGlass ONI DWDM ONI DWDM

Calient

Cisco 6509

Star LightChicagoEVL ChicagoUCSD

NWUChicago

LAC UICChicago

UCI

USC

ISI

U of Amsterdam

Amsterdam32 Nodes

Cisco 6509

Calient

2x OC-192

LAC16 Nodes

Foundry

FoundryLA POPI Wilshire

ISI1152 Nodes

ISI64 SMP

ISI32 Nodes

ISIxTB

CalREN-HPRNLR?

(tomorrow)

1/12/03 -grh

Chiaro

10GigE

OC-192

4 GigE

GigE

SDSU

Teraburst

Teraburst

OC-48/192

Future

San Diego

Los Angelas

ChicagoEurope

CalREN Fiber Paths

CalREN Southern California Paths

15808 Terminal, Regen or OADM site (OpAmp sites not shown)Fiber route

PITPIT

PORPOR

FREFRE

RALRAL

WALWAL

NASNASPHOPHO

OLGOLG ATLATL

CHICHI

CLECLE

KANKAN

OGDOGD

SACSAC BOSBOSNYCNYC

WDCWDC

STRSTR

DALDAL

DENDEN

LAXLAX

SVLSVL

SEASEA

SDGSDG

NLR Footprint and Layer 1 Topology

New OptIPuter Participate and Nodes

• Research requirements – Contribute to existing OptIPuter goals as defined in

– OptIPuter Proposal – NSF Statement of Work

– Involve collaboration with existing OptIPuter PI and Co-PIs– Expand OptIPuter project to address new areas of research

– Supported by new proposals and resources– Providing new application drivers– Providing integration with new infrastructure– Expanding the optical network testbed

• Technical and operational requirements – Network connectivity

– Dedicated research fiber/lambda path to OptIPuter network– Appropriate network electronics to support connectivity

– Ability to work within experimental network environment • Financial requirements

– Impose no financial burden on existing grant– Develop support for

– hardware– manpower – connectivity to OptIPuter network