Upload
nguyenxuyen
View
231
Download
3
Embed Size (px)
Citation preview
InfiniBand and Next Generation Enterprise Networks
Paul Morkel and Brian Savory
ADVA Optical Networking
© 2009 ADVA Optical Networking. All rights reserved. ADVA confidential. 2
Automobile
The pace of technical innovation is accelerating
0 25 50 100 125 150 75 Years
0
50
100 Telephone Electricity
Radio
Television
VCR PC
Cellular
% P
enet
ratio
n
© 2008 IBM Corporation
Adoption of new technologies are taking hold at double or triple previous rates
© 2009 ADVA Optical Networking. All rights reserved. ADVA confidential. 3
Financial services Medical imaging Mobile phones
Sources: IBM Global Technology Outlook, 2005; TABB Group, Trading at Light Speed: Analyzing Low Latency Market Data Infrastructure, March 2007; Aite Group, Algorithmic Trading 2006: More Bells and Whistles, November 2006; Infonetics Research, Radio Access Network Equipment and Subscribers report, October 2007; Pyramid Research, October 2007
1MB/2D image
1TB/4D image
5B market messages
~130B market messages
1B mobile subscribers
~4B mobile subscribers
2004 2007 2006 2010 2002 2010 By 2010 . . .
. . . medical images will take up 30% of the world’s
storage
By 2010 . . .
. . . over half of U.S. equities
trading will be algorithmic
By 2010 . . .
. . . 74% of the world’s mobile
subscribers will live in emerging economies
© 2008 IBM Corporation
Business innovation is accelerating with advancements in technology
© 2009 ADVA Optical Networking. All rights reserved. ADVA confidential. 4
© 2009 ADVA Optical Networking. All rights reserved. ADVA confidential. 5
“More than 70% of the world’s Global 1000 organizations will have to modify their data center facilities significantly during the next five years.”
Gartner Group, September 2007
© 2008 IBM Corporation
© 2009 ADVA Optical Networking. All rights reserved. ADVA confidential. 6
Problem: connectivity performance
Ref.: Ishida, O., NTT, “Toward Terabit LAN/WAN” Panel, iGRID2005
Moore’s Law Doubles every 18m
WDM
TDM
FC Ethernet
InfiniBand
4x 12x 4xDDR
12xQDR
Fiber
lin
k ca
pac
ity
[b/s
]
100M
1G
10G
100G
1T
10T
1980 1985 1990 1995 2000 2005 2010
© 2009 ADVA Optical Networking. All rights reserved. ADVA confidential. 7
CPU connectivity – market
0%
10%
20%
30%
40%
50% 2006 2007
Market penetration of different CPU interconnect technologies
© 2009 ADVA Optical Networking. All rights reserved. ADVA confidential. 8
System z10 an IB based system
© 2009 ADVA Optical Networking. All rights reserved. ADVA confidential. 9
Coupling Facility
Coupling Facility
Switch/ Director
Switch/ Director ESS DASD
ESS DASD
Mainframe
*Geographically Dispersed Parallel Sysplex™ (IBM qualified)
CF CF
Highest protection through redundant Mainframe and Storage (ESS) Server coupling and timers via Coupling Links (ISC-2, ISC-3) Disk mirroring via METRO (ESCON and FC) or GLOBAL XRC (FICON)
Fiber
Fiber
A
B
GDPS STP up to 100km and more (with RPQ)
175km
PPRC 4 &10 G ISLs to 175km WITH NO MID SPAN HUT!
Mainframe
IBM GDPS® – FC Server Time Protocol (STP)
© 2009 ADVA Optical Networking. All rights reserved. ADVA confidential. 10
Coupling Facility
Coupling Facility
Switch/ Director
Switch/ Director ESS DASD
ESS DASD
Mainframe
*Geographically Dispersed Parallel Sysplex™
CF CF
Highest protection through redundant Mainframe and Storage (ESS) Server coupling 2.5 or 5G INFINIBAND (IB) Disk mirroring via METRO (ESCON and FC) or GLOBAL XRC (FICON)
Fiber
Fiber
A
B
0-200 km
PPRC 4 &10 G ISLs to 200km WITH NO MID SPAN HUT! Mainframe
Extended Distance GDPS STP with 2.5 or 5G Infinband
IBM GDPS® – Server Time Protocol (STP) over IB ADVA is the only qualified vender!!!
© 2009 ADVA Optical Networking. All rights reserved. ADVA confidential. 11
Why is it relevant? Data centers disperse geographically
(GRID computing, visualization, disaster recovery, …)
Native, low-latency IB-over-Distance transport was still the missing part
Cluster connectivity via IB-over-WDM WAN protocol is IB, no conversion needed No additional latency Fully transparent transport
IB Switch Fabric
Dark Fiber
IB Server Cluster A
IB-over-DWDM IB Switch Fabric
IB Server Cluster B
~50km
What about Open Systems?
© 2009 ADVA Optical Networking. All rights reserved. ADVA confidential. 12
InfiniBand throughput over distance
What is the solution? IB range extender – Credit Buffering, low latency, and conversion to 10G optical WDM – lowest latency, transparency, capacity, reach, fiber relief
What are the commercial requirements? Solution must be based on commercial products Interworking capabilities must be demonstrated
Throughput drops significantly after several meters
Only buffer credits (B2B credits) ensure maximum InfiniBand performance over distance
Buffer credit size directly related to distance
Thro
ughput
Distance
w/o B2B credits
with B2B credits
© 2009 ADVA Optical Networking. All rights reserved. ADVA confidential. 13
Demonstrator setup at HLRS
Cell Cluster
DW
DM
0.4...100.4 km G.652 SSMF
IBM Cluster
Site: HLRS Nobelstrasse Site: HLRS Allmandring
DW
DM
Voltaire ISR2012 Grid Director 288 x DDR IBx4 Ports 11.5 Tb/s Backplane <450 ns latency
ADVA FSP 2000 DWDM 4 x 10Gb/s transponders <100 ns link latency
Obsidian Longbow Campus 4 x SDR copper to 10G optical 2-port switch architecture 840 ns port-to-port latency 10/40 km reach (Buffer Credits)
© 2009 ADVA Optical Networking. All rights reserved. ADVA confidential. 14
DCB LAN DCB SAN
Eth Eth
Server cluster
1
DCB LAN DCB SAN
FSP WDM
Inputs: 10Gb FCoE
IB IB
Eth Eth
IB IB
Server cluster
2
FSP WDM
Inputs: 1 x 2.5 or 5G or 10G IB per card
Inputs (not shown): Legacy ESCON, FICON, FC
The perfect convergence platform – FSP DWDM high performance computing and mainframe coupling
© 2009 ADVA Optical Networking. All rights reserved. ADVA confidential. 15
Take away
ADVA’s FSP systems provide the best network consolidation tool because they are transparent to protocol, provide unlimited bandwidth, and offer investment protection for legacy protocols!
© 2009 ADVA Optical Networking. All rights reserved. ADVA confidential. 16
ADVA Optical Networking
Founded 1994
> EUR 250 million revenue1)
Public company (FSE: ADV)
> 1,000 employees1)
Diverse global customer base > 200 carriers > 10,000 enterprises
Market leader #1 Ethernet Access Devices2) #2 Metro WDM, Europe3) #4 Metro WDM, global3)
Stable company, built for long run
Your Optical+Ethernet solutions partner to advance next-generation network convergence
1) 2007 2) Infonetics Research, 2008
3) Dell'Oro Group, Infonetics Research, Ovum RHK and ADVA Optical Networking internal estimates, 2007
“Our mission is to be the global leader of Optical+Ethernet transport solutions that ADVANCE next-generation networks for data, storage, voice and video services.”
© 2009 ADVA Optical Networking. All rights reserved. ADVA confidential. 17
ResNet / Campus Apps / K-12
The FSP product family C
ore
M
etr
o
HPC Data Center Ext / DR-BC Wireless
Un
ifie
d n
etw
ork
an
d s
erv
ice m
an
ag
em
en
t
Regional Optical Network (RON) backbone
Campus
Network
Ubiquitous Ethernet
Acc
ess
Wireless Copper Fiber
Cu
sto
mer
Pre
mis
e
Metro transport
Any media
Data center
Storage
FSP 150
Base station
FSP 3000
FSP 3000
(FTTX/DSL/Cable/HFC/WiMAX)
FSP 3000
FSP 3000
FSP 3000
FSP 150
FSP 3000
FSP 3000
FSP management software suite
FSP 3000
Questions?
Paul Morkel - [email protected]
Brian Savory - [email protected]
IMPORTANT NOTICE
The content of this presentation is strictly confidential. ADVA Optical Networking is the exclusive owner or licensee of the content, material, and information in this presentation. Any reproduction, publication or reprint, in whole or in part, is strictly prohibited.
The information in this presentation may not be accurate, complete or up to date, and is provided without warranties or representations of any kind, either express or implied. ADVA Optical Networking shall not be responsible for and disclaims any liability for any loss or damages, including without limitation, direct, indirect, incidental, consequential and special damages, alleged to have been caused by or in connection with using and/or relying on the information contained in this presentation.
Copyright © for the entire content of this presentation: ADVA Optical Networking.