Upload
others
View
0
Download
0
Embed Size (px)
Citation preview
400 Gigabit EthernetCall-For-Interest
IEEE 802.3 Ethernet Working GroupIEEE 802 March 2013 Plenary, Orlando, FL
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
Objective for this Meeting
• To measure the interest in starting a study group for 400 Gb/s Ethernet
• We don’t need to– Fully explore the problem– Debate strengths and weaknesses of solutions– Choose any one solution– Create PAR or five criteria– Create a standard or specification
• Anyone in the room may speak / vote• RESPECT… give it, get it
2March 19, 2012
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
3
• Presentations– “A Higher Speed - Overview,”.– “The Need for 400 Gb/s Ethernet,”.– “The Technical Viability of 400 Gb/s Ethernet,”.– “Higher Speed Ethernet - Why Now,” John D’Ambrosia.
• Discussion• Call for Interest• Future Work
Agenda
March 19, 2013
DRAFT PRESENTATION
WORK IN PROGRESS
A HIGHER SPEED –OVERVIEW
Presented by
IEEE 802.3 Working GroupOrlando, FL, USAMarch 19, 2013
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
5March 19, 2013
The Ethernet Eco-System (2007 HSSG)
Research, Education and Government
ResearchNetworks
Broadband Access
BroadbandAccess Networks
Data Centers and Enterprise
EnterpriseNetworks
Content Providers
ContentNetworks
Internet BackboneNetworks
Internet Backbone Networks
Internet eXchange andInterconnection Points
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
The Ethernet EcoSystem Now• Update with a figure that
shows today’s Applications• Smart pad• Smart phone• HDTV• Wi-Fi• Euro-IX (JD)• Data Center (40GBASE-T) • OTN (Andy)• R&D (JD>Bennett) • Content Providers (Andy /
Dave O)• Cloud (Amazon, Google)
6March 19, 2012
Today’s Trends• Cloud slide – anytime
anywhere anyhow(Business / consumer)
• Mobile • Outsourcing of data center / IT• Thin Client is here• Flat Networks• Data Centers
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
7March 19, 2013
2015 Global Users and Network Connections
North America
288 Million Users2.2 Billion Networked Devices
Western Europe
314 Million Users2.3 Billion Networked Devices
Central/Eastern Europe
201 Million Users902 Million Networked Devices
Latin America
260 Million Users1.3 Billion Networked Devices
Middle East & Africa
495 Million Users 1.3 Billion Networked Devices
Asia Pacific
1330 Million Users5.8 Billion Networked Devices
Japan
116 Million Users727 Million Networked Devices
Source: nowell_01_0911.pdf citing Cisco Visual Networking Index (VNI) Global IP Traffic Forecast, 2010–2015, http://www.ieee802.org/3/ad_hoc/bwa/public/sep11/nowell_01_0911.pdf
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
8March 19, 2013
Global Broadband Speed 2010-2015Average broadband speed will grow 4X; from 7 to 28 Mbps
North America
3.7-Fold growth7.5 to 27 Mbps
Western Europe
3.9-Fold growth9.2 to 36 Mbps
Central/Eastern Europe
3.3-Fold growth6.1 to 20 Mbps
Latin America
2.9-Fold growth2.8 to 8 Mbps
Middle East & Africa
2.5-Fold growth2.8 to 7 Mbps
Asia Pacific
4.6-Fold growth5.5 to 25 Mbps
Japan
4.1-Fold growth15.5 to 64 Mbps
Source: nowell_01_0911.pdf citing Cisco Visual Networking Index (VNI) Global IP Traffic Forecast, 2010–2015, http://www.ieee802.org/3/ad_hoc/bwa/public/sep11/nowell_01_0911.pdf
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
9March 19, 2013
North America
22.3 EB/Month by 201526% CAGR, 3X Growth
Western Europe
18.9 EB/Month by 201532% CAGR, 4X Growth
Central/Eastern Europe
3.7 EB/Month by 201539% CAGR, 5X Growth
Latin America
4.7 EB/Month by 201548% CAGR, 7X Growth
Middle East & Africa
2.0 EB/Month by 201552% CAGR, 8X Growth
Asia Pacific
24.1 EB/Month by 201535% CAGR, 4X Growth
Japan
4.8 EB/Month by 201527% CAGR, 3X Growth
Global IP Traffic Growth, 2010–2015Regional contributions to the Zettabyte journey
Source: nowell_01_0911.pdf citing Cisco Visual Networking Index (VNI) Global IP Traffic Forecast, 2010–2015, http://www.ieee802.org/3/ad_hoc/bwa/public/sep11/nowell_01_0911.pdf
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
10March 19, 2012
Findings of IEEE 802.3 BWA Ad Hoc
0.01
0.1
1
10
100
2004 2006 2008 2010 2012 2014 2016 2018 2020
Traf
fic re
lativ
e to
201
0 va
lue
Financial sectorfit to Figure 15 CAGR = 95%
Peeringfit to Figure 39 CAGR = 64%
IP trafficFigure 2
CAGR = 32%
Sciencefit to Figure 13
ESnet 2004 to 2011CAGR = 70%
CableFigure 20 CAGR = 50%
Figure 15 NYSE historical data
Figure 39 Euro‐IXhistorical data
HSSG tutorialSlide 22 coreCAGR = 58%
HSSG tutorialSlide 22 server I/O
CAGR = 36%
Source: http://www.ieee802.org/3/ad_hoc/bwa/BWA_Report.pdf
DiscussLimitations of analysisTechnical feasibilityDecreasing cost per bit Technology Roadmap
DRAFT PRESENTATION
WORK IN PROGRESS
“THE NEED FOR 400 GIGABIT ETHERNET”
Presented by
IEEE 802.3 Working GroupOrlando, FL, USAMarch 19, 2013
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
12March 19, 2013
10GbE Server Deployments
0.0
1.0
2.0
CREHAN RESEARCH Inc.
Ports in M
illions
10GbE Server-class Adapter/LOM Shipments
All data used with permission Seamus Crehan, Crehan Research.
Can we turn this into bandwidth?Update with latest numbers
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
13March 19, 2012
Examples - Events Drive Terabit Traffic
Source: https://labs.ripe.net/Members/fergalc/internet-traffic-during-olympics-2012
2012 Summer Olympics After First Round of Euro 2012 Matches
Source: https://labs.ripe.net/Members/fergalc/internet-traffic-after-first-round-of-euro-2012-matches/AMSIXNL.png
Thanks to Bijal Sanghani, Euro-IX.
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
14
400Gb/s vs. 4 x 100Gb/s Link Aggregation
■ Traffic is often trunked into large tunneled flows● Insufficient entropy to do hashing efficiently● Link Aggregation (LAG) is inefficient ● BW not considered which leads to flow imbalance● A faster interface provides predictable performance
■ Sources of large flows:● Content distribution● Secure traffic
■ Fewer items to manage provides operational efficiency● Bandwidth is growing exponentially● Without faster links, link count grows exponentially
therefore management pain grows exponentially
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
15
400Gb/s vs. 4 x 100Gb/s LAG, cont.
Large flows result in individual links becoming congested and bundles losing efficiency
flow size
Number of flows
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
16
Data Center Architecture Trend
Hierarchical Fat Tree architecture
Non-blocking architecture
400GbE need
C0-0 C0-1 C0-31C0-0 C0-1
B0-63B0-0 B0-1
32x100GE32x100GE 32x100GE
A-0 A-204732x100GE
C0-0 C0-1 C0-31C0-0 C0-1
B0-63B0-0 B0-1
32x100GE32x100GE 32x100GE
C0-0 C0-1 C0-31C0-0 C0-1
B0-63B0-0 B0-1
32x100GE32x100GE 32x100GE
32x100GE
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
17
400Gb/s Near-term Applications
■ Core Transport (400Gb/s Transport demonstrated)
■ Core Core
■ Datacenter Datacenter
■ Datacenter upper layer switch interconnect (shown on previous slide)
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
18
Section Summary
DRAFT PRESENTATION
WORK IN PROGRESS
THE TECHNICAL VIABILITY OF 400 GIGABIT ETHERNET
Presented by
IEEE 802.3 Working GroupOrlando, FL, USAMarch 19, 2013
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
“if you can’t always get what you want …”
Matching Needs with Capabilities
Technology AxisTime Division Multiplexing(i.e. Baud Rate)
“Widely used”“Mature”
“Emerging”“Leading edge”
“Hero experiment”“Bleeding edge”“Demo”
End user wants Relative Cost & Power
Tensionand
Innovation
“you find another way”
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
“Everything Axis”Time Division Multiplexing(i.e. Baud Rate)
Wavelength Division Multiplexing (i.e. λs )
Modulation(i.e. Bits per Hz)
Space Division Multiplexing(i.e. Multiple Optical and Electrical Channels)
4
8
16
1(e.g. NRZ)
2(e.g. PAM-4)
4(e.g. QAM-16)
4
8
16
10 Gbps
25 Gbps
50 Gbps
100 Gbps
4 8 12 16
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
Example: Anatomy of a 400GbE Optical PMD implementation
OpticsElectronics
Opt
con
nect
or
Ele
cco
nnec
tor
Definition of these interfaces…
… drives complexity of the module implementation
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
Electrical Interface Technology trade-offs
1 4 8 12 16 # channel
400 100 50 ~31 25 Gb/channel
Electronics implementation complexity 1b/sym
• Electrical width drives connector complexity
• Interface definition drives electronics complexity within module
• Advanced modulation now allows potential for reduced width
Region of Technical Feasibility
Electronics implementation complexity >1b/sym
OE
Mod
ule
Impl
emen
tatio
n C
ompl
exity
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
Optical Interface Technology trade-offs
1 4 8 12 16
Mod
ule
Impl
emen
tatio
n C
ompl
exity
# lane*
400 100 50 ~31 25 Gb/lane
Optical Packaging complexityElectronics complexity 1b/sym
• Packaging complexity drives cost
• Adoption of advanced modulation now allows trade-off of analog complexity vs. digital complexity (solid vs. dashed)
• Multiple technical feasibility data points exists within the green region
• Study Group/Task Force goal will be to converge towards optimum solution(s)
Region of Technical Feasibility
Electronics complexity >1b/sym*Lane = wavelengths or fibers
OE
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
25
400Gb/s MAC Technical Feasibility
■ CMOS IC features have shrunk by ~2x since 100Gb/s MAC/PCS was defined in 802.3ba
■ CMOS International Technology Roadmap for Semiconductors, 2011 Revision Overview:
■ ITRS Sponsoring Industry Associations (IAs): European Semiconductor IA, Japan Electronics and Information Technology Association, Korea Semiconductor IA, Taiwan Semiconductor IA, (US) Semiconductor IA
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
26
400Gb/s MAC Technical Feasibility, cont.
■ Typical 100Gb/s MAC/PCS ASIC:● 45/40nm CMOS● 160b wide bus● 644MHz clock
■ Potential 400Gb/s MAC/PCS ASIC:● 28/20nm CMOS● 400b wide bus● 1GHz clock
■ 400Gb/s MAC/PCS FPGA will be feasible with wider buses and slower clocks
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
27March 19, 2012
400 Gb/s Ethernet vs Terabit EthernetTechnology Roadmap
DRAFT PRESENTATION
WORK IN PROGRESS
400 GIGABIT ETHERNET -WHY NOW?
Presented byJohn D’Ambrosia, Dell
IEEE 802.3 Working GroupOrlando, FL, USAMarch 19, 2013
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
29March 19, 2012
Findings of IEEE 802.3 BWA Ad Hoc
0.01
0.1
1
10
100
2004 2006 2008 2010 2012 2014 2016 2018 2020
Traf
fic re
lativ
e to
201
0 va
lue
Financial sectorfit to Figure 15 CAGR = 95%
Peeringfit to Figure 39 CAGR = 64%
IP trafficFigure 2
CAGR = 32%
Sciencefit to Figure 13
ESnet 2004 to 2011CAGR = 70%
CableFigure 20 CAGR = 50%
Figure 15 NYSE historical data
Figure 39 Euro‐IXhistorical data
HSSG tutorialSlide 22 coreCAGR = 58%
HSSG tutorialSlide 22 server I/O
CAGR = 36%
Source: http://www.ieee802.org/3/ad_hoc/bwa/BWA_Report.pdf
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
30
The Need for Higher Speed
• Traffic is growing everywhere– The masses have more ways of faster access– Higher bandwidth content– New applications enabled
• Need for higher speed by multiple application
March 19, 2013
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
31
400Gb/s vs. Higher Rates
■ Customers want parity in W/bit, $/bit, and bits/system■ Faster interface rates require exotic implementations
● Not yet competitive per W, per $, or density● Higher R&D investment● Longer time to market
■ 400GbE can reuse 100GbE building blocks■ 400GbE fits in the dense 100GbE system roadmap■ Data rates beyond 400Gb/s require an increasingly
impractical number of lanes if 100GbE technology is reused
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
32
Summary• Applications are challenging today’s solutions• “Higher” Speed needed throughout the entire
Ecosystem• Needed by 2010 for multiple applications
• Past efforts took 3 to 4 years– 10GE– EFM – 10GBASE-T
• We need to begin the process and study the problem
March 19, 2013
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
33
Supporters
March 19, 2013
DRAFT PRESENTATION
WORK IN PROGRESS
STRAW POLLSMarch 19, 2013
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
35
Call-For-Interest
• Should a Study Group be formed for “ 400 Gb/s Ethernet”?
Y: N: A:
March 19, 2013
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
36
Participation
• I would participate in the “400 Gb/s Ethernet” Study Group in IEEE 802.3.
Tally: xx
• My company would support participation in the “400 Gb/s Ethernet” Study Group in IEEE 802.3
Tally: xx
March 19, 2013
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
37
Future Work
• Ask 802.3 to form 400 Gb/s Ethernet SG on Thursday
• If approved– 802 EC informed of 400 Gb/s Ethernet SG
on Friday– First 400 Gb/s Ethernet SG meeting, week
of May 2013 IEEE 802.3 Interim.
March 19, 2013
DRAFT PRESENTATION
WORK IN PROGRESS
THANK YOU!
March 19, 2013 38
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
Contributors
39March 19, 2013
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
Technology AxesTime Division Multiplexing(i.e. Baud Rate)
Wavelength Division Multiplexing (i.e. λs )
Modulation(i.e. Bits per Hz)
Space Division Multiplexing(i.e. Multiple Optical and Electrical Channels)
10 Gbps
25 Gbps
50 Gbps
100 Gbps
4
8
16
4 8 12 16
1(e.g. NRZ)
2(e.g. PAM-4)
4(e.g. QAM-16)
4
8
16
Graphically intense –need to find way to simplify
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
Time Division AxisTime Division Multiplexing(i.e. Baud Rate)
Wavelength Division Multiplexing (i.e. λs )
Space Division Multiplexing(i.e. Multiple Optical and Electrical Channels)
4
8
16
4
8
16
10 Gbps
25 Gbps
50 Gbps
100 Gbps
4 8 12 16
References /Demonstrations• Blah• Blah• Blah
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
Modulation AxisTime Division Multiplexing(i.e. Baud Rate)
Wavelength Division Multiplexing (i.e. λs )
Modulation(i.e. Bits per Hz)
Space Division Multiplexing(i.e. Multiple Optical and Electrical Channels)
4
8
16
1(e.g. NRZ)
2(e.g. PAM-4)
4(e.g. QAM-16)
4
8
16
4 8 12 16
References /Demonstrations• Blah• Blah• Blah
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
Wavelength AxisTime Division Multiplexing(i.e. Baud Rate)
Wavelength Division Multiplexing (i.e. λs )
Modulation(i.e. Bits per Hz)
Space Division Multiplexing(i.e. Multiple Optical and Electrical Channels)
1(e.g. NRZ)
2(e.g. PAM-4)
4(e.g. QAM-16)
4
8
16
10 Gbps
25 Gbps
50 Gbps
100 Gbps
4 8 12 16
References /Demonstrations• Blah• Blah• Blah
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
Possible Approaches: “Add more Modules”Time Division Multiplexing(i.e. Baud Rate)
Wavelength Division Multiplexing (i.e. λs )
Modulation(i.e. Bits per Hz)
Space Division Multiplexing(i.e. Multiple Optical and Electrical Channels)
4
8
16
1(e.g. NRZ)
2(e.g. PAM-4)
4(e.g. QAM-16)
4
8
16
10 Gbps
25 Gbps
50 Gbps
100 Gbps
4 8 12 16
Modulation(i.e. Bits per Hz)
100GBASE-LR4
Add Channels
400GInterface
DRAFT PRESENTATION
WORK IN PROGRESS
400 Gb/s Ethernet Study Group CFI, V 0.2Orlando, FL, USA
Space Division AxisTime Division Multiplexing(i.e. Baud Rate)
Wavelength Division Multiplexing (i.e. λs )
Modulation(i.e. Bits per Hz)
Space Division Multiplexing(i.e. Multiple Optical and Electrical Channels)
4
8
16
1(e.g. NRZ)
2(e.g. PAM-4)
4(e.g. QAM-16)
4
8
16
10 Gbps
25 Gbps
50 Gbps
100 Gbps
4 8 12 16
References /Demonstrations• Blah• Blah• Blah
DRAFT PRESENTATION
WORK IN PROGRESS