Upload
sushantsarkar
View
236
Download
1
Tags:
Embed Size (px)
DESCRIPTION
Cisco doc
Citation preview
© 2 0 0 6 C i s c o S y s t e m s , I n c . A l l r i g h t s r e s e r v e d . C i s c o C o n f i d e n t i a lP r e s e n t a t i o n _ I D 1
TERENA Workshop Day 2 – S e pt e m b e r 2nd 1 0 : 1 5 - 1 0 : 4 5
Data Center Ethernet -The Framework for Server I / O C on s ol i d at i on , V i rt u al i z at i on an d U n i fi ed Fab ri c
Ray O’H an l o nC i s c o E u r o p e
© 2 0 0 6 C i s c o S y s t e m s , I n c . A l l r i g h t s r e s e r v e d . C i s c o C o n f i d e n t i a lP r e s e n t a t i o n _ I D 2
Data Center N etw o rk i ng Env i ro nm ent� Clustered and Grid apps are becoming more common� M ulti-Core CP U arch itectures and serv er v irtualiz ation is driv ing th e need f or more bandw idth per serv er
� N etw ork traf f ic is:Client to S erv er, S erv er to S erv er, S erv er to S torage and S torage to S torage
� H igh er dependency of A pplication perf ormance on netw ork perf ormance
� B andw idth and L atency matter� T raf f ic ch aracteriz ation includes:
S h ort and bursty messages: client to serv er and serv er to serv er & L ong steady messages: serv er to storage and storage to storage
� P ack et “drop” af f ects most traf f ic ty pes� F lat N etw ork s are common
© 2 0 0 6 C i s c o S y s t e m s , I n c . A l l r i g h t s r e s e r v e d . C i s c o C o n f i d e n t i a lP r e s e n t a t i o n _ I D 3
T he Cas e f o r 1 0 G b E to the S erv erM ulti-Core CP U arch itectures allow ing bigger and multiple w ork loads on th e same mach ine
S erv er v irtualiz ation driv ing th e need f or more I / O bandw idth per serv er
Grow ing need f or netw ork storage driv ing th e demand f or h igh er netw ork bandw idth to th e serv er
1 0 GE L A N on serv er M oth erboards ( L oM ) beginning mid-2 0 0 8 (source: Broadcom )
© 2 0 0 6 C i s c o S y s t e m s , I n c . A l l r i g h t s r e s e r v e d . C i s c o C o n f i d e n t i a lP r e s e n t a t i o n _ I D 4
M ak i ng 1 0 G b E Co s t Ef f ec ti v e
Cable T r an s c ei v erL at en c y ( li n k )
P o w er( eac h s i d e)D i s t an c eT ec h n o lo g y
Twinax ~ 0 . 1 µs~ 0 . 1 W1 0 mS F P + C UC o p p e r
M M 6 2 . 5 µmM M 5 0 µm ~ 01 W8 2 m
3 0 0 mS F P + S Rsh o r t r e ac h
M M O M 2M M O M 3 ~ 01 W1 0 m
1 0 0 mS F P + U S Ru l t r a sh o r t r e ac h
Cat6Cat6a/ 7Cat6a/ 7
2 . 5 µs2 . 5 µs1 . 5 µs
~ 8 W~ 8 W~ 4 W
5 5 m1 0 0 m3 0 m
1 0 G B A S E -T
100Mb 1G b 10G b
UTP Cat 5 UTP Cat 5S F P F i b e r
10Mb
UTP Cat 3
Mid 1980’s Mid 1990’s E a r l y 2 000’s L a t e 2 000’s
X2S F P + C u (BER better than 10 )S F P + F i b e rC a t 6 / 7
-1 8
S F P + C uS F P + C uS F P + t o S F P +S F P + t o S F P +
© 2 0 0 6 C i s c o S y s t e m s , I n c . A l l r i g h t s r e s e r v e d . C i s c o C o n f i d e n t i a lP r e s e n t a t i o n _ I D 5
U ni f i ed F ab ri cIncreased Efficiency, Simpler Operations
UnifiedF a b r icUnifiedF a b r ic
Unified F a b r ic a nd I / OUnified F a b r ic a nd I / O
S t o r a g e N et w o r kS t o r a g e N et w o r k
M g m t N et w o r kM g m t
N et w o r k
B a c k u pN et w o r kB a c k u pN et w o r k
B a c k -E nd N et w o r kB a c k -E nd N et w o r k
F r o nt -E nd N et w o r kF r o nt -E nd N et w o r k
© 2 0 0 6 C i s c o S y s t e m s , I n c . A l l r i g h t s r e s e r v e d . C i s c o C o n f i d e n t i a lP r e s e n t a t i o n _ I D 6
T he Cas e f o r N etw o rk Co nv erg enc e
R educe ov erall data pow er consumption by up to 8 % . E x tend th e lif ecy cle of current data center.
W ire h osts once to connect to any netw ork - S A N , L A N , H P C. F aster rollout of new apps and serv ices.
E v ery h ost w ill be able to mount any storage target. D riv e storage consolidation and improv e utiliz ation.
R ack , R ow , and X -D ata Center V M portability become possible.
© 2 0 0 6 C i s c o S y s t e m s , I n c . A l l r i g h t s r e s e r v e d . C i s c o C o n f i d e n t i a lP r e s e n t a t i o n _ I D 7
� M apping of F C F rames ov er E th ernet
� E nables F C to R un on a L ossless E th ernet N etw ork
� F ew er CablesBoth block I/O & Ethernet tra f f i c co-ex i st on sa m e ca ble
� F ew er adapters needed� O v erall less pow er� I nteroperates w ith ex isting S A N ’s – S ame M anagement model
� N o Gatew ay - S tateless
F C o EF C o E B e n e f i t sB e n e f i t s
F C o v er Ethernet ( F Co E)
F i bre C ha nnel T ra f f i c
Ethernet
© 2 0 0 6 C i s c o S y s t e m s , I n c . A l l r i g h t s r e s e r v e d . C i s c o C o n f i d e n t i a lP r e s e n t a t i o n _ I D 8
F Co E Enab l ersEthe
rnet
Head
er
FCoE
Head
er
FCHe
ader F C P a y loa d CRC
EOF
FCS
Same as a physical FC frame
Co n t ro l in fo rmat io n : v ersio n , o rd ered set s (SO F, E O F)
E t hern et V 2 Frame, E t hert ype = FCo E
� 1 0 G b ps Et he rn e t� L ossl e ss Et he rn e t ( Dat a C e n t e r Et he rn e t )
M at ches t he B 2 B cred it s u sed in Fib rechan n el t o pro v id e a lo ssless serv ice
� Et he rn e t j u m b o f ram e s ( 21 8 0 B yt e s)M ax FC frame paylo ad = 2 1 1 2 b yt es
T.11 Committee FC-B B -5 W or k in g G r ou pw w w .t11.or g / f c oew w w .f c oe.c om
© 2 0 0 6 C i s c o S y s t e m s , I n c . A l l r i g h t s r e s e r v e d . C i s c o C o n f i d e n t i a lP r e s e n t a t i o n _ I D 9
A d minist r at io n/ V M R CF C S A N BF C S A N A
V M N e t 1V M N e t 2V M N e t 3V M o t io nS e r v e r N I C
V M N e t 1 B ac k u pV M N e t 2 B ac k u pV M N e t 3 B ac k u p
V M o t io n B ac k u p
A d minist r at io n/ V M R CS e r v e r N I C
F Co E f o r Co nv erg ed N etw o rk s
� T w o Serv er L O M E t hern et P o rt s� T w o 1 G Q u ad -P o rt N I Cs� T w o 4 G Sin g le P o rt H B A s
� T w o Serv er L O M E t hern et P o rt s� T w o 1 0 G Sin g le P o rt Co n v erg ed
N et w o rk A d apt ers (CN A )
T od a y ’s M od el C onv erg ed N etw orks U si ng F C oE:
F C S A N B
F C S A N A
EthernetL i nk
F C o E T ra f f i cO ther N etw o rk i ng
T ra f f i c
S o u r c e : H P W e b sit e
V M N e t 1 B ac k u pV M N e t 2 B ac k u pV M N e t 3 B ac k u p
V M o t io n B ac k u p
V M N e t 1V M N e t 2V M N e t 3V M o t io n
© 2 0 0 6 C i s c o S y s t e m s , I n c . A l l r i g h t s r e s e r v e d . C i s c o C o n f i d e n t i a lP r e s e n t a t i o n _ I D 10
V M A w are N etw o rk S erv i c es� Network services d el ivered a t V M l evel
g ra n u l a rity� P rovid es im p roved V M
p orta b il ity� A b il ity to cu stom iz e n etwork ch a ra cteristics
a t th e V M l evel a t wiresp eed
V i r t u al I n t er f ac es w i t h P h y s i c al I n t er f ac e Ch ar ac t er i s t i c s
I n d i v i d u al Co n t r o lan d E t h er n et P o li c i es
S e r v e r
V M 1 V M 3V M 2 V M 4
S w i t c hP o r t
© 2 0 0 6 C i s c o S y s t e m s , I n c . A l l r i g h t s r e s e r v e d . C i s c o C o n f i d e n t i a lP r e s e n t a t i o n _ I D 11
W hat i s Data Center Ethernet ( DCE) ?
D a ta C en ter E th ern et is a n a rch itectu ra l col l ection of E th ern et ex ten sion s d esig n ed to im p rove E th ern et n etworkin g a n d m a n a g em en t in th e D a ta C en ter. C isco is sh owin g in n ova tion wh il e workin g th rou g h th e sta n d a rd iz a tion p rocess with th ese ex ten sion s in op en sta n d a rd s f oru m s.
© 2 0 0 6 C i s c o S y s t e m s , I n c . A l l r i g h t s r e s e r v e d . C i s c o C o n f i d e n t i a lP r e s e n t a t i o n _ I D 12
P ro v id es ab ilit y t o t ran spo rt v ario u s t raffic t ypes (e. g . St o rag e, R D M A )L o ssless E t hern et
F eature / S tandard B enef itP rio rit y Flo w Co n t ro l (P FC)IEEE 8 0 2. 1Q bb
P ro v id es class o f serv ice flo w co n t ro l. A b ilit y t o su ppo rt st o rag e t raffic
B an d w id t h M an ag emen tIEEE 8 0 2. 1Q a z
G ro u pin g classes o f t raffic in t o “Serv ice L an es”Co S b ased E n han ced T ran smissio n
Co n g est io n M an ag emen tIEEE 8 0 2. 1Q a u
E n d -t o -en d co n g est io n man ag emen t fo r L 2 n et w o rk
D at a Cen t er B rid g in g E x chan g e P ro t o co l ( D C BX )
M an ag emen t & A u t o -n eg o t iat io n pro t o co l fo r en han ced E t hern et capab ilit ies
L 2 M u lt ipat h fo rU n icast an d M u lt icast
U t iliz e fu ll B i-Sect io n al b an d w id t h acro ss mu lt iple act iv e pat hs. E limin at e span n in g t ree
Data Center Ethernet F eatu resOv e r v i e w
© 2 0 0 6 C i s c o S y s t e m s , I n c . A l l r i g h t s r e s e r v e d . C i s c o C o n f i d e n t i a lP r e s e n t a t i o n _ I D 13
Data Center Ethernet F eatu res
� Ena bles lossless F a bri cs f or ea ch cla ss of serv i ce� P A U S E sent p er v i rtu a l la ne w hen bu f f ers li m i t ex ceed ed� N etw ork resou rces a re p a rti ti oned betw een V L ’s ( E. g . i np u tbu f f er a nd ou tp u t q u eu e)
� T he sw i tch beha v i or i s neg oti a ble p er V L
P riority -B ased F low Control ( P F C)P riority -B ased F low Control ( P F C)
© 2 0 0 6 C i s c o S y s t e m s , I n c . A l l r i g h t s r e s e r v e d . C i s c o C o n f i d e n t i a lP r e s e n t a t i o n _ I D 14
Data Center Ethernet F eatu res
E nh anced T ransmission S election ( E T S )E nh anced T ransmission S election ( E T S )
� Ena bles Intelli g ent sha ri ng ofba nd w i d th betw een tra f f i c cla sses control of ba nd w i d th
� Bei ng S ta nd a rd i z ed i n IEEE 8 0 2. 1Q a z� A lso know n a s P ri ori ty G rou p i ng
© 2 0 0 6 C i s c o S y s t e m s , I n c . A l l r i g h t s r e s e r v e d . C i s c o C o n f i d e n t i a lP r e s e n t a t i o n _ I D 15
Data Center Ethernet F eatu resCongestion M anagementCongestion M anagement
� M ov es cong esti on ou t of the core to a v oi d cong esti on sp rea d i ng� A llow s End -to-End cong esti on m a na g em ent� S ta nd a rd s tra ck i n 8 0 2. 1Q a u
© 2 0 0 6 C i s c o S y s t e m s , I n c . A l l r i g h t s r e s e r v e d . C i s c o C o n f i d e n t i a lP r e s e n t a t i o n _ I D 16
Data Center Ethernet F eatu resD ata Center B ridging Capability eX ch ange P rotocolD ata Center B ridging Capability eX ch ange P rotocol
H a nd sha ki ng N eg oti a ti on f or:� C oS BW M a na g em ent� C la ss Ba sed F low C ontrol� C ong esti on M a na g em ent ( BC N /Q C N )� A p p li ca ti on ( u ser_ p ri ori ty u sa g e)� L og i ca l L i nk D ow n
Data Center Ethernet
Data Center Ethernet
© 2 0 0 6 C i s c o S y s t e m s , I n c . A l l r i g h t s r e s e r v e d . C i s c o C o n f i d e n t i a lP r e s e n t a t i o n _ I D 17
Data Center Ethernet F eatu resL ay er 2 M ulti-P ath ing optionsL ay er 2 M ulti-P ath ing options
L A N
Active-Active
M ACB
M ACA
M ACA
M ACB
L A N L A N
vP CL 2 E C M P
L 2 E C M P
11 22 33
� El i m i na tes S T P o n U p l i nkB ri d g e P o rts
� A l l o w s M u l ti p l e A c ti v eU p l i nk s S w i tc h to N etw o rk
� P rev ents L o o p s b y P i nni ng aM A C A d d res s to O nl y O neP o rt
� C o m p l etel y T ra ns p a rent toN ex t H o p S w i tc h
� V i rtu a l S w i tc h reta i ns p hy s i c a l s w i tc hes i nd ep end ent c o ntro l a nd d a ta p l a nes� V i rtu a l p o rt c ha nnel m ec ha ni s m i s tra ns p a rent to ho s ts o r s w i tc hes c o nnec ted to the v i rtu a l s w i tc h� S T P a s f a i l -s a f e m ec ha ni s m to p rev ent l o o p s ev en i n the c a s e o f c o ntro l p l a ne f a i l u re
� U s es I S I S b a s ed to p o l o g y� El i m i na tes S T P f ro m L 2d o m a i n
� P ref erred p a th s el ec ti o n
V ir tu a lS w itch
© 2 0 0 6 C i s c o S y s t e m s , I n c . A l l r i g h t s r e s e r v e d . C i s c o C o n f i d e n t i a lP r e s e n t a t i o n _ I D 18
S u m m ary
A Unified fa b r ic is t h e end s t a t e net w o r k w h er e L A N , S A N , a nd I P C t r a ffic a r e c o nv er g ed o nt o a s ing l e net w o r k infr a s t r u c t u r e
D a t a C ent er E t h er net is t h e fo u nda t io n fo r del iv er ing a Unified F a b r ic . D C E w il l a l s o a p p ea l t o c u s t o m er s t h a t a r e no t p l a nning fo r c o ns o l ida t ed I / O du e t o it s L 2 m u l t ip a t h ingc a p a b il it ies a nd it s l o s s l es s s er v ic e b eh a v io r
D C E c o m p r is es a s et o f E t h er net enh a nc em ent s t a nda r ds t h a t a dh er e t o t h e em er g ing I E E E D a t a C ent er B r idg ing s p ec ific a t io n.
h ttp: / / w w w . ieee8 0 2 . org/ 1 / pages/ dcbridges. h tml
© 2 0 0 6 C i s c o S y s t e m s , I n c . A l l r i g h t s r e s e r v e d . C i s c o C o n f i d e n t i a lP r e s e n t a t i o n _ I D 19
© 2 0 0 6 C i s c o S y s t e m s , I n c . A l l r i g h t s r e s e r v e d . C i s c o C o n f i d e n t i a lP r e s e n t a t i o n _ I D 20
S ta nd a rd s
E t h e r n e t L A N S A N BS A N A
N 5 0 0 0
L A N
N 5 0 0 0
Active-Active
MACB
MACA
LAN S AN BS AN ALAN S AN BS AN A
N 5 0 0 0
MACB
MACA MAC
C
A & B C
E n d n o d e s
LAN
MACB
MACA MAC
C
A & B C
E n d n o d e s
LAN
W i r e S p eed 1 0 G bE S w i t c h i n gCap ac i t y
D at a Cen t er E t h er n etS c alabi li t y
F i br e Ch an n el o v er E t h er n etCo n s o li d at i o n
V M A w ar e N et w o r k i n gV i r t u ali z at i o n
Eco-S y stem
Del i v eri ng N etw o rk Co nv erg enc e to d ay
© 2 0 0 6 C i s c o S y s t e m s , I n c . A l l r i g h t s r e s e r v e d . C i s c o C o n f i d e n t i a lP r e s e n t a t i o n _ I D 21
Implementing Unified Fabric with Nexus 5000
1 0 G b E
1 0 G b E D a ta C en ter E th er n etF ib r e C h a n n el
1 0 G b EF C o E / D a ta C en terE th er n et
C on sol i d at e d I / OS e rv e rs t o Ac c e ss L aye r
Dat a C e n t e r Et he rn e t / F C oE L i n ks
Cisco N ex us 5 0 0 0
P re se rv e s Ex i st i n gL A N an d S A NI n v e st m e n t s
M D SM D SN ex u sN ex u sC a t a l y s tC a t a l y s tS A N BL A N S A N AL A N
P re se rv e s Ex i st i n gDu al S A NEn v i ron m e n t s
© 2 0 0 6 C i s c o S y s t e m s , I n c . A l l r i g h t s r e s e r v e d . C i s c o C o n f i d e n t i a lP r e s e n t a t i o n _ I D 22
Enc ap s u l ati o n tec hno l o g i es
Ethernet
1 , 1 0 G b p s
IPT C P
i S C S I
I nf i ni B a nd
S R P
IPT C PF C IP F C P*
IPT C Pi F C PF C P*
F i b rec ha nnel
F C P*
1 , 2 , 4 , ( 8 ) , 1 0 G b p s 1 0 , 2 0 G b p s
iS CS I F CoE I nf iniB and
i S E Ri S C S I
D a ta C enter Ethernet
F C o E
F C P*S C S I L a y e r
O p e r a t i n g S y s t e m / A p p l i c a t i o n s
( 1 ) , 1 0 G b p s
* I nc l u d e s F C L ay e r