Upload
kds850
View
238
Download
0
Embed Size (px)
Citation preview
8/12/2019 BRKDCT 3060 Dc Interconnect
1/63
8/12/2019 BRKDCT 3060 Dc Interconnect
2/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
Deployment Considerationswith Interconnecting Data Centers
BRKDCT-3060
Hernan Vukovic - Consulting Systems Engineer
!
8/12/2019 BRKDCT 3060 Dc Interconnect
3/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
The main goals of this session are:
! Highlighting the main business requirements drivingData Center Interconnect (DCI) deployments
! Understand the functional components of the holisticCisco DCI solutions
! Get a knowledge of Cisco LAN and SAN extensiontechnologies and associated deployment
considerations
Session Objectives
8/12/2019 BRKDCT 3060 Dc Interconnect
4/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
Agenda
! Distributed Data Center & Cloud evolution overview! Data Center Interconnect Design Considerations
! Storage Extension! LAN Extension
Ethernet Based
IP Based
! Network Services and Applications! Conclusions
8/12/2019 BRKDCT 3060 Dc Interconnect
5/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
DCI
Drivers Business Solution Constraints IT Technology
Business
Continuity
"Disaster Recovery"HA Framework
"Stateless"Network Service Sync"Process Sync
"GSLB"Geo-clusters"HA Cluster
Operation Cost
Containment
"Data Center Maintenance /Migration / Consolidation
"Host Mobility "Distributed VirtualData Center
Business
Resource
Optimization
"Disaster Avoidance"Workload Mobility
"VLAN Extension"Statefulness"Bandwidth & Latency "VM Mobility
Cloud Services "Inter-Cloud Networking"XaaS
"Flexibility"Application mobility "VM Mobility"Automation
! Data Centers are extending beyond traditionalboundaries
! Virtualization applications are driving DCI across PODs(aggregation blocks) and Data Centers
Data Center InterconnectBusiness Drivers
8/12/2019 BRKDCT 3060 Dc Interconnect
6/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
DCI Function Purpose
Storage Extensions Providing applications access to storage locally, as well as remotely with desirable storage attributes
LAN Extensions Extend same VLAN across Data Centers, to virtualize servers and applications
Inter-DC Routing Provide routed connectivity between data centers (used for L3 segmentation/virtualization, etc.)
Path Optimization Routing users to the data center where the application resides while keeping symmetrical routing inconsideration for IP services (e.g. Firewall)
!"#" %&'#&( )'#&(*+''&*# ,!%)-#$%&'$( )$*+$(,(-.
./(#0"1/2"3+'4551/*"3+'67489:#&'6/+'
6
;#+("+
03'
8/12/2019 BRKDCT 3060 Dc Interconnect
7/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
DC 1 DC 2
ESX-A source ESX-B target
!"#" %&'#&( )'#&(*+''&*##/0 12-,(.3$(
! #4(567$($&. 3*+%3,. .-735- 83.-9(5, %3*3-9'$(! :$59%3;9'$( $< /5'=, #-$79>, 3. ?,4#@3.-9(5, 59( A, 3*+7$=,8 &.3(> BC 955,%,79-$7 $7 59563(>#D37-&9% :E0 3. 9%%$F3(> /5'=,G/5'=,
8/12/2019 BRKDCT 3060 Dc Interconnect
8/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public H
@)I @)! @)J
#KL
8$*93(
#KL
8$*93(#KL
8$*93(
SiSiSiSi SiSi SiSi
ALT GW ALT ALTGWGW
L9-6 C+'*3;9'$(
@&9%MN$*3(>
#-$79>, ,2-,(.3$(
/(4 -4+, $< %3(?.
#KL @$*93( 3.$%9'$( O #-$7*M5$(-7$%
Data Center InterconnectLAN Extension Model
8/12/2019 BRKDCT 3060 Dc Interconnect
9/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
Ethernet
MPLS
IP
Over dark fiber or protected D-WDM
$VSS & vPC! Dual site interconnection
$FabricPath (TRILL)MPLS Transport
$ EoMPLS! Transparent point to point
$A-VPLS! Enterprise style MPLS
$ H-VPLS! Large scale & Multi-tenants
IP Transport$ OTV
! Enterprise style Inter-site MAC Routing$ VXLAN
! Intra-site MAC bridging in total virtualized context
LAN Extension for DCITechnology Selection Criteria
8/12/2019 BRKDCT 3060 Dc Interconnect
10/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
DC 1 DC 2
ESX-A source ESX-B target
!"#" %&'#&( )'#&(*+''&*#L9-6 C+'*3;9'$( A53+'6
! 1>7,..#/887,..,8 A4 PNQL P3%-,73(>
! B(>7,..RIS @0# 7,837,5'$( F3-6 /)1GT##!S Q$&-, N,9%-6 B(U,5'$( VQNBWJS :B#L
8/12/2019 BRKDCT 3060 Dc Interconnect
11/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
! K4+359%%4 /5'=,G#-9(8A4 )%&.-,7 6 +73=9-, (,-F$7? 9. F,%% 9. DBL 5%&.-,7 -67$&>6 -6, +&A%35 (,-F$7?.
Q,[&37,. :94,7 ! +9-6 A,-F,,( 6$.-.
! )%3,(- 7,5$((,5'$( -79(.+97,(- M .697,8 BL 9887,..%:94,7 ! *&.- A, \,2-,(8,8]
Cluster Application such as
! Microsoft MSCS! VMware Cluster! Veritas Cluster! Oracle RAC! .
!(/@&( B C06/'&66 %+'3'0"'*&N3>6 /=93%9A3%3-4 )%&.-,7. M :$59%
Heartbeat 1
SAN A
SAN B
Cluster VIP
EnterpriseCore
Active Standby
Heartbeat 2
Extended LAN
Extended SAN
8/12/2019 BRKDCT 3060 Dc Interconnect
12/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
! D^9563(, +7$5,.. *3>79'$( 3(57,9.,. 9++%359'$( 9=93%9A3%3-4! :/0 Z #/0 7,[&37, :94,7 ! +9-6 -$ *93(-93( &.,7 .,..3$(. 8&73(> *3>79'$(
DC 1 DC/POD
ESXi-A source ESXi-B target
D+(E1+"? F+G/1/#H I+( !/6"6#&( 4@+/?"'*&@4(9*35 ^$=,*,(- $< D37-&9% ^9563(,.GD^.
8/12/2019 BRKDCT 3060 Dc Interconnect
13/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
Agenda
! Distributed Data Center & Cloud evolution overview! Data Center Interconnect Design Considerations
! Storage Extension! LAN Extension
Ethernet Based
IP Based
! Network Services and Applications! Conclusions
8/12/2019 BRKDCT 3060 Dc Interconnect
14/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
Business Continuity / Disaster Recovery Options
! Offsite tape vaulting! Backup tapes transported to offsite
location by truck
! Electronic vaulting! Transmission of backup data to offsite
location
! Remote disk replication! Continuous copying of data to offsite
location
! Cold site! Transfer data from offsite location to
new data center
! Duplicated hot site! Replicate data remotely, ready for
operational resumption
!Application sensitivity to delay! Synchronous vs. asynchronous
! Distance requirements! Propagation delays , at least 5 sper Km.
! Service availability at a customersite
! Tag onto existing facilities or newinstall
! Bandwidth requirements! Total cost of ownership
!Equipment Cost v/s Cost ofdowntime
8/12/2019 BRKDCT 3060 Dc Interconnect
15/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
@,.3>( K,56($%$>4 #$%&'$(. K69- _9%9(5,R
/++%359'$( G L7$5,.. Q,5$=,74 CAU,5'=,. VQLC 9(8 QKCW @3.-9(5, ` a69- 3. 4$&7 \K7,9- Q983&.]b @9-9G#-$79>, )9+953-4 9(8 _9(8F38-6 7,[&37,*,(-. /++%359'$( L,7
8/12/2019 BRKDCT 3060 Dc Interconnect
16/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
RTO / RPO
8/12/2019 BRKDCT 3060 Dc Interconnect
17/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
! Synchronous Data replication: The Application receives the acknowledgement for I/O complete when bothprimary and remote disks are updated. This is also known as Zero data loss data replication method (or Zero
RPO)
! Metro Distances (depending on the Application can be 50-300kms max)! Asynchronous Data replication: The Application receives the acknowledgement for I/O complete as soon as
the primary disk is updated while the copy continues to the remote disk.
! Unlimited distances
J
K
L
M J
L
K
SynchronousData Replication
AsynchronousData Replication
;48 9:#&'6/+'#4(567$($&. =.S /.4(567$($&. @9-9 Q,+%359'$(
8/12/2019 BRKDCT 3060 Dc Interconnect
18/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
7/N/#&? GH A53*6 ,=+O&( C0?&
8/12/2019 BRKDCT 3060 Dc Interconnect
19/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
! Speed of Light is about 300000 Km/s! Speed is reduced to 200000 Km/s#5 s per Km! That gives us an average of 1ms for the light to cross 200 Kms of fiber! Synchronous Replication: SCSI protocol (FC) takes a four round trips! For each Write cmd a two round trips is about 10 s per kilometer
#20s/km for 4 round trips for Synch data replication
1
2
1
2:$59% #-$79>, /7794 Q,*$-, #-$79>, /7794
!de f. R Q,5gQ,984 b
!de f. R a93-
8/12/2019 BRKDCT 3060 Dc Interconnect
20/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
Extending Optical SAN ExtensionFibreChannel Frame Buffering
Buffer to buffer credits (BB_Credit) are negotiated between each device in aFC fabric; no concept of end to end buffering
One buffer used per FC frame, irregardless of frame size; small FC frame uses samebuffer as large FC frame
FC frames buffered and queued in intermediate switches Hop-by-hop traffic flow paced by return of Receiver Ready (R_RDY) frames; can only
transmit up to the number of BB_Credits before traffic is throttled
P% >&*&/@&
C0[&(6
Q("\* P1+O
CCY%(&?/#
P1+O %+'#(+1
P% >&*&/@&
C0[&(6
K]^ CCY%(&?/# J_]K`` CCY%(&?/# K]^ CCY%(&?/#
CCY%(&?/#
P1+O %+'#(+1
CCY%(&?/#
P1+O %+'#(+1
8/12/2019 BRKDCT 3060 Dc Interconnect
21/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
J_ aN
J UG56 P%
M UG56 P%bc EN 5&( P("N&
bK EN 5&( P("N&
Extending Optical SAN ExtensionBB_Credits and Distance
K UG56 P%bJ EN 5&( P("N&
^ UG56 P%bd EN 5&( P("N&
! BB_Credits are used to ensure enough FC frames in flight! A full (2112 byte) FC frame is approx 2 km long @ 1 Gbps, 1 km long
@ 2 Gbps and !km long at 4 Gbps
! As distance increases, the number of available BB_Credits need to increase as well! Insufficient BB_Credits will throttle performanceno data will be transmitted until R_RDY is
returned
8/12/2019 BRKDCT 3060 Dc Interconnect
22/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
DC 1DC 2
Core Network
Virtual Center
ESX-A source ESX-B target
L2 extension for VMotion Network
Target
Volumes
Initiator
;#+("
8/12/2019 BRKDCT 3060 Dc Interconnect
23/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
Core Network
DC 1 DC 2
Virtual Center
L2 extension for VMotion Network
ESX-A source ESX-B target
Improve Latency using Cisco Write Accelerationfeature on MDS Fabric
;#+(", B*+7$=,*,(- E.3(> )3.5$ BC/
Synchronous replcation Latency requirements6789::;;;?:="%@A"4=:#"%%$-,.$%:4=BC0:4=(DE:4=//C:4=FBG:;63-,H8$8,.H#DDI((EF//
8/12/2019 BRKDCT 3060 Dc Interconnect
24/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
Agenda
! Distributed Data Center & Cloud evolution overview! Data Center Interconnect Design Considerations
! Storage Extension! LAN Extension
Ethernet Based
IP Based
! Network Services and Applications! Conclusions
8/12/2019 BRKDCT 3060 Dc Interconnect
25/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
WAN
L
3
L
3
Server Cabinet Pair 1 Server Cabinet Pair N Server Cabinet Pair 1 Server Cabinet Pair N
L
2
L
2
SiSi SiSi
Primary Root Primary Root
On DCI Etherchannel:! STP Isolation (BPDU Filtering)! Broadcast Storm Control! FHRP Isolation
! Link utilization with Multi-Chassis EtherChannel
! DCI port-channel- 2 or 4 links
! Requires protectedDWDM or Direct fibers
! vPC does not support L3 peering:Use dedicated L3 Links for Inter-DC routing!
! Validated design:200 Layer 2 VLANs + 100 VLAN SVIs
1000 VLAN + 1000 SVI (static routing)
interface port-channel10
desc DCI point to point connection
switchport
switchport mode trunkvpc 10
switchport trunk allowed vlan 100-600
spanning-tree port type edge trunk
spanning-tree bpdufilter enable
storm-control broadcast level 1
storm-control multicast level x
Dual Site InterconnectionLeveraging EtherChannel between Sites
8/12/2019 BRKDCT 3060 Dc Interconnect
26/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
!0"1 ;/#&6 e6& %"6& ;0NN"(H)3.5$ D9%389-,8 @,.3>( $( )3.5$S5$*
Test Case
Hardware
failure
Ucast
Hardware
failure
Mcast
Hardware
restore
Ucast
Hardware
restore
Mcast
Link
Failure
Ucast
Link
failure
Mcast
Link
Restore
Ucast
Link
Restore
Mcast
VSS-VSS
8/12/2019 BRKDCT 3060 Dc Interconnect
27/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
FabricPath Simplicity to the Server team
! Benefits server team by providing a network Fabric that looks like a single switch "Breaks down silos,permits workload mobility, provides maximum flexibility
! Lowers OPEX by simplifying server team operation "Reduces dependency on/interaction with networkteam
Web Servers App Servers New Apps
Silo 1 Silo 2 Silo 3
Web Servers
App Servers
New Apps
P9A735L9-6 /(4 /++Y /(4F6,7,h^&%'M@$*93( ` #3%$.
Fabric
8/12/2019 BRKDCT 3060 Dc Interconnect
28/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
! Ingress FabricPath switch determines destination Switch ID and imposes FabricPath header! Destination Switch ID used to make routing decisions through FabricPath core! No MAC learning or lookups required inside core! Egress FabricPath switch removes FabricPath header and forwards to CE
STP
FabricPath Core
"FabricPath interface
"CE interface
STP
MAC A MAC B
S10 S20
DMAC"B
SMAC"A
Payload
Ingress FabricPathSwitch
Egress FabricPathSwitch
DMAC"B
SMAC"A
Payload
DSID"20
SSID"10
DMAC"B
SMAC"A
Payload
ISIS
FabricPathData Plane Operation
8/12/2019 BRKDCT 3060 Dc Interconnect
29/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
MAC C
FabricPath Core
MAC A
MAC B
FabricPath
MAC Table on S100
MAC IF/SID
A e1/1 (local)
B S200 (remote)
S100
S200
S300
FabricPath
MAC Table on S200
MAC IF/SID
A S100 (remote)
B e12/1(local)
C S300 (remote)
FabricPath
MAC Table on S300
MAC IF/SID
B S200 (remote)
C e7/10 (local)
FabricPathConversational MAC Learning
8/12/2019 BRKDCT 3060 Dc Interconnect
30/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
Site C
vPC+
! F1/F2 End to End foroptimal design
! Required point to pointconnections
! Relies on Flooding forUnknown Unicast traffic
! No current Broadcastsuppression! L2 Multipath only for equal
cost path can be leveraged
(i.e. A&B or C&D)
! Conversational MacLearning
! Offer a full HA DCI solutionwith Native STP Isolation
! Provides easy integrationwith Brownfield DC
! Optimized using vPC+Site A
Site B
vPC+
ClassicalEthernet
Cloud
Site D
vPC+
STPVSS
CE
Core FabricPath
FabricPath for DCIPartial-Meshed Topology for different models of DC
8/12/2019 BRKDCT 3060 Dc Interconnect
31/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
Agenda
! Distributed Data Center & Cloud evolution overview! Data Center Interconnect Design Considerations
! Storage Extension! LAN Extension
Ethernet Based
IP Based
! Network Services and Applications! Conclusions
8/12/2019 BRKDCT 3060 Dc Interconnect
32/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
OTV is a MAC in IP technique to
extend Layer 2 domains
OVER ANY TRANSPORT
Protocol Learning
Built-in Loop Prevention
Preserve Failure Boundary
Site Independence
Automated Multi-homing
Dynamic Encapsulation
No Pseudo-Wire State
Maintenance
Optimal Multicast
Replication
Multipoint Connectivity
Point-to-Cloud Model
First platform to support OTV(since 5.0 NXOS Release)
Nexus 7000
Now also supporting OTV(since 3.5 XE Release)
ASR 1000
J!
Overlay Transport VirtualizationTechnology Pillars
8/12/2019 BRKDCT 3060 Dc Interconnect
33/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
Overlay Transport VirtualizationOTV Control Plane
! Edge Device (ED): connects the site to the (WAN/MAN) core and responsible forperforming all the OTV functions
! Internal Interfaces: L2 interfaces (usually 802.1q trunks) of the ED that face the site! Join Interface:L3 interface of the ED that faces the core! Overlay Interface: logical multi-access multicast-capable interface. It encapsulates
Layer 2 frames in IP unicast or multicast headers
"#$
B(-,7(9%
B(-,7
8/12/2019 BRKDCT 3060 Dc Interconnect
34/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
#%&'()*%+
,'-%&(+%./+.%0
OTV OTV OTV OTV
MAC TABLE
VLAN MAC IF
100 MAC 1 Eth 2
100 MAC 2 Eth 1
100 MAC 3 IP B
100 MAC 4 IP B
MAC 1#MAC 3
MAC TABLE
VLAN MAC IF
100 MAC 1 IP A
100 MAC 2 IP A
100 MAC 3 Eth 3
100 MAC 4 Eth 4
:94,7 !
:$$?&+
j
IP A#IP BMAC 1#MAC 3MAC 1#MAC 31'/&)
J20/&)
d
MAC 1#MAC 3WestSite30%40% 5 30%40% 6
EastSite
k
l
,7 8 ,7 9
I
IP A#IP BMAC 1 #MAC 3
OTV Data PlaneInter-Site Packet Flow
Jk
8/12/2019 BRKDCT 3060 Dc Interconnect
35/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
IP A
IPB
West
East
3 New MACs arelearned on VLAN 100
Vlan 100 MAC A
Vlan 100 MAC B
Vlan 100 MAC C
IPC
South
VLAN MAC IF
100 MAC A IP A
100 MAC B IP A
100 MAC C IP A
4
OTV updates exchanged via
the L3 core
OTVUpdate
3
OTV
Upd
ate
3
2
VLAN MAC IF
100 MAC A IP A
100 MAC B IP A
100 MAC C IP A
4
3 New MACs arelearned on VLAN 100
1
Overlay Transport VirtualizationOTV Control Plane
! Neighbor discovery and adjacency overMulticast (Nexus 7000 and ASR 1000)
Unicast (Adjacency Server Mode currently available with Nexus 7000 from 5.2 release)
! OTV proactivelyadvertises/withdraws MAC reachability (control-plane learning)! IS-IS is the OTV Control Protocol - No specific configuration required
Jd
8/12/2019 BRKDCT 3060 Dc Interconnect
36/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
OTV Failure Domain IsolationSpanning-Tree Site Independence
! Site transparency: no changes to the STP topology! Total isolation of the STP domain! Default behavior: no configuration is required! BPDUs sent and received ONLY on Internal Interfaces
7K
7L
OTV OTV
QZ& C=!e6
6#+5 Z&(&
QZ& C=!e6
6#+5 Z&(&
Jj
8/12/2019 BRKDCT 3060 Dc Interconnect
37/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
OTV Failure Domain IsolationPreventing Unknown Unicast Storms
! No requirements to forward unknown unicast frames! Assumption: end-host are not silent or uni-directional! Default behavior: no configuration is required
7K
7L
OTV OTV
MAC TABLE
VLAN MAC IF
100 MAC 1 Eth1
100 MAC 2 IP B
- - -
MAC 1#MAC 3
8+ F4% L /' #Z&
F4% Q"G1&
Jl
8/12/2019 BRKDCT 3060 Dc Interconnect
38/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
Remote OTV Device MAC
Table
VLAN MAC IF
100 MAC 1 IP A
101 MAC 2 IP B
! Automated and deterministic algorithm (notconfigurable)
! In a dual-homed site:Lower IS-IS System-ID (Ordinal 0) = EVEN VLANs
Higher IS-IS System-ID (Ordinal 1) = ODD VLANs! Future functionality will allow to tune the behavior
OTV OTV
B(-,7(9% +,,73(>
8/12/2019 BRKDCT 3060 Dc Interconnect
39/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
OTV and MAC Mobility
OTV
49!
49!
OTV
OTV
OTV
F4% f
F4% f
F4% f
VM Moves
F4% f
OTV
F4% f
F4% f
49!
OTVD&6#
D&6# 9"6#
OTV
OTV 9"6#
1
Server originates a
Gratuitous ARP (GARP)frame
AED advertises MAC X with ametric of zero F4% f
LMN J,-,#-= +LO P 3=
4"; %"#$%
F4% f
F4% f
F4% f
1#n
MAC X
1#n
1#n
1#n
MAC X
F4% f
2
2.3
2.2 2.1
8/12/2019 BRKDCT 3060 Dc Interconnect
40/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
OTV
49!
OTVD&6#
49!
F4% f
49!
OTV
OTV 9"6#
F4% f
LMN 34 =3-, M$=- K".;$.J= -6,
QL1R S."$J#$=- K.$*, $#."==
-6, "T,.%$U49!
F4% f
F4% f
F4% f
1#n
LMN 34 =3-, V,=- K".;$.J= -6,
QL1R 34-" -6, =3-, $4J -6, !/
=;3-#6,= @8J$-, -6,3. OL+ -$S%,=
1#n
MAC X
F4% f
OTV and MAC Mobility
F4% f
49!
OTV
OTVD&6#
49!
OTV
OTV
F4% f
F4% f
9"6#F4% f
F4% f
1#n
1#n
MAC X
F4% f
MN= 34 =3-, V,=- =,, +LO P $JT,.A=,*,4- ;3-6 $ S,7,. *,-.3# K."* =3-, M$=- $4J
#6$42, -6,* -" .,*"-, +LO $JJ.,==>7,>9'$(
)$7,
!&IUDg
P37,F9%%P37,F9%%
"#$"#$
!&IUDg
7K
7L
Placement of the OTV Edge DeviceOption 2 - OTV at the Aggregation with L2-L3 Boundary on External Firewalls
k!
8/12/2019 BRKDCT 3060 Dc Interconnect
43/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
OTV and SVI RoutingIntroducing the OTV VDC! Guideline: The current OTV implementation on the Nexus 7000 enforces the
separation between SVI routing and OTV encapsulation for any extended VLAN
! This separation can be achieved with having two separate devices to performthese two functions
! An alternative cleaner and less intrusive solution is the use of Virtual DeviceContexts (VDCs)available with Nexus 7000 platform:A dedicated OTV VDC to perform the OTV functionalities
The Aggregation-VDC used to provide SVI routing support
AggregationOTV$2:
OTV
$2:7K
7L
kJ
8/12/2019 BRKDCT 3060 Dc Interconnect
44/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
! L2-L3 boundary at aggregation! DC Core performs only L3 role!STP and L2 broadcast Domains
isolated between PODs!Intra-DC and Inter-DCs LAN extension
provided by OTV
Requires the deployment of dedicated
OTV VDCs
!Ideal for single aggregation blocktopologies
!Recommended for Green FielddeploymentsNexus 7000 required in aggregation
=L) =L)
;.)6 ;.)6 ;.)6 ;.)6
Placement of the OTV Edge DeviceOption 3OTV in the DC Aggregation
kk
8/12/2019 BRKDCT 3060 Dc Interconnect
45/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
"#$
$2:
"#$
$2:
7/'E]J 7/'E]K=+J
8ha]4
8ha]C
7/'E]J
7/'E]L 7/'E]M
7/'E]K=+J
R6U=3#$% W3,;
!"23#$% W3,;AQ. .!% AQ. .!%
8ha]4
8ha]C
>+03'< .!%7/'E]L
>+03'< .!%
7/'E]M
7"H&(L
7"H&( K
!May use a single physical link for Join andInternal interfaces
Minimizes the number of ports required tointerconnect the VDCs
!Single link or physical node (or VDC)failures lead to AED re-election
50% of the extended VLANs affected
!Failure of the routed link to the core is notOTV related
Recovery is based on IP convergence
Single Homed OTV VDCSimple Model
kd
8/12/2019 BRKDCT 3060 Dc Interconnect
46/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
!Logical Port-channels used for the Joinand the Internal interfaces
Increases the number of physical interfaces
required to interconnect the VDCs
!Traffic recovery after single link failureevent based on port-channel re-hashing
No need for AED re-election
!Physical node (or VDC) failure stillrequires AED re-election
In the current implementation may cause fewseconds of outage (for 50% of the extended
VLANs)
"#$
$2:
"#$
$2:
=+J
8ha]4
8ha]C
7/'E 7/'E h
=+J
R6U=3#$% W3,;
!"23#$% W3,;AQ. .!% AQ. .!%
8ha]4
8ha]C
7/'E6 J]K
7"H&( L
7"H&( K
7/'E6 L]M
>+03'< .!% >+03'< .!%7/'
E` 7/'Eh
7/'E_ 7/
'E^
7/'E6 J]K 7/'E6 L]M
7/'E
7/'E _
Dual Homed OTV VDCImproving the Design Resiliency
kj
8/12/2019 BRKDCT 3060 Dc Interconnect
47/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Publicmm )$&%8 &., .-9'5 8,
8/12/2019 BRKDCT 3060 Dc Interconnect
48/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
Routing VDC
OTV VDC
hostname routing-vdc
!
interface Ethernet1/1
switchport
switchport mode trunk
switchport trunk allowed vlan 100,600-700
!
interface Ethernet2/1
ip address 3.3.3.1/24
ip router ospf 1 area 0.0.0.0
ip ospf passive-interface
hostname otv-vdc
feature otv
!
otv site-vlan 100
!
interface Ethernet1/2
description Internal Interface
switchport
switchport mode trunk
switchport trunk allowed vlan 100,600-700
!
interface Ethernet2/2
description Join Interface
ip address 3.3.3.2/24
!
interface Overlay100
otv join-interface Ethernet2/2otv adjacency-server*
otv use-adjacency-server 10.1.1.1 11.1.1.1
otv extend-vlan 600-700
!
ip route 0.0.0.0 0.0.0.0 3.3.3.1
N7K-Agg1 N7K-Agg2
e1/1 e1/2
e2/2e2/1
L3 LinkL2 Link
Routing VDC Routing VDC
OTVVDC
OTVVDC
Establish L3 peeringon a dedicated VLAN
m 0,,8,8 $(%4 $( -6, /8U95,(54 #,7=,7
OTV in the DC AggregationConfiguration (Unicast Transport)
kH
8/12/2019 BRKDCT 3060 Dc Interconnect
49/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
Agenda
! Distributed Data Center & Cloud evolution overview! Data Center Interconnect Design Considerations
! Storage Extension! LAN Extension
Ethernet Based
IP Based
! Network Services and Applications! Conclusions
8/12/2019 BRKDCT 3060 Dc Interconnect
50/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
L2 Links (GE or 10GE)
L3 Links (GE or 10GE)
Layer 3 CoreISP A
ISP B
Access
Agg
Access
Agg
DC A DC B
VLAN A
Public Network
Data-BaseFront-End
DB
144.254.100.0/25 & 144.254.100.128/25
EEM or RHI can be used to get very granular
" Move the whole application tier" Optimize the whole path:
! Client to Server! Server to Server! Server to Client
Server-Server
Path Optimization
Egress Path Optimization: Server-Client Egress Path Optimization: Server-Client
Ingress Path Optimization:Clients-Server
Path Optimization and DCIAvoid Suboptimal Traffic Path After Workload Motion
de
8/12/2019 BRKDCT 3060 Dc Interconnect
51/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
V10V20
HSRPActive
HSRPStandby
ARP forHSRP VIP
ARPreply
Filter HSRP
! Filter FHRP with combination of VACL or PACL! Result: Still have one HSRP group with one VIP, but now have active router at each
site for optimal first-hop routing
Outbound Path OptimizationFHRP Filtering
HSRPActive
HSRPStandby
HSRP Hellos HSRP Hellos
dI
8/12/2019 BRKDCT 3060 Dc Interconnect
52/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
Ingress Routing Localization
Challenge
! Subnets are spread across locations! Subnet information in the routing tables is not specific
enough
! Routing doesnt know if a server has moved betweenlocations
! Traffic may be sent to the location where the application isnot available
D&6# 9"6#
)'
8/12/2019 BRKDCT 3060 Dc Interconnect
53/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
VMotion - Primary Service in Left DCGSS and ACE KAL-AP
7"H&( L %+(&
)'#("');= 4);= C
4**&66
4
8/12/2019 BRKDCT 3060 Dc Interconnect
54/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
7"H&( L %+(&
)'#("');= 4);= C
4**&66
4
8/12/2019 BRKDCT 3060 Dc Interconnect
55/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
7"H&( L %+(&
)'#("');= 4);= C
4**&66
4
8/12/2019 BRKDCT 3060 Dc Interconnect
56/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
7"H&( L %+(&
)'#("');= 4);= C
4**&66
4
8/12/2019 BRKDCT 3060 Dc Interconnect
57/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
7"H&( L %+(&
)'#("');= 4);= C
4**&66
4
8/12/2019 BRKDCT 3060 Dc Interconnect
58/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
L2 Links (GE or 10GE)
L3 Links (GE or 10GE)
VM= 10.10.10.1
Default GW = 10.10.10.100
VMotionIngress Routing Optimization with LISP
7"H&( L %+(&
)'#("');= 4);= C
4**&66
4
8/12/2019 BRKDCT 3060 Dc Interconnect
59/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
Agenda
! Distributed Data Center & Cloud evolution overview! Data Center Interconnect Design Considerations
! Storage Extension! LAN Extension
Ethernet Based
IP Based
! Network Services and Applications! Conclusions
8/12/2019 BRKDCT 3060 Dc Interconnect
60/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
Data Center Interconnect - DCI ModelConnecting Virtualized Data Centers
L2 Domain Elasticity- 748 9:#&'6/+'
VM-Mobility
VN-linknotifications
Path Optimization- Optimal Routing- Route Portability
Storage Elasticity
-SAN Extensions
LANExtensionsOTV
OTV
OTV
OTV
! Sync or Async replication modes are driven by the applications, hence thedistance/latency is a key component to select the choice! Localization of Active Storage is key#Distance can be improved using IO accelerator or caching
#Virtual LUN is allowing Active/Active
! #KL B.$%9'$( 3. -6, ?,4 ,%,*,(-! ^&%'+$3(-! :$$+ 9=$389(5, O #-$7*M)$(-7$%
E(?($F( E(359.- Z _7$9859.- 5$(-7$%
! :3(? .-&783(,..! #59%, Z )$(=,7>,(5,
)$(.38,79'$(.! 0,-F$7? 9(8 #,5&73-4 .,7=35,. 8,+%$4*,(-! #,7=,7M)%3,(- P%$F.! #,7=,7M#,7=,7 P%$F.L9-6 C+'*3;9'$( C+'$(.
! 1>7,..#/887,..,8 A4 PNQL P3%-,73(>
! B(>7,..R#/887,..,8 A4 T##O/)1 $7 QNB $7 11^OBL#:/ $7 :B#L
je
8/12/2019 BRKDCT 3060 Dc Interconnect
61/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
Data Center InterconnectWhere to Go for More Information
http://www.cisco.com/go/dcihttp://www.cisco.com/en/US/netsol/ns749/networking_solutions_sub_program_home.html
jI
8/12/2019 BRKDCT 3060 Dc Interconnect
62/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public
Complete Your OnlineSession Evaluation! Give us your feedback and you
could win fabulous prizes.
Winners announced daily.
! Receive 20 Passport points for eachsession evaluation you complete.
! Complete your session evaluationonline now (open a browser through
our wireless network to access our
portal) or visit one of the Internet
stations throughout the Convention
Center.
Dont forget to activate yourCisco Live Virtual account for access to
all session material, communities, and
on-demand and live activities throughout
the year. Activate your account at theCisco booth in the World of Solutions or visitwww.ciscolive.com.
j!
8/12/2019 BRKDCT 3060 Dc Interconnect
63/63
2012 Cisco and/or its affiliates. All rights reserved.BRKDCT-3060 Cisco Public