Advance VPLS Technology Atachements Options

Embed Size (px)

Citation preview

  • 8/19/2019 Advance VPLS Technology Atachements Options

    1/62

    Session BRKRST-2008 

    Advanced VPLS attachment technology options

    Patrice Bellagamba

    Distinguished System Engineer

    Cisco Europe

    https://www.ciscolivelondon.com/content/sessionDetail.do?SESSION_ID=3027https://www.ciscolivelondon.com/content/sessionDetail.do?SESSION_ID=3027https://www.ciscolivelondon.com/content/sessionDetail.do?SESSION_ID=3027https://www.ciscolivelondon.com/content/sessionDetail.do?SESSION_ID=3027

  • 8/19/2019 Advance VPLS Technology Atachements Options

    2/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 2

    Problem statement

    Problem to solve:

    “Ethernet service Attachment -Circuit redundancy should not implyend to end Spanning-tree usage”  

    STP is struggling with

    - Topology diameter

    - Fault isolation between sites

    - Resilience to WAN type connections

    Position Architecture: STP domain isolation thru dual homing

    - Carrier-Ethernet

    - Data-Center Interconnect

    - Ethernet Services

  • 8/19/2019 Advance VPLS Technology Atachements Options

    3/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 3

    Access Multi-homing Solutions Summary

    Highlights 

    Multi-chassis LAG  Simple solution for spoke-and-hub topology, works for both bridging and non-bridging access device

    Standard based solution by using 802.3ad

    Sub-second convergence

    Phase 1 implement is active/standby mode.

    Phase 2 is per VLAN load balancing

    Ring topology support is under investigation

    REP /REP accessgateway

    Sub 200msec convergence

    Good access ring isolation

    Now standard based G.8032 (XR4.1 release)

    Spoke-and-hub and ring topology, not works well for mesh network 

    MST/PVST accessgateway 

    Standard based solution as long as access network support MST/PVST

    Works for any access network topology

    Good access domain isolationWork with 802.1ah PBB

    Convergence time depends on access network STP 

    Node clustering VSS (Catalyst / Cisco 7600-Sup2T)Nv cluster (ASR9k)

    One control-plane for two chassis

    Easiness, Active/Active

  • 8/19/2019 Advance VPLS Technology Atachements Options

    4/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 4

    L2 node peering solutions

    Making usage of an “Inter -Chassis Communication Protocol” 

    Service TypeL2VPN

    TransportEnabler

    AccessRedundancy

    ICCP basedProtocol / Feature

    E-LINE VPWSHub and Spoke

    (Active / Backup)mLACP + 2-way PW Red.

    (coupled mode)

    E-LAN VPLS Hub and Spoke(Active / Backup)

    mLACP + 2-way PW Red.(decoupled mode)

    E-LAN H-VPLSHub and Spoke

    (Active / Backup)mLACP + 2-way PW Red.

    (decoupled mode)

    DCI VPLS CPE service mLACP or pseudo-mLACP

    DCI EVPN PE service mLACP + BGP

    Don’t be scared of all acronyms, they will be explained along the presentation 

  • 8/19/2019 Advance VPLS Technology Atachements Options

    5/62

    Inter-Chassis Communication Protocol for L2VPN PERedundancy (ICCP)

    draft-martini-pwe3-iccp-06 

  • 8/19/2019 Advance VPLS Technology Atachements Options

    6/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 6

    Inter-Chassis Communication Protocol

    ICCP allows two or more devices to form a„Redundancy Group‟ 

    ICCP provides a control channel forsynchronizing state between devices

    ICCP uses TCP/IP as the underlyingtransport

    -ICCP rides on targeted LDP session, butMPLS need not be enabled

    Various redundancy applications canuse ICCP:

    -mLACP

    -Pseudowire redundancy

    Under standardization in IETF:-draft-ietf-pwe3-iccp-06.txt

    RG

    ICCP over Dedicated Link

    RG

    ICCP over Shared Network

  • 8/19/2019 Advance VPLS Technology Atachements Options

    7/62© 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 7

    7

    Inter-Chassis Communication Protocoldraft-ietf-pwe3-iccp-06.txt

    • ICC Protocol Transport Requirements

     –Reliable Message exchange

     –In-order Delivery

     –Sequence Numbers

     –Timeouts/Retransmissions

     use widely deployed LDP protocol.

    • Extend LDP with a small set of new messages:

     –RG Connect Message

     –RG Disconnect Message

     –RG Notification Message

     –RG Application Data Message

    • Use LDP Capability to bootstrap ICCP.

    •  Application layer specific TLVs.

  • 8/19/2019 Advance VPLS Technology Atachements Options

    8/62© 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 8

    8

    Node Failure Detection

    Two mechanisms:

    • BFD – Bi-Directional Forward Detection

    • Detection upon loss of BFD keepalives

    • Requires nodes to be co-located, with a direct link connection

    • No split-brain protection, mandates link to be port-channel

    dispatched over two different line cards

    • /32 IP Route-watch

    • Detection upon loss of IP routing adjacency

    • Geo localization of nodes

    • Split-brain tie-break via MPLS network

    • Depends on IGP timersOSPF/ISIS fast convergence tuning is required

    • Ensure not to have less specific route for detection to work

    • “ip routing protocol purge interface” 

    This is requiring to avoid route-watch flapping on peer link

    failure

     Default in IOS-XR & IOS Rls15

    RG

    ICCP over Dedicated Link

    RG

    ICCP over Shared Network

  • 8/19/2019 Advance VPLS Technology Atachements Options

    9/62

    Multi-Chassis Link Aggregation Group(ASR 9K - MC-LAG)

    &

    Multi-Chassis Link Aggregation control Protocol(Cisco 7600 - mLACP)

  • 8/19/2019 Advance VPLS Technology Atachements Options

    10/62© 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 11

    Background: Link Aggregation Control Protocol

    System attributes:-System MAC address: MAC address that uniquely identifies the switch

    -System priority: determines which switch‟s Port Priority values win   Aggregator (bundle) attributes:

    - Aggregator key: identifies a bundle within a switch (per node significance)

    -Maximum links per bundle: maximum number of forwarding links in bundle – usedfor Hot Standby configuration

    -Minimum links per bundle: minimum number of forwarding links in bundle, when

    threshold is crossed the bundle is disabled

    Port attributes:-Port key: defines which ports can be bundled together (per node significance)

    -Port priority: specifies which ports have precedence to join a bundle when thecandidate ports exceed the Maximum Links per Bundle value

    -Port number : uniquely identifies a port in the switch (per node significance)

     Agg1

     Agg2

     Agg3

     Agg4

    Port #: 1, Priority: 10

    Port #: 2, Priority: 11

    Port #: 3, Priority: 5Port #: 4, Priority: 6

    Key: 10

    Key: 20

    Key: 10

    Key: 35

    System Priority: 5

    System MAC: M1

    System Priority: 3

    System MAC: M2

  • 8/19/2019 Advance VPLS Technology Atachements Options

    11/62© 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 12

    Extending LACP Across Multi-Chassis: mLACP

    mLACP uses ICCP to synchronize LACP configuration & operational state

    between PoAs, to provide DHD the perception of being connected to a singleswitch

     All PoAs use the same System MAC Address & System Priority whencommunicating with DHD

    -Configurable or automatically synchronized via ICCP

    Every PoA in the RG is configured with a unique Node ID (value 0 to 7). Node

    ID + 8 forms the most significant nibble of the Port Number For a given bundle, all links on the same PoA must have the same Port Priority

    ICCP

    DHD = Dual-Homed-Device

    PoA1

    LACPPoA2

    Node ID: 1

    Node ID: 2

    Port #: 0x9001, Port Priority 1

    Port #:0xA001, Port Priority 2

    System MAC:

    aaaa.bbbb.cccc

    System Priority: 1

    PoA = Point of Aggregation

    DHD

  • 8/19/2019 Advance VPLS Technology Atachements Options

    12/62© 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 14

    Operational Variants

    Each PoA is configured to limit themaximum number of links per bundle

    -Limit must be set to L, where L is the minimumnumber of links from DHD to any single PoA

    DHD max link should be set > L

    - In order to insure that it is slave of the POA- This will allow faster convergence

    Selection of active/standby links is theresponsibility of the PoAs

     Advantages: Faster switchover times

    compared to other variants, and MinimumLink policy on PoA can be flexible

    Disadvantage: If ICCP transport is lost,Split Brain condition could occur

    PoA-Based Control

    ICCPDHD

    Standby PoA

    Active PoALACP

    Max Links per

    Bundle: L

    L = 2

    Max Links per

    Bundle: L

    This is the most used variant

  • 8/19/2019 Advance VPLS Technology Atachements Options

    13/62© 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 15

    Protected Failure Points

    mLACP Offers Protection Against 5 Failure Points:

     A: DHD Port Failure

    B: DHD Uplink Failure

    C: Active PoA Port Failure

    D: Active PoA Node Failure

    E: Active PoA Isolation from Core Network

     A B CD

    E

     Active PoA

    DHD

    Standby PoA

  • 8/19/2019 Advance VPLS Technology Atachements Options

    14/62© 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 16

    Failover Operation

    Step 1  – For port/link failures (A,B,C), active PoA evaluates number of surviving in bundle:

    If >= M, then no action

    If < M, then trigger failover to standby PoA

    Step 2  – Active PoA signals failover to standby PoA over ICCP

    Step 3  – Failover is triggered on DHD by one of:Dynamic Port Priority Mechanism: real-time change of LACP Port Priority on active PoA to cause the standbyPoA links to gain precedence

    Links are either Hot-Standby or Up

    Brute-force Mechanism: change the state of the surviving links on active PoA to admin down

    Links are either Err-disabled or Up

    Step 4  – Standby PoA and DHD bring up standby links per regular LACP procedures

    Port/Link Failures

    ICCPDHD

    Standby PoA

    Active PoA

    • Max Links per

    Bundle: L (=2)

    • Min Links per

    Bundle: M (=2)

     A B

    C

    2. Signal failover over

    ICCP

    3. Dynamic Port Priority

    or Brute-force failover

    3. LACP Exchanges

  • 8/19/2019 Advance VPLS Technology Atachements Options

    15/62© 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 17

    Failover Operation

    Step 1A  – Standby PoA detects failure of Active PoA via one of:

    -IP Route-watch: loss of IP routing adjacency

    -BFD: loss of BFD keepalives

    Step 1B  – DHD detects failure of all its uplinks to previously active PoA

    Step 2  – Both Standby PoA and DHD activate their Standby links perregular LACP procedures

    Node Failure ICCPDHD

    Standby PoA

    Active PoA

    1A. IP Route-

    Watch or BFD

    timeout

    D1B. Links Down

    2. LACP Exchanges

  • 8/19/2019 Advance VPLS Technology Atachements Options

    16/62© 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 18

    Failover Operation

    Step 1  – Active PoA detects all designated core interfaces are downinterchassis group 21backbone interface TenGigabitEthernet4/1backbone interface TenGigabitEthernet1/4

    Really useful if no direct connection between POA or using one onlymodule toward core

    Step 2A  – Active PoA signals standby PoA over ICCP to trigger failover

    Step 2B  – Active PoA uses either Dynamic Port Priority or Brute-forceMechanism to signal DHD of failover

    Step 3  – Standby PoA and DHD bring up standby links per regularLACP procedures

    PoA Isolation from Core ICCPDHD

    Standby PoA

    Active PoA

    E

    1. Detect coreisolation

    2A. Signal failover

    over ICCP

    2B. Dynamic Port

    Priority or Brute-

    force failover

    3. LACP Exchanges

  • 8/19/2019 Advance VPLS Technology Atachements Options

    17/62

    Works similarly with H-VPLS (MPLS Access)

    E-LAN Availability ModelsActive/Backup Access Node Redundancy (mLACP)

  • 8/19/2019 Advance VPLS Technology Atachements Options

    18/62© 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 20

    E-LAN availability model Active / Backup Access Node Redundancy (mLACP)

    VFI

    VFI

    A A

    A A

        A

     

    A  

        A

     

    A  

    LACPICCP ICCP

    For VPLS Decoupled Mode, VFI‟s PWs alwaysadvertised in Active state, regardless of AC state

    VFI

    VFI

    Forwarding EoMPLS PW Non-Forwarding EoMPLS PW

    FA

    FB

    FC

    LACP

    EventsI Initial state

    FA-C Port / Link Failures

    2 Standby link broughtup per LACP proc.

    Port / Link Failures

    1B

    1A1B

    Failover triggered onDHD

    1A

     Active PoA detectsfailure and signalsfailover over ICCP

    Standby PoA flushes

    MAC table andtriggers LDP MACadd. withdrawal toremote peers

    4 Remote PEs flushMAC addresses

    4  4 

    VPLS

    PW - PseudoWire

    VFI – Virtual Forwarding Instance

  • 8/19/2019 Advance VPLS Technology Atachements Options

    19/62© 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 21

    E-LAN availability model Active / Backup Access Node Redundancy (mLACP)

    VFI

    VFI

    A A

    A A

        A

     

    A  

        A

     

    A  

    LACPICCP

    VFI

    VFI

    Forwarding EoMPLS PW Non-Forwarding EoMPLS PW

    FA

    FB

    FC

    LACP

    Events Port / Link Failures (cont.)

    E End State

    ICCP

    VPLS

    4 Remote PEs flushMAC addresses

  • 8/19/2019 Advance VPLS Technology Atachements Options

    20/62

    E-LINE Availability ModelsActive/Backup Access Node Redundancy (mLACP)

  • 8/19/2019 Advance VPLS Technology Atachements Options

    21/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 23

    Pseudowire Redundancy with LDP

    Designate Pseudowires as either primary or backup-Primary Pseudowire used for traffic forwarding, and backuptakes over in case of failure

    Signaling Redundant Pseudowires in targetedLDP session

    -Cold Redundancy: Backup PWs were not signaled untilrequired to take over

    -Warm Redundancy: Backup PWs were signaled up in thecontrol-plane but held down in the data-plane. Use AC Faultcode-point in LDP Status Message to indicate a backup PW

    -Hot Redundancy: Use PW Preferential Forwarding Status Bits

    Background

    PW 2

    PW 1

    MPLS

    PE1

    CE

  • 8/19/2019 Advance VPLS Technology Atachements Options

    22/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 24

    Two-Way Pseudowire Redundancy

     Allows dual-homing of two local PEs to two remote PEs

    Four pseudowires: 1 primary & 3 backup provide redundancyfor a dual-homed device

    Overview

    PW 1

    MPLS

    uPE2

    uPE4

    uPE1

    CE

    uPE3PW 2 PW 3

    PW 4

  • 8/19/2019 Advance VPLS Technology Atachements Options

    23/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 25

    Pseudowire Redundancy with LDP

    -0x00000000 - Pseudowire forwarding (clear all failures)

    -0x00000001 - Pseudowire Not Forwarding-0x00000002 - Local Attachment Circuit (ingress) Receive Fault

    -0x00000004 - Local Attachment Circuit (egress) Transmit Fault

    -0x00000008 - Local PSN-facing PW (ingress) Receive Fault

    -0x00000010 - Local PSN-facing PW (egress) Transmit Fault

    -0x00000020 - PW Forwarding Standby

    -0x00000040 – PW Request to go Active

    PW Status Signaling

    RFC 4447

    draft-ietf-pwe3-redundancy-bit

    Only this bit is required/used (with help of ICCP)

    PW

    tLDP

    PE1

    CE

    PE2

  • 8/19/2019 Advance VPLS Technology Atachements Options

    24/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 26

    Two-Way Pseudowire Redundancy

    Every PE decides the local statusof the PW: Active or Standby

     A PW is selected as primary forforwarding if it is active on both local & remote PEs

     A PW is considered as backup ifit is declared as Backup by either  local or remote PE

    Independent Operation Mode

    PW

    PE1 PE2

    PE1 PE2Active Active

    Active Standby

    MPLS

    PE1 PE2Standby Standby

    PE1 PE2Standby Active

  • 8/19/2019 Advance VPLS Technology Atachements Options

    25/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 27

    Two-Way Pseudowire Redundancy

    VPWS / H-VPLS – two-waycoupled:

    -When AC changes state to Active1,both PWs will advertise Active

    -When AC changes state to Standby1,both PWs will advertise Standby 

    H-VPLS – two-way decoupled:

    -Regardless from AC state, PrimaryPW and Backup PWs will advertise

     Active state

    For H-VPLS, all PWs in VFI (at nPE)are Active simultaneously, for bothaccess & core PWs

    Determining Pseudowire State

    Active ActiveActive

    Standby Standby

    Standby

    pseudowire-class

    encapsulation mpls

    status peer topology dual-homed

    Active Active

    Active

    Standby Active

    Active

    pseudowire-class

    encapsulation mpls

    status peer topology dual-homed

    status decoupled(1) Active / Standby AC states determined for example by mLACP

  • 8/19/2019 Advance VPLS Technology Atachements Options

    26/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 28

    E-LINE availability model Active / Backup Access Node Redundancy (mLACP)

    S S

    A A

    LACP LACPICCP ICCP

    1A

    2

    1B

    S

    A

    EventsI Initial state

    FA-C Port / Link Failures

    1A

     Active PoA detectsfailure and signals

    failover over ICCP

    1BFailover triggered onDHD

    2Standby link broughtup per LACP proc.

    3

     Active PoA

    advertises “Standby”state on its PWs

    4Standby PoAadvertises “Active”state on its PWs

    For VPWS Coupled Mode, attachment circuit (AC) state(Active/Standby) drives PW state advertised to remote peers

    Forwarding EoMPLS PW Non-Forwarding EoMPLS PW

    Port / Link Failures

    VPWS

    FA

    FB

    FC

  • 8/19/2019 Advance VPLS Technology Atachements Options

    27/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 29

    LACP

    E-LINE availability model Active / Backup Access Node Redundancy (mLACP)

    S

    A

    LACPICCP ICCP

    S

    A

    FA

    FB

    FC

    EventsI Initial state

    FA-C Port / Link Failures

    1A

     Active PoA detectsfailure and signals

    failover over ICCP

    1BFailover triggered onDHD

    2Standby link broughtup per LACP proc.

    3

     Active PoA

    advertises “Standby”state on its PWs

    4Standby PoAadvertises “Active”state on its PWs

    E End State Local site access failure does not trigger LACP

    failover at remote site (i.e. control-plane

    separation between sites)Forwarding EoMPLS PW Non-Forwarding EoMPLS PW

    Port / Link Failures (cont.)

    VPWS

  • 8/19/2019 Advance VPLS Technology Atachements Options

    28/62

    Implementing MC-LAG

  • 8/19/2019 Advance VPLS Technology Atachements Options

    29/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 31

    Multi-Chassis LACP synchronization:

    LACP BPDUs (01:80:C2:00:00:00) are exchanged on each Link

    System Attributes: Priority + bundle MAC Address

    Port Attributes: Key + Priority + Number + State

    MPLS

    Terminology:mLACP : Multi-Chassis Link Aggregation Control Protocol

    MC-LAG : Multi-Chassis Link Aggregation Group

    DHD : Dual Homed Device (Customer Edge)

    DHN : Dual Homed Network (Customer Edge)POA : Point of Attachment (Provider Edge)

    Attachment Circuit Using mLACP/MC-LAG

    redundancy

    iccp

    group

    mlacp node

    mlacp system mac

    mlacp system priority

    member

    neighbor

    interface

    mlacp iccp-group

    mlacp port-priority

    interface

    bundle id mode active

    DHD

    Active POA

    Standby POA

    Redundancy

    Group

    ICCP

  • 8/19/2019 Advance VPLS Technology Atachements Options

    30/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 32

    Active/Standby Deployment Options

    ICCPVFI VFI

    MPLS Core

    Cluster node

    as a DHD

    ICCPVFI VFI

    MPLS Core

    Cluster node

    as a DHD

    LACP Hot-Standby

     Active

    PE

    Standby

    PE

    Traffic may take sub-optimal path

    via the DHD inter chassis link

    Optimal path by bundling 4 links in vPC

    Direct path exist between each N7K

    and active PE

     ASR9K‟s as 

    POA‟s   ASR9K‟s as POA‟s 

     Active

    PE

    Standby

    PE

  • 8/19/2019 Advance VPLS Technology Atachements Options

    31/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 33

    SiSi

    SiSi

    MC-LAG to VPLS Testing http://www.cisco.com/en/US/docs/solutions/Enterprise/Data_Center/DCI/vpls/vpls_asr9k.html

    MPLS

    core

    1

    23

    4

    5

    6

    7

    8

    Only error 2/3/4 are leading to ICCP convergence

    Rem: 2 & 4 are dual errors

    • 500 VLAN Unicast: Link error sub-1s & Node error sub-2s

    • 1200 VLAN unicast: Link error sub-2s & Node error sub-4s

  • 8/19/2019 Advance VPLS Technology Atachements Options

    32/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 34

    MC-LAG Not-Supported Service ExampleLocal Connect

    Local connect service between bundle port and bundle port, or between bundle port and regular port areconfigurable. And it works in the normal condition

    However, if bundle failover happen, then it won‟t work. For example, for CE2, if it failover to the bottomPOA, then there is no local connection to CE 1 or CE3

    In summary, although you can configure the local connect service for the MC-LAG bundle port, but itcould cause problem. So it‟s not supported 

    Local bridging is supported assume there is L2 link between two POA

    ICCP

    Standby POA

    Active POA

    CE1

    CE2

    CE3

    ICCP

    Standby POA

    Active POA

    CE1

    CE2

    CE3

    Local BridgingLocal Connect

  • 8/19/2019 Advance VPLS Technology Atachements Options

    33/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 35

    VPLS or H-VPLS

     AS2

    VFI

    VFI

    VFI

    VFI

     ASBR2

     ASBR3

     ASBR4

    From each pair of ASBR point of view, the other side is just a single virtual LACP device

    Pros:

    o

     Simple configuration which provide both link and node redundancyo Advantage of option A: Flexible per interface/sub-interface features: QoS, MAC limit, ACL, etc

    o Convergence time is fast: sub-second for both link and node failures

     Cons:

    o Bundle is in active/standby mode, 50% usage of the inter-AS link bandwidth

    o Need manual configuration to inter-connect different VPLS VFIs

    o limited to be 4K L2 sub-interfaces per bundle port

    o ASBR link has to be Ethernet

    MC-LAG on

    both pair of

     ASBRs

    Link bundle

     ASBR1

    VPLS or H-VPLS

     AS1

    VFI

    VFI

    Inter-AS Option A  – Resiliency SolutionsUsing MC-LAG

  • 8/19/2019 Advance VPLS Technology Atachements Options

    34/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 36

    MC-LAG & L3 ServiceIRB/BVI, decoupled mode

    Configure L2 sub-interface on the bundle, and then configure L2 PW between two POA. Both L2 sub-interface and L2 PW are in the same bridge-domain. Configure IRB/BVI for the bridge-domain for the L3service

    L3 features like HSRP, VRRP, routing, etc could be configured under BVI interface

    BVI interfaces are up on both POA regardless of the bundle status

    Bundle failover only impact the bundle itself. BVI and related L3 topology is not aware  fast L3convergence

    LACP ICCP

    Standby POA

    Active POA

    MPLS/IP

    Recommanded Option:

    DHD can run IGP with both POA. Routing

    session will be up with both POAs

     Bundle/POA failover won‟t cause

    the L3 topology change

    BD

    BD

    BVI

    BVI

  • 8/19/2019 Advance VPLS Technology Atachements Options

    35/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 37

    FeatureCisco

    Catalyst3750-ME

    Cisco ME3600X / 3800X

    Cisco ASR901/903

    Cisco7600

    CiscoASR 9000

    One-Way PW Redundancy X X X X X

    Two-Way PW Redundancy X X

    LDP MAC AddressWithdrawal

    X X

    LACP X X X X X

    mLACP X X

    ICCP X X

    mLACP Platform Support

  • 8/19/2019 Advance VPLS Technology Atachements Options

    36/62

    Pseudo mLACP

  • 8/19/2019 Advance VPLS Technology Atachements Options

    37/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 39

    Pseudo MLACP (P-mLACP) concept

    P-mLACP provides an Active / Active dual homing redundancymechanism with per-VLAN load balancing

    - higher bandwidth utilization

    Backup time does not require link state changes

    - Improve scale and convergence time

    Supports today Dual Homed Device (DHD)

    - Will support Dual Homed Network (DHN) in future

    New extensions to Inter-Chassis Communication Protocol (ICCP) used

    for communication to control the failover process

     Available in Cisco 7600 with 15.1(3)S release

    - ES / ES+ linecards

  • 8/19/2019 Advance VPLS Technology Atachements Options

    38/62

  • 8/19/2019 Advance VPLS Technology Atachements Options

    39/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 41

    Attachment Circuit options

    DHD

    ICCP

    DHD

    ICCP

    DHN

    Mono-Device Dual Homed Device(DHD)

    Multi-Devices Dual Homed Device (DHD)

     The one analyzed in this presentation

    Dual Homed Network (DHN)• 7600 do support MVRP

    • But not officially supported as it would

    require DHN to support MVRP to flush

    local MAC

    •  4K VLAN Scale (no multi-chassis

    etherchannel)

    Traffic path

  • 8/19/2019 Advance VPLS Technology Atachements Options

    40/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 42

    Traffic path

    DHD

    Per VLAN group balancing over Etherchannel

    Traffic path

  • 8/19/2019 Advance VPLS Technology Atachements Options

    41/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 43

    Traffic path

    DHD

    With VPLS, on the ES+ facing edge card

    EVC load balancing over lacp bundle is only on per EFP

    With one EFP per VLAN, repartition is OK

    If one EFP for all VLAN, then no balancing

  • 8/19/2019 Advance VPLS Technology Atachements Options

    42/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 44

    EFP static load repartition over bundle

    interface TenGigabitEthernet2/3

    channel-group 2 mode active link 1

    interface Port-channel2

    port-channel load-balance link 1

    service-instance 4021

    !

    service instance 4021 ethernet

    description ### VDC-2 VLANs ###

    encapsulation dot1q 400,1000-1999

    bridge-domain 4021

    Optional, but useful to control

    which link is primary

    EFP

  • 8/19/2019 Advance VPLS Technology Atachements Options

    43/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 45

    Active path failures

    DHD

    ICCP

     AB

    CD E

     A = Nexus port failure (shut)

    B = Attachment-Circuit failure

    C = Dual AC failure

    D = 7600 crash

    E = MPLS link failureN= DHD member crash

    N

    F il diti d MAC fl h id ti

  • 8/19/2019 Advance VPLS Technology Atachements Options

    44/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 46

    Failure condition and MAC flush considerationMAC learning on nominal mode

    Mr

    LAG PWForwarding

    Ml

    Ml

    Ml

    Mr

    Mr

     Assuming no VLAN repartition

    ICCP

    Blocking

    Mr

    Mr

    F il diti d MAC fl h id ti

  • 8/19/2019 Advance VPLS Technology Atachements Options

    45/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 47

    Failure condition and MAC flush considerationMAC learning on PE failure

    Mr

    LAG PWForwarding

    Blocking

    Ml

    Ml

    Ml

    Mr

    Mr

    Mr

    Mr

     Assuming no VLAN repartition

    ICCP

    Mr

    Mr

    Mr

    Ml

    Ml

    F il diti d MAC fl h id ti

  • 8/19/2019 Advance VPLS Technology Atachements Options

    46/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 48

    Failure condition and MAC flush considerationMAC learning on PE up time

    Mr

    LAG PWForwarding

    Ml

    Ml

    Ml

    Mr

    Mr

    Due to lack of per VLAN MVRP, second path VLAN may be affected during recovery

     Manual trigger is prefered

    ICCP

    Blocking

    Mr

    Mr

    Mr

    Mr

    Mr

    Ml

    Ml

    Reversion

    trigger

    -

    Manual

    procedure

    No MVRP

    Requires to flap port-channel,

    R i d

  • 8/19/2019 Advance VPLS Technology Atachements Options

    47/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 49

    Reversion procedurescripted for easiness

    event manager applet Revert_po2

    event none

    action 1.0 cli command en

    action 1.1 cli command conf t

    action 2.0 cli command int po2

    action 2.1 cli command shut

    action 2.2 cli command no shut

    action 2.3 cli command end

    action 3.0 syslog msg Preemption requested for port-channel “ 

    alias exec Revert_po2 event manager run Revert_po2

  • 8/19/2019 Advance VPLS Technology Atachements Options

    48/62

    Active path failures measurement

    Failure type Traffic 

    Down Up

    Traffic

    Down Up

    Comment

    A DHD link

    shut

    0.5s-1s 1.5s

  • 8/19/2019 Advance VPLS Technology Atachements Options

    49/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 51

    HW and SW considerations

    Supported today by Cisco 7600 with following HW:

    -  Access linecard: ES+ and ES-20 (Core linecard: Any)

    - SUP-720 and RSP-720

    Supported on port-channel with service instances (evc-based port-channel)

    - EFP with bridge-domain and SVI for VPLS uplinks

    - EFP with xconnect (PoA with EoMPLS uplinks – VPWS and H-VPLS spoke)

    - EFP with C-MAC bridge-domain (PoA with native 802.1ah Ethernet uplinks)

    PBB configurations support only one (1) member link per PoA in mLACP/P-mLACP port-channels

    - EFP with C-MAC bridge-domain with SVI for VPLS uplinks

    Supported by Cisco 7600 starting with IOS 15.1(3)S

    Planned support with ASR9K

  • 8/19/2019 Advance VPLS Technology Atachements Options

    50/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 52

    P-mLACP Configuration Guidelines / Restrictions

    Only one Port-channel of type „mLACP or pmLACP‟ is supported on a single

    RG. There can be one mLACP port-channel and one more pmLACP port-channel on a single RG, but not two Port-channel of same type.

    Bridge-domain associated to P-mLACP port-channel should not be part of anyother non P-mLACP interfaces

    ICCP ICCP

    Working in normal mode Blocking in failure mode !

    Not supported

    Fo a given Bridge-domain (SVI)

  • 8/19/2019 Advance VPLS Technology Atachements Options

    51/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 53

    P-mLACP Configuration Guidelines / Restrictions

    DHCP / IGMP snooping state synchronization over ICCP is supported from 15.2S

    Routed PW will not be supported in Core

    Connectivity Fault Management (CFM) maintenance points (MEP/MIP) notsupported on P-mLACP port-channel

    - CFM Port MEP (untagged CFM) can be configured under port-channel member

    Link OAM can be configured under port-channel members

    Recommended configuration sequence:

    - Configure “interchassis group” 

    - Configure port-channel interface

    - Configure port-channel memberlinks

     Any Out-Of-Sequence Configuration may need flapping of the Port-Channel to ensureproper pmLACP functionality

  • 8/19/2019 Advance VPLS Technology Atachements Options

    52/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 54

    SSO considerations

    Pseudo-mLACP is supporting SSO- With LDP graceful

    Software crash protected gracefully

    But manual command “redundancy force-switchover”

    - Is subject to timing constraints and could lead tomedium term blackout

    - Under investigation

    - Recommendation is to preventively swap traffic toalternate node

  • 8/19/2019 Advance VPLS Technology Atachements Options

    53/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 55

    PE1 Configuration

    redundancy

    interchassis group 100

    monitor peer bfd

    member ip 2.2.2.2

    backbone interface GigabitEthernet2/21 

    mlacp node-id 1

    PE2 Configuration

    redundancy

    interchassis group 100

    monitor peer bfd

    member ip 1.1.1.1

    backbone interface GigabitEthernet1/12 

    mlacp node-id 2

    Sample Configuration

    DHD

    PE-1 (POA1)

    1.1.1.1

    ICCPmLACP-AA

    PE-2 (POA2)

    2.2.2.2

    Redundancy

    Group 100

    Gig2/20

    Gig1/11

    Prim: 4041

    Sec: 4042

    Prim: 4042

    Sec: 4041

    Gig2/21

    Gig1/12

  • 8/19/2019 Advance VPLS Technology Atachements Options

    54/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 56

    Sample Configuration (cont.)

    PE1 Configurationinterface Port-channel34

    no ip address

    mlacp interchassis group 100

    mlacp mode active-active

    mlacp load-balance primary vlan 4041

    mlacp load-balance secondary vlan 4042

    ethernet vlan color-block all*service instance 888 ethernet

    description vpls_coupled

    encapsulation dot1q 4041

    rewrite ingress tag pop 1 symmetric

    bridge-domain 4041

    !

    service instance 999 ethernet

    description vpls_decoupled

    encapsulation dot1q 4042

    rewrite ingress tag pop 1 symmetric

    bridge-domain 4042

    PE2 Configurationinterface Port-channel34

    no ip address

    mlacp interchassis group 100

    mlacp mode active-active

    mlacp load-balance primary vlan 4042

    mlacp load-balance secondary vlan 4041

    ethernet vlan color-block all*service instance 888 ethernet

    description vpls_coupled

    encapsulation dot1q 4041

    rewrite ingress tag pop 1 symmetric

    bridge-domain 4041

    !

    service instance 999 ethernet

    description vpls_decoupled

    encapsulation dot1q 4042

    rewrite ingress tag pop 1 symmetric

    bridge-domain 4042

    (*) Configuration required if EVC cross connect or PBB is used on the P-mLACP port-channel

  • 8/19/2019 Advance VPLS Technology Atachements Options

    55/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 57

    Debugging/Troubleshooting

    Show commands

    show lacp multi-chassis group

    show lacp multi-chassis port-channel

    show lacp multi-chassis load-balance group

    show lacp multi-chassis load-balance port-channel show lacp internal

    show lacp neighbor

    show etherchannel [id] [detail | port | port-channel | summary]

    show redundancy interchassis

    show mpls ldp iccp

  • 8/19/2019 Advance VPLS Technology Atachements Options

    56/62

  • 8/19/2019 Advance VPLS Technology Atachements Options

    57/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 59

    Checking P-mLACP state

    PE1#show lacp multi chassis load balance port channel 34

    Interface Port-Channel 34

    Local Configuration:

    P-mLACP Enabled: Yes

    Redundancy Group: 100

    Revertive Mode: Revertive

    Primary VLANs: 4041Secondary VLANs: 4042

    Local Interface State:

    Interface ID: 34

    Port State: Up

    Primary VLAN State: Active

    Secondary VLAN State: Standby

    Peer Interface State:

    Interface ID: 34

    Primary VLAN State: Active

    Secondary VLAN State: Standby

    Show Commands

    Fail flags (bitfield):

    MLACP_FAIL_PEER = 0x1, /* Node failure */

    MLACP_FAIL_MIN_LINK = 0x2, /* A/B/C failure */MLACP_FAIL_CORE = 0x4, /* Core failure */

  • 8/19/2019 Advance VPLS Technology Atachements Options

    58/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 60

    Debugging/Troubleshooting

    SP Debugging commands

    - debug lacp load-balance- debug lacp load-balance vlan

    - debug lacp load-balance database

    - debug lacp load-balance redundancy-group

    - debug lacp load-balance all

    - debug redundancy interchassis [all | application | error | event | monitor]

    - debug ethernet service instance error

    - debug ethernet service instance xdr- debug ethernet service instance event

    - debug mvrp all

    - debug mvrp error

    - debug mvrp packet

    - debug mvrp verbose

    RP Debugging commands- debug lacp load-balance vlan

    - debug lacp load-balance database

    - debug redundancy interchassis [all | application | error | event | monitor]

    - debug mpls ldp iccp

    - debug ethernet service error

    - debug ethernet service api

  • 8/19/2019 Advance VPLS Technology Atachements Options

    59/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 61

    Ethernet spoke-and-hub(MC-LAG)

    L2 Ethernet Ring

    (MST/REP-AG,G.8032) 

    IP/Service Edge

    IP/MPLS

    L3 Router dual-homing (L3 ECMP)

    Service Multi-Homing

    Building blocks

     Point to point L2 Service PW redundancy Multi-point L2 Service  MC-LAG

    Changing the Redundancy Paradigm

  • 8/19/2019 Advance VPLS Technology Atachements Options

    60/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 62

    g g y g

    Virtual Cluster and Satellite for BNG

    Home

    Aggregation

    (MPLS)

    Cluster ASR 9000

    Distribution

    Home

    Cluster & Satellite

    Core

    BNG

    BNG

     ASR 9000

    VirtualCluster

    BNG

    BNG

     ASR 9000Virtual Cluster

    Satellite

    Aggregation

    (MPLS)

     ASR 9000

    Distribution

    Core

    • Geo Redundant Dual Homing

    • High Availability

    • Single-Chassis-like look&feel and

    Management of cluster Members

    • Stateful Failover between chassis

    •  Active/active LAG user facing

    +• Huge 1GE Fan-out

    • Satellites appear like ASR 9000

    Linecards

    • Simplified topology, No Spanning

    tree or other L2 redundancy

    protocols needed

  • 8/19/2019 Advance VPLS Technology Atachements Options

    61/62

    © 2011 Cisco and/or its affiliates. All rights reserved. Cisco PublicPresentation_ID 63

    Complete Your Online Session Evaluation

    Give us your feedback andyou could win fabulous prizes. Winnersannounced daily

    Receive 20 Cisco Preferred Access pointsfor each session evaluation you complete

    Complete your session evaluation onlinenow (open a browser through our wirelessnetwork to access our portal) or visit oneof the Internet stations throughout theConvention Center

    Don‟t forget to activate your Cisco Live 

    and Networkers Virtual account for access

    to all session materials, communities, and

    on-demand and live activities throughout

    the year. Activate your account at any internet station

    or visit www.ciscolivevirtual.com.  

    http://www.ciscolivevirtual.com/http://www.ciscolivevirtual.com/http://www.ciscolivevirtual.com/

  • 8/19/2019 Advance VPLS Technology Atachements Options

    62/62

    Thank you.