WBC Leadership Review Slides

WBC Collaboration

“We want to engage with customers to help us all understand what will be delivered at each stage, capture any missing, changed or delayed requirements and ensure a positive Customer Experience”

To do this we:

• Hold frequent bilaterals

• Encourage direct customer involvement

• Provide “War Room” Support

• Flexibly reprioritise each 90 day development cycle

• Add and amend requirements with our customers

We need to take this approach forward into the End to End testing world.

WBC – Providing a Positive Customer Experience

“We are aiming for a Smooth and Seamless CE delivered through joint testing & collaborative development and communications”

We do this with:

• A CE roadmap planned and measured throughout the trial, launch and in-life stages of WBC.

• Use measurable CE targets to share underlying test results with customers, rather than getting bogged down in reams of test results.

• We focus on delivering a positive E2E CE for BTW, the CP and their EU customers.

• We help customers deliver a marketing and sales message based on the CE delivered by the product.

WBC CE Roadmap - High Level View    Milestones

  High Level Measures POCService

TrialCustomer Trial (1)

Launch(Apr 08)

Customer Trial (2)

In Life(Q3)

Mar-09Commit

QoS & CE Provide to ODD L2C AP/EP NA NA 96% 96% 96% 96% 96%

  ELFs L2C AP/EP NA NA 7% 7% 7% 7% 4%(1)

RFT L2C EUA 80% 80% 85% 85% 87% 87% 95%

  ELF EUA N/A 8% 8% 8% 8% 7% 4%(1)

  RFT T2R EUA 50% 50% 60% 60% 65% As 20C 95% (6)

Repeat Reports N/A 20% 20% 20% As 20C As 20C As 20C (7)

  Cleared in objective time T2R AP/EP NA NA 86% 86% 86% 86% 86%

  Repeats T2R AP/EP NA NA 18% 18% 18% 18% 18%

Provisioning exceptions Migrations  NA NA  3% 2%  2%  1% 1%

  ELFs Migrations  NA NA  8% 8%   8%  7% 4%(1)

 

  CT L2C EUA 8WD 6.5WD 5WD 5WD 5WD 5WD

SelectableLead time(2)1 Hr (3)

  CT L2C AP/EP N/A 23WD 10WD 10WD 10WD 10WD 5WD(4)

  CT T2R EUA <96Hrs <72Hrs <50Hrs <40Hrs <40Hrs <40Hrs 2-24 (5)

  CT T2R AP/EP N/A 7Hrs 7Hrs 6Hrs 6Hrs 6Hrs 5Hrs

 

  In-life Fault Rate N/A N/A N/A 0.1 0.1 0.1 0.08

  Billing Accuracy N/A N/A 100% 100% 100% 100% 100%

  CP satisfaction with WBC service. NA 60% 80% 90% 80% 90% 90% (8)

WBC CE Roadmap – Consolidates underlying CE criteria and test results

Division/Author/OwnerMay 9, 2006www.btwholesale.com

WBC CE Roadmap - High Level View

NA

N/A

N/A

N/A

<96Hrs

N/A

8WD

NA

NA

NA

NA

N/A

50%

N/A

80%

NA

NA

POC

1%1%2%2%3%NAProvisioning exceptions Migrations

As 20C (7)As 20CAs 20C20%20%20%Repeat Reports

95%87%87%85%85%80%RFT L2C EUA

90% (8)90%80%90%80%60%CP satisfaction with WBC service.

100%100%100%100%100%N/ABilling Accuracy

0.080.10.10.1N/AN/AIn-life Fault Rate

5Hrs6Hrs6Hrs6Hrs7Hrs7HrsCT T2R AP/EP

2-24 (5)<40Hrs<40Hrs<40Hrs<50Hrs<72HrsCT T2R EUA

5WD(4)10WD10WD10WD10WD23WDCT L2C AP/EP

SelectableLead time(2)1 Hr (3)5WD5WD5WD5WD6.5WDCT L2C EUA

4%(1)7%8%8%8%NAELFs Migrations

18%18%18%18%18%NARepeats T2R AP/EP

86%86%86%86%86%NACleared in objective time T2R AP/EP

95% (6)As 20C65%60%60%50%RFT T2R EUA

4%(1)7%8%8%8%8%ELF EUA

4%(1)7%7%7%7%NAELFs L2C AP/EP

96%96%96%96%96%NAProvide to ODD L2C AP/EPQoS & CE

Mar-09Commit

In Life(Q3)

Customer Trial (2)

Launch(Apr 08)

CustomerTrial (1)

Service TrialHigh Level Measures

Milestones

Trial & launch success criteria – customer service requirements

As 20CAs 20CAs 20CAs 20C20%60%NAMaximum % CP manual handlingSupport/ Resource

100%100%99%99%95%90%NAEUA & AP/EP Product Compliance with Handbook, STINs etc

100%100%99%99%95%90%TBDEUA & AP/EP availability of product functionality

Product Functionality

99.995%TBDTBDTBDTBDTBDTBDNetwork service availability (including planned outages)

6.1.46.1.46.1.45.0.35.0.35.0.35.0.3Network releases availabilityNetwork

Same as IPstream

16%18% total order types

15% provide, cease, modify

20% simprovide

20% provide, cease & modify

50% simprovide

60% provide, cease & modify

100%Maximum % Customer Service manual handling

99%99%99%99%90%50%NASuccess rate of T2R transactions

99%99%99%99%90%50%NASuccess rate of L2C transactions

5000OSS live test environment requirement volume dependency

TBDTBDTBDTBDTBDTBDTBDBB E2E system response time (L2C & T2R) - latency

99%99%99%99%90%50%NABB E2E system & OSS network availability (inc planned outages)

TBDCycle 8Cycle 8Cycle 7Cycle 6Cycle 5ManualDevelopment cycle availabilityOSS

2mTBD200003000300025015EUA volume ramp-up profile (up to)Volume Profiles

Mar-09CommitIn Life

Customer Trial (2)Launch

Customer Trial (1)

Service TrialPOCHigh Level Measures

Milestones

Trial & launch success criteria – CP & EU requirements

TBDTBDTBDTBDTBDTBDTBDEtc – to be determined

90%90%80%90%80%60%NAEU Perception of WBC Service

40%40%40%40%40%NANA% on higher line rate than Max

5%5%5%5%10%NANA% on lower line rate than Max

0.005%0.005%0.005%0.005%0.05%0.5%NA% flappers

5 days5 days5 days8 days10 daysNANATime to stabiliseQoS & CE

Mar-09CommitIn Life

Customer Trial (2)Launch

CustomerTrial (1)

Service TrialPOCHigh Level Measures

Milestones

Trial & launch success criteria – customer migration additional requirements

TBDTBDTBDTBDTBDTBDTBDEtc – to be determined

TBDTBDTBDTBDTBDTBDTBDVolume supported

TBDTBDTBDTBDTBDTBDTBDNo of single line regressions

TBDTBDTBDTBDTBDTBDTBDAve time out of service

TBDTBDTBDTBDTBDTBDTBDNo of outagesQoS & CE

Mar-09CommitIn Life

Customer Trial (2)Launch

CustomerTrial (1)

Service TrialPOCHigh Level Measures

Milestones

1-Urgent2-High

Defects - Age Graph

Times: D-Days, W-Weeks, M-Months, Y-Years

0D

1D

2D

3D

4D

5D

6D

1W

2W

3W

4W 1M

2M

3M

4M

5M

6M

7M

8M

Nu

mber

of D

efe

cts

40

35

30

25

20

15

10

5

0

27

9

2

14

10

13

10

23

12

5

2

38

10

31 1

3 21

4.081.473.2Test run rate4.080.943.2Pass run rate

19/11/2007

12/11/2007UAT Start date - duration 30 days

RequiredActualPlanned

8No. of tests in flight2No. of tests descoped

32%% Tests possible complete10%% Inflight25Total number of tests run1%% Failed79%% of initial no. possible

21%% Passed77No. of tests possible

1Failed19No. of tests blocked16Passed98Initial no. of tests

wBc Q2/Cycle 6 L2C IVVT High level progress

4.081.473.2Test run rate4.080.943.2Pass run rate

19/11/2007

12/11/2007UAT Start date - duration 30 days

RequiredActualPlanned

8No. of tests in flight2No. of tests descoped

32%% Tests possible complete10%% Inflight25Total number of tests run1%% Failed79%% of initial no. possible

21%% Passed77No. of tests possible

1Failed19No. of tests blocked16Passed98Initial no. of tests

wBc Q2/Cycle 6 L2C IVVT High level progress

High Level View

Lower Level CE Support Requirements Detailed network &

IVV&T results

WBC product overview

CP

CMSANs

Aggregation Point 1

Metros

BRAS

Aggregation Point 20

*

*

*EU

*

*

*EU

MSIL

MSIL Downstream Network

WBC – three main components

EUA Aggregation Point & Extension Path

Customer Network & Interconnect

123

What Does End to End Testing Mean for WBC? ->

WBC End to End Testing overview

CP

CMSANs

AggregationPoint 1

Metros

BRAS

AggregationPoint 20

*

*

*EU

*

*

*EU

MSIL

MSIL Downstream Network

CP

CMSANs

AggregationPoint 1

Metros

BRAS

AggregationPoint 20

AggregationPoint 1

Metros

BRAS

AggregationPoint 20

*

*

*EU

**

**

**EU

*

*

*EU

**

**

**EU

MSIL

MSIL Downstream Network

123Internet

End Users CP Help Desks Web Portals

CPE

B2B GatewaysBTW SMC

email

VOIP

VAD/ IPTV

WBC ProductCP Servers &

Interface

People OSS

Support Systems

CPE Compatibility Testing is also a key component of the E2E testing story for Customers