Introduction 3G Network KPIs

06.April 2006

HUAWEI TECHNOLOGIES CO., LTD.

www.huawei.com

Introduction to UMTS Radio KPI


www.huawei.com

Huawei Northwest Africa Region

RNP Solution Manage: William.chen

[email protected]

3G network planning introduce

PDF created with pdfFactory Pro trial version www.pdffactory.com

http://www.huawei.com

mailto:[email protected]

http://www.pdffactory.com

HUAWEI TECHNOLOGIES CO., LTD. Page 2

Agenda

n UMTS Radio KPI overview

n 3G Network Optimization

n Case Study of KPI Optimization




3G KPIs Principle: S.M.A.R.T

Specificthe KPI has clear and complete definition and formula, include check point and procedure.

Measurable KPIs are measurable by given condition, measurement equipment and procedure.

Attainable all the KPIs should be reachable, it is refer to the commercial network.

Relevant the KPI can show the subscriber experience

Time-bound the KPI target should be on the base of time-bound




3G KPIs : Specific

Complete KPI definition include the formula combine with the check point or procedure.

The example: RRC Connection Successful Rate

100%×ionAttemptRRCConnectionSuccessRRCConnect

=RRCS_SRservice

serviceService

n formula

n Check point

The number of “RRC Connection Attempt” is A1 or A2?

A2 represent the effective number of “RRC Connection Attempt”.




n Field Test -> Drive Test

3G KPIs : Measurable – Drive Test

Evaluate the overall network performance, usually on the network pre-launch phase and initial stage of commercial launch.

Driver test route is based on cluster, it is involved about 20 sites in one cluster usually.

Test platform

Multiple test model UEs can perform different tests.

Data analysis

Probe & Assistant is used for analyzing test data




n Field Test ->stationary TestEvaluate the system / equipment performance.

3G KPIs : Measurable – Stationary test

Core Network

RNC

NodeB

NodeB

System performance Radio Network performance

nEquipment ability

nTransmission

nNetwork construct

n….

nRadio network planning

nSpecial environment condition

System KPI is suggested to be test by stationary:

n Throughput KPI

n Delay KPI

n Quality KPI

Stationary test condition is fixed, and usually used in indoor test scenario.

Radio Network KPI test is suggested to be test by drive test

n Call drop rate

n Handover successful rate




Monitoring & analysis center

Subscriber care center

Optimization team

Any corresponding dept.

Terminal: ordinary PC or laptop, no distance limitation

Local networks

Nastar server

Recommended for security

OM system

Essential

3G KPIs : Measurable – Statistic test

n Statistic Test

There must be enough statistic sample, that mean network traffic should be reach high level.

Pre-Condition for Statistic Test




MSC/SSP/VLR

HLR/AC

GMSC/SSP

PSTNPLMNISDN

iManagerTM M2000

GENEX Nastar 3G

GENEX Assistant3G

GENEX ProbeWCDMA

CN

Node B

Node B

Node B

RNC

RNC

Node B

Node B

Node B RNS

RNS

network pre-planning/planning

wireless test data

multiple test data

obtaining test dataparameter

optimization files

v GENEX Probe

v AGILENT

v QUALCOMMv HUAWEI RNC

comprehensive analysis of the performance, configuration, alarm

GENEX U-Net

automatic delivery

RNC testdata

sharing of

analysis results

Huawei KPI test platform




Statistic / Measurement data

Examples of User Experience (QoE)

completion of a download file

Voice, Video Phone, MMS, WAP, Email, FTP, HTTP…

AMR12.2, CS64k,PS64k/128k/384k, HSDPA/HSUPA

Accessibility Retainability Integrity Mobility Utilization Availability

End-to-end response is fast

The voice and video is Clare

Service Performance

Radio Network KPI

3G KPIs: Relevant




3G KPIs

Accessability Retainability Service Integrity Mobility Delay/Latency

• Call Setup Success Rate (Voice/VP)

• PDP Context Activation Success Rate

• SMS/MMS Success Rate

• Call Drop Rate (Voice/VP)

• PDP Context Drop Rate

• PS Throughput • SHO Success Rate

• Hard Handover Success Rate

• Inter-RAT Handover Success Rate

• Call Setup Delay (Voice/VP)

• PDP Context Activation Time

• RTT

• Worst Cell Rate

Availability

Huawei 3G KPIs Architecture




3G KPI is not only a value, but a system, for example of CDR (Call Drop Rate)

3G KPIs: It is not only a value

Network Planning Network Construct Transmission optimization

Coverage

Pilot pollution

Neighbor cell problem

Hand over Transport

congestionInterference Scramble2G

resource Call drop cause

Others

59.45% 7.29% 4.56% 0.68% 0.68% 3% 2.28% 11.94%10.02%

Root cause drop-call




Reasonable KPI target

Cost

CompetitionCompetition

Technical Technical

3G KPIs: Attainable

3G KPI is output of combination with investment include technology, HR,cost, competition strategy etc.

Huawei KPI comply principle: n Huawei will be responsibility for every complied KPI;

n Cooperate with Mobilis to work out a Competitive KPI;

n Use the experience from other commercial network;

AttainableAttainable Common target for Mobilis and Huawei



HUAWEI TECHNOLOGIES CO., LTD. Page 130 3 6 9

12 15 18 21 24 27

30 33 36 39 42

45 48

010

2030

4050

60

70

80

90

100

Number of Sites

0 3 6 9

12 15 18 21 24 27

30 33 36 39 42

45 48

010

2030

4050

60

70

80

90

100

Number of Sites

nOngoing Optimization

nCommercial Launch

n Pre-LaunchKPI Acceptance

nMature Network

Nastar

Probe & Assistant

ü Drive Test KPIsü Stationary test KPIsü Network Statistics

Probe & Assistant

ü Drive Test KPIsü Stationary test KPIs

nNetwork constructü Site verification

3G KPIs: Time-bound

ü Network Statisticsü Benchmark test

Probe & Assistant

Each KPI has

life duration




Recommend test methodology

Statistic TestDrive TestPS Call drop rate

Statistic Test-CS Call complete rate

-Drive TestRRC connection success rate

Statistic Test-PS Call Complete rate

StationaryStationaryR99 PS Throughput

StationaryStationaryHSPA Throughput

Statistic TestDrive TestSoft handover success rate

StationaryStationaryHSPA Call drop rate

Statistic TestDrive TestInter-RAT handover success rate

Statistic TestDrive TestCS Call drop rate

Statistic TestDrive TestPDP activation success rate

Statistic TestDrive TestCall setup success rate

On-going OptimizationPre-launch AcceptanceTest Methodology




Contents

• UMTS Radio KPI overview

• 3G Radio Network Optimization

• Case Study of KPI Optimization




Construction phase

Troubleshooting

Booming phaseOptimizing

Mature phaseBalancing

Time

Subs. Num

ber

RF plan review

Single site verification

Pre-launch optimization

KPI analysis

ComplaintsDT & CQT

Prob

lem

ana

lysi

s

and

reso

lutio

n

Customized and differentiated

services

Billing strategies

Drop call

Congestion

Poor quality

Access failure

……

•RF adjustment

•Para. adjustment

•Maintenance and upgrade

•Contingency planning

•Network expansion

•…….

Investment Return

Commercial launch

Optimization throughout Life Cycle




Network Optimization Phases

RF optimization

Y

N

N

Y

Single site verification

80％ sites in thecluster ready?

Service test and parameter optimization

Routine drive test and stats. analysis

Acceptance criteriasatisfied?

New site integrated

Optimizationpreparation

Acceptance




RF Optimization TargetRF Optimization Target

n To optimize coverage

n To minimize pilot pollution

n To optimize cell dominance

n To optimize neighbor cell list

n To resolve RF-related drop calls




RF Parameters Optimization

n Engineering parameters adjustmentTo adjust antenna down tilt

To adjust antenna azimuth

To adjust antenna location

To adjust antenna height

To replace antenna

To replace site

To add new cell

n Radio part parameters adjustment

To optimize neighbor cell list




Pilot Pollution MinimizationPilot Pollution Minimization

-62 -64 -66 -68 -69

-81

-90

-85

-80

-75

-70

-65

-60

SC1 SC2 SC3 SC4 SC5 SC6

RSC

P (d

Bm)

Active Set Pilot Pollution

Margin

NotPilot Pollution

Ways to optimize:(1) Antenna adjustment

(e.g. azimuth or down tilt)(2) Pilot power optimization

n SHO candidates (A)

n Active set size (B)

n If A>B, pilot pollution exists

Pilot pollution definition:Pilot pollution will result in:(1) low signal quality(2) decreased system

capacity(3) Call drops easier




Pilot Pollution: ExamplePilot Pollution: Example




RF-related Drop CallsRF-related Drop Calls

n Poor coverage

n High interference

n Poor UL coverage

n Poor dominance

n Pilot pollution

n Missing neighbors

Problems

Fast change of RF conditions usually causes drop calls, e.g. turning a corner.

Poor RSCP & Ec/Io

Poor Ec/Io or RTWP

UE max Tx power

many SHO events

many cells present

Appearance




Para. Optimization TargetPara. Optimization Target

n To reduce access failures

n To reduce drop calls

n To enhance service quality

Para. optimization is an important step after RF optimization

Service quality and network resources utilization will be improved after para. optimization




Parameters to be OptimizedParameters to be Optimized

n CCCH power allocation para.

n RL maximum power para.

n Cell re-selection para.

n Intra-freq. handover para.

n Inter-RAT handover para.

n Power control para.

n Access power para.

n Other related para.

The influence caused by the cell parameters adjustment should be analyzed carefully.

Seldom adjusted

An effective way to reduce drop calls




Intra-freq. Re-selection Para.

Treselection, Qhyst2, Sintrasearch = 0

Optimize Treselection, Qhysts and Sintrasearch so as to have minimum ping-pong and minimum camped onto wrong cell

Qhyst2

Qhyst2

Qhyst2

Treselection TreselectionTreselection Treselection

Qqualmin

CPICH_Ec/Io

The black dotted line is the serving cells.UE doesn’t camp

onto the best cells.

Treselection, Qhyst2, Sintrasearch != 0

Qqualmin

Sintrasearch

CPICH_Ec/Io

Time

The black dotted line is the serving cells.

Qhyst2

Qhyst2

UE doesn’t camp onto the best cells.

Treselection Treselection




Contents

• UMTS Radio KPI overview

• 3G Radio Network Optimization

• Case Study of KPI Optimization




Case study from commercial projects

• Example of Accessibility KPI analysis

• Example of Call Drop KPI issue & solution

• Example of Throughput KPI issue analysis




Example of accessibility KPIs issue

Trouble-shooting of RRC setup and RAB assignmentproblems: • STEP1: Identify the counter with the highest number

• STEP2: Identify the Top 10 cells with the same problem

VS.RAB.FailEstPS.RIPFail

VS.RAB.FailEstabCS.Other.Cell

VS.RAB.FailEstCS.IUB.Band

Breakdown of CS RAB failure (Counters)

Definition of Counters l VS.RAB.FailEstPs.IUB.Band: The number of RABs unsuccessfully established in a cell due to IUB resource congestion causes.

RRC.FailConnEstab.NoReply

VS.RRC.Rej.UL.CE.Cong

VS.RRC.Rej.Code.Cong

VS.RRC.Rej.RL.Fail

Breakdown of CS RRC failure (Counters)

• VS.RAB.FailEstabCS.Other.Cell: Pre-admission control module reports a resource congestion.

• VS.RRC.Rej.UL.CE.Cong: RRC setup failure due to lack of UL CE resources




148.96%132.29%132.29%158.33%0111TO

180.21%175.00%175.00%142.71%0109TO

171.88%132.29%132.29%120.83%0070TO

2007-02-222007-02-212007-02-202007-02-19

UL CE Occupation RateNodeB Name

n0109TO (cell id 578/579/580) n0111TO (3882/3883/3884)n0070TO (18641/18642/18643)

The “worst” sites (cells) that have been found to have both IUB and CE congestion issues:

Analysis




Suggested solution

97.81%(48854/49946)

98.80%(13638/13803)

83.10%(1981/2384)

98.67%(2891/2930)

98.09%(241127/245815)

99.35%(256449/258126)

KPIs (without IUB Congestion sites)

97.53%(58114/59584)

98.48%(16674/16932)

84.93%(2462/2899)

98.31%(3314/3371)

97.79%(294499/301169)

99.17%(313992/316615)

KPIs (including IUB Congestion sites)

PS384 RAB Assignment Success Rate(>97%)



Video Call RAB Assignment Success Rate(>98%)

AMR RAB Assignment Success Rate(>98%)

RRC Connection Setup Success Rate (CS)(>98%)

A comparative analysis shows that, if excluding the problematic sites, the KPI would improve substantially, say, AMR RAB assignment success rate from 97.79% to 98.09%:

Suggested action plan:• CE/IUB expansion

• Perform regular neighbour list check to further tune the performance







• Example of Throughput KPI issue analysis




AMR12.2 Call Drop Rate

0.0%

0.5%

1.0%

1.5%

2.0%

2.5%

3.0%

3.5%

2006

-01-

16

2006

-01-

18

2006

-01-

2020

06-0

1-22

2006

-01-

24

2006

-01-

26

2006

-01-

2820

06-0

1-30

2006

-02-

01

2006

-02-

0320

06-0

2-05

2006

-02-

0720

06-0

2-09

2006

-02-

1120

06-0

2-13

2006

-02-

15

2006

-02-

17

2006

-02-

19

2006

-02-

2120

06-0

2-23

2006

-02-

25

2006

-02-

27

2006

-03-

0120

06-0

3-03

2006

-03-

05

2006

-03-

07

2006

-03-

0920

06-0

3-11

2006

-03-

13

2006

-03-

1520

06-0

3-17

2006

-03-

19

Drop Call Rate Voice(3G)Drop Call Rate Video(3G)Drop Call Rate (2G)

Example of Call drop rate issues

Voice call drop rate changes over a three-month optimization

period

Zone1 Zone2Zone3Solving Voice call drop

rate problems in Top 3 zones




What measures were taken to solve the call drop problems?

1.34%->1.10%Mar.2-6Zone 3

1.38%->1.21%Feb. 23-25Zone 2

ü Scrambling code planning adjustmentü System/handover parameter tuningü Neighbour list optimizationü RF optimization, etc.

1.57%->1.27%Feb. 14-17Zone 1

Optimization measures Call drop rate reduction

Action timeZone







• Example of Throughput issue analysis




45 Huawei sites provide coverage for DT route (Madrid South East)

Example of throughput KPI issues

2808787> 384 Kbit/sHSDPAMinimum application throughput DL

319 (UL)293 (DL)

118 (UL)87 (DL)

118 (UL)87 (DL)

UL > 300 kbpsDL > 361 kbps

I/B PS UL:384DL:384

FTP application throughput

KPI Successful Valid callsTargetService Group




RNC 123

RNC 122

RNC 121

Areas that lack dominant pilot

Analysis: coverage problems

Drive test route involves 3 Huawei RNCs and 1 Nortel RNC




• DL R99 throughput has been impacted by the interference generated by missing neighbors, mostly concerning the new sites that had been recently put on air

• Areas with low throughput corresponds to bad Ec/Io figures and HHO to 2G

The impact of missing neighbours

Low throughput

UE handover to GSM




In addition to coverage and missing neighbour causes, the HSDPA minimum throughput problem is due to:

• DT route crosses the IUR area where HSDPA calls are reconfigured to DCH (H2D)

• UE moves from a non-hotspot to a hotspot site in HSDPA connected mode

RNC 123 RNC 122

RNC 121

RNC 123RNC 122

RNC 121

Other causes



06.April 2006


www.huawei.com

Thank You

www.huawei.com


http://www.huawei.com


Documents

Introduction 3G Network KPIs