135109106 GSM Key Performance Indicator（KPI）Guidebook V1 1

GSM Key Performance Indicator（KPI（Guidebook

Version: V1.1

Security Category: Secret

Serviceable range: Radio Planning Section

GSM Network Planning & Optimization Dept. of Engineering Service Division

ZTE Corporation

5

10

15

Secret▲

Work Guidebook for GSM P&O Dept.

Version Introduction

Version Date Writer Assessor Amendment Records

V1.0 2008-01-21 Chen Chun Zheng Hao None

V1.1 2008-12-07 Yang Jiazhi

Zheng Hao,

Chen Chun,

Fei Aiping

1（V3 KPI and EDGE KPI were added.

2（Amendment: mainly directed at V2.97

and V6.0.

3（Some classic KPI cases and comments

were added.

4 （ Principles for KPI risk analysis were

added.

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.

5

Secret▲

CONTENTS

1 Overview.................................................................................................................................................1

2 CS Radio Service Statistical KPI.........................................................................................................4

2.1 Availability .....................................................................................................................................4

2.1.1 SDCCH availability/SDCCH .............................................................................................4

2.1.2 TCH availability/TCH ........................................................................................................4

2.1.3 Cell utilization.....................................................................................................................4

2.2 Accessibility ...................................................................................................................................5

2.2.1 Random Access Success rate ..............................................................................................5

2.2.2 SDCCH blocking rate ........................................................................................................5

2.2.3 TCH blocking rate ..............................................................................................................6

2.2.4 Radio connection ratio ........................................................................................................6

2.2.5 SDCCH drop rate................................................................................................................7

2.2.6 SDCCH assignment success rate.........................................................................................7

2.2.7 TCH assignment success rate..............................................................................................7

2.2.8 Call setup success rate ........................................................................................................8

2.3 Mobility ..........................................................................................................................................9

2.3.1 Handover success rate ........................................................................................................9

2.4 Reliability........................................................................................................................................9

2.4.1 TCH Call Drop Rate ...........................................................................................................9

2.4.2 Traffic Call Drop ..............................................................................................................10

2.4.3 Call Completion rate .........................................................................................................10

2.4.4 UL RxQual 0-4 .................................................................................................................10

2.4.5 DL RxQual 0-4 .................................................................................................................11

2.5 Call Setup time...............................................................................................................................11

2.5.1 Call setup time (GSM to PSTN) .......................................................................................11

2.5.2 Call setup time (GSM to GSM) .......................................................................................12

3 CS Radio Service Test KPI.................................................................................................................13

3.1 Call Setup Success Rate ...............................................................................................................13

3.2 Handover Success Rate ................................................................................................................13

3.3 Call Drop Rate ..............................................................................................................................13


5

10

15

20

25

30

Secret▲

3.4 Coverage (Drive Test)...................................................................................................................13

3.4.1 SQI ...................................................................................................................................14

3.4.2 MOS .................................................................................................................................14

3.4.3 MOS & PSEQ...................................................................................................................15

4 PS Radio Service Statistical KPI.......................................................................................................18

4.1 Accessibility..................................................................................................................................18

4.1.1 DL TBF establishment success rate ..................................................................................18

4.1.2 UL TBF establishment success rate ..................................................................................18

4.1.3 GPRS RLC .......................................................................................................................19

4.1.4 GPRS RLC .......................................................................................................................19

4.1.5 EGPRS RLC .....................................................................................................................20

4.1.6 EGPRS RLC .....................................................................................................................20

5 PS Radio Service Test KPI..................................................................................................................22

5.1 Accessibility..................................................................................................................................22

5.1.1 Attach success rate ...........................................................................................................22

5.1.2 Average GPRS attach time ...............................................................................................22

5.1.3 PDP context activation success rate .................................................................................22

5.1.4 PDP context activation time .............................................................................................23

5.1.5 PING test success rate ......................................................................................................23

5.1.6 Average PING test time ....................................................................................................23

5.2 Mobility ........................................................................................................................................24

5.2.1 Routing Area Update Successful rate ...............................................................................24

5.3 Data Throughput ...........................................................................................................................24

5.3.1 Average FTP download rate...............................................................................................24

5.3.2 Average FTP upload rate...................................................................................................25

5.3.3 Throughput........................................................................................................................25

5.4 Reliability .....................................................................................................................................25

5.4.1 PDTCH Drop Rate ...........................................................................................................25

6 Introduction to CN Statistical KPI....................................................................................................27

6.1 Paging success rate .......................................................................................................................27

6.2 Location update success rate ........................................................................................................27

6.3 Attach success rate ........................................................................................................................27

6.4 GPRS average attach time ............................................................................................................28


5

10

15

20

25

30

Secret▲

6.5 PDP context activation success rate .............................................................................................28

6.6 Routing Area Update Success rate ................................................................................................28

7 Comments on KPI Cases.....................................................................................................................30

7.1 Pengshui (Chongqing) PS Test Result...........................................................................................30

7.2 Jishou (Hunan) China Mobile EDGE Test Result.........................................................................31

7.3 Acceptance requirements for EDGE KPI of Data Service of a network......................................33

7.4 Operation & Maintenance KPI of a Network................................................................................34

7.5 Operation & Maintenance KPI of a network in Southeast Asia ...................................................36

7.6 KPI requirements for Indonesia Telkomsel network......................................................................40


5

Secret▲

1 Overview

This guidebook collected the Key Performance Indicators (KPI) for CS and PS

services, which are now commonly adopted in presales bidding projects; and the

definitions of different KPIs and counter formulas for V2/V3 are explained here as

well. Meanwhile, with the aim to unify response on KPIs and avoid the possible

market risks, after analyzing the performance indicators of current networks of both

domestic and overseas key projects, the writer provides the reference values and risk

values of different KPIs in this guide. If the KPIs listed in the bidding documents go

beyond the reference values and risk values (suppose risk value of the KPI is

provided; otherwise, suggested values shall be applied.), we need to conduct risk

analysis and evaluation, meanwhile, try to avoid the risk and send out pre-warning.

The KPIs can be quite different due to the differences in network structure and

dimension. To make sure that our KPI can meet requirements in bidding documents,

we need not only support from theories, but accumulation of work experience as

well. The suggested values and risk values of KPI mentioned in this guide are

reference suggestions concluded from the current conditions of GSM network. As

GSM techniques and skills are developing and equipment performance is improving

constantly, the reference standards for KPI will change accordingly.

The key requirement for engineers engaged in presales network planning is to

thoroughly understand and master the related KPIs, which is also the basic but

highest demand for radio network planning engineers.

Why network operators set up KPIs and what are they aimed at?

How to define KPI and what can be resulted from deviation of KPI?

How much influence can the value of KPI impose on presales bidding?

How to clarify KPI and how to achieve favorable negotiation results during KPI

clarification?

How to avoid and pre-warn KPI risks?

What is the development direction of KPI assessment?

Each presales radio network planning engineer shall possess related techniques of

and up-to-date answers to the six questions above. For lack of space, the six

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 1（Total 46 pages

5

10

15

20

25

30

Secret▲

questions will not be further discussed in this guidebook. The engineers will be able

to experience and get to know them in presales planning work in future.

Generally, KPI can be classified into four types: statistical KPI, testing KPI,

equipment performance KPI, customer perception KPI. Only statistical KPI and

testing KPI are elaborated here. As for equipment performance KPI and customer

perception KPI, they are focused on in another guidebook. Nowadays, network

operators are attaching more and more importance to KPI during negotiations.

Besides the four types mentioned above, a lot more aspects are involved in KPI. KPI

is also closely related to the basic network environment. Therefore, KPI is affected

by various factors. That is why operators are now regarding KPI as a very important

leverage to shift risk and decrease network investment and maintenance cost.

Equipment manufacturers must commit themselves to suitable, reasonable and

timely KPI, so as to bring down contract risk and ensure profits. “Rationalize

commitment, share risks” is an important principle in presales planning work.

The following are the factors that shall be taken into consideration when we work on

KPI:

1. network dimension;

2. network type;

3. degree of subscriber(number) growth;

4. geographical distribution of network(urban, countryside, village)

5. equipment types; there is difference in KPI for V2 and V3.

Functional principles for this guidebook (mainly directed at KPI):

1. This guide is only available to the radio network planning engineers engaged in

presales bidding. No one is entitled to spread it outside or extensively spread it

inside the company. The right to interpret the serviceable range of this guide

remains with GSM Technical Research Section & Resources Section.

2. It is suggested to release the guidebook in encrypted document. It can not be

procured unless logging into document security software.

3. The guide is a reference to radio network planning staff engaged in presales

bidding. It can not replace the presales KPI project evaluation.


5

10

15

20

25

30

Secret▲4. The KPI values enclosed in this guide are valid within only half a year since the

release of it. After half a year, it needs to be updated and reassessed.

5. The guide is mostly applicable to V2.97 of V2 and V6.0 (ISMG) and V6.1

(Minos) of V3.

Notes: V6.0 (ISMG), V6.1 (Minos), sic passim


5

Secret▲

2 CS Radio Service Statistical KPI

2.1 Availability

2.1.1 SDCCH availability/SDCCH

KPI SDCCH availability (SDCCH in service rate)

KPI reference

value

99%

Indicator

definition

SDCCH usable total*100%/(SDCCH usable total +SDCCH unusable total（

Counter

formula

V2 C11601*100%/(C11601+C11602)

V3V6.0 C100030122*100%/( C100030122+ C100030123)

V6.1 C900060122*100%/(C900060122+C900060123)

Notes

The ratio of the SDCCH usable total to the total SDCCH allocated in network is mainly

used to examine equipment performance, especially to inspect the utilization of SDCCH in

the cells. It is directly related to the stability of equipment（transmission and power supply,

etc.. It reflects the utilization ratio of network equipment and the stability of initial network

operation.

2.1.2 TCH availability/TCH

KPI TCH availability (TCH in service rate)

KPI

reference

value

98%

Indicator

definition

TCH usable total*100%/(TCH usable total+ TCCH unusable total（

Counter

formula

V2 C11607*100%/(C11607+C11608)

V3

V6.0(C100030125+C100030134+C100030155)*100% / (C100030125 +

C100030134 + C100030155 + 100030126+ C100030217+ C100030218)

V6.1

(C900060125+C900060134+C900060155) *100%/

(C900060125+C900060134+

C900060155+C900060126+C900060217+C900060218)

Notes

The ratio of the SDCCH usable total to the total SDCCH allocated in network is mainly used

to examine equipment performance, especially to inspect the utilization of SDCCH in the cells. It

is directly related to the stability of equipment（transmission and power supply, etc..

2.1.3 Cell utilization

KPI Cell utilization

KPI reference 80%


5

Secret▲

value

Indicator

definition

Cells, in which ratio of actual traffic / desired traffic<1

Counter

formula

None

Notes

This is mainly to compare performance of preplanning network with that of actual

network. The prerequisite is that precise traffic model （ traffic dispersion （ network

capacity and redundancy rate shall be provided in preplanning period. This KPI is also

related with network configuration and traffic distribution.

2.2 Accessibility

2.2.1 Random Access Success rate

KPI Random Access Success rate

KPI reference

value

Suggested value 99%

Risk value 99.5%

Indicator

definition

Random access success times *100% / Random access call attempt times

Counter

formula

V2 (C11626+C11696-C11697)*100%/(C11625+C11696)

V3

V6.0(C100030004+C100030010+C100030038-(C100030011 +C100030039))

*100%/(C100030003+C100030010+C100030038)

V6.1(C900060004+C900060010+C900060038-(C900060011 +C900060039))

*100%/(C900060003+C900060010+C900060038)

Notes SDCCH congestion rate shall be taken into consideration, because of its direct influence on

this KPI.

2.2.2 SDCCH blocking rate

KPI SDCCH blocking rate

KPI reference

value

1%

Indicator

definition

Signaling channel congestion times*100% / signaling channel call attempt times

Counter

formula

V2 (C11625-C11626+C11697)*100%/(C11625+C11696)

V3

V6.0(C100030005+C100030011+C100030039) *100%/ (C100030003+

C100030010+C100030038)

V6.1(C900060005+C900060011+C900060039)*100%/(C900060003+

C900060010+C900060038)

Notes This is mainly to evaluate the fitness between preplanned network and actual network. It will

be affected by the following factors:

1. the fitness between network desired capacity and actual capacity; fitness between preset

traffic model and the actual one; 2. burst traffic; 3. lack of SDCCH capacity; 4. internal &

external interference; 5. preplanned redundancy rate; 6. operators’ special requests; 7. FR and


Secret▲

HR used as signaling channel.

2.2.3 TCH blocking rate

KPI TCH blocking rate

KPI

reference

value

2%

Indicator

definitionTCH congestion times*100%/ TCH call attempts

Counter

formula

V2 （C11612-C11699（*100%/（C11611-C11698（

V

3

V6.0

(C100030020+C100030031+C100030043+C100030047+C100030022 +

C100030033+C100030045+C100030049)*100%/(C100030019+C100030030+

C100030042+C100030046+C100030021+C100030032 +C100030044+C100030048)

V6.1

(C900060020+C900060031+C900060043+C900060047+C900060022+C900060033+

C900060045+C900060049)*100%/(C900060019+C900060030+C900060042+C900060046+

C900060021+C900060032+C900060044+C900060048)

Notes

This is mainly to evaluate the fitness between preplanned network and actual network, and the precondition is

that precise traffic model （ traffic dispersion （ network capacity and redundancy rate shall be provided in

preplanning period. It is related to the following factors:

1. the fitness between network desired capacity and actual capacity; fitness between preset traffic model and

the actual one; 2. burst traffic; 3. lack of TCH capacity; 4. internal & external interference; 5. preplanned

redundancy rate; 6. handovers.

2.2.4 Radio connection ratio

KPI Radio connection ratio

KPI

reference

value

97%

Indicator

definition（1-signalling channel congestion rate（*(1-voice channel congestion rate)*100%

Counter

formula

V2 (1-(C11625-C11626+C11697)*100%/(C11625+C11696))*(1-(C11612-C11699)/(C11611-C11698))

V

3V6.0

(1-(C100030005+C100030007)*100% / (C100030003+C100030006)) * (1-(C100030011

+C100030020+ C100030031+C100030039 +C100030043 + C100030047 +C100030013+

C100030022 +C100030033+C100030041 +C100030045+C100030049) / (C100030010+

C100030019+ C100030030 + C100030038+ C100030042+C100030046+ C100030012+

C100030021 +C100030032+C100030040 +C100030044+C100030048))

V6.1 (1-(C900060005+C900060011+C900060039)*100%/

(C900060003+C900060010+C900060038))*(1-

(C900060020+C900060031+C900060043+C900060047+C900060022+C900060033+

C900060045+C900060049)/(C900060019+C900060030+C900060042+C900060046+


Secret▲

C900060021+C900060032+C900060044+C900060048))

Notes

This is mainly to compare performance of preplanned network with that of actual network. The prerequisite is that

precise traffic model （ traffic dispersion （ network capacity and redundancy rate shall be provided in preplanning

period. This KPI is in direct tie-in constraint with SDCCH blocking rate and TCH blocking rate.

2.2.5 SDCCH drop rate

KPI SDCCH drop rate

KPI reference

value

Suggested value 0.1%

Risk value 0.05%

Indicator

definition

SDCCH call drop total*100%/(random access call attempts + voice channel call attempts total

(handover excluded)（signalling（)

Counter

formula

V2 C11605*100%/(C11625+C11696)

V3 V6.0 C100030053*100%/(C100030003+C100030010+C100030038)

V6.1 C900060053*100%/(C900060003+C900060010+C900060038)

Notes

C11605 accumulates SDCCH call drops resulted from all reasons, including radio link

failure （ LAPD link breaks （ handover failure, etc., but except the following four reasons: lost

connection with SMM, forced OMC-R disconnection, forced disconnection by other calls, and other

causes. If we compute according to the formula above, SDCCH call drop rate will be rather low. If

counter 116135 is included (BSS call drop times on SDCCH), the suggested KPI value is 0.6%, and

suggested risk value 0.4%.

C100030053/C900060053 is used to find out the frequency of call drops resulted from radio link

failure（LAPD link breaks（handover failure. This KPI value is relatively lower.

2.2.6 SDCCH assignment success rate

KPI SDCCH assignment success rate

KPI reference

value

Suggested value 96%

Risk value 98%

Indicator

definition

SDCCH assignment success rate*100/(SDCCH assignment success times +SDCCH assignment

failure times)

Counter

formula

V2 C11644*100%/( C11644+ C11645)

V3

V6.

0

C100420014*100%/（C100420014+C100420015)

V6.

1

C901250014*100%/(C901250014+C901250015)

NotesSDCCH assignment success rate is involved with many factors, such as LAPD link（ frequency

interference（access parameters, etc..

2.2.7 TCH assignment success rate

KPI TCH assignment success rate

KPI reference

value

Suggested

value

98%


Secret▲

Risk value 99%

Indicator

definition

TCH assignment success times*100/( TCH assignment success times +TCH assignment

failure times)

Counter

formula

V2 C11657*100%/(C11657+C11658)

V3

V6.0

(C100030017+C100030028+C100030036+C100030235 +

C100030199+C100030210)*100%/(C100030017+C100030028

+C100030036+C100030018+C100030029+C100030037+

C100030235+C100030199+C100030210+C100030200+

C100030211+C100030135)

V6.1

(C900060017+C900060028+C900060036+C900060199+

C900060210+C900060235) *100%/(C900060018+C900060029+

C900060037+C900060200+C900060211+C900060135+

C900060017+C900060028+C900060036+C900060199+

C900060210+C900060235)

Notes This KPI is directly related to radio environment （ frequency carrier

problems（assignment methods（application of data service, etc..

2.2.8 Call setup success rate

KPI Call setup success rate （CSSR（

KPI reference

value I

Suggested value 92%

Risk value` 94%

Indicator

definition I

(1-SDCCH blocking rate)* (1-SDCCH assignment failure rate)*(1-SDCCH drop

rate)*(1-TCH blocking rate)*(1-TCH assignment failure rate)

Note I The definition of this CSSR is relatively strict because too many factors are included

(LAC（SMS, etc.). The definition is not rational from the view of voice call, so that the

CSSR used in MOTO excluded SMS factor. Handover is excluded.

KPI reference

value II

Suggested value 93%

Risk value 95%

Indicator

definition II

((MOC success + MTC success （ / (MOC attempt + MTC attempt)) *(1-SDCCH drop


Note II According to common understanding, CSSR is mostly applied to inspect the establishment

of voice call. It is rather reasonable to exclude LAC and SMS. Handover is excluded.

KPI reference

value III

Suggested value 97%

Risk value 95%

Indicator

definition III

((MOC success + MTC success （ / (MOC attempt + MTC attempt)) *(1-SDCCH drop


Note III The CSSR is mainly measured in the view of congestion. It is similar to Hutchison’s

definition of CSSR. Handover excluded.

Counter

formula

CSSR is usually obtained from the combination of original KPI.

Explanation Different manufacturers have different definitions for CSSR. The formula above is

regarded too strict. Some may define it to be TCH assignment success rate or radio access

completion rate. We need to make clear the formula with customers. It is regarded a


Secret▲

favorable way to exclude location update indicators when we define this KPI.

2.3 Mobility

2.3.1 Handover success rate

KPI Handover success rate

KPI reference

value

V2Suggested value 94%

Risk value 96%

V3Suggested value 95%

Risk value 97%

Indicator

definition

Handover success times in busy hours*100% / handover request times in busy hours

Counter

formula

V2(C11618+C11669-C11675)*100%/(C11617+C11668-

C11675)

V3

V6.0

(C100030098+C100030102+C100030120+C100030094+

C100030096)*100 %/ (C100030097+C100030213+

C100030214+ C100030215+C100030099+C100030100

+C100030101+C100030216 +C100030119 +C100030093

+C100030095)

V6.1

(C900060098+C900060102+C900060120+C900060094+

C900060096) *100%/

(C900060097+C900060213+C900060214+

C900060215+C900060099+C900060100+C900060101+

C900060216+C900060119+C900060093+C900060095)

Notes

This formula includes both incoming and outgoing handovers, while some operators may take

into consideration only one of them. As for V3 equipment, 1-2% can be appropriately increased

according to real situations. This KPI can differ a lot from each other due to different types of

network. In many presales bidding, the operators require a handover success rate of around 98%,

which involves high risks to be reached, though several networks have reached 98%.

2.4 Reliability

2.4.1 TCH Call Drop Rate

KPI TCH drop rate / Call drop rate

KPI reference

value

V2Suggested value 1.0%

Risk value 0.7%

V3Suggested value 0.7

Risk value 0.5

Indicator

definition

TCH call drop times*100%/TCH assignment success times


Secret▲

Counter

formula

V2C11615*100%/(C11611-C11698-(C11612+C11656+C11658+

C11617-C11618-C11699-C116103-C116133))

V3

V6.

0

(C100030054+C100030055)*100%/(C100030028+ C100030036+

C100030199+C100030210+ C100030098+C100030102+C100030120)

V6.

1

(C900060054+C900060055) *100%/(C900060028+C900060036+

C900060199+C900060210+C900060098+C900060102+

C900060120)

Notes

Voice channel call drop rate falls into two types: one is with handover included; the other is with

handover excluded. The formula above takes handover in it. If handover is not included, the indicator

will be about 0.2% higher than the one with handover included. This discrepancy is not universally

definite yet, for it can be bigger in dual-band network. Generally, call drop rate of V3 equipment is a

bit lower than the one of V2. This KPI differs a lot in varied types of network. The discrepancy can

reach 0.3%.

2.4.2 Traffic Call Drop

KPI Minute per drop(MPD)

KPI reference

value

V2Suggested value 90

Risk value 120

V3Suggested value 120

Risk value 180

Indicator

definition

Traffic /TCH call drop times*60

Counter

formula

V2 (C11616/3600)*60/C11615

V

3

V6.0((C100030129+C100030127)/3600)*60/

(C100030054+C100030055)

V6.1 ((C900060129+C900060127)/3600)*60/(C900060054+C900060055)

Notes This KPI of different networks varies to a large extent. Generally, it’s difficult for to

reach this KPI’s standards, if the call drop (with handover included) rate is higher than

0.5%.

2.4.3 Call Completion rate

KPI Call Success Rate （CSR（

KPI

reference value

Suggested

value

92%

Risk value 94%

Indicator

definition

CSSR*(1- Call drop rate)

Counter

formula

None. Refer to Indicator Definition II under Item 2.2.8

Notes This formula is a customer KPI. We need to make it clear with customers

when referring to this KPI. But it is close to customers’ perception.

2.4.4 UL RxQual 0-4

KPI UL RxQual 0-4


Secret▲

KPI reference

value

Suggested

value

95%

Risk value 97%

Indicator

definition

UL RxQual 0-4 *100 / UL RxQual 0-7

Counter

formulaV2

(C116114+C116115+C116116+C116117+C116118) * 100 / (C116114

+C116115+C116116+C116117+C116118+ C116119

+C116120+C116121)

V3

V6.0

(C100030066+ C100030067+ C100030068+ C100030069+

C100030070)*100/ (C100030066+ C100030067+ C100030068+

C100030069+ C100030070+ C100030071+ C100030072+ C100030073)

V6.1

(C900060066+ C900060067+ C900060068+ C900060069+

C900060070)*100/ (C900060066+ C900060067+ C900060068+

C900060069+ C900060070+ C900060071+ C900060072+ C900060073)

Notes None

2.4.5 DL RxQual 0-4

KPI DL RxQual 0-4

KPI reference

value

Suggested

value

95%

Risk value 97%

Indicator

definition

DL RxQual 0-4 *100 / DL RxQual 0-7

Counter

formula

V2

(C116122+C116123+C116124+C116125+C116126+C116127)* 100 /

(C116122 +C116123+C116124+C116125+C116126 +C116127

+C116128+C116129)

V3

V6.

0

( C100030074+ C100030075 + C100030076+ C100030077 +

C100030078)*100/ ( C100030074+ C100030075 + C100030076+ C100030077 +

C100030078+ C100030079+ C100030080+ C100030081)

V6.

1

( C900060074+ C900060075 + C900060076+ C900060077 +

C900060078)*900/ ( C900060074+ C900060075 + C900060076+ C900060077 +

C900060078+ C900060079+ C900060080+ C900060081)

Notes None

2.5 Call Setup time

2.5.1 Call setup time (GSM to PSTN)

KPI Call setup time (GSM to PSTN)

KPI reference

value

Suggested

value

8 seconds


Secret▲

Risk value 5 seconds

Indicator

definition

time duration from starting call to ringing out

Notes We can use test software to estimate the time duration, which is related with network

structure（ routing and radio environment. MSC provides this KPI. It differs in different

network configurations.

2.5.2 Call setup time (GSM to GSM)

KPI Call setup time (GSM to GSM)

KPI reference

value

Suggested

value

7 seconds

Risk value 5 seconds

Indicator

definition

Obtain from test the time duration from starting call to ringing out

Notes We can use test software to estimate the time duration, which is related with network

structure（ routing and radio environment. MSC provides this KPI. It differs in different

network configurations.


Secret▲

3 CS Radio Service Test KPI

3.1 Call Setup Success Rate

KPI Call Setup Success Rate

KPI reference

value

Suggested

value

95%

Risk value 98%

Indicator

definition

Call connection times*100% / call attempt times

Indicator value DT&CQT, test pre-defined locations and Drive Test route

Notes None

3.2 Handover Success Rate

KPI Handover Success Rate

KPI reference

value

Suggested

value

95%

Risk value 98%

Indicator

definition

Handover success times*100% / handover attempt times

Indicator value DT&CQT, Pre Defined Drive Test Route or NMS

Notes None

3.3 Call Drop Rate

KPI Call Drop rate

KPI reference

value

Suggested

value

3%

Risk value 2%

Indicator

definition

Call drop times*100% / call connection times

Indicator value DT&CQT, test Pre Defined Drive Test Route or NMS

Notes None

3.4 Coverage (Drive Test)

Urban Suburban Rural Road

Illustration of

coverage

requirement

85% of the

sample values

should have a value

85% of the

sample values

should have a value

85% of the

sample values

should have a value

85% of the

sample values

should have a value


5

Secret▲

equal to or higher

than –75 dBm.

equal to or higher

than –80 dBm.

equal to or higher

than –85 dBm.

equal to or higher

than –90 dBm.

Influencing factors 1. landform; 2. inconsistency between project implementation and project plans;

3. test equipment; 4. test routes

Notes

Detailed coverage requirements (as shown above) are delivered in the bid documents.

Estimation of network dimension is also based on the requirements. Nowadays,

requirements for network coverage are higher, so the accordingly estimated number of

sites will meet the needs. If the network dimension has to be reduced due to market

strategies needs, this KPI will cause problems in the acceptance inspection. Further more,

we need to make sure that our customers are aware of regional assignment（DT routes and

test methods. Coverage KPI is one of the most important KPIs, because it directly reflects

not only our radio network planning ability and the performance of our equipment, but

also our core competitive strength in network planning. Due to lack of space, there is no

more illustration of coverage KPI hereafter in this guide.

3.4.1 SQI

KPI SQI

KPI reference

value

Suggested

value

95% sample >=18

Risk value 95% sample >=25

Indicator

definition

TEMS test value

Notes

This KPI is for inspecting the sound distortion degree resulted from incapable link

transmission. The formula is Ericsson’s patent. It takes into consideration many factors,

including BER（FER（handover times（handover conditions（DTX activated (or not)（and

the encoder in use, etc., to finally get the SQI. There are different SQI top limits for

different types of encoders. For half-rate encoder, the SQI top limit is 19; for full-rate

encoder, 21; for enhanced full-rate encoder, 30. SQI ranges from 18 to 30. SQI value will

increase when EFR is applied.

3.4.2 MOS

KPI Mean Opinion Score ( MOS)

KPI reference

value

Refer to the form attached bellow.

Indicator

definition

Test value

Notes The commonly used MOS assessment method consists of subjective and objective scoring

parts. In the subjective part, engineers subjectively compare the original voice material

and the deteriorated voice material according to ITU-T Suggestion book P.800 and P.830,

and give their MOS scores respectively, then average the scores from different engineers.

While in the objective part, PESQ method from ITU-T Suggestion book P.862 is

employed, that is special equipment or software (e.g. the VQT test equipment of Agilent)

is used to proceed the assessment. In MOS, 0 means the worst quality, 5 stands for the

highest. Standard PCM quality shall reach around 4.4.


Secret▲

The MOS values for commonly used coding formats are as follows:

G.711——MOS（ 4.8

G.721（G.723（G.726——MOS（ 4.2

G.728 ——MOS（4.2

G.729 ——MOS（4.2

G.723.1（5.3（——MOS（3.5

G.723.1（6.3（——MOS（3.98

MOS can be affected greatly by the performance of test equipment. The test results

from different manufacturers are different. Currently, the test equipment from Actena

performs the best.

Voice version combination

Average MOS(Including FR &HR

MOS)TFO

Frequency

hopping

No frequency

hopping

Frequency

hopping

No frequency

hopping

100% FR 3.04 3.29 （（

100% EFR 3.63 3.57 （（

100% AMR FR 3.56 3.54 （（

60% HR (+EFR) （（（（

30% HR (+EFR) （（（（

10% HR (+EFR) （（（（

60% AMR HR (+AMR FR) （（（（



3.4.3 MOS & PSEQ

Subjective scoring method had been used in assessment on voice quality until 2001.

Users were requested to assess the voice quality of incoming calls by scoring 1-5 (5-

best, 1 - worst). This assessment method was regulated to be a standard by ITU in

August, 1996. MOS assessment method was defined in its P.800 standard in details.

But later it was found that this method not only took too much time, but also cost a

lot. So there was an urgent need for a kind of economic test equipment, which can be

used to simulate the voice quality received by users, and thus can play its part in

designing（testing and debugging new type of voice encoders.

With the aim to meet the need, in February 2001 ITU issued the new test standard on

voice transmission quality-P.862 (PESQ-Perceptual Evaluation of Speech Quality).

It adopts the new algorithm developed by Psytechnics company. PESQ can be used

to compute voice sample’s MOS-LQO value (Mean Opinion Score-Listening

Quality Objective). The computed result and the subjective scoring result are


5

10

15

http://baike.baidu.com/view/1389750.htm





Secret▲

basically the same. PESQ compares the output signal (collected after the signal is

transmitted through equipment) and the reference signal, then works out the

difference. In the ordinary course of event, the bigger the difference between the

output signal and the reference signal, the smaller the reference value of MOS will

be. PESQ is testified to be a reliable（economic and fast measuring tool for voice

encoder. Compare PESQ’s predicted value and the result from subjective scoring

method, we can see the correlation between the two values is 0.935(refer to

（ P862E.doc（ for correlation factors). For 22 kinds of ITU benchmark tests, the

absolute error is within 0.5 MOS, 69.2% among which is within 0.25 MOS. It is

worth our attention that PESQ value ranges from 0.5 to 4.5, while MOS value

ranges from 1 to 5.

Fig 1 MOS/PESQ Correlation Diagram

At the present time, there are two types of QOS test method-subjective and objective

methods. MOS subjective test method is defined in ITU-T P.800. The objective test

methods includes PSQM （ PSQM+ and PESQ etc.. ITU-T P.862 （ PESQ （ is the

method currently recommended by ITU to test end-to-end network voice quality. It

would be ideal if MOS and PESQ are simultaneously supported in the QOS test.

Form 1 Definition of MOS Values

Level MOS


5

10

15

20

Secret▲

Excellent 5

Good 4

Fair 3

Poor 2

Bad 1


Secret▲

4 PS Radio Service Statistical KPI

4.1 Accessibility

4.1.1 DL TBF establishment success rate

KPI DL TBF establishment success rate

KPI reference

value

Suggested value 95%

Risk value 96%

Indicator type Statistical value

Indicator

definition

（GPRS DL signalling TBF link setup times+ GPRS DL data TBF link setup

times +EGPRS DL signalling TBF link setup times +EGPRS DL data TBF link

setup times（*100%/ DL packet channel request times（V3（

Counter

formula

V2 (C70043+C70057+C70071)*100/C70041

V3

V6.0

(C100010007+C100010015+C100010008+C100010016)

*100%/(C100010141+C100010142+C100010143+

C100010144+C100010145+C100010146+C100010147

+C100010148)

V6.1

(C900040007+C900040015+C900040008+C900040016)

*100%/(C900040141+C900040142+C900040143+

C900040144+C900040145+C900040146+C900040147

+C900040148)

Notes

This KPI reflects the request fulfilled status of PS downlink resources. Its TBF

includes DL signaling TBF（GPRS DL data TBF and EGPRS DL data TBF. DL TBF

link setup success rate can reflect the DL PS quality of a cell. Its major influencing

factors are as follows:

1. Interference: internal & external interference;

2. Parameters setting: eg. errors in Timer and functional parameters

3. Stability of equipment and transmission: eg. instant breakdown(flash)

resulted from high error rate or unstable link;

4. Usability of data service functions.

4.1.2 UL TBF establishment success rate

KPI UL TBF establishment success rate

KPI

reference

value

Suggested

value

92%

Risk value 95%


Indicator

definition

（GPRS UL signalling TBF link setup times + GPRS UL data TBF link setup times

+EGPRS UL signalling TBF link setup times +EGPRS UL data TBF link setup

times（*100/ UL packet channel request times（V3（


Secret▲

Counter

formula

V2 (C70042+C70055+C70069)*100%/C70040

V3

V6.0

(C100010025+C100010033+C100010026+C100010034)

*100% /(C100010159 +C100010160+C100010161+C100010168

+C100010163+C100010164+ C100010165+C100010166)

V6.1

(C900040025+C900040033 +C900040026 +C900040034)

*100%/ (C900040159+ C900040160

+C900040161+C900040168+C900040163 +C900040164

+C900040165+C900040166)

Notes

This KPI reflects the request fulfilled status of PS uplink resources. Its TBF includes

UL signaling TBF（GPRS UL data TBF and EGPRS UL data TBF. UL TBF link setup

success rate can reflect the UL PS quality of a cell. Its major influencing factors are as

follows:


2. Parameters setting: eg. errors in Timer and functional parameters

3. Stability of equipment and transmission: eg. instant breakdown resulted

from high error rate or unstable link;

4. Usability of data service functions.

4.1.3 GPRS RLC

KPI UL GPRS RLC retransmission rate

KPI

reference

value

Suggested

value

10%

Risk value 5%


Indicator

definition

GPRS UL TBF NACK blocks *100% / valid data statistics received by GPRS UL

TBF

Counter

formula

V2 C70066*100%/ C70065

V3

V6.0C100010063*100%/C100010062

V6.1C900040063*100%/C900040062

Notes

This KPI reveals UL GPRS RLC retransmission rate, which is the most important

indicator to reflect the sensibility of GPRS UL service and to show whether

instability（congestion and interference exist in the system. Its major influencing factors

are as follows:




4.1.4 GPRS RLC

KPI DL GPRS RLC retransmission rate

KPI Suggested 10%


Secret▲

reference

value

value

Risk value 5%

Indicatory

type

Statistical value

Indicator

definition

GPRS DL TBF NACK blocks *100% / valid data statistics received by GPRS DL

TBF

Counter

formula

V2 C70068*100%/ C70067

V3

V6.0C100010065*100%/C100010064

V6.1C900040065*100%/C900040064

（（Notes

This KPI reveals DL GPRS RLC retransmission rate, which is the most important

indicator to reflect the sensibility of GPRS DL service and to show whether

instability（congestion and interference exist in the system. Its major influencing factors

are as follows:




4.1.5 EGPRS RLC

KPI UL EGPRS RLC retransmission rate

KPI

reference

value

Suggested

value

10%

Risk value 5%

Indicatory

type

Statistical value

Indicator

definition

EGPRS UL TBF NACK blocks *100% / valid data statistics received by EGPRS UL

TBF

Counter

formula

V2 C70080*100%/ C70079

V3

V6.0C100010071*100%/C100010070

V6.1C900040071*100%/C900040070

（（Notes Refer to UL GPRS RLC retransmission rate

4.1.6 EGPRS RLC

KPI DL EGPRS RLC retransmission rate

KPI

reference

value

Suggested

value

10%

Risk value 5%

Indicatory

type

Statistical value


Secret▲

Indicator

definition

EGPRS DL TBF NACK blocks *100% / valid data statistics received by EGPRS DL TBF

Counter

formula

V2 C70082*100%/ C70081

V3

V6.0C100010073*100%/C100010072

V6.1C900040073*100%/C900040072

Notes Refer to DL GPRS RLC retransmission rate


Secret▲

5 PS Radio Service Test KPI

5.1 Accessibility

5.1.1 Attach success rate

KPI Attach success rate

KPI reference

value

Suggested

value

95%

Risk value 98%

Indicator

definition

Attach success times/Attach attempt times×100（

Indicatory

type

test

Counter

formula

None

Notes Normally, this KPI is the CQT value. Attach success means that the

mobile phone receives the Attach Accept signaling within 15 seconds

after it sends the Attach Request. It is required to perform the Attach

test ten times at each test site.

5.1.2 Average GPRS attach time

KPI Average GPRS attach time

KPI reference

value

Suggested value 2 sec

Risk value 1.5 sec

Indicator

definition

Sum of attach success duration/ Attach success times. It is the

duration from the mobile sends out the first Attach Request to it

receives the Attach Accept signaling.

It is required to perform the test ten times at each test site.

Indicatory type Test value

Counter

formula

None

Notes Normally, this KPI is the same as the CQT value. Authentication

included.

5.1.3 PDP context activation success rate

KPI PDP context activation success rate

KPI reference

value

Suggested

value

95%

Risk value 98%

Indicator PDP activation success times/attempt times ×100（.


5

Secret▲

definition PDP activation success means that the mobile phone receives the

Activate PDP Context Accept signaling 15 seconds after it sends the

Activate PDP Context Request.

Indicatory type Test

Counter

formula

None

Notes Normally, this KPI is the same as the CQT value. It is required to

perform the PDP activation test ten times at each test site. Test methods

for GPRS and EDGE are the same.

5.1.4 PDP context activation time

KPI PDP context activation time

KPI reference

value

Suggested value 1.5 sec

Risk value 1.2 sec

Indicator

definition

Sum of PDP activation duration/ PDP activation success

times.

PDP activation time means the duration from the mobile

phone sends out the first Activate PDP Context Request

to it receives the Activate PDP Context Accept.


Counter

formula

None

Notes Normally, this KPI is the same as the CQT value.

Authentication included. GPRS and EDGE are not

separated in this test.

5.1.5 PING test success rate

KPI PING test success rate

KPI reference

value

Suggested value 95%

Risk value 98%

Indicator

definition

Ping success times/Ping attempt times*100%

Counter

formula

None

Notes It is regarded as failure if the time exceeds 30 seconds.

5.1.6 Average PING test time

KPI PING test time

KPI reference

value

GPRSSuggested value 1.5 sec

Risk value 1.4 sec

EDGESuggested value 1 sec

Risk value 0.6 sec

Indicator Sum of Ping success duration/ Ping success times


Secret▲

definition


Counter

formula

None

Notes Authentication is included in this KPI. The Ping package size

will have influence on the test result. Generally, the smaller

the Ping package is, the better the test result will be. It is

sometimes referred as Round Trip Time.

5.2 Mobility

5.2.1 Routing Area Update Successful rate

KPI Routing Area Update Success rate

KPI referenceSuggested value 90%

Risk value 95%

Indicator

definition

Routing update attempt times*100% / Routing update success times

Indicatory type test

Counter

formulaNone

Notes Usually it can be statistical value. It also can be obtained from DT too.

5.3 Data Throughput

5.3.1 Average FTP download rate

KPI FTP download rate

KPI

reference

value

GPRS

Suggested value 20kbps

Risk value 30kbps

EDGE


Risk value 120kbps

Indicator definition Actual download data quantity (byte)/actual download duration


Counter formula None

Notes Normally, this KPI is the CQT value. Class 4 mobile. Size of the

downloaded document will affect the test result. Usually, the

smaller the document size is, the better the test result will be. It is

related to the number of PS channels （ terminal type （ encoding

method and test software, etc.. The test result can also be affected


Secret▲

by the adoption of encoding method for CS3 and CS4. 3static time

slots are configured.

5.3.2 Average FTP upload rate

KPI FTP upload rate

KPI reference

value

GPRS


Risk value 10kbps

EDGE


Risk value 35kbps

Indicator definition Actual upload data quantity (byte)/actual upload duration


Counter formula None

Notes Normally, this KPI is the same as the CQT value. Class 4 mobile.

Size of the uploaded document will affect the test result. Usually,

the smaller the document size is, the better the test result will be.

It is related to the number of PS channels（terminal type（encoding

method and test software, etc.. The test result can also be affected

by the adoption of encoding method for CS3 and CS4. This KPI is

the result of single time slot.

5.3.3 Throughput

Preconditions

Mobile phone with multi-timeslot Level 8; single

subscriber; 4 DL static signaling channels, 1 UL static

signaling channel

Indicators (EN) Indicators (CN) Suggested value

GPRS: Max data throughput-DL GPRS DL maximum transmission rate 9.8kbyte/s

GPRS: Max data throughput-UL GPRS UL maximum transmission rate 2.4kbyte/s

GPRS: Average data throughput-DL GPRS DL average transmission rate 5kbyte/s

GPRS: Average data throughput-UL GPRS UL average transmission rate 1.3kbyte/s

EDGE: Max data throughput-DL EDGE DL maximum transmission rate 26.5kbyte/s

EDGE: Max data throughput-UL EDGE UL maximum transmission rate 7kbyte/s

EDGE: Average data throughput-DL EDGE DL average transmission rate 14kbyte/s

EDGE: Average data throughput-UL EDGE UL average transmission rate 3.5kbyte/s

5.4 Reliability

5.4.1 PDTCH Drop Rate

KPI PDTCH Drop Rate


Secret▲

KPI reference

value

Suggested value 5%

Risk value 2%

Indicatory type DT test value

Indicator

definition

PDTCH drop times/ FTP download attempt times *100%

Counter

formula

None

Notes


Secret▲

6 Introduction to CN Statistical KPI

6.1 Paging success rate

KPI Paging success rate

KPI reference

value

Suggested value 90%

Risk value 93%

Indicator

definition

Paging response times*100% / Paging request times

Counter

formula

Paging request times refer to the sum of PAGING information sent out by all

MSCs in the area, excluding the secondary paging information. Paging response

times refer to the sum of the PAGING RES received by all MSCs in the area,

including the second paging response. Statistical point is at MSC side.

Notes BSC can indirectly provide this KPI, but its statistical point differs from that of

MSC. The difference lies in call loss at Interface A.

6.2 Location update success rate

KPI Location update success rate

KPI reference

value

Provided by the SMC side

Indicator

definition

Location update success times *100%/ location update request times

Counter

formula

Provided by the SMC side

Notes This KPI can be indirectly provided by BSC, but the value is different and its statistical

point differs from that of MSC too.

6.3 Attach success rate

KPI Attach success rate

KPI reference

value

Suggested value 90%

Risk value 95%

Indicator

definition

GPRS attach success times *100% / GPRS attach times

Indicatory

type

GPRS attach success times（SGSN delivers（ATTACH ACCEPT（3GPP

TS 24.008（（excluding redeliver

Counter

formula

Statistics at SGSN side

Notes excluding Unregistered subs


Secret▲6.4 GPRS average attach time

KPI GPRS average attach time

KPI reference

value

Suggested value To be confirmed

Risk value To be confirmed

Indicator

definition

Customer attach establishment duration *100% / customer

number of attach establishment success

Indicatory type Statistics

Counter

formula

Attach establishment time refers to the time duration from the

receipt of GPRS ATTACH REQUEST by MS to the delivery of

ATTACH ACCEPT by SGSN. If the attach time exceeds the

timer, the attach duration is only computed within the attach

accepted period.

Notes

6.5 PDP context activation success rate

KPI PDP context activation success rate

KPI reference

value

Suggested value 80%

Risk value 85%

Indicator

definition

success times of PDP context activation started by MS*100%/ attempt

times of PDP context activation started by MS

The attempt times of PDP context activation started by MS is the times

GGSN received Create PDP Context Request from SGSN.

The success times of PDP context activation started by MS is the statistic

of Create PDP Context Response sent from GGSN to SGSN when Cause

value is Request Accepted.

Indicatory type Test or statistics

Counter

formula

Statistics at GGSN side

Notes The performance evaluation in China Mobile in 2003 (success times of

PDP context activation started by GPRS terminal/ attempt times of PDP

context activation started by GPRS) results are as follows:

Excellency index: 94%

Reach-the-mark index: 90%

Lowest Threshold index: 85%

6.6 Routing Area Update Success rate

KPI Routing Area Update Success rate

KPI reference

value

Suggested value 92%

Risk value 95%

Indicator

definition

Routing update attempt times*100%/ routing update success times

Indicatory type From statistical value or DT.


Secret▲

Counter

formulaStatistics at SGSN side, provided by GPRS core network

Notes Update success rate at routing area crossing SGSN is lower than that at the SGSN

routing area.


Secret▲

7 Comments on KPI Cases

7.1 Pengshui (Chongqing) PS Test Result

1（ CQT scene（near cell

2（ EDGE Commissioned

3（ Multi-timeslot capability3+1

4（ Number of PDCH static channels: 3

Test state Test

serialFTP type

FTP

size（Kbyte（

Download

speed

(Kbyte/s)

Download

speed (kbps)

Average timeslot

speed（kbps（

Pre-optimization 1 Download 102.381 8.99 71.93 23.98











Ping

interval

Ping

package

size （ byt

e（

Ping timelag（ms（ Averag

e

timelag

（ms（

Ping

success

rate1 2 3 4 5 6 7 8 9 10

0 32 839 634 61261

2608 589 566 765 561 761 655 100%

5 32 816 590 58177

9757

73

3716 692 812 609 709 100%

2 100 571 650 69775

6753

65

1711 729 707 688 691 100%

2 500 839 955107

5

82

1779

73

7918 894 875 840 873 100%

5 500 862 760 85775

5672

81

1690 811 709 825 775 100%


5

Secret▲

2 800 959 910 86986

9845

82

3781 883 860 846 865 100%

2 1000115

7

115

8880

90

7

102

8

91

8

105

4881

108

2

103

71010 100%

2 1200107

8840 897

95

7

101

7

95

9

119

1

102

0

101

8

104

21002 100%

Comments on case:

1. When C/I is in good condition, the EDGE download speed of current equipment

can reach above 40kbps.

2. The Ping success rate and Ping timelag can vary very much due to different Ping

intervals（ different Ping package sizes and different Ping servers.

7.2 Jishou (Hunan) China Mobile EDGE Test Result

Test Specification

Test equipment（ANT Pilot for E-GPRS（

Test phone SEGAM OT490(one set)

Test laptop: memory 1024M （ harddisk 80G （ CPU

1.60Ghz （Windows XP-SP2 （ standard 28800bps modem （ rate at

115200bps（modem error control and compression forbidden（no

software irrelevant to the test.

Test method（outdoor static FTP download test Test location （11

sites at Baoqing market in Fenghuang county Test time（19th—30th,

June 2008

Test aim（to test E-FPRS network performance under static state

Test aim（to download 1000KB document

Timeslot （4 static timeslots

Test Result

Branc Test sites Test Test Download Test location RLC RLC


5

10

15

20

Secret▲

h

office

documen

t size

（KB（

electrical

level（dB

m（

times

average

rate（Kbp

s（

average

rate （Kbp

s（

Jishou

Fenghuang County

prefectural government

office building

Cell 1

1000 -44 2 Gate of Prefectural government office 201.19 181.3

Jishou

Fenghuang County


office building

Cell 2

1000 -40 2 Lobby of MingDu Hotel 192.6 198.98

Jishou

Fenghuang County


office building

Cell 3

1000 -51 2 Opposite MingDu Hotel 197.09 206.26

Jishou Old district Cell 1 1000 -49 2Basketball field

of Jiandaoping Primary School197.74 201.79

Jishou Old district Cell 2 1000 -32 2Basketball field

of Jiandaoping Primary School207.29 193.91

Jishou Old district Cell 3 1000 -56 2Kindergarten

next to Jiandaoping Primary School198.83 196.38

Jishou Rainbow Bridge Cell 1 1000 -43 2 Opposite Wanmingta River 185.72 191.1

Jishou Rainbow Bridge Cell 2 1000 -43 2 Opposite Wanmingta River 191.37 181.36

Jishou TianXia Feng Huang Cell 1 1000 -34 2Square in front of

TianXiaFengHuang Hotel197.46 186.55

Jishou TianXia Feng Huang Cell 2 1000 -59 2Square in front of

TianXiaFengHuang Hotel197.09 206.26

Jishou BaoQing market Cell 1 1000 -38 2 Gate of Linlinlou Drug Store 207.85 198.02



Jishou Xinhua Bookstore Cell 1 1000 -50 2 Lobby of Xinhua Hotel 195.81 191.5

Jishou Xinhua Bookstore Cell 2 1000 -53 2 Lobby of Xinhua Hotel 198.02 188.38

Jishou Xinhua Bookstore Cell 3 1000 -45 2 Parking lot of Xinhua Hotel 183.08 190.16

JishouComprehensive Building Cell

11000 -37 2 Lane, west to ChinaMobile business hall 178.96 157.44


21000 -45 2 Gate of XingGuang Hotel 185.46 187.98


21000 -60 2 Gate of XingGuang Hotel 184.07 184.45

JishouComprehensive Building

Cell 1800M1 1000 -50 2 Gate of XingGuang Hotel 193.98 184.51

JishouComprehensive Building

Cell 1800M2 1000 -62 2 Gate of XingGuang Hotel 176.22 185.21

Jishou Telecom Bureau Cell 1 1000 -51 2 Business Hall of Telecom Bureau 180.75 197.88


Secret▲

Jishou Telecom Bureau Cell 2 1000 -64 2 Business Hall of Telecom Bureau 171.85 199.19

Jishou Telecom Bureau Cell 3 1000 -57 2Backdoor of Supermarket (next to Telecom

Bureau)182.7 179.49

Jishou Telecom Bureau Cell 1800M1 1000 -59 2 Gate of furniture store (next to Telecom Bureau) 105.44 106.48

Jishou Telecom Bureau Cell 1800M2 1000 -73 2 Business Hall of Telecom Bureau 181.85 185.85

Jishou Telecom Bureau Cell 1800M3 1000 -84 2 Business Hall of Telecom Bureau 159.20 166.92

Comments on case:

1. When C/I is in good condition, the average EDGE download speed can reach

above 180kbps with a peak value of above 200kbps;

2. This test is the CQT. Cell reselection and RAC renewal can be neglected, that is

they are not necessary to the test conditions.

7.3 Acceptance requirements for EDGE KPI of Data Service of a network

Serial Indicators Explanation Formula Target

1 GPRS/EGPRS

attach

success rate

GPRS/EGPRS Attach success

means that the mobile phone

receives the Attach Accept

signaling 15 seconds after it sends

the Attach Request.

GPRS/EGPRS attach

success rate （ GPRS Attach

success times/attach

attempt times×100（

>95%

2 Average

attach time

Attach time means the

duration from the mobile

sends out Attach Request

until it receives GPRS attach

accept signaling.

Average attach time（sum of

attach success duration

/attach success times

<3s

3 PDP

activation

success rate

PDP activation success means that

the mobile phone receives the

Activate PDP context Accept

signaling 15 seconds after it sends

the Activate PDP Context Request.

PDP activation success

rate（PDP activation success

times/attempt times×100（

>95%

4 PDP average

activation

time

PDP average activation time

means the duration from

the delivery of Activate PDP

Context Request to the

receipt of Activate PDP

Context Accept by the

mobile phone.

PDP average activation time

（ sum of PDP activation

success duration/PDP

activation success times

<3s

5 WAP website

log-in

success rate

WAP website log-in success

means that the homepage

fully and correctly displays

within 60seconds after the

WAP website log-in

success rate （ WAP website

log-in success times/

website log-in attempt

>95%


5

Secret▲

mobile phone started the

WAP website log-in request.

times×100％。

6 average WAP

homepage

displaying

time

WAP homepage displaying

time refers to the duration

from the WAP website log-in

request is sent out until the

homepage fully and

correctly displays.

average WAP homepage

displaying time （ sum of

successful homepage

displaying duration / WAP

homepage displaying

success times

<10s

7 WAP

webpage

refresh

success rate

WAP webpage refresh

success means that the

selected webpage can be

refreshed within 60seconds.

WAP webpage refresh

success rate（WAP webpage

refresh success times /

webpage refresh attempt

times×100％。

>95%

8 Ping success

rate

Ping success rate （ ping

success times/ping attempt

times×100

>95%

9 Ping average

timelag

Ping average timelag （ sum

of each Ping success

duration/ping success times

<2s

10 FTP

download

speed

FTP download speed（actual

download data

quantity （ Byte （ /actual

download time(sec)×9

>80kbp

s

11 FTP upload

speed

FTP upload speed （ actual

upload data

quantity （ Byte （ /actual

upload time(sec) ×9

>20kbp

s

Comments on case:

1. Requirements of operation and maintenance KPI are not as strict as those of

acceptance check KPI.

2. Usually these KPI requirements can be satisfied.

7.4 Operation & Maintenance KPI of a Network

SN Indicator Unit Target Level Permissible

Level

Remark

1 SDCCH Drop

Ratio

% 1 1.2 Base on system performance report of

OMCR, Indication Definition: SDCCH

Drop Ratio=SDCCH call drops/ Access

attempt Number

2 TCH Drop

Ratio


OMCR, Indication Definition: TCH Drop


5

Secret▲

Ratio = TCH call drops/ Seized TCHs

(include handover )

3 Call Success

Ratio

% 98 97 Base on system performance report of

OMCR, Indication Definition: Call Success

Rate = 1（TCH assignment failure rate

4 SDCCH

Blocking Ratio

% 0.5 0.75 Base on system performance report of

OMCR, Indication Definition: SDCCH

Blocking Ratio=SDCCH overflows/

SDCCH call attempts

5 TCH

Blocking Ratio


OMCR, Indication Definition: TCH

Blocking Ratio=TCH overflows (include

handover)/ TCH call attempts (include

handover)

6 TCH

Assignment

Success Ratio

% 98 97 Base on system performance report of

OMCR, Indication Definition: TCH

assignment Success Ratio=Number of TCH

assignment successful / Number of TCH

call attempts (include handover)

7 GPRS average

DL throughout

per TBF

Kbp

s

28 25 24-Hour measurement

8 EDGE average

DL throughout

per TBF

Kbp

s

45 40 24-Hour measurement

9 Attach

Success Rate

(GPRS/ EDGE)

% 99 97 24-Hour measurement

10 Handover

Success Ratio

% 94 93

11 Call Blocking

Ratio

% < 2 for

98% of all

GSM cells

< 2 for

90% of all

GSM cells

Based on OMC-R statistics

12 Call Setup

Success Rate

(Drive Test)

% 97 90 Depend on the DT route and method

13 Call Drop

Rate (Drive

Test)

% 2 3 Depend on the DT route and method

14 Speech

Quality (Drive

Test)

MOS >= 3 for

95% of

measurement

samples

>= 3 for

90% of

measurement

samples

Depend on the DT route and method

15 Coverage

(Drive Test)

dBm >= -85 for

95% of

>= -85 for

90% of

Depend on the DT route and method


Secret▲

measurement

samples

measurement

samples

16 UL

Throughput

Kbps >10 >10 Based on DT

17 DL

Throughput

Kbps >30 >30 Based on DT

18 BSC/RNC

down time

(unscheduled)

% >99.999

(< 6 sec)

>99.999

(< 6 sec)

per BSC/RNC / week

19 TRX/channel

element failure

(unscheduled)

% < 1 of all

active TRX

< 2 of all

active TRX

per BSC/RNC / week

20 SDCCH

Mean Holding

Time

s < 2 < 3 per BSC/RNC / BH of a week

21 Radio Access

Success Ratio

% >99.5 >99 per BSC/RNC / BH of a week

22 Worst Cells

GOS

Less than

1.5% cells of

Network with

GOS 5% or

above

Less than

1.5% cells of

Network with

GOS 5% or

above

per BSC/RNC / BH of a week

23 RXQUAL 0 to 3 % >97 >95 per BSC/RNC / BH of a week

24 AMR voice

FER

% < 1 <1 per BSC/RNC / BH of a week

Comments on case:

1. This KPI comprises statistical KPI（ testing KPI and equipment performance KPI, which

features detailed classification and all-round evaluation;

2. Requirements for KPIs like GPRS average DL throughout per TBF and EDGE average

DL throughout per TBF are higher.

3. Requirements for evaluation of CS voice quality are higher.

7.5 Operation & Maintenance KPI of a network in Southeast Asia

No. KPIMeasuremen

tLevel 0 Level 1 Level 2

Scope and interval

1

% of outdoor

area with 2G signal

level > -104 dBm

pre-defined Drive test

route>90% >97% >99%

per city / monthly


5

Secret▲

2

Call Setup Success

Rate (exclude blocking)

pre-defined locations and

Drive test route/NMS

95% >98% >99%per city / BH of a week (drive test monthly)

3Paging Success

RateNMS >90% >95% >97%

per city / BH of week.With condition that Core Network is achived the same value of Level 1 and Level 2

4Call

blocking rate

pre-defined locations and

Drive test route/NMS

<0.5% <0.5% <1%per city / BH of a week (drive test monthly)

5

Drop Call Rate

(excluding inter RAT)

Pre Defined Drive Test

Route/NMSGSM: <3%

GSM: <2%

GSM: <1%per city / BH of a week (drive test monthly)

6Handover Success

Rate


Route or NMS>90% >97% >97%

per city / BH of a week (drive test monthly),per city / BH of week.With condition that Core Network is achived the same value of Level 1 and Level 2

9SQI

(TEMS)


Route>20(95%) > 25(95%) > 25(95%)

Average value per city / BH of a week

10

Call setup delay

(PSTN to MS, time

from number dialed to

ring)


Route<6s < 6s <6s

per Media Gateway/ monthly

11

Call setup delay (MS to PSTN, time from

send pressed to

ring)


Route<5s < 5s <5s

per Media Gateway/ monthly

12Call Setup Successful

RateNMS >95% >98% >99%


13SDCCH Access Success

NMS >99% >99% >99.5%per BSC/RNC / BH of a week


Secret▲

15SDCCH Blocking

Rate


Route/NMS<0.5% <0.5% <1%


(drive test monthly)

16TCH

Blocking Rate


Route/NMS<0.5% <0.5% <1%



18Drop Call

Rate


Route/NMS<5% <2% <1.5%



19Handover Success

Rate


Route/NMS

Inter BSS: >92% : Inter Cell: >92%

Inter BSS: >97% :

Inter Cell: >97%

Inter BSS: >97% : Inter Cell: >97%

per BSC/RNC / BH of a week (drive test monthly)With condition that Core Network is achived the same value of Level 1 and Level 2

20RXQUAL 0

to 3


Route/NMS>80% >85% >90%



21AMR voice

FER


Route/NMS<1% <1% < 1%;



23

Successful PS

Attachment

NMS >98% >98% >98%per city / BH of

a week

24

Successful PDP

context activation


a week

25

Data session Setup

Success Rate (PDP

context already exist)


Route/NMS>95% >98% >98%

per city / BH of a week

26

Moving MS FTP download 1MB file

Pre Defined Drive test

routeGPRS>30kbps

GPRS (Class 4

MS): >30Kb

GPRS (Class 4 MS):> 30Kbps

per city / BH of a month


Secret▲

27

Moving MS FTP upload

1MB file

Pre Defined Drive test

routeGPRS>8kbps

GPRS (Class 4 MS): > 9Kbps;

GPRS (Class 4 MS): > 9Kbps;


28

Stationary MS near site, FTP download 1MB file

Pre-defined locations

GPRS (Class 4 MS): > 40 Kbps

GPRS (Class 4

MS): > 40 Kbps



29

Stationary GPRS MS

in cell border,

FTP download 1MB file



GPRS (Class 4

MS): > 20 Kbps;

GPRS (Class 4 MS): > 20 Kbps;


30

Stationary UMTS MS

in cell border (SHO),

FTP download 1MB file


N/A> 150 Kbps

> 150 Kbpsper city / BH of

a month

31PDTCH blocking

rateNMS <0.5% <0.5% <1%;

per BSC / BH of a week

32

60 second data

transfer drop Rate

(MS moving)


Route<3% <2% <1.5%


33

Routing Area

Update Successful

rate

NMS > 95% > 95% >97%per city / BH of

week

34

MS initiated service

setup time


Route<5s <5s <5s


35

MS roundtrip Ping time (20 ping

averaged)


Route<1 <1 <0.8s


36

PDP update success

rate


a week

Comments on case:


Secret▲

1. This OM KPI just got some of the indicators, excluding the weighing of all KPIs

and 2/3G interoperate KPI, etc.. Due to market factors, the OM KPI of this

network is set unreasonable, and there is risk in some of the KPIs.

2. The evaluation of this KPI falls into three grades. The requirements for

handover success rate and paging success rate are very high, which are difficult

to reach. But the attached prerequisites can lower the risk to some extent.

Besides, the definition of handover success rate varies with different

manufacturers, which we need to make clear with customers in technical

clarification.

3. The requirements for data service and voice KPI are higher.

7.6 KPI requirements for Indonesia Telkomsel network

KPI requi rements for I ndi nesi a Tel komsel . xl s

Comments on case

1. The evaluation scale of KPI is relatively large, mainly dealing with statistical

KPI and testing KPI;

2. It ranges from 2G to 3G network. Its service includes voice（GPRS and 3G data

service, etc..

3. The division of KPI evaluation scenes and most KPI values are relatively

reasonable.


5

10

15

Documents

135109106 GSM Key Performance Indicator（KPI）Guidebook V1 1