UMTS Radio Network Evaluation Guide(v1.2)

7/31/2019 UMTS Radio Network Evaluation Guide(v1.2)

1/28

Radio Network Evaluation Guide

V i V1 2


2/28

Version V1 2

UMTS Radio Network Evaluation Guidebook Internal Use

UMTS Network Planning & Optimizing

Guidebook

Version statement

Version Date Author Audit Modification Record

V1.0 2004/11/02 Hu Bin No No

V1.1 2005/06/0

1

Hu Bin Yin Jianhua Modify the testing method of average paging

delay and PDP context activation time.

Coverage propability is classified into coverage

and interference categories.

V1.2 2008/12/3

0

Qin Jianhan Chief

Engineer

Team

Remove previous testing criteria and modify

scoring standards.


3/28


Contents

Fig 2-1 Network Evaluation Process in Network Optimizing Phase 6.........................................2

Fig 2-2 Network Evaluation Process in Operation & Maintenance Phase 7...............................2

Table 3-1 DT Items 9........................................................................................................................2

Table 3-2 Grading Weight of Testing Categories 9.......................................................................2

Table 4-3 CQT Testing Content 15..................................................................................................2

Table 5-4 OMC Statistics Indicators 18..........................................................................................2

Table 5-5 OMC Indicator Grading Standards 20..........................................................................2

1 Overview .........................................................................................................................................4

2 UMTS Radio Network Evaluation ................................................................................................5

2.1 Network Evaluation in Network Optimizing Phase ...................................................................5

2.2 Network Evaluation in Network Operation & Maintenace Phase .............................................6

2.3 Matters be Observed in Network Evaluation .......................................

.......................................7

3 Drive Test ........................................................................................................................................8

3 1 Test Time 8


4/28


Radio Access Success Rate.......................................................................................................18

RNC CS Call Drop Rate...........................................................................................................18

RNC CS Call Drop Rate)..........................................................................................................19

RNC Success Rate of SHO.......................................................................................................19

RNC Inter-RAT CS Outgoing Handover Success Rate(WCDMA->GSM).......................19

5.2 Grading Standards ......................................................................................................................20

6 Network Evaluation .....................................................................................................................21

7 Attachment ....................................................................................................................................22

7.1 CQT test Table ...........................................................................................................................22

7.2 CQT Statistics Table ...................................................................................................................23


5/28


Figures

Fig 2-1 Network Evaluation Process in Network Optimizing Phase..............................................6

Fig 2-2 Network Evaluation Process in Operation & Maintenance Phase....................................7


6/28


Tables

Table 3-1 DT Items.............................................................................................................................9

Table 3-2 Grading Weight of Testing Categories ............................................................................9

Table 4-3 CQT Testing Content.......................................................................................................15

Table 5-4 OMC Statistics Indicators...............................................................................................18

Table 5-5 OMC Indicator Grading Standards...............................................................................20


7/28


Key Words:

Network evaluation, DT, CQT, OMC

Abstract:

UMTS radio network evaluation targets at pilot signaling coverage, service

coverage and performance. Network evaluation is performed based on DT and

network management indicators through the analysis of relevant data from DT,

CQT and OMC.

The guidebook presents the procedures and methods of UMTS radio network

evaluation work, providing guidance for concrete operations in network

evaluation in optimizing and operation and maintenance phases.

Abbreviations:

DT: Drive Test

CQT: Call Quality Test

OMC O ti & M i t C t


8/28


1 Overview

The guidebook presents the procedures and methods of UMTS radio network

evaluation work, providing guidance for concrete operations in network

evaluation in optimizing and operation & maintenance phases.


9/28


2 UMTS Radio Network Evaluation

Network evulation can be performed at different phases of network lifespan

and the methods may have some differences. Optimizing work can be divided

into engineering optimizing phase and network operation & maintenance

phase. This guidebook makes description of network evaluation work of these

two phases.UMTS radio network evaluation is performed from three aspects: pilot

signaling coverage, service coverage and performance. Network is evaluated

based on DT and network management indicators through the analysis of

relevant data from DT, CQT and OMC. The scoring items and testing criteria

can be customized upon customers demand.

2.1 Network Evaluation in Network Optimizing Phase

In network optimizing phase, the network is zero-load and evaluation data is

mainly acquired through DT test (drive test) or CQT call quality test) test. The

evaluation is fit for making conparision and contrast of the network before and

after network optimizing and making initial estimation of the network.

N t k l ti i i i ti i i h i h i th


10/28


Start

DT data

collecting

CQT data

collecting

E d

DT data

processing

CQT data

processing

DT indicator

grading

CQT indicator

grading

Network overall

grading

Submit network

evaluation

report


11/28


Start

DT data

collecting

CQT data

collecting

DT data

processing

CQT data

processing

DT indicators

grading

CQT indicators

grading

Network overall

grading

Submit network

evaluation

report

OMC data

collecting

OMC data

processing

OMC indicators

grading


12/28


3 Drive Test

Network coverage and interference can be measured by coverage propability

indicators. CS domain service DT evaluating items include paging success

rate, call drop rate, handover success rate and average paging delay; PS

domain service DT evaluating items are mainly uplink and downlink average

transmission rate.

3.1 Test Time

According to the load selection of the network, choose the appropriate time to

perform the test.

Network evaluation in optimizing phase can be conducted with or withoutload and DT can be performed at normal time usually between 9:00 and 21:

00.

Network evaluation in operation & maintenance phase can be conducted in

busy hours or with load. Busyhour DT are usually performed in the busiest

time, for example, 9:00~21:00 from Monday to Friday; DT test with load can

only be performed at 0:005:00 when the traffic volume is very low.


13/28


3.3 DT Items

Please refer to UMTS Radio Network Testing Criteria for specific testingcriteria.

DT includes testing items are shown below:

Table 3-1 DT Items

Data Resources Testing Items Testing Subitems

DT Pilot channel coverage test

CS domain service test Voice service paging success

rate

Voice service paging access

delay

Voice service call drop rate

Voice call quality

Voice service 3G->2G handover

success rate

Video service paging success

rate

Video call drop rate

PS domain service test PDP activation success rate

Call drop rate

D l d


14/28


CS service 30% 40%

PS service 25% 30%

HSPA

service

25%

Pilot Coverage Rate

Pilot coverage ratefull score: 100

Coverage rate indicators score

95% 10

0

90%,95% 80

85%,90% 50

80%,85% 20

CS Service

(1) Paging success rate(full socre: 30

Paging success rate indicators Scores

98% 15


15/28


(4) Voice service average paging delayfull score: 10A) When UE dials UE:

Average paging delay indicators Scores

6 s 10

6 s,8 s 8

8s 10s 5

10s 0

B)When UE dials PSTN

Average paging delay indicators Scores

4s 10

4s , 6s 8

6s, 8s 5

8s 0

(5) Voice service 3G->2G handover success ratefull score: 10

3G->2G handover success rate Scores

96% 10

93%, 90% 8

90%, 88% 5

88% 0

PS Service


16/28


64/384 Kbps, 64/128Kbps and 64/64Kbps services are summed separately and

accumulated to get the overall score.

(8) Uplink average transmission ratefull score: 30

Uplnk average transmission rate indicator(single service) Scores

50Kbps 10

50Kbps, 40Kbps 8

40Kbps, 30Kbps 5

30Kbps 064/384 Kbps, 64/128Kbps and 64/64Kbps are summed respectively and

accumulated to get the over score.

(9) 3G->2G handover success ratefull score: 10

3G->2G handover success rate Scores

96% 10

93%, 90% 8

90%, 88% 5

88% 0

Not limited to service types.

HSPA S i


17/28


80% 5


18/28


4 Call Quality TestMake dialing test at fixed spots and keep record of the data. Make multiple

dialing tests at each testing spots. Call quality test (CQT) includes CS service,

PS service and HSPA service.

4.1 Testing TimeCQT is uaually performed on non-holidays, at 9:00~ 21:00 from Monday to

Friday.

4.2 Testing Spots

Testing spots shall be selected taking the following factors into considerations:Traffic volume of the testing areas. For network already exists, usually select

spots with dense traffic.

Geographic condtion in the testing area. 80 shall be indoors and 20%

outdoor and traffic shall be even distributed geographically.

Radio environment of the testing areas. Places installed with repeaters or

indoor distributing systems shall be top priority.

A h k bl l h f l bli d


19/28


Specific testing spots shall be selected in view of the above principles and

according to the actual condition, which shall be cleary stated in the report

submitted. Testing spots of PS service can be different from those of CS

service or we can select the spots that are suitable for PS test out of the testing

spots of PS service.

4.3 CQT Items

Please refer toUMTS Radio Network Testing Criteria for specific testing

criteria.

CQT includes the testing items:

Table 4-3 CQT Testing Content

Testing data

resources

Testing item Testing subitem

CQT CS service test Voice service paging success

rate

Voice paging access delay

Voice call drop rate

PS service test PDP activation success rate

Call drop rate


20/28


(10)Call drop rate(full score: 40)

Call drop rate indicator Score

1% 40

1%,1.5% 30

1.5%,2% 20

2%,4% 10

(11)Average paging delay(full score: 20)A) When UE dials UE,

Average paging delay indicator Score

8s 20

8s ,10s 15

10s ,12s 10

12s 0

B)When UE dials PSTN

Average paging delay indicator Score

4s 20

4s ,6s 15

6s ,8s 10

8s 0

PS Service


21/28


64/384 Kbps, 64/128Kbps and 64/64Kbps services are recorded separately and


(14)Uplink average transmission rate (full score: 30)

Uplink average transmission rate indicator(single service) Score

50Kbps 10

50Kbps,40Kbps 8

40Kbps,30Kbps 5

30Kbps 064/384 Kbps, 64/128Kbps and 64/64Kbps services are recorded separately and


HSPA Service

(1) PDP context activation success rate indicator (full score: 20)

PDP context activation success rate indicator Score

99% 20

98%,99% 15

97%,98% 10

97% 5


22/28


5 OMC Indicator StatisticsIt applies to network evaluation in operation & maintenance phase.

It mainly refers to network manager statistics on OMC reflecting the network

operation quality indicators, as shown in the following table:

Table 5-4 OMC Statistics Indicators

Data resources Testing items

OMC Radio connection rate

RNC CS service disconnect

rate

RNC PS service disconnect

rate

RNC soft handover success

rate

Voice service 3G->2G

handover success rate

KPI can also be customized upon clients requirements.

1 I di D i i


23/28


CS call drop rate=(RAN release number for call drop requested by UTRAN for

CS domain + RAB release number for Iu connection release request by UTRAN

for CS domain / Successful RAB establishment number for CS domain100%

RNC CS Call Drop Rate)

Indicator significance: to reflect commucation holding capability and is a key

performance indicator reflecting users perception of the network.

Equation:

PS call drop rate=(RAN release number for call drop requested by UTRAN

for PS domain) + RAB release number for Iu connection release request by

UTRAN for PS domain / Successful RAB establishment number for PS

domain100%

RNC Success Rate of SHO

Indicator significance: to reflect RNC soft handover success rate and has

direction influence on customers perception of the network. Soft handover

i i li d i f h


24/28


5.2 Grading StandardsThis section provides grading standards of KPI from OMC platform, while in

practical network evaluation; specific grading standards shall be established

upon customers requests.

Based on the significance of different indicators, different weighting is given

to different indicators. The overall score of OMC indicators is the sum of all

indicator socres with their weights.

Table 5-5 OMC Indicator Grading Standards

International Grading System

Item Full Score Weig

ht

Baseline Full score Calculation

Radio access success rate 100 0.25 92.0% 98.0% automatic

CS call drop rate 100 0.25 4.0% 1.0% automatic

PS call droprate 100 0.2 15.0% 4.0% automatic

RNC soft handover success

rate

100 0.15 92.0% 99.80% automatic

W->G handover success rate 100 0.15 88.0% 96.0% automatic


25/28


6 Network EvaluationThe overall score of network evaluation is the sum of DT score, CQT score and

OMC indicators scores with their weights.

Network evaluation score DT score30% CQT score30% OMC

indicators score40%

For network evaluation in network optimizing phase, only DT score and CQT

score are involved..

Network overall scoreDT score60%CQT score40%


26/28


7 Attachment

7.1 CQT test TableAttachment 1: CQT test table

City Network Testing Item Originating location: Terminating location:

No. Mobile Number Commcunication Status Communication Quality Location

originati

ng

terminating

normal ailurefall dropc

normal o voice onologuen mn mn mn mn mn mn mn mn mn mn mn mn m n m rosstalk echo ackground noise nt erruption ad imagec b i bc b i bc b i bc b i bc b i bc b i bc b i bc b i bc b i bc b i bc b i bc b i bc b i bc b i b

normal

ailure all dropf cf cf cf cf cf cf cf cf cf cf cf cf cf c

normal o voice onologuen mn mn mn mn mn mn mn mn mn mn mn mn m n m

rosstalk echo ackground noise nterruption ad imagec b i bc b i bc b i bc b i bc b i bc b i bc b i bc b i bc b i bc b i bc b i bc b i bc b i bc b i b

normal




normal




normal




normal




normal normal o voice onologuen mn mn mn mn mn mn mn mn mn mn mn mn m n m

ZTE Corporation Copyright Reserved, No Spreading Abroad unless Permitted. Page 22 of 30


27/28


ailure all dropf cf cf cf cf cf cf cf cf cf cf cf cf cf c rosstalk echo ackground noise nterruption ad imagec b i bc b i bc b i bc b i bc b i bc b i bc b i bc b i bc b i bc b i bc b i bc b i bc b i bc b i b

normal




normal




normal




normal




normal




normal




normal




normal




normal




Testing staff testing time

7.2 CQT Statistics TableAttachment 2 CQT statistics table



28/28


City Network Testing Item Originating location: Terminating location:

No. Testing

spots

Coverage

field

strength

Paging

number

Call

establisheme

nt number

Number of

call drops

Number of no

voice crosstalkmonologue andecho

Number of interruption

and background noise

Number of bad

images

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

Sub

Testing staff Testing time


Documents

UMTS Radio Network Evaluation Guide(v1.2)