Towards Quality and QOS Assessment for VoLTE -IMSWF.ppt

7/23/2019 Towards Quality and QOS Assessment for VoLTE -IMSWF.ppt

1/42

TOWARDS QUALITY AND QOSASSESSMENT FOR VOLTE IN ETSI

TC INT chairman Giulio Maggiore - IMS World Forum 30th April 201

! "TSI 2013# All right$ re$er%ed


2/42

Outline

"TSI Technical Committee TCINT &or Core Net'or( andInteropera)ilit* Te$ting

"TSI INT technical 'or($peci+cation$

,ualit* and ,S A$$e$$ment

&or .o/T" in "TSIWhat$ net

2 ! "TSI 2013# All right$ re$er%ed


3/42

CORE NETWORK ANDINTEROPERABILITY TESTING

(INT)3 ! "TSI 2013# All right$ re$er%ed


4/42

TC INT (C!e Net"!# $n%Inte!&e!$'ilit Tetin*)

Mem)er o& " "2NA In 2012 TC INT participated in the creation o& the "TSI

"2NA pro4ect contri)uting 'ith it$ eperti$e in net'or(te$ting a$ de$cri)ed in the "2NA To5$ appro%ed )* the

6oard789#TC INT change o& To5$ and name

According to "2NA To5$ appro%ed )* 6oard789

The modi+cation o& the To5$ in order to align it$ acti%itie$and contri)ution$ 'ith " "2NA#

Change o& name 'ith C!e Net"!# $n%Inte!&e!$'ilit Tetin* (INT) to )etter re:ect thearea$ o& acti%it*#

No change o& acron*m that 'ill remain INT

"TSI;6A59?014


5/42

ETSI INT SPECIFICATIONS

Inte!&e!$'ilit + Pe!,!-$n.e + Se.u!it $n% Cn,!-$n.e



6/42

P!%u.tin , tet &e.i/.$tin

roduction o& te$t $peci+cation$@ =11> Interopera)ilit*

=> IMS;NGN er&ormance 6enchmar(

=1> Securit*

roduction o& IMS Con&ormance@ =32> Te$t Suite Structure and Te$t urpo$e$=TSST>

=2> A)$tract Te$t Suite =ATS>

=2> rotocol In&ormation Con&ormance

Statement =ICS> =2> rotocol Implementation eBtra

In&ormation &or Te$ting =IBIT>

INT &ull 'or( programme

6

! "TSI 2013# All right$ re$er%ed


7/42

QUALITY AND QOS ASSESSMENTETSI APPROAC0



8/428

Qu$lit1 t2e ne" $&&!$.2

Access Core

APN

APN

Network Centric Customer Centric

Access

CoreAPN

3 Qu$liti$ the -t i-&!t$nt ,$.t! in client choice and churn#

3 In order to oer the )e$t u$er eperience it$ nece$$ar* to $hi&t in the Dualit*monitoring@ ,!- $ 4Net"!# Cent!i.5 &int , 6ie" t 4Cut-e! Cent!i.5


9/429

Cut-e! Cent!i. -nit!in* !e7ui!e ne"KPI

9

Localized Access layer Operative System Device Network section

Core

Critical Indicators

3

M6in* ,!- t2e net"!# t t2e ue! .ent!i. &int , 6ie" $ ne" et ,KPI $!e !e7ui!e% $'le t $n$l8e t2e e9&e!ien.e , t2e in*le ue!

3 In !%e! t -nit! t2e e:e net"!# .2$in t2e KPI 2$6e t 'ete.2nl*;$..e in%e&en%entService KPI

Immediate overview of the service

Tecnical KPI

brics of service !PImonitor s"ecific networ elements


10/42

: ? VOLTE QOS ASSESSMENTTEC0NOLOGY EVALUATIONEVENT#$ ! "TSI 2013# All right$ re$er%ed


11/42

VLTE QS Ae-ent e6ent 6e!6ie"

! "TSI 2013# All right$ re$er%ed##

S.&e@ Technolog* e%aluation lugte$t$ aiming at%alidating the dierent methodologie$ &or end toend ,oS A$$e$$ment &or .o/T" de$cri)ed in "TSI

TS 103 189 o%er a deplo*ed /T";IMS net'or(#

D$te@ 18-20 No%em)er 2013Venue@ "TSIE Sophia Antipoli$E F5

We'1 http@;;'''#et$i#org;ne'$-e%ent$;e%ent$;98-%olte-Do$-a$$e$$ment-2013

P$!ti.i&$nt1

Su&&!te!@


12/42

VLTE QS Ae-ent e6ent .&e

! "TSI 2013# All right$ re$er%ed#2

"nd to end te$t$ per&ormed 'ith $e%eral dierent "$o%er a deplo*ed /T" ; IMS te$t net'or(#

Te$t Setup$

Acou$tic to acou$tic

Acou$tic to electrical "lectrical to acou$tic

"lectrical to electrical

.oice Dualit* te$t$ )a$ed on in$trumental a$$e$$mento& $peech $ample$ per&ormed on dierent

com)ination$ o& the acou$tic and electrical inter&ace$'hich allo'$ e%aluating the dierent methodologie$and $etup$#

arallel net'or( per&ormance e%aluation


13/42

: ? VLTE QS Ae-ent Te.2nl*E6$lu$tin e6ent ? tet %e.!i&tin TS = =@

Su'&$!$-ete! %eli6e!e% ' t2e&$!ti.ul$! tet1"nd-to-end Te$t$ )a$ed on In$trumental A$$e$$ment

o& Speech Sample$ =/,A model deplo*ed>@ Mean pinion Score =MS>-/i$tening ,ualit* )4ecti%e @


14/42

: ? VLTE QS Ae-ent Te.2nl*E6$lu$tin e6ent ? tet %e.!i&tin TS = =@

Su'&$!$-ete! %eli6e!e% ' t2e&$!ti.ul$! tet1

ther end-to-end te$t$ in the %oice channel@ "nd-to-end &reDuenc* re$pon$e

%erall loudne$$ rating

"nd-to-end dela*

,ualit* o& echo cancellation


15/42

: ? VLTE QS Ae-ent Te.2nl*E6$lu$tin e6ent ? tet %e.!i&tin

Gene!$l %e.!i&tin , tet %e/ne% in ETSI TS= =@1

,oS te$t$ )a$ed on the "TSI INT $peci+cation$ a$

de$cri)ed in the late$t %er$ion$ o&@ "TSI TS 18 011-1 =Te$t purpo$e$ &or IMS NNI Interopera)ilit*>

"TSI TS 18 011-2 =Te$t de$cription$ &or IMS NNI Interopera)ilit*>

"TSI TS 102 901 =IMS NNI interopera)ilit* te$t de$cription$ &or 5CS>

"TSI TS 103 029 =IMS "C Interopera)ilit*>#

,oS te$t$ di%ided into t'o part$@

Fir$t one &ocu$ing on the in$trumental a$$e$$ment o& $peechand %ideo Dualit* )* u$ing real $peech and %ideo $ample$

Second one dealing 'ith &unctional parameter$ o& %oice and

%ideo o%er /T" connection$ and other parameter$ in

the end-to-end %oice channel

n the top o& itE $elected net'or( per&ormance parameter$li$ted in the TS 103 189#5 ! "TSI 2013# All right$ re$er%ed


16/42

VLTE QS Ae-ent ? Setu& =A.uti.tA.uti.

! "TSI 2013# All right$ re$er%ed6


17/42

ITUT S&e.i/.$tin ,! Qu$lit-e$u!e-ent

5ecommendation IT-T H#2J@ K)4ecti%e perceptual multimedia %ideo Dualit*

mea$urement in the pre$ence o& a &ull re&erenceK#

5ecommendation IT-T #L0@ KArti+cial %oice$K#

5ecommendation IT-T #LJ@ KArti+cial ear$K#

5ecommendation IT-T #L8@ Kead and tor$o $imulator &or telephonometr*K#

5ecommendation IT-T #@ K


18/42

VLTE QS Ae-ent ? Setu& :A.uti. t Ele.t!i.$l

! "TSI 2013# All right$ re$er%ed#%


19/42

VLTE QS Ae-ent ? Setu& >Ele.t!i.$l t A.uti.

! "TSI 2013# All right$ re$er%ed#9


20/42

VLTE QS Ae-ent ? Setu& Ele.t!i.$l t Ele.t!i.$l

! "TSI 2013# All right$ re$er%ed2$


21/42

MAIN OUTCOME OF T0E VOLTEQOS ASSESSMENT AND NETSTEPS2# ! "TSI 2013# All right$ re$er%ed


22/42

M$in e6ent ut.-e

.alidation o& J o& the te$t ca$e$in TS 103 189

A num)er o& gap$ and potentialimpro%ement$ in TS 103 189 ha%e)een identi+ed

A ne' 'or( item ha$ )een open &orthe update o& TS 103 189 'ith thene' $etupE acou$tic-to-electricalidenti+ed during the e%ent

TS 103 189 ha$ )een pu)li$hed andi$ a%aila)le on the "TSI portal



23/42Maputo - Moam)iDue - 1 - 1 April 20123

Fu!t2e! te& "it2 !e*$!% t ETSI TS= =@

.eri+cation o& remaining %oice Dualit* te$tca$e$ t)d

.eri+cation o& %ideo Dualit* te$t ca$e$=5T-)a$ed %ideo $treaming>@ Te$t hou$e$ 'illing to do $o are needed

"ten$ion o& %ideo Dualit* te$t ca$e$

to'ard$ M"G-


24/42

: ? VLTE QS Ae-ent Te.2nl*E6$lu$tin e6ent ? tet !eult



25/42

: ? VLTE QS Ae-ent Te.2nl*E6$lu$tin e6ent ? tet !eult



26/42

Ve!i/.$tin , 6i%e 7u$lit tet .$e(RTP'$e% 6i%e t!e$-in*)

What 'e are loo(ing &or

What are the parameter 'e 'ant tomea$ure

What are the tool$ epected


arameter$Co%ered )*

TS 183#189

test tools

foc&sed on

video '&alit(

Prototi"i)ation

and validation


27/42

Cut-e! &e!.e&tin KPI


*treamin+,-..P /o&.&be sessions incl&ded0

N&mber of streamin+ sessions

Avera+e d&ration of streamin+sessions

Avera+e *treamin+ .hro&+h"&t

Pea *treamin+ .hro&+h"&t

*et&" *treamin+ .ime

*treamin+ 1ro""ed *essions*treamin+ navailabilit(

e&fferin+ .ime d&rin+ *treamin+

*treamin+ *(nchroni)ation

Pacet loss rate

atenc(

itter

8* A&dio:;ideo


28/42

Net"!# KPI;KQI

Dhilabs 2$#4E Confidential Information09;09;1L 2%


29/42

Ne9t te&

Get comment$ on TS 103189

"tend TS 103 189addiming more Cu$tomer

erception PI$Get propo$al &rom .ideo

Te$t ou$e$

Net e%ent 'ill )e

launched 'hen .o/T"Nati%e and$et and ".,tool$ 'ill )e a%aila)le &orte$ting

29


30/42

Contact


31/42

TC INT TERMS OF REFERENCE

3# ! "TSI 2013# All right$ re$er%ed

TC INT (C!e Net"!# $n%


32/42

TC INT (C!e Net"!# $n%Inte!&e!$'ilit Tetin*) Te!- ,Re,e!en.e

T2e .&e , INT in.lu%e@

To coordinate$ interopera)ilit* eort$ 'ithother organi$ation$ GSMAE MAE IMS;NGN

ForumE IMTCE etc#

"ndor$ement o& te$t $peci+cation$ &rom;toother S


33/42

ETSI INT SPECIFICATIONS

Inte!&e!$'ilit + Pe!,!-$n.e + Se.u!it $n% Cn,!-$n.e


TC INT I t 'ilit S i/ ti


34/42

TC INT Inte!&e!$'ilit S&e.i/.$tinW!#

2008 2009 2010 2011 2012

R6

R1 R2

R7 Late R7

Late R2

R8 R9 R10

2007

TS 186 011

V 1.1.1TS 186 011

V 2.1.1

TS 186 011

V 2.2.1

TS 186 011

V 3.1.1

TS 102 901

V 1.1.1

TS 186 011

V 4.1.1

TS 102 901

V 2.1.1

TS 103 129

TS 186 011

V 5.0.2

TS 102 901

V 5.0.6

TS 103 129

V2.0.4

2013

E2NA

34 "TSI;6A59?01


35/42

Cn,!-$n.e Tet S&e.i/.$tin

IMS 6a$ic Call Speci+cation$ and Supplementar*Ser%ice$


36/42

Inte!&e!$'ilit Tet S&e.i/.$tin

IMS NNI Inter'or(ingTe$t Speci+cation$ TS18 011

5CS TS 102 901

IMS"Cinteropera)ilit* TS103 129

"TSI;6A59?0136

IMS Inte!"!#in*Tet S&e.i/.$tin

IMS Inte!.nne.tinTet S&e.i/.$tin


37/42

INTEROPERABILITY EVENTS



38/42

Inte!&e!$'ilit e6ent

200J The +r$t e%ent eamined interconnection a$pect$ o&3G IMS 5elea$e E including )a$ic call on the M' inter&ace#

2008 - The $econd e%ent had a 'ider $cope that included thete$ting o& 3G IMS 5elea$e J inter'or(ingE roamingE )ordercontrolE and integration o& application $er%er$ eecuting$elected Multimedia Telephon* $upplementar* $er%ice$#

2009 - The third "TSI IMS e%ent a$$e$$ed the interopera)ilit*a$ 'ell a$ con&ormance o& IMS core net'or($ =compo$ed o&;I;S-CSCFE I6CFE ASE 'hich are implemented onthe )a$i$ o& "TSI TS 12 229;3G TS 2#229 =.er$ion J#1#0>=3G late relea$e J>#

2012 5CS.o/T" interopera)ilit* e%ent in cooperation 'ithGSMA and MSF held in Pran4 =Slo%enia> and 6ei4ng =China>

"TSI;6A59?013%


39/42

P!e C6e!$*e1 RCS VLTE Tet E6ent

=.*I:A1,#3094F$4#39

:


40/42

:


41/42

:


42/42

:

Documents

Towards Quality and QOS Assessment for VoLTE -IMSWF.ppt