3GPP TR 26.975

8/12/2019 3GPP TR 26.975

1/63

3GPP TR 26.975 V11.0.0 (2012-09)Technical Report

3rd Generation Partnership Project;Technical Specification Group Services and System Aspects;

Performance characterization of theAdaptive Multi-Rate AMR! speech codec

Release ""!

The present document has been developed within the 3rdGeneration Partnership Project (3GPPTM) and may be further elaborated for the purposes of 3GPP.

The present document has not been subject to any approval process by the 3GPP Orani!ational Partners and shall not be implemented.

This "pecification is provided for future development wor# within 3GPP only. The Orani!ational Partners accept no liability for any use of this"pecification.

"pecifications and reports for implementation of the 3GPPTMsystem should be obtained via the 3GPP Orani!ational Partners$ Publications Offices.

8/12/2019 3GPP TR 26.975

2/633GPP

%eywordsUMTS, GSM, codec, LTE

3GPP

Postal address

3GPP support office address

650 Route des Luco!es - So"#$ %&t"o!s

V$!'o&&e - R%*ETe!.+ 33 92 9 2 00 $+ 33 93 65 7 16

&nternet

#tt"+//.3"".o

Copyright Notification

'o part may be reproduced ecept as authori!ed by written permission.The copyriht and the foreoin restriction etend to reproduction in all media.

*+,*- 3GPP Orani!ational Partners (/&0- T&"- 11"- 2T"&- TT- TT1).ll rihts reserved.

MT"4 is a Trade Mar# of 2T"& reistered for the benefit of its members

3GPP4 is a Trade Mar# of 2T"& reistered for the benefit of its Members and of the 3GPP Orani!ational Partners5T24 is a Trade Mar# of 2T"& currently bein reistered for the benefit of its Members and of the 3GPP

Orani!ational PartnersG"M6 and the G"M loo are reistered and owned by the G"M ssociation

3GPP TR #$%&'( )""%*%* #*"#-*&!#Release ""

8/12/2019 3GPP TR 26.975

3/63

*o&te&ts

1ontents....................................................................................................................................................3

7oreword...................................................................................................................................................8

, "cope......................................................................................................................................................9

* /eferences..............................................................................................................................................9

3 :efinitions and abbreviations.................................................................................................................;3., :efinitions..............................................................................................................................................................;

3.* bbreviations.........................................................................................................................................................;

< General...................................................................................................................................................=istory.......................................................................................................................................................=

8/12/2019 3GPP TR 26.975

4/63

Annex ):

AMR Characterization in 3G Channe"s.....................................................................*4

2., Overview of the 3G 1haracteri!ation Phase.....................................................................................8F7" Traffic 1>annel daptive 7ull rate "peechT1>F>" Traffic 1>annel daptive >alf rate "peech

T:M Time :ivision Multiple ccessT7O Tandem 7ree Operation

tMOP" true Million of Operations per "econds

T Typical rban at multipath propaation profile at #mBsA: Aoice ctivity :etector wMOP" weihted Million of Operations per "econds

7or abbreviations not iven in this clause- see G"M +,.+< H,I and 3GPP T/ *,.?+8 H*I.

Ge&e$!

.1 Poect sto8

3GPP

3GPP TR #$%&'( )""%*%* #*"#-*&!,Release ""

8/12/2019 3GPP TR 26.975

9/63

7ollowin the standardi!ation of the 27/ speech codec- the "MG* "peech 2pert Group ("2G) and especially the

"@"G ("peech @uality "tratey Group) were tas#ed by "MG to study possible strateies for the continuous

improvement of the end to end performances of the speech service in G"M networ#s. "2G was specifically as#ed toevaluate the opportunity to desin a robust 7ull /ate mode andBor an 2nhanced >alf /ate mode.

The "@"G report- presented to "MG in ,??9- recommended to start a oneFyear feasibility study of a MultiF/ate speech

codec capable to offer at the same time a /obust 7ull /ate mode and an 2nhanced >alf /ate mode providin wirelineDuality under low propaation error conditions%.

The feasibility study was completed in 3@?; and the results presented to "MGL*3. 0ased on the feasibility report-

"MG approved a new /?= or# &tem for the development of the daptive MultiF/ate (M/) "peech 1odec.

@ualification Phase was completed by the end of *@?= with the preFselection of 8 candidates amon the ,, proposals

received by "MG,,.

The selection tests too# place in the summer of ,??= and the results analy!ed in "MG,,L; in "eptember ,??=. "MG,,

reached a consensus on one solution and recommended to "MG to select the 2'", solution proposed by 2ricsson-'o#ia and "iemens as the basis of the M/ standard. This proposal was approved by "MGL*;.

The completion of the M/ development included a short optimi!ation phase restricted to the codec proponents

followed by an ehaustive Aerification and G"M 1haracteri!ation Phase whose results are reported in the main part ofthe present document.

"MG later approved two additional or# &tems for the selection of a 'oise "uppresser and the development of a

ideband etension of the M/ speech codec. The outcome of these or# &tems is not included in the presentdocument.

&n early ,???- 3GPP approved the selection of M/ as the mandatory speech codec. simplified characteri!ation in3G 1hannels was completed in *+++ and the #ey results included in nne 2 of the present document.

.2 ee o t#e %MR *o&ce"t

M/ is a MultiF/ate speech codec with the ability to operate at = distinct bit ratesE ,*-* ,+-* ;-?8 ;-/) which operate at a fied rate and constant error protection

level- the M/ speech codec offers the possibility to adapt the error protection level to the local radio channel andtraffic conditions. G"M system usin the M/ speech codec may select the optimum channel (half or full rate) and

codec mode (speech and channel bit rates) to deliver the best combination of speech Duality and system capacity. Thisfleibility provides a number of important benefitsE

F &mproved speech Duality in both halfFrate and fullFrate modes by means of codec mode adaptation i.e. by varyinthe balance between speech and channel codin for the same ross bitFrate

F The ability to trade speech Duality and capacity smoothly and fleibly by a combination of channel and codecmode adaptation this can be controlled by the networ# operator on a cell by cell basis

F &mproved robustness to channel errors under marinal radio sinal conditions in fullFrate mode. This increasedrobustness to errors and hence to interference may be used to increase capacity by operatin a tihter freDuency

reFuse pattern

F bility to tailor M/ operation to meet the different needs of operators

% The "2G report also proposed to evaluate and standardi!e the Tandem 7ree Operation of the G"M codecs and proposed the creation of a new

"T1- later called "MG,,- responsible for the end to end Duality of the speech service in G"M 'etwor#s.

3GPP

3GPP TR #$%&'( )""%*%* #*"#-*&!&Release ""

8/12/2019 3GPP TR 26.975

10/63

F Potential for improved handover and power control resultin from additional sinalin transmitted rapidly inF

band.

The MultiF/ate concept is adaptable not only in terms of its ability to respond to chanin radio and traffic conditionsbut also to be customi!ed to the specific needs of networ# operators. This allows the codec to be operated in many ways

of which three important G"M eamples areE

7ullFrate only for maimum robustness to channel errors. This additional robustness may be used to etend the

coverae in marinal sinal conditions- or to improve the capacity by usin a tihter freDuency reFuse- assuminhih M/ M" penetration.

>alfFrate only for maimum capacity advantae more than ,++N capacity increase achievable relative to 7/ or

27/ (i.e. same as eistin >/). "inificant Duality improvements relative to the eistin >/ will be iven for a

lare proportion of mobiles as a result of the codec mode adaptation to the channel conditions and ecellent

(wireline li#e) speech Duality in half rate mode for low error conditions.

Mied halfBfull rate operation allowin a tradeFoff between Duality and capacity enhancements accordin to the

radio and traffic conditions and operator priorities.

.3 u&cto&$! 4esc"to& & $ GSM S8ste:

The M/ speech codec includes a set of fied rate speech codecs modes for half rate and full rate operation- providin

the possibility to switch between the different modes as a function of the propaation error conditions. 2ach codecmode provides a different level of error protection throuh a dedicated distribution of the available ross bit rate

(**-= #bitBs in 7ull /ate and ,,-< #bitBs in >alf rate) between source codin and channel codin.

The actual speech rate used for each speech frame depends on the eistin radio channel conditions. codec adaptation

alorithm selects the optimi!ed speech rate (or codec mode) as a function of the channel Duality. The most robust codecmode is selected in bad propaation conditions. The codec mode providin the best Duality is selected in ood

propaation conditions. The codec adaptation relies on channel Duality measurements performed in the M" and thenetwor# and on in band information sent over the ir &nterface toether with the speech data.

The followin diaram shows the main information flows over the #ey system interfacesE

MS ;TS

U"!&< S"eec# 4$t$

*odec Mode =&dc$to& (for uplink)

Suested *odec Mode (for downlink)

4o&!&< S"eec# 4$t$

*odec Mode =&dc$to& (for downlink)

*odec Mode *o::$&d (for uplink)

*odec

%d$"t$to&

*odec

%d$"t$to&

SP4

SP4 SPE

SPE *E

*E

*4

*4

*E+ *#$&&e! E&code

*4+ *#$&&e! 4ecode

SPE+ S"eec# E&code

SP4+ S"eec# 4ecode

TR%U

&n both directions- the speech data frames are associated with a 1odec Mode &ndication used by the receivin end to

select the correct channel and source decoders. &n the networ#- the 1odec Mode &ndication must also be sent to theTranscoder nits so that the correct source decodin is selected.

3GPP

3GPP TR #$%&'( )""%*%* #*"#-*&!"*Release ""

8/12/2019 3GPP TR 26.975

11/63

7or the adaptation of the uplin# codec mode- the networ# must estimate the channel Duality- identify the best codec for

the eistin propaation conditions and send this information to the M" over the ir &nterface (1odec Mode 1ommand

:ata field).

7or the downlin# codec adaptation- the M" must estimate the downlin# channel Duality and send to the networ# a

Duality information- which can be mapped in the networ# to a $suested$ codec mode.

&n theory- the codec mode can be chaned every speech frame. &n practice- because of the propaation delays and

necessary filterin in the codec adaptation functions- the codec mode should be adapted at a lower rate.

2ach lin# may use a different codec mode but it is mandatory for both lin#s to use the same channel mode (either full

rate or half rate).

The channel mode is selected by the /adio /esource manaement function in the networ#. &t is done at call set up or

after a handover. The channel type can further be chaned durin a call as a function of the channel conditions.

The #ey characteristics of the selected M/ solution areE

F = codec modes in 7ull /ate mode includin the G"M 27/ and &",39 27/.

F 9 codec modes in >alf /ate mode (also supported in 7ull /ate)- includin the &",39 27/.

F Possibility to operate on a set of up to < codec modes selected at call set up or handover.

F 1odec Mode &ndications multipleed with the plin# 1odec Mode 1ommand and "uested :ownlin# 1odec

Mode every other frame.

F &n band sinalin based on a * bits information field sent every other bloc# coded over the ir &nterface.

The full set of codec modes is listed in the followin tableE

Tale +%3%". AMR Speech /odec Modes

/hannel Source codec it-rate

12.2

8/12/2019 3GPP TR 26.975

12/63

F The transparence to :TM7 tones-

F The transparence to networ# sinalin tones

F The performances special input sinalsF The lanuae and tal#er dependency

F The freDuency responseF The transmission delay

F The compleity

nne 0 lists the reference contributions used in these sections.

3GPP

3GPP TR #$%&'( )""%*%* #*"#-*&!"#Release ""

8/12/2019 3GPP TR 26.975

13/63

5 >u$!t8 & *!e$& S"eec# $&d Eo *o&dto&s

The codec performances in clean speech and error conditions were measured in 2periment ,a (7ull /ate) and ,b (>alf/ate) of the G"M 1haracteri!ation phase of testin. The clean speech performance reDuirements were set for the best

codec mode in each error condition as defined in the followin tableE

Tale (%". est /odec Performance Re4uirements in /lean Speech and 5rror /onditions

/16 2ull Rateest /odecperformancere4uirement

0alf Rateest /odecperformancere4uirement!

o Eos ER o Eos G.72? @12A &oeos

19 d; ER o Eos G.72? @12A &oeos

16 d; ER o Eos G.72? @12A &oeos

13 d; ER o Eos R $t 13 d;10 d; G.72? @12A o

EosR $t 10 d;

7 d; G.72? @12A oEos

R $t 7 d;

d; ER $t 10 d; R $t d;

summary of the essential test results is provided below. dditional results are included in nne 1.

The followin fiures provide a raphical representation (in Mean Opinion "cores) of the M/ performances in clean

speech in 7ull /ate mode%. 7iure 8., compares the performance recorded for the best M/ full rate codec mode foreach impairment condition- with the correspondin performance of 27/ and the related M/ project performance

reDuirement.

Experiment 1a - Test Results

1.0

2.0

3.0

.0

5.0

Conditions

M !

Se!. ReBu.

%MR-R

ER

Se!. ReBu. .01 .01 .01 3.65

%MR-R .06 .06 .13 .0? 3.96 3.59 2.66

ER .01 .01 3.65 3.05 1.53

o Eos */=C16 d; */=C13 d; */=C10 d; */=C 7 d; */=C d; */=C 1 d;

2i7ure (%". AMR full rate1clean speech performances curveest AMR /odec vs% 52R vs% Performance Re4uirements!

7iure 8.* shows the performances recorded for all = M/ full rate codec modes in clean speech and error conditions.

'ortant 8ote:MO" values are provided in these fiures for infor'ation on",. Mean Opinion "cores can only berepresentative of the test conditions in which they were recorded (speech material- speech processin- listenin

% &n these fiures- the performance of 27/ at ,3 d0 was arbitrarily set to the performance of 27/ in 'o 2rrors conditions.

3GPP

3GPP TR #$%&'( )""%*%* #*"#-*&!"3Release ""

8/12/2019 3GPP TR 26.975

14/63

conditions- lanuae- and cultural bac#round of the listenin subjects). 5istenin tests performed with other

conditions than those used in the M/ 1haracteri!ation phase of testin could lead to a different set of MO" results.

On the other hand- the relative performances of different codec under tests is considered more reliable and less impactedby cultural difference between listenin subjects. 7inally- it should be noted that a difference of +.* MO" between two

test results was usually found not statistically sinificant.

Experiment 1a - Test Results

1.0

2.0

3.0

.0

5.0

Conditions

M !

E(R12.210.27.957.6.75.9

5.15.75

E(R .01 .01 3.65 3.05 1.53

12.2 .01 .06 .13 3.93 3. 1.6

10.2 .06 3.96 .05 3.?0 2.0

7.95 3.91 .01 .0? 3.96 3.26 1.3

7. 3.?3 3.9 3.9? 3.? 3.11 1.39

6.7 3.77 3.?0 3.?6 3.29 1.?7

5.9 3.72 3.69 3.59 2.20

5.15 3.50 3.5? 3. 2.3

.75 3.50 3.52 3.3 2.66

)o Eos */=C16 d; */=C13 d; */=C10 d; */=C 7 d; */=C d; */=C 1 d;

2i7ure (%#. 2amily of curves for 58periment "a /lean speech in 2ull Rate!

The M/ 1haracteri!ation test results showed that the selected solution satisfies the M/ reDuirements in clean

speech in 7ull /ate 1hannel. The previous results demonstrate that the combination of all = speech codec modes

provide a robust 7ull /ate speech codec down to < d0 1B&.

The results also showed that the four hihest codec modes (,*.*- ,+.*- ;.?8 and ;.

8/12/2019 3GPP TR 26.975

15/63

Experiment 1" - Test Results

1.0

2.0

3.0

.0

5.0

Conditions

M !

Se!. ReBu.

%MR-R

E(R

(R

R

Se!. ReBu. 3.99 3.99 3.99 3.1 2.7 1.50

%MR-R .11 .0 3.96 3.72 3.3? 3.10 2.00

E(R .21 .21 3.7 3.3 1.5?

(R 3.50 3.50 3.1 2.7 1.50

R 3.35 3.2 2.?0 1.92

)o Eos */=C19 d; */=C16 d; */=C13 d; */=C10 d; */=C 7 d; */=C d;

2i7ure (%3. AMR half rate1clean speech performances curveest AMR /odec vs% 52R vs% GSM 2R vs% GSM 2R vs% Performance Re4uirements!


1.0

2.0

3.0

.0

5.0

Conditions

M !

E(R7.957.6.75.95.15.75(RR

E(R .21 .21 3.7 3.3 1.5?

7.95 .11 .0 3.96 3.37 2.53 1.60

7. 3.93 3.93 3.95 3.52 2.7 1.7?

6.7 3.9 3.90 3.53 3.10 2.22 1.21

5.9 3.6? 3.?2 3.72 3.19 2.57 1.33

5.15 3.70 3.60 3.60 3.3? 2.?5 1.?

.75 3.59 3.6 3.2 3.30 3.10 2.00

(R 3.50 3.50 3.1 2.7 1.50

R 3.35 3.2 2.?0 1.92

)o Eos */=C19 d; */=C16 d; */=C13 d; */=C10 d; */=C 7 d; */=C d;

2i7ure (%+. 2amily of curves for 58periment " /lean Speech in 0alf Rate!

The M/ 1haracteri!ation test results showed that the selected solution complies with the M/ reDuirements in cleanspeech in >alf /ate 1hannel. The results demonstrate that the combination of all 9 speech codec modes provide a >alf

/ate speech codec eDuivalent to the &T T /ecommendation G.;*= H,*I (,9 #bitBs) speech codec down to ,9 d0 1B&.7urthermore- the results show that M/ can provide sinificantly better performances than G"M 7/ in the full rane of

test conditions- and sinificantly better performances than the G"M >/ codec down to ; d0 1B&.

The four hihest codec modes (;-?8 ;-

8/12/2019 3GPP TR 26.975

16/63

6 >u$!t8 u&de '$c

8/12/2019 3GPP TR 26.975

17/63


1.0

2.0

3.0

.0

5.0

)o Eo s */=C16 d; */=C13 d; */=C10 d; */=C 7 d; */=C d; */=C 1 d;

Conditions

#M!

Se!. ReBu.

%MR-(R

E(R

(R

G.729

2i7ure $%#. AMR performance curves for 58periment 3 2ull rate :ith /ar oise!

Experiment 3c - Test Results

1.0

2.0

3.0

.0

5.0

)o Eo s */=C16 d; */=C13 d; */=C10 d; */=C 7 d; */=C d; */=C 1 d;

Conditions

#M!

Se!. ReBu.

%MR-(R

E(R

(R

G.729

2i7ure $%3. AMR performance curves for 58periment 3c 2ull rate :ith

8/12/2019 3GPP TR 26.975

18/63

The followin fiures provide a raphical representation (in Mean Opinion "cores) of the performances recorded in

>alf /ate in 2periments 3d- 3e and 3f3.

Experiment 3d - Test Results

1.0

2.0

3.0

.0

5.0

)o E os */=C19 d; */=C16 d; */=C13 d; */=C10 d; */=C 7 d; */=C d;

Conditions

#M!

Se!. ReBu.

%MR-R

E(R

(R

R

2i7ure $%+. AMR performance curves for 58periment 3d 0alf rate :ith Street oise!

Experiment 3e - Test Results

1.0

2.0

3.0

.0

5.0


Conditions

#M!

Se!. ReBu.

%MR-R

E(R

(R

R

2i7ure $%(. AMR performance curves for 58periment 3e 0alf rate :ith /ar oise!

3 &n these fiures- the performance of 27/ at ,3 d0 was arbitrarily set to the performances of 27/ in 'o 2rrors conditions.

3GPP

3GPP TR #$%&'( )""%*%* #*"#-*&!",Release ""

8/12/2019 3GPP TR 26.975

19/63

Experiment 3f - Test Results

1.0

2.0

3.0

.0

5.0


Conditions

#M!

Se!. ReBu.

%MR-R

E(R

(R

R

2i7ure $%$. AMR performance curves for 58periment 3f 0alf rate :ith / in the same test conditions.

'one of the codec modes is able to meet the initial project reDuirement at ,+ d0 1B&. ll codec modes are found worse

than the taret 7/ at ,+ d0 1B& in these conditions. This is the only critical failure recorded in the characteri!ationphase.

t ; d0 1B& and below the two lowest codec modes match or eceed the performances of the G"M 7/ and G"M >/.

7 Peo:$&ces & T$&de:& $&d t# $$to& o t#e&"ut s"eec# !ee!

2periment * and 2periment 9 of the G"M 1haracteri!ation Test plan were intended to evaluate the performances ofthe M/ 1odec modes in selfFtandemin and crossFtandemin and with variation of the input speech level.

n overview of the correspondin results is provided in the followin fiuresE

Experiment $ - Test Results

1.00

1.50

2.00

2.50

3.00

3.50

.00

.50

12.2 10.20 7.95 7.0 6.70 5.9 5.15 .75

M !

4ectT$&d. /12.2-E(RT$&d. /10.2T$&d. /7.95T$&d. /7.T$&d. /6.7T$&d. /5.9T$&d. /5.15T$&d. /.75T$&d. /(RT$&d. /R

2i7ure '%". 58periment # Test Results cross-codec tandemin7!

3GPP

3GPP TR #$%&'( )""%*%* #*"#-*&!"&Release ""

8/12/2019 3GPP TR 26.975

20/63

Experiment $ - Test Results

1.00

1.50

2.00

2.50

3.00

3.50

.00

.50

E(R (R R

M !

4ectT$&d. /12.2-E(RT$&de:T$&d. /10.2T$&d. /7.95T$&d. /7.T$&d. /6.7T$&d. /5.9T$&d. /5.15T$&d. /.75

2i7ure '%#. AMR /odec Tandemin7 performances :ith e8istin7 GSM /odecs

Experiment % - Test Results

1.00

1.50

2.00

2.50

3.00

3.50

.00

.50

E(R 12.2 10.20 7.95 7.0 6.70 5.9 5.15 .75

/odec

M

8/12/2019 3GPP TR 26.975

21/63

The #ey performances demonstrated by 2periment * test results areE

F Tandemin with the clean speech error free ,*.* and ,+.* modes of M/ do not sinificantly derade the sinle

encodin performances of any of the M/ codec or eistin G"M codecs.

F ny other tandemin confiuration involvin any two other M/ codecs introduce a sinificant deradation

when compared to the sinle encodin performances of any of the two codecs involved in the tandemconfiuration. This deradation is however less sinificant than a tandem confiuration involvin either the

G"M 7/ or the G"M >/.

F ll tandemin confiurations between two M/ speech codecs (ecept the worst confiuration 8.,8F/ in Tandem.

2periment 9 test results show that the different M/ speech codec were not sinificantly more impacted by the input

speech level than 27/. The hihest codec modes (,*.* down to ;.ysteresis used for the codec adaptation in the different confiurations are listed in the followin

tableE

Tale ,%#. /odec Mode Adaptation thresholds and 0ysteresis used in 58periment +a and +

Adaptation Thresholds and 0ysteresis for 58periment +a

Threshold"

0ysteresis"

Threshold#

0ysteresis#

Threshold3

0ysteresis3

Set>"

11,5 d; 2,0 d; 6,5 d; 2,0 d;

Set>#

11,5 d; 2,0 d;

Set>3

11,5 d; 2,0 d; 7,0 d; 2,0 d; 5,5 d; 2,0 d;

3GPP

3GPP TR #$%&'( )""%*%* #*"#-*&!#"Release ""

8/12/2019 3GPP TR 26.975

22/63

Adaptation Thresholds and 0ysteresis for 58periment +

Threshold"

0ysteresis"

Threshold#

0ysteresis#

Threshold3

0ysteresis 3

Set >" 15,0 d; 2,0 d; 12,5 d; 2,5 d; 11,0 d; 2,0 d;

Set ># 12,5 d; 2,0 d; 11,0 d; 2,0 d;Set >3 13,5 d; 2,0 d;

The results of 2periments

8/12/2019 3GPP TR 26.975

23/63

activated were always found sinificantly worse than their performances when ideal or nonFideal freDuency

hoppin was used.

F 'o sinificant difference was found when :TC was activated in the return lin# in either full rate or half ratemode.

F There was no sinificant difference between the three codec sets used in full rate or half rate modes- even whenthe set was limited to two codec modes.

9 V%4/4T Peo:$&ces

The objective of 2periment ; of the G"M characteri!ation test plan was to evaluate the deradation induced by theactivation of the voice activity detection and discontinuous transmission on the lin# under test %. The eperiment was

divided in < subFeperiments to separately test the effect on the 7ull /ate and >alf /ate channel operation and then theperformances of each A: alorithm (2'" solution and Motorola solution). The tests used a ;Fpoint 1omparison

1ateory /atin to amplify any possible deradation. They consisted in comparin a speech sample for which theA:B:TC has been applied with the same speech sample without A:B:TC but in the same channel errorBimpairment

condition. The ;Fpoint scale (1MO"F3 to K3) corresponded to Duality deradation defined asE $Much worse$- $orse$-

$"lihtly worse$- $bout the same$- $"lihtly better$- $0etter$ and $Much better$.

The followin impairment type were included in each eperiment and tested for multiple error conditions (alf /ate)E

F "inle encodin in clean speech at nominal input level

F "inle encodin in clean speech ,+ d0 below the nominal input level

F "inle encodin in clean speech ,+ d0 above the nominal input

F "inle encodin in street noise at ,8 d0 "'/

F Tandemin in street noise at ,8 d0

F "inle encodin in car noise at ,8 d0

F "inle encodin in office noise at *+.

The tests were performed with the adaptation turned on- usin the sets of codec modes L, of table 9.,. 'evertheless- astatic 1B& profile was used for all test conditions involvin propaation errors.

The tests also included a set of references usin the 27/ codec with the oriinal 27/ A: and the new M/ A:

alorithms in a subset of the impairment conditions- and the 7/ codec in clean speech with the oriinal 7/ A:. nullcondition was also included in the test.

ll test results with one eception showed that the activation of the M/ A:B:TC do not introduce any sinificantderadation to the performances of M/. The difference between the scores obtained by the different conditions were

below their respective ?8N confidence interval indicatin that the deradation is not sinificantly different for eitherimpairment type. The same results were found for both A: solutions. direct comparison between the two A:

options in paired eperiments (2periments ;a and ;c in 7ull /ate and 2periments ;b and ;d in >alf /ate) did notallow to differentiate their respective performances.

The only condition showin a sinificantly hiher deradation level in all tests performed was for the G"M 7/ codecwith its own A: alorithm. 2ven then- the score obtained by the 7/BA: codec association was not as bad as a bein

Dualified as $"lihtly worse$ (first deradation level in the ;Fpoint 1MO" scale). &t was in the order of the deradation ofa M'/ at 3+ d0 "B' compared with the oriinal speech sample.

% The influence of discontinuous transmission on the in band sinalin (mode command and Duality reportin) was tested in 2periment

8/12/2019 3GPP TR 26.975

24/63

10 Peo:$&ces t# 4TM to&es

Twelve eperiments were performed durin the verification phase to evaluate the transparency of the M/ codecmodes to :TM7 tones. The correspondin test conditions are listed in Table ,+.,. The eperiments were limited to

error free conditions only.

The freDuency deviation was set for the duration of a diit- and was randomly chosen between F,.8 and K,.8N. The

rane of tone levels was chosen to avoid clippin in the diital domain and to eceed the minimum acceptable input

level for the 5inemasterunit used for the detection of :TM7 tones.

set of ten codecs was tested in each eperiment- comprisin the eiht M/ modes- the fullFrate G"M speech codecand the Flaw codecs alone (direct condition).

Tale "*%". 58perimental conditions for the evaluation of the AMR /odecs Transparency to ?TM2Tones

58periment

@o:tonelevel

seenote!

0i7htonelevel

seenote!

T:ist ?i7itduration

2re4uencydeviation

1 -6 d;: -6 d;: 0 d; 50 :s &o&e

2 -16 d;: -16 d;: 0 d; 50 :s &o&e

3 -26 d;: -26 d;: 0 d; 50 :s &o&e

-16 d;: -16 d;: 0 d; 50 :s /- 1.5

5 -19 d;: -13 d;: -6 d; 50 :s &o&e

6 -13 d;: -19 d;: 6 d; 50 :s &o&e

7 -6 d;: -6 d;: 0 d; ?0 :s &o&e

? -16 d;: -16 d;: 0 d; ?0 :s &o&e

9 -26 d;: -26 d;: 0 d; ?0 :s &o&e

10 -16 d;: -16 d;: 0 d; ?0 :s /- 1.5

11 -19 d;: -13 d;: -6 d; ?0 :s &o&e

12 -13 d;: -19 d;: 6 d; ?0 :s &o&e

'OT2E The levels are iven as measured at the input to the :TM7 detector- however- since the :1 is calibrated

accordin to &TFT /ec. G.;,,- +d0m in the analoue section is eDuivalent to F9.,8d0ov in the diital

section.

#est se$ences:

7or each eperiment- *+ test seDuences were processed per codec under test. 2ach test seDuence was produced by the:TM7 enerator- and comprised a header ofx ms followed by each of the ,9 :TM7 diits as defined in

&TFT /ecommendation @.*3 H,9I. The ap between adjacent :TM7 diits was eDual to the duration of the diits (seeTable ,). The lenth of the header in seDuence number n- was set to

x*++Knmilliseconds where n+..,?.

This approach was ta#en to eercise the speech codecs over the complete rane of possible phase relationships between

the start of a :TM7 diit and a speech codec frame (*+ms in lenth). Thus each codec mode was subjected to 3*+separate diits per eperiment.

#est Proce!$re:

7or each test seDuence- the number of diits undetected by the :TM7 detector was recorded. 'o attempt to identify

misdetected diits was made- althouh there were no out of seDuence diits observed.

Res$"ts:

The percentae of undetected diits measured for each codec mode is iven in Table ,+.*a for 2periments , to 9

(8+ms diits)- and in Table ,+.*b for 2periments ; to ,* (=+ms diits).

3GPP

3GPP TR #$%&'( )""%*%* #*"#-*&!#+Release ""

8/12/2019 3GPP TR 26.975

25/63

Tale "*%#a. Percenta7e of ?TM2 di7its undetected :hen passed throu7h different codecs :ith (*ms?TM2 di7its% The mean value is calculated over all si8 e8periments%

/odecmode

Rate9it1s!

58p% " 58p% # 58p% 3 58p% + 58p% ( 58p% $ Mean

AMR mode*

.75 35.3 0.9 3?.1 1.3 50.0 3.? 1.6

AMR mode"

5.15 32.? 3?. 3.7 3?.? 52.5 37.5 39.1

AMR mode#

5.90 19.7 20.3 25.0 25.3 37.? 19.1 2.5

AMR mode3

6.70 7.? 7.? 10.6 ?.? 23. 6.3 10.?

AMR mode+

7.0 3.? 5.0 .7 .1 13.1 2.2 5.5

AMR mode(

7.95 0.3 1.3 1.3 2.2 9.7 0.6 2.6

AMR mode$

10.20 0.0 0.0 0.3 0.0 0.3 0.0 0.1

AMR mode'

12.20 0.0 0.0 0.0 0.0 0.0 0.0 0.0

2R GSM 13.00 0.0 0.0 0.3 0.0 0.6 0.0 0.2

?irect A-la:!

- 0.0 0.0 0.0 0.0 0.0 0.0 0.0

Tale "*%#. Percenta7e of ?TM2 di7its undetected :hen passed throu7h different codecs :ith ,*ms?TM2 di7its% The mean value is calculated over all si8 e8periments%

/odecmode

Rate9it1s!

58p% ' 58p% , 58p% & 58p%"*

58p%""

58p%"#

Mean

%MR :ode0

.75 21.3 2.7 27.5 26.9 35.9 26.6 27.1

%MR :ode

1

5.15 1?.1 21.3 25.9 22.? 33. 2?.1 2.9

%MR :ode2

5.90 ?.? 11.6 11.6 7.? 2.1 9. 12.2

%MR :ode3

6.70 1.6 1.6 2.5 2.5 5.9 3.? 3.0

%MR :ode

7.0 0.0 0.0 0.3 0.6 2.2 0.3 0.6

%MR :ode5

7.95 0.0 0.0 0.0 0.0 1.9 0.3 0.

%MR :ode6

10.20 0.0 0.0 0.0 0.0 0.0 0.0 0.0

%MR :ode7

12.20 0.0 0.0 0.0 0.0 0.0 0.0 0.0

R GSM 13.00 0.0 0.0 0.0 0.0 0.0 0.0 0.0

4ect (%-!$)

- 0.0 0.0 0.0 0.0 0.0 0.0 0.0

($rther o2servations:

&nspection of the results for the M/ speech codecs reveals notably worse performance for :TM7 sinals enerated

with neative twist. To eliminate the :TM7 detector as the cause of this effect- subsets of 2periments 8 and 9 wererepeated usin a proprietary networ# based :TM7 detection alorithm. These additional eperiments also showed

substantially worse performance in the presence of neative twist.

n analysis of the processed files revealed that for :TM7 diits enerated with neative or !ero twist- the M/ speech

codecs have a tendency to add additional neative twist to the sinal. This effect is more pronounced for the lower ratespeech codecs.

3GPP

3GPP TR #$%&'( )""%*%* #*"#-*&!#(Release ""

8/12/2019 3GPP TR 26.975

26/63

Conc"$sions:

The results for the fullFrate G"M speech codec appear to be consistent with results from previous tests. 'o detection

errors were measured for the reference Flaw condition.

7or 8+ms :TM7 diits- the ,+-* and ,*-* #bitBs M/ modes appear to be essentially transparent to :TM7 sinals

under error free conditions- whereas the lower rate modes do not appear to be transparent.

7or =+ms :TM7 diits the ;-

8/12/2019 3GPP TR 26.975

27/63

#est con!itions

The sinalin tones at a level of F,+ d0m+ were tested under clean error conditions with no adaptation activated and

fiin the codec mode to the = different possible modes. The sinalin tones were also tested with adaptation on- understatic errors with 1B& ; d0.

This was tested for :TC off and :TC on.

The German sinalin tones at a level of F,8 d0m+ were only tested under clear channel conditions with :TCactivated. This was done to ensure that the artifact identified for the 7/ speech codec with low level sinalin tones and

:TC did not appear in the case of M/.

#est res$"ts

The testin has been performed by informal listenin involvin trained listeners- their main concern bein to reconi!e

the sinalin tones.

The test results can be summari!ed as followsE

,) 'o sinificant difference was perceived between the tests performed with :TC O' and those performed with:TC O77.

*) 7or the error free conditionsE the decoded tones were always easily reconi!ed. Ret the perceived Duality wasfound to decrease when the codec rate decreases and for the two lowest bit rates (alf /ate mode- the result was rather poor for the whole set of tones. &n 7ull /ate

mode- the Duality was found acceptable with a sliht deradation for the two dial tones. 'ote that the effect oferrors was perceived for both channel modes- but more limited and clustered in some parts of the sinal in 7ull

/ate mode.

Conc"$sion

lthouh the Duality of networ# sinalin tones is audibly decreasin for lower bit rates and especially in presence of

channel errors in >alf /ate mode- the sinalin tones were always easily reconi!ed under all testin conditions.dditionally- :TC activation did not create any deradation of the transparency of the M/ codec towards sinalintones. This conclusion is still valid for low amplitude sinalin tones.

12 Peo:$&ces t# s"ec$! &"ut s&$!s

The behavior of the M/ speech codec in presence of multiple Jspecial input sinalsJ was tested durin theAerification Phase. These tests includedE

Overload conditions

dditional bac#round 'oises and Tal#ers

Music sinals

&dle channel behavior.

&n informal epert listenin tests- coverin a wide rane of overload levels and error conditions- there was no evidence

to suest that the M/ speech channel ehibits any sinificant problems- such as ross instability- in the presence ofoverload sinals.

"imilarly- tests in presence of multiple types of bac#round noises or with a hiher number of tal#ers did not ehibit

any problem with any of the M/ speech codec modes.

The tests in presence of Music indicated that the M/ speech codec did not ehibit any problem when compared to the

behavior of other wellF#nown speech codecs (27/- &"F9

8/12/2019 3GPP TR 26.975

28/63

13 L$&u$e 4e"e&de&c8

The selection and characteri!ation tests were performed by a lare number of laboratories worldwide usin differentlanuaes (see nne ). Tests were performed inE

2nlish (" and %)- 7rench- German- &talian- Mandarin- "panishThe results reported by the different laboratories were consistent. 'o sinificant Duality difference was identified

between the results reported by the different listenin laboratories for the different M/ 1odec Modes.

1 T$&s:sso& 4e!$8

The transmission delay of a G"M communication usin M/ has been evaluated usin the same method as for the

previous G"M speech codecs H*- 3 and

8/12/2019 3GPP TR 26.975

29/63

TencodeE Processin delay reDuired to perform the channel encodin (implementation dependent). :epends

on the channel codin compleity of each codec mode.

Tmsc "witchin delay in the M"1 (implementation dependent). "et to +.8ms H* and alf /ate mode H* and / /T: increased by ,+ ms in >alf /ate mode.

% This 2"P value was derived in ,??9- durin the 27/ standardi!ation. &t is based on a ! :"P- with an efficiency of , and a 9+N 1P

availability. ll processin delays would be improved assumin :"P performances correspondin to the state of the art of :"P technoloy.

3GPP

3GPP TR #$%&'( )""%*%* #*"#-*&!#&Release ""

8/12/2019 3GPP TR 26.975

30/63

Tables ,

8/12/2019 3GPP TR 26.975

31/63

Tale "+%3. plin9 Transmission ?elay in 2ull Rate Mode in ms and "$ 9it1s su-multiple8in7scheme!

UL R 16 and :P11> is iven in H=I.

spreadin factor of 9< implies slot format L* to be used for the :P:1> and a spreadin factor of ,*= implies slot

format L, to be used for the :P:1>. 7or :P11>- nonFcompressed frame formats and no :5 transmitter diversityimply to use slot format L+E the frame structure is 9 pilot bits K * T71& K * TP1.

Gain (actors: The ain factor is the power offset between the :P11> (which carries the control bits such as the Pilot

bits- T71&- TP1- etc.) and the :P:1> (which carries the user data and the T/' sinallin). This difference of

power comes from the difference between spreadin factors.

The ain factor for :P11> is ,, and the ain factor for :P:1> is ,8.

nterferences: #here was no MA in "in=D however an A6G8 channe" was $se!.

E.2.3 4o&!&- of either 3.< or ,.; #bitBs dependin on the spreadin factor- shared the :P:1> with the Tr1>

carryin the voice.

S"ot (or'at: spreadin factor of ,*= and *89- which depends on source bitFrate- and nonFcompressed frame format

imply slot format L,* to be used for :P1> includin both :P:1> and :P11>. The frame structure for :P11> is and :P11> for :5. This means there is no power offsetbetween them.

nterferencesE 1hannel settin defined in Table 1.3 of H?I is used for :5.

E.3 %MR 3G *#$$cteJ$to& Test Resu!ts & *!e$&S"eec#

The followin diarams present the raw test results of 2periments ,a- ,b and ,c- for the different path profiles and

taret 72/ tested in these eperiments. The performances are presented as a function of the taret 72/. s in nne :-

the performances are usually showin no sinificant deradation of the speech Duality down to ,N 72/. &t is to benoted that the shown performance deradation for modes M/,*.* and M/,+.* is worse than can be epected with

more appropriate @o" attributes for class 1 bits.

3GPP

3GPP TR #$%&'( )""%*%* #*"#-*&!($Release ""

8/12/2019 3GPP TR 26.975

57/63

'MR-N. 3G Characteri,ation - Exp1a - English

Clean !peech - /plin0 ehicular 20m4h Profile

1.0

2.0

3.0

.0

5.0

0.00 0.50 1.00 3.00 (ER

M!

G.726L32 )o Eos=S-127 )o EosG.729 ? )o EosG.723.1 6.3 )o Eos

E(R )o EosE(R L10d;E(R L7d;GSM (R )o Eos%MR5.15%MR12.2

%MR7.95%MR6.7

2i7ure 53-". AMR 3G /haracterization 58p% "a Test Results I /lean Speech I plin9 )ehicular- (*9m1h Profile


Clean !peech - #o5nlin0 ehicular 1$0m4h Profile

1.0

2.0

3.0

.0

5.0

0.00 0.50 1.00 3.00 (ER

M!

G.726L32 )o Eos=S-127 )o Eos

G.729 ? )o EosG.723.1 6.3 )o EosE(R )o Eos

E(R L10d;E(R L7d;GSM (R )o Eos

%MR5.15%MR12.2%MR7.95%MR6.7

2i7ure 53-#. AMR 3G /haracterization 58p% "a Test Results I /lean Speech I ?o:nlin9 )ehicular-"#* 9m1h Profile

3GPP

3GPP TR #$%&'( )""%*%* #*"#-*&!('Release ""

8/12/2019 3GPP TR 26.975

58/63


Clean !peech - /plin0 Pedestrian 30m4h Profile

1.0

2.0

3.0

.0

5.0

0.00 0.50 1.00 3.00 (ER

M!

G.726L32 )o Eos=S-127 )o EosG.729 ? )o EosG.723.1 6.3 )o EosE(R )o EosE(R L10d;E(R L7d;GSM (R )o Eos

%MR.75%MR10.2%MR7.

%MR5.9

2i7ure 53-3. AMR 3G /haracterization 58p% "a Test Results I /lean Speech I plin9 Pedestrian- 39m1h Profile

'MR-N. 3G Characteri,ation - Exp1" - 6orean

Clean !peech - #o5nlin0 ehicular 20m4h Profile

1.0

2.0

3.0

.0

5.0

0.00 0.50 1.00 3.00 (ER

M!

G.726 32 )o Eos

=S-127 )o EosG.729 ? )o EosG.723.1 6.3 )o Eos

E(R )o EosE(R L10d;

E(R L7d;GSM (R )o Eos%MR5.15%MR12.2%MR7.95%MR6.7

2i7ure 53-+. AMR 3G /haracterization 58p% " Test Results I /lean Speech I ?o:nlin9 )ehicular-(* 9m1h Profile

3GPP

3GPP TR #$%&'( )""%*%* #*"#-*&!(,Release ""

8/12/2019 3GPP TR 26.975

59/63


Clean !peech - /plin0 7ndoor 30m4h Profile

1.0

2.0

3.0

.0

5.0

0.00 0.50 1.00 3.00(ER

M!

G.726 32 )o Eos=S-127 )o EosG.729 ? )o EosG.723.1 6.3 )o EosE(R )o EosE(R L10d;

E(R L7d;GSM (R )o Eos%MR.75%MR10.2%MR7.%MR5.9

2i7ure 53-(. AMR 3G /haracterization 58p% " Test Results I /lean Speech Iplin9 6ndoor-A 3 9m1hProfile


Clean !peech - #o5nlin0 Pedestrian 30m4h Profile

1.0

2.0

3.0

.0

5.0

0.00 0.50 1.00 3.00 (ER

M!

G.726 32 )o Eos=S-127 )o EosG.729 ? )o EosG.723.1 6.3 )o EosE(R )o Eos

E(R L10d;E(R L7d;GSM (R )o Eos%MR.75%MR10.2%MR7.

%MR5.9

2i7ure 53-$. AMR 3G /haracterization 58p% " Test Results I /lean Speech I ?o:nlin9 Pedestrian-3 9m1h Profile

3GPP

3GPP TR #$%&'( )""%*%* #*"#-*&!(&Release ""

8/12/2019 3GPP TR 26.975

60/63

'MR-N. 3G Characteri,ation - Exp1c - 8apanese

Clean !peech - /plin0 ehicular 1$0m4h Profile

1.0

2.0

3.0

.0

5.0

0.00 0.50 1.00 3.00 (ER

M!

G.726 32 )o Eos=S-127 )o EosG.729 ? )o EosG.723.1 6.3 )o Eos

E(R )o EosE(R L10d;E(R L7d;

GSM (R )o Eos%MR5.15%MR12.2%MR7.95

%MR6.7

2i7ure 53-'. AMR 3G /haracterization 58p% "c Test Results I /lean Speech I plin9 )ehicular- "#*9m1h Profile


Clean !peech - #o5nlin0 7ndoor 30m4h Profile

1.0

2.0

3.0

.0

5.0

0.00 0.50 1.00 3.00 (ER

M!

G.726 32 )o Eos=S-127 )o EosG.729 ? )o EosG.723.1 6.3 )o EosE(R )o EosE(R L10d;E(R L7d;GSM (R )o Eos%MR5.15%MR12.2%MR7.95%MR6.7

2i7ure 53-,. AMR 3G /haracterization 58p% "c Test Results I /lean Speech I ?o:nlin9 6ndoor-A 39m1h Profile

3GPP

3GPP TR #$%&'( )""%*%* #*"#-*&!$*Release ""

8/12/2019 3GPP TR 26.975

61/63


Clean !peech - /plin0 Pedestrian 30m4h Profile

1.0

2.0

3.0

.0

5.0

0.00 0.50 1.00 3.00(ER

M! G.726 32 )o Eos=S-127 )o EosG.729 ? )o EosG.723.1 6.3 )o EosE(R )o EosE(R L10d;E(R L7d;

GSM (R )o Eos

%MR.75%MR10.2%MR7.%MR5.9

2i7ure 53-&. AMR 3G /haracterization 58p% "c Test Results I /lean Speech I plin9 Pedestrian-A 39m1h Profile

E. %MR 3G *#$$cteJ$to& Test Resu!ts & *$ ose

The followin diarams present the raw test results of 2periment * for the different path profiles and taret 72/ testedin this eperiment. The performances are presented as a function of the taret 72/. ain- and as in nne :- the

performances are usually showin no sinificant deradation of the speech Duality down to ,N 72/. &t is to be noted

that the shown performance deradation for modes M/,*.* and M/,+.* is worse than can be epected with moreappropriate @o" attributes for class 1 bits.

'MR-N. 3G Characteri,ation - Exp$ - EnglishCar Noise - #o5nlin0 Pedestian 30m4h Profile

1.0

2.0

3.0

.0

5.0

0.00 0.50 1.00 (ER

#M!

G.729 ? o Eos

G.723.1 6.3 o Eos

GSM ER o Eos

ER 10d;

ER 7d;

%MR.75

%MR10.2

%MR7.

%MR5.9

2i7ure 5+-". AMR 3G /haracterization 58p% # Test Results I "( d SR /ar oise I ?o:nlin9Pedestrian- 3 9m1h Profile

3GPP

3GPP TR #$%&'( )""%*%* #*"#-*&!$"Release ""

8/12/2019 3GPP TR 26.975

62/63

'MR-N. 3G Characteri,ation - Exp$ - English

Car Noise - /plin0 ehicular 20m4h Profile

1.0

2.0

3.0

.0

5.0

0.00 0.50 1.00 (ER

#M!

G.729 ? )o Eos

G.723.1 6.3 )o Eos

GSM E(R )o Eos

E(R L10d;

E(R L7d;

%MR5.15

%MR12.2

%MR7.95

%MR6.7

2i7ure 5+-#. AMR 3G /haracterization 58p% # Test Results I "( d SR /ar oise I plin9 )ehicular-A (* 9m1h Profile

'MR-N. 3G Characteri,ation - Exp$ - English

Car Noise - /plin0 ehicular 1$0m4h Profile

1.0

2.0

3.0

.0

5.0

0.00 0.50 1.00 (ER

#M!

G.729 ? )o Eos

G.723.1 6.3 )o Eos

GSM E(R )o Eos

E(R L10d;

E(R L7d;

%MR10.2

%MR7.

%MR5.9

2i7ure 5+-3. AMR 3G /haracterization 58p% # Test Results I "( d SR /ar oise I plin9 )ehicular- "#* 9m1h Profile

Reee&ces to %&&e E+H2,I 3GPP T" *9.,+*E VM/ speech codec &nterface to &u and uW- Aersion 3.3.+

H2*I 3GPP T"GF"< Tdoc "

8/12/2019 3GPP TR 26.975

63/63

%&&e +*#$&e #sto8

/han7e history?ate TSG > TSG ?oc% /R Rev Suject1/omment

Documents

3GPP TR 26.975