ITU-T Study Group 12: Structures and Guide for University Participants Sebastian Möller (with the support from Jean-Yves Monfort, ITU-T SG12 Chairman)

ITU-T Study Group 12: Structures andGuide for University Participants Sebastian Möller(with the support from Jean-Yves Monfort, ITU-T SG12 Chairman)

Quality and Usability Lab, Deutsche Telekom Laboratories

TU Berlin, Germany

[email protected]

2

Overview

Structure of ITU-T Study Group 12 – General structure of the ITU-T– Study Group 12– Documents, etc.

Quality assessment and prediction for voice services

3

General Secretariat: Coordinates the Union's activities and the overall management of the Union

ITU-T: Telecommunication standardization on a world-wide basis on technical, operating and tariff Questions

ITU-R: Radio communications and wireless ITU-D: Use and deployment of telecom networks

and services in the developing nations

Plenipotentiary Conference

ITU Council

ITU-TWorld

Telecommunication Standardization

Assembly

ITU-RWorld

Radiocommunication Conference

ITU-DWorld

Telecommunication Development Conference

GeneralSecretariat

Structure of ITU-T Study Group 12General structure of the ITU-T.

4

WORLD TELECOMMUNICATIONSTANDARDIZATION ASSEMBLY

TELECOMMUNICATIONSTANDARDIZATIONADVISORY GROUP

WORKINGPARTY

R

STUDY GROUP X STUDY GROUP Y

WORKINGPARTY

WORKINGPARTY

R R R

R = RAPPORTEUR GROUP

RECOMMENDATION EDITORS

R R R R

(WTSA)

(TSAG)

(WP)

STUDY GROUP XX

Structure of ITU-T Study Group 12Structure of ITU-T Study Groups and Working Parties.

5

Workshops / Seminars: Cover the most important topics in modern

telecommunication technology and applications. Speakers are renowned telecommunication experts. Usually free of charge and open to public . To come : From Speech to Audio: Bandwidth Extension,

Binaural Perception, see http://www.itu.int/ITU-T/studygroups/com12/index.asp.

Focus Groups: Participation of non-member experts welcome. Work on a well-defined topic and time-schedule for

completion. e.g. : IPTV Focus Group in which SG12 is involved Under SG12 : Focus Group From/In/ToCarCommunication,

see http://www.itu.int/ITU-T/studygroups/com12/fgfit/index.html

Joint Coordination Groups: Coordinate a broad study by more than one study group.

They do not perform technical studies nor write Recommendations.

Structure of ITU-T Study Group 12Structure of ITU-T Study Groups and Working Parties.

6

Responsible for Recommendations on the end-to-end transmission performance of terminals and networks, in relation to the perceived quality and acceptance by users of text, data, speech, and multi-media applications. Although this work includes the related transmission implications of all networks and all telecommunication terminals, a special focus is given to IP QoS, interoperability and implications for NGN, and also includes work on performance and resource management.

Structure of ITU-T Study Group 12Study Group 12 mandate.

7

Bridging the gapfor developping countriesMr J.J. Massima-Landji, VC

SG 12 – Performance and QoS

Chairman Mr Jean-Yves Monfort

Telephonometry, terminals and subjectiveassessmentCo-Chairs : C. Quinquis, G. Lecucq

Performance, planning and tools

Mr Klemens Adler, SG 12 Vice Chair

WP 1

WP 2

WP 3 IP-related QoS and resource management

M. Paul Coverdale, SG 12 Vice Chair

QoS CoordinationMr C. Dvorak, VC

TSB Support

Mrs J. Katona Kiss, Councellor

Mrs S. Scott, Secretary

Structure of ITU-T Study Group 12Management team and structure.

8

SG 12 – Questions 1/12 and 15/12

Q.1/12

Q.15/12QoS and performance

coordinationMr C. Dvorak

QoS and performancecoordination

Mr C. Dvorak

Workprogram, definitions, handbooks, guides, tutorials, Bridging the Standardization GapsMr JY Monfort, Mr J. Pomy, Mr J.J. Massima-Landji

Structure of ITU-T Study Group 12SG12 structure and questions.

9

WP /12 – Telephonometry, terminalsand Subjective assessment

Co Acting Chairs C. Quinquis, G. Lecucq

Q.4/12

Q.5/12

Hands-free communications in vehicles Mr H.W. Gierlich, Mr M.

Rung

Telephonometrics methodologies for handsets and headset terminals Mr L. Madec

Q.7/12 Methods, tools and test plans for the subjective assessment… Mr P. Usai and Mrs C. Quinquis

Q.3/12

Analysis methods using complex measurement signals…. Mr H.W. Gierlich

Q.6/12

Speech transmission characteristics of speech terminals … Mr Shi Denian


10

WP 2/12 – Performance, Planning and Tools

Chairman Mr Klemens Adler

Q.9/12

Q.10/12

Perceptual-based objective methods for voice, audio and visual quality… Mr J. Berger

Transmission planning and performance considerations… Mr V. Sypli

Q.20/12 Objective assessment of conversational speech quality in networks Mr J. Pomy

Objective assessment of conversational speech quality in networks Mr J. Pomy

Q.8/12

In-service non intrusive assessment of voice transmission performance Mr V. Barriac

Q.14/12

Extension of the E-model Mrs U. Jekosch and Mr S. Möller

Q.12/12Performance evaluation of services based on speech technology Mr S.Möller&MrA. Raake


11

WP 3/12 – IP-Related QoS andRessource management

Chairman Mr Paul Coverdale(also involved in Questions* 13/12 and 19/12)

Q.13/12

Q.16/12

IP based multimedia services end to end transm. planning …. M. J. Pomy

IPTV and multimedia QoE/QoS performance requ. and assessment methods A. Takahashi

IPTV and multimedia QoE/QoS performance requ. and assessment methods A. Takahashi

Q.19/12

Performance of IP-based networks Mr A. Morton and Mr

H. Kim

Speech transmission charact. & meas. methods for IP terminals and gateways Mr U. Brunner

Q.11/12

Broadband and IP-related resource management Mr D. Mustill

Q.17/12

Call processing performance Call processing performance

Q.2/12


12

SG 12 Liaison OfficersSG 12 Liaison Officers

IEEE

QSDG

Electroacoustics Mr L. Madec, Mr H.Gerlich

Electroacoustics Mr A. WooElectroacoustics Mr A. Woo

Others

Communication Mr C. Dvorak,EWM Mr J. Pomy, Bridging the standardization Gaps Mr J.J. Massima-Landji

Joint Rapporteur Group "Multimedia quality assessment" Mr P. Juric

IEC 29

QoS Development Group Mr D. Mustill

TSAG

Security, OAM, ICG-SAT Mr JY Monfort, FGNGN Mr C.Dvorak, FGNGN Mr P. CoverdaleITU-D Mr J.J. Massima

Security, OAM, ICG-SAT Mr JY Monfort, FGNGN Mr C.Dvorak, FGNGN Mr P. CoverdaleITU-D Mr J.J. Massima

JRG MMQA

Flagship Group QoS Mr D. Waturu Flagship Group QoS Mr D. Waturu


13

Questions: Set up by the WTSA or by the Study Group. Define a particular subject to be studied.Rapporteurs: Appointed by the SG or a WP to each Question. Ensure progress of the group of experts towards

Recommendations. Lead, moderate debates (e-mails, conf. Calls, etc.)

and coordinate progress. Chair the meetings of the experts (Rapporteurs

Group Meetings).Editors: Appointed by Rapporteurs, prepare and follow-up

draft Recommendations.

Structure of ITU-T Study Group 12Questions, Rapporteurs and Editors.

14

Alternative Approval Process (AAP):

For technical Recommendations

Once the text is considered to be mature, it is submitted for AAP at an SG or WP meeting (Rec. A.8)

Traditional Approval Process (TAP):

For Recommendations subject to policy or regulatory implications

Initiated at an SG or WP meeting and completed, for final approval, at the subsequent SG meeting (Res. 1)

Structure of ITU-T Study Group 12Approval of Recommendations.

15

TG120480-00

4(b)

(c)

9 11

(a)

(a) (b)

(a)(b)

SG orWP

meeting(1)

Editedtext

for LC(2)

Director'sannouncementand postingfor LC

(3)

Editedtext

for AR(8)

Director'sannouncementand postingfor AR

(10)

Director'sannouncement

and posting(5)

SGMeeting

(6)

Director'snotification

and publication(see Rec. A.11)

(12)

3 weeks

LC: Last Call

AR: Additional Review

Approved

Approved

Approved

Commentresolution

AR3 weeks

LC4 weeks

(7)

See Figure 1 (Rec. A.8)

Structure of ITU-T Study Group 12AAP Sequence.

16

Contributions (C):

To be submitted at least 10 calendar days before the meeting.

Reports (R):

Official records of SG or WP meetings. To be available shortly after the closure of the meetings (Rec. A.1).

Temporary Documents (TDs):

Submitted by an ‘official’ (a member of the SG Management Team, Rapporteur, Editor, etc.) within the meeting participants.

Working Documents (WDs):

Issued during meetings by small groups.

Structure of ITU-T Study Group 12Meeting documentation.

Visit www.itu.int/ITU-T/studygroups/com12/index.aspfor more information.

Structure of ITU-T Study Group 12Further information.

18

Overview

Structure of ITU-T Study Group 12 Quality assessment and prediction for voice

services– Quality assessment and prediction– Taxonomy of prediction models– E-model for NB and WB networks

19

Our focus: Methods for assessing narrow-band and wideband speech,but also video quality

Quality Assessment and PredictionVoice services.

ModelEstimated Quality Index

SystemParameter

s

Linguist.Backgr.

AttitudeEmotions Experi-ence

Motivation,

GoalsUser Factors

Subjective Quality Judgment

Transmission

System

20

Quality:Result of judgment of theperceived composition ofan entity with respectto its desired composition.(Jekosch, 2005) Quality of Service

(Rec. E.800) Quality of Experience

Quality Assessment and PredictionQuality aspects of transmitted speech.

Quality of Service

ServiceFactors

Contextual

Factors

Speech Communication

Factors

Voice Transmissio

nQuality

Ease of Communic

ation

Conversation

Effectiveness

Communication

Efficiency

Economical

Benefit

Service Efficien

cy

Usability

Utility

Acceptability

UserSatisfacti

on

User

Facto

rs

Quality of Experience

(Möller, 2000)

21

Input information: Signals

− one or two signals− acoustic or electric

Parameters Protocol information

Measurement of input information:

Online Offline Estimation

Quality Assessment and Prediction Taxonomy of prediction models.

Output information: Listening-only

− integral quality− quality features

Conversational Talking-only

Application area: Planning Set-up and optimization Monitoring

Network type: Narrow-band Wideband

22

Quality Assessment and Prediction Taxonomy of prediction models: Narrow-band case.

Listening Conversation

OverallQuality

QualityFeat.

OverallQuality

QualityFeat.

Signals 1, el. P.563 Psychoac.

Measures

CCI (P.562)

1, ac. Psychoac.

Measures

2, el. P.862P.OLQA

[Heute05]

P.CQO? P.CQO?

2, ac. P.OLQA [STI]P.OLQA

?Protocol Meas. P.VTQ?

P.CQO?P.CQO?

Parameters Estim. G.107

Meas. NIEM (P.562)

Output InformationIn

put

Info

rmati

on

23

Listening Conversation

OverallQuality

QualityFeat.

OverallQuality

QualityFeat.

Signals 1, el. Psychoac.

Measures

1, ac. Psychoac.

Measures

2, el. P.862.2P.OLQA

[Heute05]

2, ac. P.OLQA [STI]P.OLQA

?Protocol Meas.

Parameters Estim. WB-E-Model

Meas.

Quality Assessment and Prediction Taxonomy of prediction models: Wideband case.

Output InformationIn

put

Info

rmati

on

24

Quality Assessment and Prediction E-model for narrow-band networks.

Backgr.noise,acousticcoupling

Linear distortion, delay

Codec Packetloss

Jitterbuffer,VAD

Talker echo,listener echo

Circuitnoise

Backgr.noise,acousticcoupling

IP WAN

IP WAN

4

4

25

IP WAN

IP WAN

4

4

Quality Assessment and Prediction E-model for narrow-band networks.

Overall quality R = Ro - Is - Id - Ie,eff

Estimated user judgment MOS = f (R )

Impairments SNR simultaneous delayed nonlin./timevar.

Ps, Ds,STMR

SLR, RLR, Ta

Ie, qdu PplBpl TELR, T,WEPL, Tr

Nc, Nfor Pr, Dr,LSTR

26

Quality Assessment and Prediction E-model extension for wideband networks.

(Raake, 2006; Appendix II, ITU-T Rec. G.107, 2006)

0 20 40 60 80 1000

20

40

60

80

100

120

140R

max=129

RNB/WB

RN

B

Ro,max = 129

27

Quality Assessment and Prediction E-model extension for wideband networks.

Ref.Operating rate kbit/s

Ie,wbvalue

G.722 64 1356 2048 31

G.722.1 32 1324 19

G.722.2 23.85 823.05 119.85 318.25 515.85 714.25 1012.65 138.85 266.6 41

G.711 64 36G.728 16 43G.729 8 46G.729A + VAD 8 47IS-54 8 56GSM 06.10, FR 13 56GSM 06.60, EFR 12.2 41G.723.1 5.3 55G.723.1 6.3 51

Ro,max = 129

(Raake, 2006;Möller et al., 2006)

AMR-WB (23.05)

AMR-WB (6.6)

Thanks to Jean-Yves Monfort (ITU-T SG12 Chairman) for providing the description of Study Group 12.

Thank you for your attention.

Visit www.qu.tlabs.tu-berlin.de for more information.