INTERNATIONAL ORGANISATION FOR STANDARDISATIONORGANISATION INTERNATIONALE DE NORMALISATION

ISO/IEC JTC 1/SC 29/WG 11CODING OF MOVING PICTURES AND AUDIO

ISO/IEC JTC 1/SC 29/WG 11 N11077Kyoto, JP – January 2010

Source: Leonardo Chiariglione Title: Report of 91st meetingStatus

Report of 91st meeting.........................................................................................................................1Annex A – Attendance list.................................................................................................................17Annex B – Agenda.............................................................................................................................25Annex C – Input contributions...........................................................................................................28Annex D – Output documents............................................................................................................42Annex E – Requirements report.........................................................................................................47Annex F – Systems report..................................................................................................................56Annex G – Video report.....................................................................................................................94Annex H – Audio report...................................................................................................................107Annex I – 3DG report.......................................................................................................................140

Report of 91st meeting

1 OpeningThe 91st MPEG Meeting took place from 18th to 22nd January 2010 at Kyoto Research Park, Kyoto, Japan.

2 Roll call of participantsAnnex 1 provides the list of participants

3 Approval of agendaThe agenda adopted is provided by Annex 2

4 Allocation of contributionsAnnex 3 provides the list of input documents

5 Communications from ConvenorThere was no specific communication

1

6 Report of previous meetingThis was approved

7 Processing of NB Position PapersPapers were presented and, where appropriate, responses provided.

8 Work plan management

8.1 Media coding

8.1.1 AVC 6th editionThe following document was approved

11084 Text of ISO/IEC IS 14496-10:201X (6th edition)

8.1.2 Scalable-complexity 3D mesh compressionThe following documents were approved

11122 Description of 3DG Core Experiments11123 DoCR on ISO/IEC 14496-16:2009 FPDAM1 Scalable Complexity 3D Mesh

Compression11124 ISO/IEC 14496-16:2009 FDAM1 Scalable Complexity 3D Mesh Compression

8.1.3 Efficient representation of 3D meshes with multiple attributesThe following document was approved

11125 WD 2.0 of ISO/IEC 14496-16:2009 AMD2 Efficient representation of 3D meshes with multiple attributes

8.1.4 Many-to-one range mappings in Open Font FormatThe following document was approved

11141 Study Text of ISO/EC 14496-22:2009/FPDAM 1 Support for many-to-one range mappings

8.1.5 Composite Font in Open Font FormatThe following document was approved

11212 Draft Requirements and Use Cases for the Composite Font Standard

8.1.6 Media Value Chain OntologyThe following documents were approved

11145 DoC on ISO/IEC FCD 21000-19 Media Value Chain Ontology11146 Text of ISO/IEC FDIS 21000-19 Media Value Chain Ontology

2

8.1.7 Video Tool LibraryThe following documents were approved

11093 Description of Core Experiments in RVC11094 RVC Work Plan

8.1.8 Spatial Audio Object CodingThe following documents were approved

11206 DoC on ISO/IEC FCD 23003-2:2010, Spatial Audio Object Coding11207 ISO/IEC FDIS 23003-2: 2010, Spatial Audio Object Coding11210 Draft Workplan for SAOC Verification Test

11211 Application Scenarios for SAOC TeleconferencingUse Cases and Workplan For Their Technical Evaluation

8.1.9 Unified Speech and Audio CodingThe following documents were approved

11213 WD6 of USAC11214 Workplan for USAC CEs11215 Workplan on MPEG USAC Reference Software

8.1.10 Media Context and Control – Control InformationThe following documents were approved

11176 Study Text of ISO/IEC FCD 23005-2 Control Information11177 WD of ISO/IEC 23005-2/AMD1 Adaptation Preferences

8.1.11 Media Context and Control – Sensory InformationThe following document was approved

11178 Study Text of ISO/IEC FCD 23005-3 Sensory Information

8.1.12 Media Context and Control – Virtual World Object CharacteristicsThe following document was approved

11179 Study Text of ISO/IEC FCD 23005-4 Virtual World Object Characteristics

8.1.13 Media Context and Control – Data Formats for Interaction DevicesThe following documents were approved

11180 Study Text of ISO/IEC FCD 23005-5 Data Formats for Interaction Devices

3

11181 WD of ISO/IEC 23005-5/AMD1 Multipoint Interaction

8.1.14 Media Context and Control – Common Types and ToolsThe following documents were approved

11182 Request for subdivision of ISO/IEC 23005-6 Common Types and Tools11183 Draft text of ISO/IEC FDIS 23005-6 Common Types and Tools

8.1.15 3D Video CodingThe following documents were approved

11095 Description of Exploration Experiments in 3D Video Coding11201 Draft Report on Experimental Framework in 3D Video Coding

8.1.16 High-Performance Video CodingThe following documents were approved

11096 Vision, Applications and Requirements of High Performance Video Coding11113 Joint Call for Proposals on Video Compression Technology

8.2 Composition coding

8.2.1 BIFS for Interactive Digital RadioThe following documents were approved

11134 Study Text of ISO/IEC 14496-11:2005/FPDAM 7 ExtendedCore2D Profile11135 Technologies under Consideration for use of BIFS for collaborative applications

8.2.2 LASeR AdaptationThe following document was approved

11140 Updated Workplan for service examples of LASeR Adaptation & PMSI

8.2.3 Presentation and Modification of Structured InformationThe following document was approved

11140 Updated Workplan for service examples of LASeR Adaptation & PMSI

8.2.4 Advanced User InteractionThe following document was approved

11175 Technology under consideration for using advanced user interaction in LASeR

4

8.3 Description coding

8.3.1 Video Signature DescriptorsThe following documents were approved

11085 Study Text of ISO/IEC 15938-3/FPDAM 4 Video Signature Tools11086 MPEG-7 Visual XM 3811087 Description of Core Experiments in Video Signature Description development

8.3.2 Mobile Visual SearchThe following document was approved

11227 Vision, Applications and Requirements for Mobile Visual Search (MVS)

8.4 IPMP

8.4.1 Protection of Presentation ElementThe following document was approved

11144 Text of ISO/IEC 21000-2:2005/FPDAM 2 Protection of presentation description

8.5 Digital Item

8.5.1 Presentation of Digital ItemThe following document was approved

11143 Text of ISO/IEC 21000-2:2005/FPDAM 1 Presentation of digital item

8.6 Transport and File formats

8.6.1 MVC operation point descriptorThe following document was approved

11131 Study Text of ISO/IEC 13818-1:2007/PDAM 6 MVC operation point descriptor

8.6.2 Carriage of JPEG2000 on MPEG-2 SystemsThe following document was approved

11130 Study Text of ISO/IEC 13818-1:2007/PDAM 5 Transport of JPEG2000

8.6.3 Sub-track selection & switchingThe following documents were approved

11136 Request for ISO/IEC 14496-12:2008/AMD 2 Sub-track selection & switching

5

11137 Text of ISO/IEC 14496-12:2008/PDAM 2 Sub-track selection & switching

8.6.4 Handling of MPEG-4 Audio enhancement layersThe following document was approved

11138 Text of ISO/IEC 14496-14:2003/FDAM 1 Handling of MPEG-4 audio enhancement layers

8.6.5 AVC File FormatThe following document was approved

11139 Text of ISO/IEC 14496-15 2nd edition

8.6.6 MPEG Media TransportThe following documents were approved

11223 Draft Requirements for MMT (MPEG Media Transport)11224 Draft Call for Proposals on MMT11225 Draft MPEG Media Transport (MMT) Context and Objectives11226 Draft use cases for MMT

8.7 Multimedia architecture

8.7.1 MXM Architecture and TechnologiesThe following documents were approved

11162 DoC on ISO/IEC FCD 23006-1 MXM Architecture and Technologies11163 Text ISO/IEC FDIS 23006-1 MXM Architecture and Technologies

8.7.2 MXM APIThe following documents were approved

11164 DoC on ISO/IEC FCD 23006-2 MXM APIs11165 Text of ISO/IEC FDIS 23006-2 MXM APIs

8.7.3 MXM ProtocolsThe following documents were approved

11169 DoC on ISO/IEC FCD 23006-4 MXM Protocols11170 Text of ISO/IEC FDIS 23006-4 MXM Protocols

8.7.4 MPEG Rich Media UIThe following documents were approved

6

11172 Study Text of ISO/IEC FCD 23007-1 Widgets11173 Items Under Consideration for ISO/IEC 23007-1 AMD1 Security Aspects

8.7.5 Advanced User InteractionThe following document was approved

11174 WD of ISO/IEC 23007-2 Advanced User Interaction Interface

8.7.6 Advanced IPTV TerminalThe following documents were approved

11228 Requirements for Advanced IPTV Terminal (AIT)11229 Advanced IPTV Terminal (AIT): Call for Proposals11230 Context and Objectives for Advanced IPTV Terminal (AIT)11231 Use Cases for Advanced IPTV Terminal (AIT)

8.8 Application formats

8.8.1 Media Streaming AFThe following documents were approved

11148 DoC on ISO/IEC CD 23000-5 2nd Edition Media streaming application format11149 Text of ISO/IEC FCD 23000-5 2nd Edition Media streaming application format

8.8.2 DMB AF Harmonization of MPEG-2 TS storageThe following documents were approved

11152 DoC on ISO/IEC 23000-9:2008 FPDAM 2 Harmonization on MPEG-2 TS storage11153 Text of ISO/IEC 23000-9:2008 FDAM 2 Harmonization on MPEG-2 TS storage

8.8.3 Interactive Music Application Format The following documents were approved

11157 DoC on ISO/IEC FCD 23000-12 Interactive Music AF11158 Text of ISO/IEC FDIS 23000-12 Interactive Music AF

8.9 Reference implementation

8.9.1 SC3DMC Reference SoftwareThe following document was approved

11121 Study Text of ISO/IEC 14496-5:2001/FPDAM 27 Reference Software for Scalable Complexity 3D Mesh Coding

7

8.9.2 LASeR Adaptation Tools Reference SoftwareThe following documents were approved

11132 Request for ISO/IEC 14496-5:2001/AMD 28 Reference Software for LASeR Adaptation Tools

11133 Text of ISO/IEC 14496-5:2001/PDAM 28 Reference Software for LASeR Adaptation Tools

8.9.3 Media Value Chain Ontology Reference SoftwareThe following document was approved

11147 Workplan for Media Value Chain Ontology Reference Software

8.9.4 DMB AF Reference Software The following document was approved

11151 Text of ISO/IEC 23000-9:2008 FDAM 1 Conformance and reference software

8.9.5 Video Surveillance AF Reference Software The following documents were approved

11154 DoC on ISO/IEC 23000-10:2009 FPDAM 1 Conformance and reference software11155 Text of ISO/IEC 23000-10:2009 FDAM 1 Conformance and reference software

8.9.6 Stereoscopic video AF Reference Software The following document was approved

11156 Study Text of ISO/IEC 23000-11/FPDAM 1 Stereoscopic Video AF Ref. Soft and Conf.

8.9.7 Interactive Music AF Reference SoftwareThe following documents were approved

11159 Request for ISO/IEC 23000-12/AMD 1 Conformance and Reference Software11160 Text of ISO/IEC 23000-12 PDAM 1 Conformance and Reference Software11161 Workplan for the Interactive Music AF Conformance & Reference SW

8.9.8 Video Tool Library Reference SoftwareThe following document was approved

11092 Study Text of ISO/IEC 23002-4/FPDAM 1 Video Tool Library Conformance and Reference Software

8

8.9.9 MPEG Surround Reference SoftwareThe following document was approved

11205 Status of MPEG Surround Reference Software

8.9.10 SAOC Reference SoftwareThe following documents were approved

11208 WD of MPEG SAOC Conformance and Reference Software11209 Workplan on MPEG SAOC Reference Software

8.9.11 MXM Reference SoftwareThe following documents were approved

11167 DoC on ISO/IEC FCD 23006-3 MXM Conf. & Ref. SW11168 Text of ISO/IEC FDIS 23006-3 MXM Conf. & Ref. SW

8.9.12 Media Context and Control – Reference SoftwareThe following documents were approved

11185 Request for subdivision of ISO/IEC 23005-7 Conformance and Reference Software11186 Text of ISO/IEC CD 23005-7 Conformance and Reference Software

8.10 Conformance

8.10.1 Scalable Complexity 3DMC ConformanceThe following document was approved

11126 Study Text of ISO/IEC 14496-27:2009/FPDAM2 Conformance for Scalable Complexity 3D Mesh Coding

8.10.2 3D Graphics Compression Model ConformanceThe following document was approved

11127 Text of ISO/IEC 14496-27:2009/PDAM3 Conformance for Scalable Complexity 3D Mesh Coding in 3DG Compression Model

8.10.3 Image Signature Tools ConformanceThe following documents were approved

11088 Disposition of Comments on ISO/IEC 15938-7/FPDAM 5 11089 Text of ISO/IEC 15938-7/FDAM 5 Conformance Testing for Image Signature Tools

9

8.10.4 Photo Player AF ConformanceThe following documents were approved

11090 Disposition of Comments on ISO/IEC 23000-3/FPDAM 211091 Text of ISO/IEC 23000-3/FDAM 2 Conformance Testing for Photo Player MAF

8.10.5 DMB AF Conformance The following document was approved

11151 Text of ISO/IEC 23000-9:2008 FDAM 1 Conformance and reference software

8.10.6 Video Surveillance AF ConformanceThe following documents were approved

11154 DoC on ISO/IEC 23000-10:2009 FPDAM 1 Conformance and reference software11155 Text of ISO/IEC 23000-10:2009 FDAM 1 Conformance and reference software

8.10.7 Stereoscopic video AF ConformanceThe following document was approved

11156 Study Text of ISO/IEC 23000-11/FPDAM 1 Stereoscopic Video AF Ref. Soft and Conf.

8.10.8 Interactive Music AF ConformanceThe following documents were approved

11159 Request for ISO/IEC 23000-12/AMD 1 Conformance and Reference Software11160 Text of ISO/IEC 23000-12 PDAM 1 Conformance and Reference Software

8.10.9 Video Tool Library ConformanceThe following document was approved

11092 Study Text of ISO/IEC 23002-4/FPDAM 1 Video Tool Library Conformance and Reference Software

8.10.10 SAOC ConformanceThe following document was approved

11208 WD of MPEG SAOC Conformance and Reference Software

10

8.10.11 MXM ConformanceThe following documents were approved

11167 DoC on ISO/IEC FCD 23006-3 MXM Conf. & Ref. SW11168 Text of ISO/IEC FDIS 23006-3 MXM Conf. & Ref. SW

8.10.12 Media Context and Control – ConformanceThe following documents were approved

11185 Request for subdivision of ISO/IEC 23005-7 Conformance and Reference Software11186 Text of ISO/IEC CD 23005-7 Conformance and Reference Software

8.11 Maintenance

8.11.1 Systems coding standardsThe following document was approved

11142 Text of ISO/IEC 14496-22:2009/DCOR 1

8.11.2 Video coding standardsThe following documents were approved

11082 Disposition of comments on ISO/IEC 14496-10:2009/DCOR 111083 Text of ISO/IEC 14496-10:2009/COR 1

8.11.3 Audio coding standardsThe following documents were approved

11202 Study on ISO/IEC 14496-5:2001/AMD 10:2007/DCOR 4, SLS11203 23003-1/AMD 1/DCOR 1, Corrections to Conformance11204 23003-1 AMD 2/DCOR 2, Corrections to Reference Software

8.11.4 MPEG-A standards The following document was approved

11150 Text of ISO/IEC 23000-6:2009/DCOR 1 Professional archival application format

8.12 Work plan and time line

9 Organisation of this meeting

9.1 Tasks for subgroupsThe following tasks were assigned

11

Requirements Std Pt AmdAdvanced IPTV TerminalHVC – CfP, Requirements Vision Applications 3DVMMT– CfP, Requirements, Context & Objectives, Use CasesRoyalty free codecToR of collaboration with ITU-T on HVCNew standard areas

Audio for HVCSystems Std Pt Amd

2 1 5 Carriage of JPEG20006 MVC operation point descriptors

4 1 4 LASeR in MPEG-4 System and RA5 ? SVC FF RS11 7 New BIFS Profile for Digital Radio14 1 MPEG-4 Audio Enhancement Layers (FF)22 1 Open Font Format

7 12 Amd1 C and RSAmd2 Semantic enhancement

21 2 Amd1 PDI4 Amd4 Protection of presentation element19 MVCO

A 5 2nd Ed Media Streaming AF6 2 Cor Professional Archival AF 9 1 DMB AF RS & C9 2 DMB MPEG-2 TS storage10 1 Video Surveillance AF RS & C11 1 Stereoscopic video AF RS & C

2 Additional composition type12 Interactive music AF

M 1 MXM Architecture2 MXM API3 MXM RS & C4 MXM Protocols

V 1 Architecture2 Control Information3 Sensory information4 Avatar information5 Data representation for interaction devices

U 1 Rich Media Widgets2 Advanced input device interface3 Reference Software and Conformance

X Advanced IPTV TerminalVideo

4 10 Cor 1 Miscellanea7 3 4 Video Signature Tools

? Mobile search7 5 Image Signature Tools Conf

A 3 2 Photo Player Conformance

12

C 4 1 Video Tool Library Conformance & RS2 Video Tool Library extensions

3DV/FTVHVC

Audio 4 3 2 ALS profile26 2 BSAC for broadcasting

D 2 Spatial Audio Object Coding3 USAC

New audio issues (HVC)3DG 4 16 1 Scalable complexity 3DMC

2 Mesh representation supporting multiple attributes27 2 Scalable complexity 3DMC Conformance

3 Scalable complexity 3DMC in part 25 Conformance5 26 3D Graphics Compression model Reference Software

27 Scalability complexity 3DMC RSV Information exchange with virtual worlds

Reconfigurable Graphics Coding16 Multiresolution 3DMC

9.2 Joint meetingsThe following joint meetings were held

Groups What Day Time WhereS, R AIT Mon 16:00-18:00 ReqS, R MMT Tue 09:00-10:30 ReqV, R, Vg HVC Reqs Tue 11:00-13:00 VidS. R AIT Tue 14:00-18:00 ReqS, 3 MPEG-U/V Tue 14:00-16:00 SysS, R Font Format Tue 10:30-11:00 ReqsV,R Mobile visual search Wed 11:00-12:00 Vid3, S MXM Wed 11:00-11:30 3V, R Video Surveillance Wed 12:00-12:30 VidAll MMT Workshop Wed 13:00-17:00 Vid3, S MPEG-V Wed 14:00-17:00 3S, R MMT Thu 09:00-11:00 Req3, V RGC Thu 09:00-10:00 3A, V, R Audio for HVC Thu 14:00-15:00 AudS, R AIT Thu 15:00-16:00 Sys

10 WG management

10.1 Terms of referenceThe following documents were approved

11100 Terms of reference11112 Terms of Reference of the Joint Collaborative Team on Video Coding 11187 Terms of Reference of the Joint Collaborative Team on Advanced IPTV Terminal

13

10.2 OfficersJens-Rainer Ohm was nominated as co-chair of the JCT on Video Coding

10.3 EditorsThe following document was approved

11104 Editors of MPEG standards

10.4 LiaisonsThe following liaison statements were issued

11191 Liaison statement to SMTPE on JPEG2000 over MPEG-2 TS 11192 Liaison statement template on AIT11193 Liaison statement template on MMT11194 Liaison statement to SC 29/WG 1 on PA- AF11195 Liaison statement to IEC TC 100 and ITU-T SG 16 on RII11196 Liaison statement to W3C on Widgets 11197 Liaison statement to ISO/TC 223 on Video Surveillance11198 Liaison statement to JTC 1/SC 38 11199 Liaison statement to IEC TC 100 on Common Control Interface 11166 Liaison statement to ITU-T SG 16 on Collaboration on AIT 11097 Liaison statement to ITU-T SG16 Q6 on Video Coding Collaboration11098 Liaison statement to ITU-T SG 9 on 3D Video Coding11099 Liaison statement to ITU-R SG 6/WP 6C on 3D Video Coding11114 Liaison statement to SMPTE on 3D Video Coding11216 Response to Liaison from World DMB Forum11217 Response to Liaison from ITU-T SG 16 on Enhanced Low Delay AAC11218 Response to Liaison from ITU-R SG 6/WP 6B11111 List of Organisations with which MPEG entertains liaisons

10.5 Standard development practicesThe following document was approved

11221 Possible future actions on standardization with Type 1 licensing

10.6 Responses to National BodiesThe following documents were approved

11115 Responses to National Bodies on video issues 11222 Responses to NB position statements on N1066

10.7 SVN supportThe following documents were approved

14

11188 Guide to the MPEG Subversion Repository11189 List of non-MPEG members allowed to access the MPEG SVN repository

10.8 Ad hoc groupsThe following ad hoc groups were established

11119 AHG on 3D Video Coding11128 AHG on 3DG documents, software maintenance and core experiments11235 AHG on Advanced IPTV Terminal11233 AHG on Application Format11219 AHG on Audio Standards Maintenance11234 AHG on Font Format Representation11120 AHG on High-Performance Video Coding11116 AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and

Conformance11238 AHG on Mobile Visual Search11232 AHG on MPEG File Formats11239 AHG on MPEG Media Transport (MMT)11220 AHG on MPEG Surround, SAOC, USAC11118 AHG on MPEG-7 Visual11237 AHG on MPEG-V11129 AHG on Multi-Resolution 3D mesh Coding11236 AHG on MXM11117 AHG on Reconfigurable Video Coding11171 AHG on Scene Representation

10.9 Asset managementThe following documents were approved

11105 Schema assets11106 Software assets11107 Conformance assets11108 Content assets11109 URI assets

10.10 IPR managementThe following document was approved

11110 Standards under development for which a call for patent statements is issued

10.11 Work plan and time lineThe following documents were approved

11101 MPEG Standards11102 Table of unpublished FDISs

15

11103 Work plan and time line

11 Administrative matters

11.1 Schedule of future MPEG meetingsThe following meeting schedule was approved

# City Country yy mm dd-dd91 Kyoto JP 10 01 18-2292 Dresden DE 10 04 19-2393 Geneva CH 10 07 26-3094 Guangzhou CN 10 10 11-1595 ? KR 11 01 24-2896 Geneva CH 11 03 21-2597 Torino IT 11 07 18-2298 ? US 11 10 17-2199 ? ? 12 01 ??-??100 Suzhou CN 12 04 16-20

11.2 Promotional activitiesThe following documents were approved

11190 Ideas on ISO/IEC 23007-1 MPEG-U Widgets Video.11079 Kyoto press release

12 Resolutions of this meetingThese were approved

13 A.O.B.There was no other business

14 ClosingMeeting closed at 2010/01/22T19:30 with thanks to the hosting organisation

16

Annex A – Attendance list

# First name Last name Affiliation Country1 Takanori Senoh National Institute of Info & Comm Tech Japan2 Bernhard Grill Fraunhofer IIS Germany3 Kazumasa Enami NICT Japan4 Kazuhito Sakomizu OKI Japan5 Leonardo Chiariglione CEDEO Italy7 Leonid Terentiev Fraunhofer IIS Germany8 Tiejun Huang Peking University China9 Joern Ostermann Leibniz University Hannover Germany10 Vittorio Baroncini Fondazione Ugo Bordoni Italy11 Schuyler Quackenbush Audio Research Labs USA12 Mohamad Raad Raadtech Consulting Australia13 Huifang Sun Mitsubishi Electric Research Labs USA14 Kazuo Sugimoto Mitsubishi Electric Japan15 Tokumichi Murakami Mitsubishi Electric Japan16 Kohtaro Asai Mitsubishi Electric Japan17 Kenta Senzaki NEC Japan18 Iraj Sodagar Microsoft USA19 Cheon Lee GIST Korea20 Li Te Institute For Infocomm Research, A*Star Singapore21 Miroslaw Bober Mitsubishi Electric Merce-Uk UK22 Per Fröjdh Ericsson Sweden23 Vladimir Levantovsky Monotype Imaging Inc. USA24 Gary Sullivan Microsoft USA25 David Singer Apple Inc., USA USA26 Li Zhengguo Institute For Infocomm Research Singapore27 Yeo Chuo Hao Institute For Infocomm Research Singapore28 Dong Seok Jeong Inha University Korea29 Teruhiko Suzuki Sony Japan30 Takuyo Kogure Panasonic Japan31 Toshiyuki Nomura NEC Japan32 Keiichi Chono NEC Japan33 Tham Jo Yew Institute For Infocomm Research, A*Star Singapore34 Takayuki Kunieda Ricoh Japan35 Shinya Shimizu NTT Japan36 Hong Yingjie ZTE China37 Jaejoon Lee Samsung Electronics Korea38 Ayumi Matsumoto NTT Japan39 Satoshi Nakagawa OKI Japan40 Krzysztof Wegner Poznan University of Technology Poland41 Christian Timmerer Klagenfurt University Austria42 Alexander Giladi Avail-TVN USA43 Francisco Morán Burgos Universidad Politécnica De Madrid Spain44 Filippo Chiariglione CEDEO Italy45 Takeshi Chujoh Toshiba Japan46 Tomoo Yamakage Toshiba Japan47 Andrew Tescher Microsoft USA

17

48 Ji Hun Cha ETRI Korea49 Yong Il Kwon Kyung Hee University Korea50 Yonghun Lee Kyung Hee University Korea51 Doug Young Suh Kyung Hee University Korea52 Shun-Ichi Sekiguchi Mitsubishi Electric Japan53 Yoshiaki Kato Mitsubishi Electric Japan54 Yusuke Itani Mitsubishi Electric Japan55 Marco Mattavelli EPFL Switzerland56 Anthony Vetro Mitsubishi Electric USA57 Sinwook Lee Hanyang University Korea58 Daiyong Kim Hanyang University Korea59 Kiho Choi Hanyang University Korea60 Euee S. Jang Hanyang University Korea61 Hyungyu Kim Hanyang Univeristy Korea62 Miran Choi ETRI Korea63 Yuan Hao ZTE China64 Akihide Sei JEITA Japan65 Cheng Carmen ASTRI Hong Kong66 Kyung Yong Kim Kyung Hee University Korea67 Yoonjin Lee Kyung Hee University Korea68 Robert A Cohen Mitsubishi Electric USA69 Kenji Yamamoto National Institute of Info & Comm Tech Japan70 Hitoshi Niigaki NTT Japan71 Takeshi Norimatsu Panasonic Japan72 Atsuro Ichigaya NHK Science & Technology Research

Labs.Japan

73 Takahiro Nishi Panasonic Japan74 Masatsugu Kitamura For More Convenient AV Life Japan75 Youji Shibahara Panasonic Japan76 Minhua Zhou Texas Instruments USA77 Hyunok Oh Hanyang University Korea78 Hee-Suk Pang Sejong Univ. Korea79 Truong Cong Thang ETRI Korea80 Akira Minezawa Mitsubishi Electric Japan81 Gwang Hoon Park Kyung Hee University Korea82 Junghoe Kim Samsung Electronics Korea83 Zhou Huan Panasonic Singapore Labs Singapore84 Zhong Haishan Panasonic Singapore Labs Singapore85 Jong-Ki Han Sejong University Korea86 Chanwon Seo Sejong University Korea87 Kazuhisa Iguchi Japan Broadcasting (NHK) Japan88 Jae-Joon Han Samsung Electronics Korea89 Tomoyuki Yamamoto Sharp Japan90 Hideaki Kimata NTT Japan91 Chan Ti Eu Institute For Infocomm Research

(A*Star)Singapore

92 Takafumi Koike Hitachi Japan93 Tomokazu Ishikawa Panasonic Japan94 Philippe Pierrick Orange Labs France95 Gregory Pallone Orange Labs France96 Hirofumi Aoki NEC Japan

18

97 Kota Iwamoto NEC Japan98 Sang-Kyun Kim Myongji University Korea99 Takehiro Moriya NTT Japan100 Satoshi Ito Toshiba Japan101 Akiyuki Tanizawa Toshiba Japan102 Noboru Harada NTT Japan103 Yutaka Kamamoto NTT Japan104 Hyuk Lee Hanyang University Korea105 Takaaki Ishikawa Waseda University Japan106 Won-Sik Cheong ETRI Korea107 Kug Jin Yun ETRI Korea108 Takahiro Fukuhara Sony Japan109 Bumsuk Choi ETRI Korea110 Ferenc Kraemer Dolby Germany Gmbh Germany111 Kristofer Kjoerling Dolby Sweden Ab Sweden112 Heiko Purnhagen Dolby Sweden Ab Sweden113 Mitsuru Maeda Canon Japan114 Oliver Hellmuth Fraunhofer IIS Germany115 Shuichi Aoki Japan Broadcasting (NHK) Japan116 Panos Koudoumakis Queen Mary University of London UK117 Katsuyuki Nakamura Hitachi Japan118 Laurent Guillo Inria France119 Peter Amon Siemens Germany120 David Flynn British Broadcasting UK121 Bill Zou DTS USA122 Minsu Ahn Samsung Electronics Korea123 Yasuaki Tokumo Sharp Japan124 Shigeru Fukushima JVC Kenwood Holdings Japan125 Kazushi Sato Sony Japan126 Satoru Sakazume JVC Kenwood Holdings Japan127 Shinichi Sakaida NHK Japan128 Seungwook Park LG Electronics Korea129 Byeongmoon Jeon LG Electronics Korea130 Yoshiaki Shishikui NHK Japan131 Jin Xin Waseda University Japan132 Hirofumi Nishikawa Mitsubishi Electric Japan133 Motoharu Ueda JVC Kenwood Holdings Japan134 Daiki Kudo Mitsubishi Electric Japan135 Junghan Kim Kyung Hee University Korea137 Tadashi Uchiumi Sharp Japan138 Hirohisa Jozawa NTT Japan139 Jaewon Sung LG Electronics Korea140 Hae Kwang Kim Sejong University Korea141 Yi-Jen Chiu Intel USA142 Seungwu Han Sejong University Korea144 Yoon Daeil Sejong University Korea145 Taekyu Shin Sejong University Korea146 Joo-Hee Moon Sejong University Korea147 Hyoungmee Park Sejong University Korea148 Lim Chong Soon Panasonic Singapore Labs Singapore150 Zhu Yongwei Institute For Infocomm Research Singapore

19

151 Hyunkook Lee LG Electronics Korea152 Sungyong Yoon LG Electronics Korea154 Kyuheon Kim Kyung Hee University Korea155 Kenneth Vermeirsch Ghent University - IBBT Belgium156 Jan De Cock Ghent University - IBBT Belgium157 Sebastiaan Van Leuven Ghent University - IBBT Belgium158 Yasushige Nakayama NHK Japan159 Marc Gauvin SDAE Spain160 Yoonsik Choe Yonsei University Korea161 David Virette Huawei Technologies Germany162 Thomas Davies British Broadcasting UK163 Zhang Qing Huawei Technologies China164 Akira Nakagawa Fujitsu Laboratories Japan165 Seong Hoon Kim Galaxia Communications Korea166 Seunghoon Jung Galaxia Communications Korea167 Inkwon Kim Galaxia Communications Korea168 Steffen Wittmann Panasonic Germany169 Wu Feng Microsoft Research Asia China170 Eung-Don Lee ETRI Korea171 Gun Bang ETRI Korea172 Leszek Cieplinski Mitsubishi Electric R&D Centre Europe UK173 Ajay Luthra Motorola USA174 Pengjun Huang Qualcomm USA176 Toshiaki Fujii Tokyo Institute of Technology Japan177 Byeungwoo Jeon SKKU Korea178 Yung-Lyul Lee Sejong University Korea179 Jungyoup Yang Sungkyunkwan University Korea180 Sung-Wook Hong Sejong University Korea181 Sungjei Kim Yonsei University Korea182 Owen Li M3 Canada183 Yuriy Reznik Qualcomm USA184 Kyeongok Kang ETRI Korea185 Itaru Kaneko Tokyo Polytechnic University Japan186 Haoping Yu Huawei Technologies (USA) USA187 Yukiko Ogura IPSJ/ITSCJ Japan188 Karsten Mueller Fraunhofer HHI Germany189 Takehiko Nakano Sony Japan190 Pablo Carballeira Universidad Politecnica De Madrid Spain191 Ken McCann Zetacas, Samsung UK192 Ying Chen Qualcomm USA193 Zhixiong Wu Oki Japan194 Chen Weizhong Huawei Technologies China195 Edouard Francois Thomson France196 Jens-Rainer Ohm Rwth Aachen University Germany197 Gero Bäse Siemens Germany198 Wonsuk Lee ETRI Korea199 Zhenyu Wu Thomson USA200 Haechul Choi ETRI Korea201 Hiroyuki Sano Mitsubishi Electric Japan202 Satoru Tokiya Mitsubishi Electric Japan203 Daisuke Ito Mitsubishi Electric Japan

20

204 Jong-Ho Kim Yonsei University Korea205 Avraham Shimor Sandisk Israel206 Gwo Giun

(Chris)Lee National Cheng Kung University Taiwan

207 Khaled Mammou Fittingbox France208 Yongju Cho ETRI Korea209 Kaoru Watanabe NHK Japan210 Jeongil Seo ETRI Korea211 Clinton Priddle Ericsson Sweden212 Arild Fuldseth Tandberg Norway213 Juergen Herre Fraunhofer IIS Germany214 Bernd Girod Stanford University USA215 Mickael Raulet IETR/INSA Rennes France216 Vijay Chandrasekhar Stanford University USA217 Hui Yong Kim ETRI Korea218 Nhut Nguyen Samsung Electronics USA219 Weon Geun Oh ETRI Korea220 Yong-Goo Kim Korean German Institute of Technology

(Kgit)Korea

221 Tan Thiow Keng NTT Docomo Japan222 Ju Kyong Jin Inha University Korea223 Ichiro Ando JVC Japan224 Shawmin Lei Mediatek Taiwan225 Pankaj Topiwala Fastvdo LLC USA226 Inseon Jang ETRI Korea227 Seongho Cho Samsung Electronics Korea228 Jin Lee ETRI Korea229 Yu Weiling ITRI Taiwan230 Liu Guizhong XJTU China231 Sang-Il Na ETRI Korea232 Patrick Lopez Thomson France233 Markus Multrus Fraunhofer IIS Germany234 Amonou Isabelle France Telecom France235 Jung Joel Orange Labs France236 Philippe Gournay Voiceage Canada237 Bruno Bessette Voiceage Canada238 Andrew Segall Sharp USA239 Sei Naito KDDI Japan240 Rhyu Sungryeul Samsung Electronics Korea241 Siwei Ma Peking University China242 Zhang Li Peking University China243 Xin Wang Huawei Technologies, USA USA244 Zhang Fan NTT Japan245 Akira Fujibayashi NTT Docomo Japan246 Yoshinori Suzuki NTT Docomo Japan247 Justin Ridge Nokia USA248 Peng Wen-Hsiao ITRI Taiwan249 Min Sung Kim Humax Korea250 Chung Ku Lee Humax Korea251 Woo-Jin Han Samsung Electronics Korea252 Henney Oh LG Electronics Korea

21

253 Donggyu Sim Kwangwoon University Korea254 Youngkwon Lim Mic Korea255 Jeongook Song Yonsei University Korea256 Jung Suk Suh Samsung Electronics Korea257 Neungjoo Hwang Kwangwoon University Korea258 Yurika Ogawa Toshiba Japan259 Hyunho Jo Kwangwoon University Korea260 Shuji Miyasaka Panasonic Japan261 Kyungmo Park Samsung Electronics Korea262 Chang-Heon Lee Yonsei University Korea263 Chun-Jen Tsai NCTU/ITRI Taiwan264 Wen Gao Peking University China265 Sun Haiwei Panasonic Singapore Labs Singapore266 Max Neuendorf Fraunhofer IIS Germany267 Jechang Jeong Hanyang University Korea268 Jeonghoon Park Samsung Electronics Korea269 Julien Robilliard Fraunhofer IIS Germany270 Jaeyeon Song Samsung Electronics Korea271 Lin He-Yuan National Cheng Kung University Taiwan272 Roch Lefevre Voiceage, University of Sherbrooke Canada273 Werner Oomen Philips Applied Technologies Netherlands274 Thomas Sikora Tu Berlin Germany275 Yu Lu Zhejiang University China276 Shen Xiaolin Zhejiang University China277 Richard Clark ETRI UK278 He Yun Tsinghua University China279 Yuan Yuan Tsinghua University China280 Li Shao Tsinghua University China281 Wang Yunfei Tsinghua University China282 Evain Jean-Pierre European Broadcasting Union (Ebu) France284 Po Lai-Man City University of Hong Kong Hong Kong285 Sam Narasimhan Motorola USA286 Geert Van Der

AuweraSamsung Information Systems America USA

287 Sangyoun Lee Yonsei University Korea288 Mehrdad Panahpour

TehraniNagoya University Japan

289 Seong Wan Kim Yonsei University Korea290 Kei Kikuiri NTT Docomo Japan291 Katsunori Aoki Japan Broadcasting (NHK) Japan292 Masayuki Tanimoto Nagoya University Japan293 Beack Seungkwon ETRI Korea294 Nobuhiko Naka NTT Docomo Japan295 Matthias Narroschke Panasonic R&D Center Gemany Germany296 Pateux Stephane Orange Labs France297 Menno Wildeboer Nagoya University Japan298 Oliver Wuebbolt Thomson Germany299 Bourge Arnaud Ericsson France300 Alberto Duenas Cavium Networks USA301 Zheng Jianhua Huawei Technologies China302 Eunmi Oh Samsung Electronics Korea

22

303 Taejin Lee ETRI Korea304 Lee Men Huang Panasonic Singapore Labs Singapore305 Kouadio Adi EBU Switzerland306 Hong Hotaek LG Electronics Korea307 Kemal Ugur Nokia Finland309 Cordara Giovanni Telecom Italia Lab Italy310 Takeshi Tanaka Panasonic Japan312 Xing Wen Hkust Hong Kong313 Stavros Paschalakis Mitsubishi Electric R&D Centre Europe UK314 Tomomi Takashina Nikon Systems Japan315 Tae-Young Jeong Hanyang University Korea316 Smolic Aljoscha Disney Research Zurich / ETH Zurich Switzerland317 Yuan Hui Xidian University China318 Chang Yilin Xidian University China319 Ho-Cheon Wey Samsung Electronics Korea320 Kazuya Hayase NTT Japan322 Jae-Gon Kim Korea Aerospace University Korea323 Frank Bossen Docomo USA Labs USA324 Kyoungro Yoon Konkuk University Korea325 Jani Lainema Nokia Finland326 Kiho Cho Seoul National University Korea327 Yukihiro Bandoh NTT Japan328 Kenichi Nakamura Panasonic Japan329 Thomas Schierl Fraunhofer HHI Germany330 So Won Kim Hanyang Univeristy Korea331 Cyril Concolato Telecom Paristech France332 Jaime Delgado Dmag-Upc Spain333 Seung Wook Lee ETRI Korea334 Ku Cheonhak LG Electronics Korea335 Yungho Choi Konkuk Univ. Korea336 Nikola Sprljan Mitsubishi Electric R&D Centre Europe UK337 Felix Fernandes Samsung Electronics USA338 Masayuki Nishiguchi Sony Japan339 Takayuki Nakachi Inconsistencies Japan340 Jin Soo Choi ETRI Korea341 Toru Chinen Sony Japan342 Rodriguez Arturo Cisco Systems USA343 ho Kyunam Galaxia Communications Korea344 Seong Yong Lim ETRI Korea345 Sang Hyun Joo ETRI Korea346 Yong Han Kim University of Seoul Korea347 Lee Eun Seo ETRI Korea348 Song Jinhan SK Telecom Korea349 Bivolarsky Lazar Skype USA350 Yoshihide Tonomura Japan Japan351 Karczewicz Marta USA USA352 Fernando Gerard USA USA353 Tung Yi-Shin Taiwan Taiwan354 Toshiya Suzuki Japan Japan355 GUEZ

VUCHERMarc France France

23

356 Xiangyang Ji Tsinghua University China357 Qifei Wang Tsinghua University China359 Marek Domanski POZNAN UNIV. TECHNOLOGY Poland360 Bruls Fons PHILIPS Netherlands361 Marius Preda institut TELECOM France362 Jongyoun Kim Net&TV Korea363 Hughes Kilroy Microsoft USA364 Francoise Preteux Institut Telecom France365 Yeongmi Kim Gwangju Institute of Science & Tech Korea366 Ryu Jeha Gwangju Institute of Science & Tech Korea367 Scott Foshee Adobe Systems Incorporated USA368 Iain James Marshall PROLOQUE PME France369 Touradj Ebrahimi EPFL Switzerland370 Walt Husak USNB & SMPTE dolby/SMPTE USA371 Dale Stolitzka ANALOG DEVICES USA372 Hae-Moon Seo KETI Korea373 Woo Chool Park KETI Korea374 Kwangmo Chung KETI Korea375 Sung Hee Hong KETI Koreav001 Michael Horowitz Vidyo, Inc. USAv002 Liu Yu Hong Kong Applied Science &

Technology Research Institute (ASTRI)Hong Kong

v003 Gisle Bjontegaard Tandberg Norwayv004 Gaelle Martin-Cocher Research In Motion Limited. Canadav006 Hui Wai Lam The Hong Kong Polytechnic University Hong Kongv007 Kam Yan-Ho The Hong Kong Polytechnic University Hong Kongv008 Fu Changhong The Hong Kong Polytechnic University Hong Kongv009 Siu Wan-Chi Hong Kong Polytechnic University Hong Kongv011 Wiegand Thomas Fraunhofer HHI Germanyv013 Jesus Sampedro Polycom USAv014 Au Oscar C. Hong Kong University of Science and

TechnologyHong Kong

24

Annex B – Agenda

1 Opening2 Roll call of participants3 Approval of agenda4 Allocation of contributions5 Communications from Convenor6 Report of previous meeting7 Processing of NB Position Papers8 Work plan management8.1 Media coding8.1.1 AAC family of Profile8.1.2 960 frame length in MPEG-4 AAC8.1.3 ALS simple profile8.1.4 Constrained Baseline Profile and Stereo High Profile8.1.5 AFX 3rd edition8.1.6 Multiresolution profile8.1.7 Scalable-complexity 3D mesh compression8.1.8 Open Font Format8.1.9 Media Value Chain Ontology8.1.10 Codec Configuration Representation8.1.11 Video Tool Library8.1.12 Spatial Audio Object Coding8.1.13 Unified Speech and Audio Coding8.1.14 Media Context and Control – Control Information8.1.15 Media Context and Control – Sensory Information8.1.16 Media Context and Control – Avatar Information8.1.17 3D Video Coding8.1.18 High-Performance Video Coding8.2 Composition coding8.2.1 BIFS for Interactive Digital Radio8.2.2 LASeR Adaptation8.2.3 Presentation and Modification of Structured Information8.2.4 Advanced User Interaction8.3 Description coding8.3.1 Video Signature Descriptors8.3.2 Extraction and Matching of Image Signature Tools8.3.3 Enhanced MPEG-7 Query Format8.3.4 Metadata driven post processing of audio signals8.4 Systems support8.4.1 MPEG-4 Systems 4th edition8.4.2 Registration Authority and Systems support8.5 IPMP8.5.1 Protection of Presentation Element8.6 Digital Item8.6.1 Presentation of Digital Item8.7 Transport and File formats8.7.1 SAOC transport8.7.2 Carriage of MVC in MPEG-2 Systems

25

8.7.3 Miscellaneous additions to File Format8.7.4 Sub-track selection & switching8.7.5 Handling of MPEG-4 Audio enhancement layers8.7.6 MPEG Media Transport8.8 Multimedia architecture8.8.1 Mesh codec for 3DGCM8.8.2 MXM Architecture and Technologies8.8.3 MXM API8.8.4 MXM Protocols8.8.5 MPEG Rich Media UI8.8.6 Media Context and Control - Architecture8.8.7 Advanced IPTV Terminal8.9 Application formats8.9.1 Media Streaming AF8.9.2 DMB AF Harmonization of MPEG-2 TS storage8.9.3 Stereoscopic Video AF composition type8.9.4 Interactive Music Application Format8.10 Reference implementation8.10.1 AAC-ELD Reference Software8.10.2 MVC Reference Software8.10.3 Stereo High Profile Reference Software8.10.4 File Format Reference Software8.10.5 Geometry and Shadow Reference Software8.10.6 SC3DMC Reference Software8.10.7 Scene Partitioning Reference Software8.10.8 Synthesized Texture Reference Software8.10.9 Image Signature Tools Reference Software8.10.10Professional Archival AF Reference Software8.10.11DMB AF Reference Software8.10.12Video Surveillance AF Reference Software8.10.13Stereoscopic video AF Reference Software8.10.14Interactive Music AF Reference Software8.10.15Video Tool Library Reference Software8.10.16MXM Reference Software8.10.17MPEG Rich Media UI Reference Software8.10.18Media Context and Control – Reference Software8.11 Conformance8.11.1 MPEG-4 Video bitstreams8.11.2 MPEG-4 Audio Conformance8.11.3 AAC-ELD, OAFI and additional AAC Conformance8.11.4 BSAC Conformance for Broadcasting8.11.5 MVC Conformance8.11.6 File Format Conformance8.11.7 3DG Conformance8.11.8 Scene Partitioning Conformance8.11.9 Scalable Complexity 3DMC Conformance8.11.103D Graphics Compression Model Conformance8.11.11Image Signature Tools Conformance8.11.12Photo Player AF Conformance8.11.13Musical Slide Show AF Conformance8.11.14Professional Archival AF Conformance

26

8.11.15DMB AF Conformance8.11.16Video Surveillance AF Conformance8.11.17Stereoscopic video AF Conformance8.11.18Interactive Music AF Conformance8.11.19Video Tool Library Conformance8.11.20MXM Conformance8.11.21MPEG Rich Media UI Conformance8.11.22Media Context and Control – Conformance8.12 Maintenance8.12.1 Systems coding standards8.12.2 Video coding standards8.12.3 Audio coding standards8.12.4 3DG coding standards8.12.5 Systems description coding standards8.12.6 Visual description coding standards8.12.7 Audio description coding standards8.12.8 MPEG-21 standards8.12.9 MPEG-A standards8.13 Work plan and time line9 Organisation of this meeting9.1 Tasks for subgroups9.2 Joint meetings10 WG management10.1 Terms of reference10.2 Officers10.3 Editors10.4 Liaisons10.5 Responses to National Bodies10.6 Work item assignment10.7 Ad hoc groups10.8 Asset management10.8.1 Reference software10.8.2 Conformance10.8.3 Test material10.8.4 URI10.9 IPR management10.10 Work plan and time line11 Administrative matters11.1 Schedule of future MPEG meetings11.2 Promotional activities12 Resolutions of this meeting13 A.O.B.14 Closing

27

Annex C – Input contributions

Number Source Title

17081 Webmaster Kyoto document register

17082 Francisco Morán Burgos Ad Hoc Group on 3DG documents, software maintenance and core experiments

17083 Yi-Shin Tung, Jens-Rainer Ohm Ad Hoc Group on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance

17084 Euee S. Jang, Marco Mattavelli, Kazuo Sugimoto

Ad Hoc Group on Reconfigurable Video Coding

17085 Miroslaw Bober, Paul Brasnett, Ryoma Oami

Ad Hoc Group on MPEG-7 Visual

17086 Karsten Müller, Anthony Vetro Ad Hoc Group on 3D Video Coding

17087 Jens-Rainer Ohm, Gary Sullivan, Vittorio Baroncini

Ad Hoc Group on High-Performance Video Coding

17088 S. Quackenbush Ad Hoc Group on Audio Standards Maintenance

17089 S. Quackenbush Ad Hoc Group on SAOC, USAC and MetaData

17090 Young-Kwon Lim, Jaeyeon Song, Cyril Concolato

Ad Hoc Group on Scene Representation

17091 David Singer Ad Hoc Group on MPEG File Formats

17092 Kyuheon Kim, Hui Yong Kim Ad Hoc Group on Application Format

17093 Vladimir Levantovsky Ad Hoc Group on Font Format Representation

17094 Xin Wang, Young Kwon Li Ad Hoc Group on Advanced IPTV Terminal

17095 Filippo Chiariglione, Christian Timmerer, Victor Rodriguez, Marius Preda

Ad Hoc Group on MXM

17096 Marius Preda Ad Hoc Group on MPEG-V

17097 Jörn Ostermann, Young-Kwon Lim, Doug Suh, Jaeyeon Song

Ad Hoc Group on MPEG Media Transport (MMT)

17098 Leonardo Chiariglione Advanced IPTV Terminal (AIT): Context and Objectives

17099 Leonardo Chiariglione Advanced IPTV Terminal (AIT): Requirements, candidate technologies and protocols

17100 Leonardo Chiariglione Advanced IPTV Terminal (AIT): Use case based testing of Basic Services

17101 Leonardo Chiariglione Advanced IPTV Terminal (AIT): Call for Proposals

17102 World DMB Forum via SC 29 Secretariat Liaison Statement from World DMB Forum [SC 29 N 10820]

17103 ITU-T SG 9 via SC 29 Secretariat Liaison Statement from ITU-T SG 9 [SC 29 N 10821]

17104 ITU-T SG 9 via SC 29 Secretariat Liaison Statement from ITU-T SG 9 [SC29 N 10822]

17105 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-14:2003/FPDAM 1 [SC 29 N 10833]

17106 SC 29 Secretariat Summary of Voting on ISO/IEC 23000-9:2008/FPDAM 2 [SC 29 N 10834]

17107 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 23000-12 [SC 29 N 10835]

17108 SC 29 Secretariat Summary of Voting on ISO/IEC 23000-10:2009/FPDAM 1 [SC 29 N

28

10838]

17109 ITU-T SG 16 via SC 29 Secretariat Liaison Statement from ITU-T SG 16 on Study Activities on Advanced IPTV Terminal [SC 29 N 10849]

17110 ITU-T SG 16 via SC 29 Secretariat Liaison Statement from ITU-T SG 16 on Enhanced Low Delay AAC [SC 29 N 10851]

17111 ITU-T SG 16 via C 29 Secretariat Liaison Statement from ITU-T SG 16 on Next-generation Video Coding Collaboration [SC 29 N 10852]

17112 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-3:2009/FDAM 1 [SC 29 N 10854]

17113 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-4:2004/FDAM 37 [SC 29 N 10855]

17114 JTC 1/SC 38 via SC29 Secretariat Establishment of JTC 1/SC 38, Distributed Application Platforms and Services [SC 29 N 10856]

17115 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 13818-1:2007/FDAM 4 [SC 29 N 10859]

17116 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 21000-19 [SC 29 N 10867]

17117 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-5:2001/FDAM 25 [SC 29 N 10868]

17118 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC FDIS 23001-4 [SC 29 N 10869]

17119 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC FDIS 23002-4 [SC 29 N 10870]

17120 Miran ChoiEuisok ChungMyung-Gil JangYunkeun Lee

AIT Testing of Basic Services for Speech QA and Advertisements Use Cases

17121 Kyoungro YoonJaeyeon SongJihun Cha

Draft Text of ISO/IEC FCD 23005-5 Data Formats for Interaction Device

17122 Kyungmo ParkJihun Chakyoungro YoonJae-joon HanSeoyoung HwangSanhyung JooYoungKwon Lim

Ideas on MPEG-V part 5: Data Formats for Interaction Devices

17123 ISO/TC 223 via SC 29 Secretariat ISO/TC 223's Resolutions and ISO/WD 22311 [SC 29 N 10876]

17124 IEC TC 100 via SC 29 Secretariat IEC NP: Common control interface for networked digital audio and video products -- Part 5-1: Transmission over networks -- General (62379-5-1)

17125 IEC TC 100 via SC 29 Secretariat IEC NP: Common control interface for networked digital audio and video products -- Part 5-2: Transmission over networks -- Signalling (62379-5-2)

17126 SC 29/WG 1 via SC 29 Secretariat Liaison Statement from SC 29/WG 1 [SC 29 N 10759]

17127 ITU-R SG 6/WP 6C via SC 29 Secretariat Liaison Statement from ITU-R SG 6/WP 6C [SC 29 N 10904]

17128 ITU-R SG 6/WP 6C via SC 29 Secretariat Liaison Statement from ITU-R SG 6/WP 6C [SC 29 N 10905]

17129 Luca AielloLeonardo ChiariglioneMarco MilaneseGiancarlo Ruffo

A top-down approach in the definition of AIT Basic Services

17130 ITU-R SG 6/WP 6B via SC 29 Secretariat Liaison Statement from ITU-R SG 6/WP 6B [SC 29 N 10911]

17131 ITU-R SG 6/WP 6B via SC 29 Secretariat Liaison Statement from ITU-R SG 6/WP 6B [SC 29 N 10912]

17132 Markus WaltlChristian Timmerer

Updated MPEG-V Part 3 Reference Software

17133 Markus WaltlChristian Timmerer

Updated MPEG-V Part 3 Conformance

29

17134 Leonardo Chiariglione OIPF Services and Functions

17135 Leonardo ChiariglioneVito U. Vavalli

Overview of the Universal Business Language version 2.0 (UBL 2.0)

17136 Christian Timmerer An Integrated Management Supervisor for Advanced IPTV Terminal (AIT)

17137 IEC TC 100 via SC 29 Secretariat IEC CDV 61966-12 [SC 29 N 10927]

17138 SC 29 Secretariat Summary of Voting on ISO/IEC 23000-3:2007/FPDAM 2

17139 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 23003-2.2

17140 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-10:2009/DCOR 1

17141 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-15:2004/FDAM 3

17142 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-16:2009/FPDAM 1

17143 SC 29 Secretariat Summary of Voting on ISO/IEC 23002-4:200X/FPDAM 1

17144 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 23006-1

17145 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 23006-2

17146 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 23006-3

17147 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 23006-4

17148 AIT AHG Advanced IPTV Terminal (AIT): Context and Objectives

17149 AIT AHG Advanced IPTV Terminal (AIT): Requirements, candidate technologies and protocols

17150 AIT AHG Advanced IPTV Terminal (AIT): Call for Proposals

17151 AIT AHG Adavanced IPTV Terminal - Toward a joint ISO/ITU project

17152 Liaison Statement from Broadband Forum via SC 29 Secretariat

Liaison Statement from Broadband Forum [SC 29 N 10937]

17153 Pierrick Philippe Contribution to the MPEG USAC Reference Encoder

17154 Shuichi AokiKatsunori AokiHiroyuki Hamada

Proposal of additional MMT use cases and requirements

17155 Gun BangNeung-joo HwangDonggyu SimHyunho JoGi-Mun UmWon-Sik CheongNamho HurJinwoong Kim

3DV/FTV EE results of depth estimation and coding experiment on "lovebird1" sequence

17156 A. G. Tescher for USNB On standardization of mobile visual search

17157 Next Generation Broadcasting Forum (Korea)

Study Text of ISO/IEC 23000-11/FPDAM1 Stereoscopic Video AF: Conformance and Reference Software

17158 S. Quackenbush Report of 90th MPEG Audio Meeting

17159 Riccardo Chiariglione Vincenzo GiarratanaEmiliano LeporatiSergio MatoneAndrea PignatielloFederico PaganiniEdoardo Radica

An Example of Media Streaming AF: IPTV Marketplace (IPTV-MP)

17160 JNB JNB comments on N11066

30

17161 Shuichi AokiYukihiro Nishida

Proposal of an additional stream type assignment in MPEG-2 Systems

17162 National Body of Japan Comment on Call for Proposals on HVC

17163 Lai-Man PoKa-Man WongKa-Ho NgKwok-Wai CheungChi-Wang TingYu LiuKa-Man ChengYan Huo

Motion Compensated Prediction by Subsampled Block Matching for Zoom Motion Contents

17164 Minsu AhnJames Do Kyoon Kim

Multi-resolution approach for 3D Mesh Compression

17165 Kristofer KjörlingLars Villemoes

Report on cross-check listening test for the USAC CE on ?Unification of USAC Windowing and Frame Transitions?

17166 Per EkstrandLars VillemoesSascha DischFrederik NagelStephan Wilde

WD text for USAC CE on Harmonic Transposer

17167 Max Neuendorf

Philippe GournayStefan Bayer

Completion of Core Experiment on unification of USAC Windowing and Frame Transitions

17168 Vijay ChandrasekharDavid ChenAndy Lai LinGabriel TakacsSam S. TsaiNgai-Man CheungBernd Girod

Comparison of Image Feature Descriptors for Mobile Visual Search

17169 Yuriy Reznik Cross-check of contribution M17168 (Comparison of Image Feature Descriptors for Mobile Visual Search)

17170 Yuriy ReznikKyu-Han Kim Cheng-Hsin Hsu Jatinder Pal Singh Herbert Bay

Mobile Visual Search and Mobile Augmented Reality Applications: Opportunity for a new Standard

17171 Yu LiuYan HuoCarmen Cheng

Unified Loop Filter for Video Coding

17172 B. S. ChoiE. S. LeeJangHanYoon

Conformance Test added with Rigid Body Motion Effect

17173 Shinichi SakaidaAtsuro IchigayaYasutaka MatsuoTakahiro ToyodaKazuhisa IguchiYoshiaki Shishikui

7680 x 4320 format test sequences for HVC

17174 Jakub StankowskiKrzysztof KlimaszewskiOlgierd StankiewiczKrzysztof WegnerMarek Domanski

Preprocessing methods used for Poznan 3D/FTV test sequences

17175 Olgierd StankiewiczKrzysztof Wegner

Newspaper sequence - Results of 3DV/FTV Exploration Experiments with depths and view synthesis

31

Krzysztof Klimaszewski

17176 Marek DomanskiOlgierd StankiewiczKrzysztof Wegner

First version of depth maps for Poznan 3D/FTV test sequences

17177 Khaled MamouTitus ZahariaMarius PredaFrançoise.Prêteux

SC3DMC integration into IM1

17178 Khaled MamouChristophe Dehais

PTFAN: a multi-resolution extension for the TFAN codec

17179 JNB Request for assigning an additional stream type in MPEG-2 Systems

17180 Siu Wan-Chi (PolyU)Kam Yan-Ho (PolyU)Liu Yu (ASTRI)Cheng Ka Man (ASTRI)Huo Yan (ASTRI)

Advanced Direct Mode for Bi-directionally Predictive Block Coding

17181 Kam Yan-Ho (PolyU)Siu Wan-Chi (PolyU)Chan Yui-Lam (PolyU)Hui Wai-Lam (PolyU)Fu Changhong (PolyU)Liu Yu (ASTRI)Cheng Ka Man (ASTRI)Huo Yan (ASTRI)

Variable Block Size Skip Mode and New Partition Modes for Inter-prediction

17182 Wonsuk LeeSeungyun Lee

Proposal for revised generic metadata APIs on MXM

17183 UK National Body UKNB Comments on Call for Proposals on HVC

17184 Noboru HaradaHouari Sabirin Hendry Takehiro MoriyaYutaka KamamotoMunchuri Kim

Proposed corrigendum to ISO/IEC 23000-6:2009 PA-AF

17185 Weon-Geun OhJu-Kyong JinJu-hee ChoSang-il NaDong-Seok Jeong

Suggestion of pre-filtering descriptor for efficient search of long length videos

17186 Sang-il NaWeon-Geun OhJu-Kyong JinJu-hee ChoDong-Seok Jeong

Proposal on Video Signature Tools for fast matching (VCE-1)

17187 Jeongil SeoKyeongok Kang

Comments on the Usage of DCU in SAOC

17188 Hui Yuan ylchang@xidian.edu.cnMing liFuzheng YangJunjyan HuoZhibin Li

Distortion Model of Virtual Views based on texture and depth compression

17189 Doug Young Suh Extension of NAL for MMT

17190 Hui YuanYilin ChangMing LiFuzheng YangJunyan HuoZhibin Li

Model based Optimal Bit allocation between texture and depth

32

17191 Shinya ShimizuHideaki Kimata

3DV/FTV EE4 results on Pantomime sequence

17192 JIn Young LeeSeong-Jun BaeSoon-heung JungJeong Ju Yoo

Walkthrough of AIT Use Case : Distance Learning

17193 Jin Young LeeSeong-Jun BaeSoon-heung JungJeong Ju Yoo

Walkthrough of AIT Use Case : Traffic/Accident Live-cast

17194 Jin Young LeeSeong-Jun BaeSoon-heung JungJeong Ju Yoo

Comments on MMT requirements

17195 Ian BurnettMohamad Raad

Proposed technical solutions for the Presentation item in MPEG-21

17196 Mohamad Raad A comment on royalty free standards development

17197 Sungryeul Rhyu MMT Requirements

17198 Seo-Young Hwang Proposed text for WD of 14496-20 LASeR AMD2 Reference SW

17199 Seo-Young Hwang a demonstration of MPEG-4 LASeR AMD2

17200 Inseon JangHui Yong KimJeongil SeoLaurent PrimauxOwen LagadecEmmanuel Bouix

Editor's study on ISO/IEC 23000-12 FCD Interactive music application format

17201 Inseon JangJeongil SeoKyeongok Kang

Proposed text for WD of ISO/IEC 23000-12 Interactive Music AF Conformance and Reference SW

17202 Gregory PallonePierrick Philippe

Proposed configuration for the SAOC verification tests

17203 Jihun ChaSungyoung LimInjae LeeHankyu LeeYoung-kwon Lim

Data format for multi-pointing AUI device

17204 Zhou HuanChong Kok SengZhong HaishanTakeshi NorimatsuTomokazu IshikawaNeo Sua Hong

Updated Information on CE proposal of QMF Based Phase Vocoder in eSBR Tool

17205 Masayuki TanimotoToshiaki Fujii Mehrdad Panahpour Tehrani Menno Wildeboer

3DV/FTV EE1 report on Champagne Tower sequence

17206 Masayuki TanimotoToshiaki Fujii Mehrdad Panahpour Tehrani Menno Wildeboer

3DV/FTV EE4 report on Champagne Tower sequence

17207 Masayuki TanimotoToshiaki Fujii Mehrdad Panahpour Tehrani Menno Wildeboer

3DV/FTV EE1 report on Kendo and Balloons sequences

17208 Masayuki TanimotoToshiaki Fujii

Depth Estimation for Moving Camera Test Sequences

33

Mehrdad Panahpour Tehrani Menno Wildeboer

17209 Jeongook SongChang-Heon LeeHenney Oh

YSU-LG Listening test report on Unification of USAC Windowing and Frame Transitions

17210 Cyril ConcolatoKyungmo Park

Comments on ISO/IEC 23007-1 FCD MPEG-U Widgets

17211 Takehiro Moriya Crosscheck report of Huawei?s CE proposal for memory and complexity reduction of USAC LPD mode

17212 Takehiro MoriyaYutaka KamamotoNoboru Harada

Core Experiment proposal on lossless coding of pitch lag for ACELP in USAC

17213 Cyril ConcolatoKyungmo Park

Proposal for updated text on ISO/IEC 23007-3 MPEG-U Conf. & Ref. Software

17214 Cyril ConcolatoKyungmo Park

Ideas on ISO/IEC 23007-1 MPEG-U Widgets Video.

17215 Taejin LeeSeungkwon BeackMinje KimKyeongok Kang

Report on TCX Improvements

17216 Taejin LeeSeungkwon BeackMinje KimKyeongok Kang

ETRI Listening Test Results for CE on Unification of USAC Windowing and Frame Transitions

17217 Pablo CarballeiraJulián CabreraFernando JaureguizarGianluca CernigliaroJuan CasalNarciso García

Refinement results on 3DVC EE4 for Beergarden MVD2

17218 Pablo CarballeiraJulián CabreraFernando JaureguizarGianluca CernigliaroJuan CasalNarciso García

Refinement results on 3DVC EE4 for Newspaper MVD3

17219 Christian Timmerer(on behalf of ANB)

Austrian NB comments on ISO/IEC FCD 23006-1

17220 Christian Timmerer(on behalf of ANB)

Austrian NB comments on ISO/IEC FCD 23006-2

17221 Christian Timmerer(on behalf of ANB)

Austrian NB comments on ISO/IEC FCD 23006-3

17222 Christian Timmerer(on behalf of ANB)

Austrian NB comments on ISO/IEC FCD 23006-4

17223 Cheon LeeMinkoo KangYo-Sung Ho

Results of EE1 on ?Cafe? Sequence

17224 Cheon LeeSang-Beom LeeYo-Sung Ho

Results of EE4 on ?Pantomime? Sequence

17225 Eun-Kyung LeeYun-Suk KangJae-Il JungYo-Sung Ho

3-D Video Generation using Multi-depth Camera System

17226 Patrick Lopez 3DV EE4 Results on BeerGarden sequence

34

Dong Tian

17227 JungHoe KimEunmi OhWerner OomenHeiko PurnhagenJulien Robilliard

Proposed change of the IPD sign in USAC

17228 JungHoe KimEunmi Oh

Proposed informative encoder description of phase coding in USAC

17229 JungHoe KimEunmi Oh

Crosscheck report on Unification of USAC Windowing and Frame Transitions

17230 JungHoe KimMiyoung KimEunmi Oh

Comments on reference software of MPEG Surround and reference software using MPEG Surround tool

17231 Paul BrasnettKota IwamotoStavros PaschalakisMiroslaw Bober

CE Results on Video Signature Tools (VCE-1 & VCE-2)

17232 Truong Cong ThangJung Won KangJeong-Ju Yoo

Comments on MPEG AIT Requirements

17233 Paul BrasnettKota IwamotoStavros PaschalakisRyoma OamiMiroslaw Bober

Proposal for Study on ISO/IEC 15938-3/FPDAM4 Video Signature Tools

17234 Truong Cong ThangJung Won KangSeong-jun BaeJeong-Ju Yoo

Proposed Updates to MMT Use Cases and Requirements

17235 Paul BrasnettNikola SprljanStavros Paschalakis

CE Results on Video Signature Tools (VCE-3)

17236 Paul BrasnettStavros PaschalakisMiroslaw Bober

Results On Image Signature Conformance Testing

17237 Pierrick Philippe on Behalf of the FRNB French National Body comments on ?Royalty-free? Standardization by MPEG

17238 Kazuo SugimotoRyoji HattoriShun-ichi SekiguchiYoshihisa Yamada

Block-based Pyramid Prediction (BPP) for High-performance Video Coding

17239 Ferenc KraemerHeiko PurnhagenFrans de Bont

Proposed corrections to MPEG Surround conformance and reference software

17240 Kazuo SugimotoShun-ichi SekiguchiKeiichi ChonoAtsuro IchigayaKazuhisa IguchiTakahiro NishiSteffen Wittmann

AVC Anchor Streams of Class-A for CfP on HVC

17241 Wei XiaoDavid ViretteHerve Taddei

Progress report on improved indexing of the AVQ-based LPC quantization for USAC

17242 David ViretteDejun ZhangFuwei Ma

Progress report on Improved Pulse Indexing for ACELP in USAC

35

Hervé Taddei

17243 Christian TimmererMichael Grafl

Comments on Advanced IPTV Terminal (AIT)

17244 Jaewon SungByeong-Moon Jeon

EE4 Coding Experiment Results Using Book_Arrival Test Sequence

17245 Zhengzhong DuWei XiaoDavid ViretteHervé Taddei

Huawei Listening Test Report on Harmonic Transposition

17246 Wei XiaoDavid ViretteHerve Taddei

Proposed CE on Spectral Noiseless Coding for USAC

17247 Fabian HausselRalf Geiger

Bugfixes to MPEG-4 SLS Reference Software

17248 Gerhard TechKarsten Müller

3D Video Coding Results of Exploration Experiments

17249 Oliver Wuebbolt Spectral Noiseless Coding CE: Crosscheck report

17250 Dong TianPo-Lin LaiPatrick Lopez

3D Video Coding Results of Exploration Experiments on BookArrival

17251 Kei Kikuiri NTT DOCOMO Listening Test Results for Harmonic Transposer CE in USAC

17252 Kei KikuiriAtsushi YamaguchiNobuhiko Naka

Additional Information on Enhanced Temporal Envelope Shaping CE for USAC

17253 Max Neuendorf Proposed Corrections to Reference Software and WD5 of USAC

17254 Victor Rodriguez-DoncelJaime Delgado

Proposal for a MVCO Reference Software Plan

17255 Yin ZhaoLu Yu

3DV EE4 Report on Book_arrival Sequences

17256 Yin ZhaoLu Yu

A Video Quality Assessment Method

17257 Pierrick PhilippeGregory Pallone

Cross check report for Huawei proposal on Spectral Noiseless Coding for USAC

17258 VOID VOID

17259 fons bruls 3DV EE Results

17260 Karol Wnukowicz Cross validation report on M17231

17261 Zhong HaishanChong Kok SengZhou Huan Takeshi NorimatsuTomokazu IshikawaNeo Sua Hong

Status report of time warping CE

17262 Karol Wnukowicz Cross validation report on M17235

17263 Jonas EngdegårdHeiko PurnhagenJürgen HerreAndreas HölzerLeonid TerentievCornelia FalchOliver HellmuthJeroen Koppens

Changes for editorial consistency of SAOC FCD text

36

17264 Jonas EngdegårdHeiko PurnhagenJürgen HerreAndreas HölzerLeonid TerentievCornelia FalchOliver HellmuthMaria Luis ValeroJeroen Koppens

Report on corrections for SAOC

17265 Jonas EngdegårdHeiko PurnhagenOliver HellmuthJürgen HerreJohannes HilpertLeonid TerentievAndreas HölzerCornelia FalchWerner Oomen

Additional information on the SAOC verification test plan

17266 Jonas EngdegårdHeiko PurnhagenJürgen HerreLeonid TerentievCornelia FalchOliver Hellmuth

Provisions for MBO handling in SAOC

17267 Jonas EngdegårdHeiko PurnhagenJürgen HerreCornelia FalchLeonid TerentievOliver Hellmuth

Additional information on SAOC DCU

17268 Jonas EngdegårdHeiko PurnhagenAndreas HölzerJohannes HilpertJürgen HerreOliver Hellmuth

Proposal for improvement of SAOC parameter quantization schemes

17269 Bojan JoveskiIain-James MarshallMihai MitreaFrançoise PreteuxPieter SimoensAbdeslam TanguengayteBart Dhoedt

Towards adoption of collaborative BiFS technologies for use in immersive environments

17270Guillaume FuchsJungHoe KimMarkus MultrusEunmi OhNikolaus RettelbachVignesh Subbaraman

Updated proposal of the CE on the Spectral Noiseless Coding in USAC

17271 Oliver WuebboltMarkus Multrus

Spectral Noiseless Coding CE in USAC: Report on evaluation of a combined proposal from Fraunhofer and Thomson

17272 Bojan JOVESKIMihai MITREAFrançoise PRETEUXIain-James MARSHALLPieter SIMOENSBart DHOEDT

Data setup for a comparative study between BiFS & LASeR performances for thin client player

17273 Heiko PurnhagenPontus CarlssonWerner OomenErik Schuijers

Educational information on Unified Stereo encoding

37

17274 Sehoon YeaAnthony Vetro

Results of EE4 on Mobile

17275 Iain James MarshallAbdeslam TaguengayteErick Fremont

Cooperative Multi User Mpeg Technologies for Business Tools

17276 Cliff Reader Video Coding Intellectual Property Rights: Analysis and Risk Management

17277 Rob Glidden Gerard FernandoCliff Reader

Information on royalty-free standardization in MPEG

17278 Erik SchuijersHeiko PurnhagenPontus CarlssonWerner OomenJulien Robilliard

Corrections to Unified Stereo Coding

17279 Erik SchuijersHeiko PurnhagenPontus CarlssonWerner Oomen

Update on CE on parametric stereo coding in USAC

17280 Werner OomenKristofer KjorlingHeiko PurnhagenBernhard GrillJohannes HilpertPhilippe Gournay

Further thoughts on USAC CE process

17281 Bernd Girod Recent Advances in Mobile Visual Search

17282 Yuriy Reznik On algorithms and architectures for mobile visual search

17283 Marius Preda Streaming needs for MPEG-V

17284 Ivica ArsovLuyen van NgoMarius Preda

FootPrint API for MXM

17285 Henney Oh Proposed corrections on MPEG SAOC text

17286 Henney OhJeongil Seo

LG-ETRI Crosscheck listening test report on SAOC DCU

17287 Henney Oh Information and comments on SAOC DCU

17288 Henney Oh Report on lossless parameter coding in SAOC, LD-SAOC and LD-MPS

17289 Sungyong YoonHyunkook Lee

Progress report on the arithmetic coding CE for USAC

17290 Ying ChenPeisong ChenMarta Karczewicz

Comments on PDAM 6 of MPEG-2 Systems: Transport of Multiview Video

17291 Kiho ChoSungyong YoonHyunkook LeeNam Soo Kim

Core Experiment Proposal on the quantization of spectral coefficients of TCX

17292 Hyunkook LeeSungyong Yoon

Report on the USAC reference encoder

17293 Jaejoon LeeSeok LeeHoCheon WeyDu Sik Park

3DV EE4 Results on Newspaper sequence

17294 David Singer Two issues with movie fragments

38

17295 Takanori Senoh Kenji Yamamoto Ryutaro OiTomoyuki MishinaTaiichiro Kurita

Report of 3DV Exploration Experiment1

17296 Takanori SenohKenji YamamotoRyutaro OiTomoyuki MishinaTaiichiro Kurita

Improvement of Depth Estimation

17297 David Singer Two minor issues with the proposed amendent to Part 12

17298 Takehiko Nakano Study on file format video requirements

17299 Hyungyu KimMinsoo ParkHwa Seon ShinYong-Hwan KimByeongho ChoiEuee S. Jang

A further study on media identification engine for MXM

17300 Seungju HanJae-Joon HanWonchul BangJames D. Kim

Sensor Adaptation Preference

17301 Jae-Joon HanSeungju HanWonchul BangJames D. KimSang-Kyun Kim

Consideration for massive real-time data

17302 E.S. LeeB.S. ChoiJ.H. JangD.W. HanK.R. ParkK. YoonH. S. Choi

MPEG-V Part 2 Reference Software

17303 Qifei WangXiangyang JiQionghai DaiNaiyao Zhang

3DV/FTV EE results of coding experiment on "Lovebird1" sequence

17304 Qifei WangMingjin YangXiangyang JiQionghai Dai

3D Video Coding EE1 Results for Poznan_Hall Test Sequence

17305 Jeha RyuYeongmi Kim

Updated MPEG-V Part 3 Conformance to Support Haptic Effects

17306 Xianguo ZhangQian HuangLuhong LiangTiejun HuangWen Gao

Proposal of New Profile for Surveillance Videos

17307 Sowon KimDaiyong KimSeungwook LeeBonki KooEuee S. Jang

SC3DMC software integration on 3DGraphicsEngine in MXM

17308 Seungwook LeeBonki KooDaiyong KimSowon KimEuee S. Jang

Implementation and bug fixing of MPEG-4 3DMCe reference software

39

17309 Seungwook LeeBonki KooMing-Xiao ChenSowon KimDaiyong KimHyunok OhEuee S. Jang

Case study of 3DMCe implementation in RVC framework using HOPES

17310 Kyoungro YoonJaeyeon SongJihun Cha

Proposal text for the study of FCD of MPEG-V Part5

17311 Kyoungro YoonSoohan KIMMyungsu LeeWoo Chool ParkHae Moon SeoChoi Jae Wan

Proposal of Identification Scheme for Virtual Objects

17312 IEC TC 100 via SC 29 Secretariat Liaison Statement from IEC TC 100 [SC 29 N 10966]

17313 Kyoungro Yoon Proposal text for the study of FCD of MPEG-V Part2

17314 Alex Giladi MMT Vision

17315 Sairus Patel Corrigenda Items for ISO/IEC 14496-22 "Open Font Format"

17316 Xiaoxian LiuYuan Hui

A depth estimation method for edge precision guarantee of synthesized view

17317 Nhut NguyenJaeyeon SongKyungmo Park

Jean Le Feuvre

Proposed text for security section of MPEG-U specification

17318 Jérôme GorinMatthieu WipliezMickaël RauletMarco MattavelliFrançoise Préteux

Demo : An MPEG RVC decoder based on LLVM

17319 Mickaël Raulet MPEG-4 AVC conformance testing status report

17320 Ying ChenMarta KarczewiczRahul Panchal

Video Track Selection and Switching based on Temporal Subsets

17321 Doug Young SuhYongil KwonJae Yeon Song

Additional use case for MMT(informative)

17322 Ihab AmerMariam Mostafa SalehMarco MattavelliMickaël Raulet

MPEG-4 SP conformance testing status report with Btype

17323 Hui Yong KimYong Han KimJungHui LeeHeon Ju Park

Text, conf. file, and ref. SW for S-DMB in DMB-AF (23000-9/Amd1)

17324 Withdrawn [WITHDRAWN] Editorial update on DMB-AF FPDAM1 text ...

17325 Chris LeeHe-Yuan Lin Tsung-Yuan HuangJia-Wei Liang

RVC Conformance testing for IQ/IDCT and intra prediction of MPEG-4 AVC

17326 Hui Yong KimMyung Seok KiHan-Kyu Lee

Clarification on OD/BIFS box in DMB-AF FPDAM2 (23000-9/Amd2)

40

Yong Han Kim

17327 Pierrick PhilippeGregory Pallone

Cross check of proposed SAOC quantization scheme improvement

17328 Jean Le Feuvre Electronic Attachments of ISO/IEC 14496-11:2005 AMD7

17329 Christian Timmerer Abstracts for MXM

17330 Yongju ChoHankyu Lee

Cross Layer Optimization (CLO) for reliable video delivery over mobile wireless networks

17331 Cyril ConcolatoJean Le Feuvre

About MPEG-U and W3C

17332 Walt Husak SMPTE Liaison on 3D

17333 Walt Husak SMPTE liaison on JP2K over M2T

17334 Seongho ChoKyungmo Park

Industry Viewpoints of Internet TV over IP networks: Trends and Technologies

17335 ITU-T SG 16 via SC 29 Secretariat Liaison Statement from ITU-T SG 16

17336 Gero Bäse GNB response to: "Call for Comments on Possible Future activities on "Royalty-free" Standardization by MPEG"

17337 Jihun ChaInjae LeeSeong-Yong LimHanKyu LeeYounf-Kwon Lim

Use of MPEG-V Part 5 Sensed Information in LASeR

17338 Feng LuXiangyang JiGuihua ErQionghai Dai

Test on multi-resolution mesh coding for CE 4

17339 Zhenyu WuStephane GouacheGuillaume Bichot

Future media adaptation and delivery (MMT)

17340 Yongwei ZhuRongshan YuSusanto Rahardja

Comments on Study of ISO/IEC FCD 23000-12 Interactive Music AF (N10970)

17341 Yongwei ZhuRongshan YuSusanto Rahardja

A proposal for the support of audio equalization and interactivity in IM AF

17342 Xiaocong Zhou (xczhou@jdl.ac.cn )Tiejun Huang (tjhuang@pku.edu.cn)

Revised text of ISO/IEC 21000-2/PDAM 1: Presentation of Digital Item

17343 Hyungyu KimMinsoo ParkSowon KimEuee S. Jang

RVC Conformance Testing Result on MPEG-4 SP and RSM Debugging Report

17344 Hyunok OhEuee S. Jang

HOPES : Retargetable parallel-programming framework in C and C++

17345 Tiejun Huang Comments on Royalty-free Standardization by MPEG

17346 Open IPTV Forum via SC 29 Secretariat Liaison Statement from Open IPTV Forum (OIPF)

17347 IEC TC 100 via SC 29 Secretariat IEC CDV 62605

17348 Jean Le Feuvre Cyril Concolato on behalf of FRNB

FRNB Comment on ISO/IEC 14496-11:2005 AMD7

17349 Hwa Seon Shin Coordinator's Report on RVC RSM Management

17350 Alex Giladi MMT Vision: Reflections on the Scope of MMT

41

17351 Kilroy Hughes SMPTE Liaison on MMT

17352 Euee S. JangGwo Giun Lee

Comments on RVC conformance and development

17353 Madhukar BudagaviMinhua Zhou

Orthogonal MDDT and Mode Dependent DCT

17354 Pierrick Philippe on Behalf of the FRNB French National Body comments on HVC

17355 Gary J. SullivanJens-Rainer OhmThomas WiegandAjay Luthra

Report of the 32nd JVT Meeting (Geneva, 2 - 3 November 2009)

17356 Xin Wangon behalf of the AIT ad hoc group

Context and Objectives for Advanced IPTV Terminal (AIT)

17357 Xin Wangon behalf of the AIT ad hoc group

Requirements for Advanced IPTV Terminal (AIT)

17358 Xin Wangon behalf of the AIT ad hoc group

Advanced IPTV Terminal (AIT): Call for Proposals

17359 Touradj EbrahimiMarco Mattavelli

CHNB comments on Royalty-Free Standardization

17360 Kyeongok Kang KNB Comment on ISO/IEC 14496-16:200X/FPDAM1

17361 Markus MultrusJungHoe Kim

Changes to WD5 for the CE on the Spectral Noiseless Coding in USAC

42

Annex D – Output documents

 

Number Source Title

11074 Convener List of Documents from the 91st Meeting in Kyoto, Japan

11075 Convener Resolutions of the 91st Meeting in Kyoto, Japan

11076 Convener List of AHGs Established at the 91st Meeting in Kyoto, Japan

11077 Convener Report of the 91st Meeting in Kyoto, Japan

11078 Convener Guidelines for Electronic Distribution of MPEG M and N Documents

11079 Convener Press Release of the 91st Meeting in Kyoto, Japan

11080 Convener Meeting Notice of the 92nd Meeting in Dresden, Germany

11081 Convener Guide for WG 11 Meeting Hosts

11082 Video Disposition of comments on ISO/IEC 14496-10:2009/DCOR 1

11083 Video Text of ISO/IEC 14496-10:2009/COR 1

11084 Video Text of ISO/IEC IS 14496-10:201X (6th edition)

11085 Video Study Text of ISO/IEC 15938-3/FPDAM 4 Video Signature Tools

11086 Video MPEG-7 Visual XM 38

11087 Video Description of Core Experiments in Video Signature Description development

11088 Video Disposition of Comments on ISO/IEC 15938-7/FPDAM 5

11089 Video Text of ISO/IEC 15938-7/FDAM 5 Conformance Testing for Image Signature Tools

11090 Video Disposition of Comments on ISO/IEC 23000-3/FPDAM 2

11091 Video Text of ISO/IEC 23000-3/FDAM 2 Conformance Testing for Photo Player MAF

11092 Video Study Text of ISO/IEC 23002-4/FPDAM 1 Video Tool Library Conformance and Reference Software

11093 Video Description of Core Experiments in RVC

11094 Video RVC Work Plan

11095 Video Description of Exploration Experiments in 3D Video Coding

11096 Video Vision, Applications and Requirements of High Performance Video Coding

11097 Convener Liaison statement to ITU-T SG16 Q6 on Video Coding Collaboration

11098 Convener Liaison statement to ITU-T SG 9 on 3D Video Coding

11099 Convener Liaison statement to ITU-R SG 6/WP 6C on 3D Video Coding

11100 Convener Terms of Reference

11101 Convener MPEG Standards

11102 Convener Unpublished standards at FDIS level

11103 Convener MPEG work plan and time line

11104 Convener MPEG Standard Editors

11105 Convener Schema assets updates

11106 Convener Software assets

43

11107 Convener Conformance assets

11108 Convener Content assets

11109 Convener MPEG URIs and MIME Types

11110 Convener Standards under development for which a call for patent statements is issued

11111 Convener List of Organisations with which MPEG entertains liaisons

11112 Convener Terms of Reference of the Joint Collaborative Team on Video Coding Standard Development

11113 Convener Joint Call for Proposals for Video Coding Technology

11114 Convener Liaison statement to SMPTE on 3D Video Coding

11115 Convener Responses to National Bodies on video issues

11116 Convener AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance

11117 Convener AHG on Reconfigurable Video Coding

11118 Convener AHG on MPEG-7 Visual

11119 Convener AHG on 3D Video Coding

11120 Convener AHG on High-Performance Video Coding

11121 3DGC Study Text of ISO/IEC 14496-5:2001/FPDAM 27 Reference Software for Scalable Complexity 3D Mesh Coding

11122 3DGC Description of 3DG Core Experiments

11123 3DGC DoC on ISO/IEC 14496-16:2009 FPDAM1 Scalable Complexity 3D Mesh Compression

11124 3DGC ISO/IEC 14496-16:2009 FDAM1 Scalable Complexity 3D Mesh Compression

11125 3DGC WD 2.0 of ISO/IEC 14496-16:2009 AMD2 Efficient representation of 3D meshes with multiple attributes

11126 3DGC Study Text of ISO/IEC 14496-27:2009/FPDAM2 Conformance for Scalable Complexity 3D Mesh Coding

11127 3DGC Text of ISO/IEC 14496-27:2009/PDAM3 Conformance for Scalable Complexity 3D Mesh Coding in 3DG Compression Model

11128 Convener AHG on 3DG documents, software maintenance and core experiments

11129 Convener AHG on Multi-Resolution 3D mesh Coding

11130 Systems Study Text of ISO/IEC 13818-1:2007/PDAM 5 Transport of JPEG2000

11131 Systems Study Text of ISO/IEC 13818-1:2007/PDAM 6 MVC operation point descriptor

11132 Systems Request for ISO/IEC 14496-5:2001/AMD 28 Reference Software for LASeR Adaptation Tools

11133 Systems Text of ISO/IEC 14496-5:2001/PDAM 28 Reference Software for LASeR Adaptation Tools

11134 Systems Study Text of ISO/IEC 14496-11:2005/FPDAM 7 ExtendedCore2D Profile

11135 Systems Technologies under Consideration for use of BIFS for collaborative applications

11136 Systems Request for ISO/IEC 14496-12:2008/AMD 2 Sub-track selection & switching

11137 Systems Text of ISO/IEC 14496-12:2008/PDAM 2 Sub-track selection & switching

11138 Systems Text of ISO/IEC 14496-14:2003/FDAM 1 Handling of MPEG-4 audio enhancement layers

11139 Systems Text of ISO/IEC 14496-15 2nd edition

11140 Systems Updated Workplan for service examples of LASeR Adaptation & PMSI

11141 Systems Study Text of ISO/EC 14496-22:2009/FPDAM 1 Support for many-to-one range mappings

11142 Systems Text of ISO/IEC 14496-22:2009/DCOR 1

44

11143 Systems Text of ISO/IEC 21000-2:2005/FPDAM 1 Presentation of digital item

11144 Systems Text of ISO/IEC 21000-2:2005/FPDAM 2 Protection of presentation description

11145 Systems DoC on ISO/IEC FCD 21000-19 Media Value Chain Ontology

11146 Systems Text of ISO/IEC FDIS 21000-19 Media Value Chain Ontology

11147 Systems Workplan for Media Value Chain Ontology Reference Software

11148 Systems DoC on ISO/IEC CD 23000-5 2nd Edition Media streaming application format

11149 Systems Text of ISO/IEC FCD 23000-5 2nd Edition Media streaming application format

11150 Systems Text of ISO/IEC 23000-6:2009/DCOR 1 Professional archival application format

11151 Systems Text of ISO/IEC 23000-9:2008 FDAM 1 Conformance and reference software

11152 Systems DoC on ISO/IEC 23000-9:2008 FPDAM 2 Harmonization on MPEG-2 TS storage

11153 Systems Text of ISO/IEC 23000-9:2008 FDAM 2 Harmonization on MPEG-2 TS storage

11154 Systems DoC on ISO/IEC 23000-10:2009 FPDAM 1 Conformance and reference software

11155 Systems Text of ISO/IEC 23000-10:2009 FDAM 1 Conformance and reference software

11156 Systems Study Text of ISO/IEC 23000-11/FPDAM 1 Stereoscopic Video AF Ref. Soft and Conf.

11157 Systems DoC on ISO/IEC FCD 23000-12 Interactive Music AF

11158 Systems Text of ISO/IEC FDIS 23000-12 Interactive Music AF

11159 Systems Request for ISO/IEC 23000-12/AMD 1 Conformance and Reference Software

11160 Systems Text of ISO/IEC 23000-12 PDAM 1 Conformance and Reference Software

11161 Systems Workplan for the Interactive Music AF Conformance & Reference SW

11162 Systems DoC on ISO/IEC FCD 23006-1 MxM Architecture and Technologies

11163 Systems Text ISO/IEC FDIS 23006-1 MxM Architecture and Technologies

11164 Systems DoC on ISO/IEC FCD 23006-2 MXM APIs

11165 Systems Text of ISO/IEC FDIS 23006-2 MXM APIs

11166 Convener Liaison statement to ITU-T SG 16 on Collaboration on AIT

11167 Systems DoC on ISO/IEC FCD 23006-3 MXM Conf. & Ref. SW

11168 Systems Text of ISO/IEC FDIS 23006-3 MXM Conf. & Ref. SW

11169 Systems DoC on ISO/IEC FCD 23006-4 MXM Protocols

11170 Systems Text of ISO/IEC FDIS 23006-4 MXM Protocols

11171 Systems AHG on Scene Representation

11172 Systems Study Text of ISO/IEC FCD 23007-1 Widgets

11173 Systems Items Under Consideration for ISO/IEC 23007-1 AMD1

11174 Systems WD of ISO/IEC 23007-2 Advanced User Interaction Interface

11175 Systems Technology under consideration for using advanced user interaction in LASeR

11176 Systems Study Text of ISO/IEC FCD 23005-2 Control Information

11177 Systems WD of ISO/IEC 23005-2/AMD1 Adaptation Preferences

11178 Systems Study Text of ISO/IEC FCD 23005-3 Sensory Information

11179 Systems Study Text of ISO/IEC FCD 23005-4 Virtual World Object Characteristics

11180 Systems Study Text of ISO/IEC FCD 23005-5 Data Formats for Interaction Device

45

11181 Systems WD of ISO/IEC 23005-5/AMD1 Multipoint Interaction

11182 Systems Request for subdivision of ISO/IEC 23005-6 Common Types and Tools

11183 Systems Text of ISO/IEC FCD 23005-6 Common Types and Tools

11184 Systems Items under consideration for ISO/IEC FCD 23005-2/AMD1 Streaming support

11185 Systems Request for subdivision of ISO/IEC 23005-7 Conformance and Reference Software

11186 Systems Text of ISO/IEC CD 23005-7 Conformance and Reference Software

11187 Convener Terms of Reference of the Joint Collaborative Team on Advanced IPTV Terminal

11188 Convener Guide to the MPEG Subversion Repository

11189 Convener List of non-MPEG members allowed to access the MPEG SVN repository

11190 Systems Ideas on ISO/IEC 23007-1 MPEG-U Widgets Video

11191 Convener Liaison statement to SMTPE on JPEG2000 over MPEG-2 TS

11192 Convener Liaison statement template on AIT

11193 Convener Liaison statement template on MMT

11194 Convener Liaison statement to SC 29/WG 1 on PA- AF

11195 Convener Liaison statement to IEC TC 100 and ITU-T SG 16 on RII

11196 Convener Liaison statement to W3C on Widgets

11197 Convener Liaison statement to ISO/TC 223 on Video Surveillance

11198 Convener Liaison statement to JTC 1/SC 38

11199 Convener Liaison statement to IEC TC 100 on Common Control Interface

11200 Requirement 2nd MMT Workshop in Kyoto: Presentations

11201 Video Draft Report on Experimental Framework in 3D Video

11202 Audio Study on ISO/IEC 14496-5:2001/AMD 10:2007/DCOR 4, SLS

11203 Audio 23003-1/AMD 1/DCOR 1, Corrections to Conformance

11204 Audio 23003-1 AMD 2/DCOR 2, Corrections to Reference Software

11205 Audio Status of MPEG Surround Reference Software

11206 Audio DoC on ISO/IEC FCD 23003-2:2010, Spatial Audio Object Coding

11207 Audio ISO/IEC FDIS 23003-2: 2010, Spatial Audio Object Coding

11208 Audio WD of MPEG SAOC Conformance and Reference Software

11209 Audio Workplan on MPEG SAOC Reference Software

11210 Audio Draft Workplan for SAOC Verification Test

11211 Audio Application Scenarios for SAOC Teleconferencing Use Cases and Workplan For Their Technical Evaluation

11212 Requirement Draft Requirements and Use Cases for the Composite Font Standard

11213 Audio WD6 of USAC

11214 Audio Workplan for USAC CEs

11215 Audio Workplan on MPEG USAC Reference Software

11216 Convener Response to Liaison from World DMB Forum

11217 Convener Response to Liaison from ITU-T SG 16 on Enhanced Low Delay AAC

46

11218 Convener Response to Liaison from ITU-R SG 6/WP 6B

11219 Convener AHG on Audio Standards Maintenance

11220 Convener AHG on MPEG Surround, SAOC, USAC

11221 Convener Possible future actions on standardization with Type 1 licensing

11222 Convener Responses to NB position statements on N10666

11223 Requirement Draft Requirements for MMT MPEG Media Transport)

11224 Requirement Draft Call for Proposals on MMT

11225 Requirement Draft MPEG Media Transport (MMT) Context and Objectives

11226 Requirement Draft use cases for MMT

11227 Requirement Vision, Applications and Requirements for Mobile Visual Search (MVS)

11228 Requirement Requirements for Advanced IPTV Terminal (AIT)

11229 Requirement Advanced IPTV Terminal (AIT): Call for Proposals

11230 Requirement Context and Objectives for Advanced IPTV Terminal (AIT)

11231 Requirement Use Cases for Advanced IPTV Terminal (AIT)

11232 Convener AHG on MPEG File Formats

11233 Convener AHG on Application Format

11234 Convener AHG on Font Format Representation

11235 Convener AHG on Advanced IPTV Terminal

11236 Convener AHG on MXM

11237 Convener AHG on MPEG-V

11238 Convener AHG on Mobile Visual Search

11239 Convener AHG on MPEG Media Transport (MMT)

47

Annex E – Requirements report

Source: Jörn Ostermann (Leibniz Universität Hannover)

No. Title

11096 Vision, Applications and Requirements for High-Performance Video Coding (HVC)

11113 Joint Call for Proposals on Video Compression Technology11200 Vision, Applications and Requirements for Mobile Visual Search (MVS)11212 Draft Requirements and Use Cases for the Composite Font Standard11221 Possible future actions on standardization with Type 1 licensing11222 Responses to NB position statements on N106611223 Draft Requirements for MMT (Modern Media Transport)11224 Draft Call for Proposals on MMT11225 Draft Modern Media Transport (MMT) Context and Objectives11226 Draft use cases for MMT11227 Vision, Applications and Requirements for Mobile Visual Search (MVS)11228 Requirements for Advanced IPTV Terminal (AIT)11229 Advanced IPTV Terminal (AIT): Call for Proposals11230 Context and Objectives for Advanced IPTV Terminal (AIT)11231 Use Cases for Advanced IPTV Terminal (AIT)

15MPEG-4 AudioIn a joint meeting with Audio, Video and Requirements, the implications of UHDTV on audio were discussed. UHDTV will have a viewing distance of about 1m resulting in a viewing angle of about 100 degrees (Figure 1). It is assumed that standard audio transmissions like 7.1 multi-channel will not provide sufficient localization of an audio source. Given the screen sizes, left-right as well as top-bottom localization will be required. WP3C developed a preliminary draft for 3D sound with a hierarchy of surround sound systems including 22.2, 12.2, 10.2, 7.1, and 6.1. As a further requirement, a large sweet spot for the viewers was identified. Possible work areas for MPEG include also the rendering of audio signals with the number of speakers smaller than the number of transmitted channels.

48

Figure 1 - UHDTV in the living room will have a viewing distance of about 1m which requires a very precise localization of audio sources.

16VideoA proposal for a new profile for surveillance videos did not find sufficient support in the MPEG membership.

17Mobile Visual SearchSeveral companies are investing in services which combine the camera of a mobile phone with the network and a compute service in order to help mobile phone users to identify contents in the image of their camera. Figure 2 shows an example. Currently, the mobile phone sends the image in order to use the server service. Replacing the image by features representing the image can reduce the size of the information to be transmitted to the server to less than 400 bits.

At this point, industrial support for such a service, requirements for a standard defining the representation of features and the scope of the standard need to be defined. N11227 Vision, Applications and Requirements for Mobile Visual Search (MVS) summarizes initial thoughts on these topics. Further discussions are carried out within the MPEG-7 adhoc group.

49

Figure 2 - Proposed application scenario for mobile visual search where features instead of images are sent

18Explorations

18.1 MPEG Font FormatsThe exploration on the future Composite Font Standard currently has a draft requirements and use cases defined. As a step towards the standard, requirements and a work plan have to be agreed upon. Given the small number of four implementations in the market, the group also needs to provide an analysis of the possible impact this standard may have. The concept of virtual fonts is perceived as a solution for the development of the standard. N11212 Draft Requirements and Use Cases for the Composite Font Standard is a starting point towards the full set of documents for preparing the standardization process.

18.2 3D Video Coding

The 3DV experts offered a time table for developing the standard at the 90th meeting. The Call for Proposals is expected for the 95th meeting in January 2011.

50

Data Format

Data Format

Constrained Rate(based on distribution)

LimitedCamera Inputs

• Wide viewing angle• Large number of

output views

Left

Right

Auto-stereoscopicN-view displays

Stereoscopic displays• Variable stereo baseline• Adjust depth perception

Figure 3 - Area of standardization for 3DV

18.3 High Performance Video Coding (HVC)HVC targets mobile services, IPTV, and Ultra High Definition (UHD) displays with a focus on coding efficiency considering codec complexity as well. The current target is to increase coding efficiency by 25% at low complexity and 50% at full complexity. N11096 Vision, Applications and Requirements for High-Performance Video Coding (HVC) is the updated requirements documents serving as a guideline for applications of HVC.MPEG plans to collaborate with the ITU on high performance video coding. N11113 Joint Call for Proposals on Video Compression Technology was issued. Proposals are evaluated by subjective tests to be carried out prior to the 92nd meeting in April 2010. N11113 provides further detail on the test sequences and rate points as well as time schedule. At this meeting, more than 30 preregistrations were registered.

18.4 Advanced IPTV Terminal (AIT)

MPEG accelerated its time table for the standardization of AIT. Together with ITU-T Q13/16 Multimedia terminals, systems and applications, N11229 Joint Call for Proposals on Advanced IPTV Terminal was issued. Evaluation will take place on the weekend prior to the 92nd meeting.

Based on 21 input documents, updated requirements as well as context and objectives are reported in N11228 Requirements for Advanced IPTV Terminal (AIT) and N11230 Context and Objectives for Advanced IPTV Terminal (AIT), respectively. The main purpose of the upcoming standard is to define the exchange of information as well as command and control between the different services involved in AIT. Figure 4 shows that the combination of many services will be enabled. Therefore protocols will be at the core of the standard. It will build on the many standards already available within ITU and ISO. N11231 Use Cases for Advanced IPTV Terminal (AIT) describes applications and uses for the AIT standard. Figure 5 gives an example of an applications that AIT with its service aggregation capability will enable.

51

Figure 4 - The AIT Ecosystem

Figure 5 - Example of an AIT Service

52

18.5 MPEG Media Transport (MMT)According to N10496 issued at the 87th meeting, there is a need for a transport and file format friendly stream format. Error resilience of current MPEG streams might not be optimal. The potential gains of joint optimization of coding and transport are not known. Conversions between different transport mechanisms like from MPEG-2 Transport Stream to MPEG Program Stream are not straight forward or defined. Furthermore, MPEG does not provide any hint on how to adapt content to different networks. Information provided in NAL unit headers is not used optimally in real world implementations. However, previous attempts outside of MPEG showed that MPEG-2 Transport is difficult to replace. Hence, special care has to be taken in order to assure that MMT will find a place in the commercial market.

The area of work for MMT (Figure 6) might include adaptive progressive transport (download/stream), cross layer optimization, hybrid delivery and conversational services. It is foreseen that MMT will also provide adaptive streaming support for mp4 files.

Figure 6 - Networks of interest in the context of MPEG Media Transport

DVB, 3GPP and OIPF indicated interest in the work area. New services in the area of MMT are expected towards the end of 2010. Hence, MPEG expects to issue a Call for Proposals in April of 2010 with a due date in July of 2010.

A second workshop on MMT (N11060 Workshop on MMT (MPEG Modern Transport) – Call for Contributions) with 90 attendees took place at this 91st meeting. Eight presentations focused mainly on application scenarios, adaptive progressive download and cross layer design. N11200 2nd MMT Workshop in Kyoto: Presentations includes the program and the presentations of the workshop. Main conclusions of the work shop were: Uni- and bidirectional channels have to be considered; buffer sizes and management are not as important as in MPEG-2 development times; requirements are not yet fully understood due to the potentially diverse application scenarios. Initial design goals for an architecture were discussed. These include compatibility and efficiency which is measured in terms of rate, functionality and quality. At this point, a choice of three architectures with different implications is considered (Figure 7, Figure 8, Figure 9).

A set of documents required for the Call for Proposals in April was prepared: N11223 Draft Requirements for MMT (Modern Media Transport), N11224 Draft Call for Proposals on MMT,

53

N11225 Draft Modern Media Transport (MMT) Context and Objectives, N11226 Draft use cases for MMT. They are still in a draft status and require significant work until the next meeting. Until the 92nd meeting work on MMT is carried out within the File Format Adhoc group.

MPEG is considering combining the upcoming standards for HVC, Audio and MMT into one package.

Figure 7 - Potential architecture for MMT over TCP/UDP and http/RTP

18.6 Royalty-free CodecsIn order to help with the discussion on royalty-free codecs, several National Bodies provided input as requested in N11066 Call for Comments on Possible Future activities on “Royalty-free” Standardization by MPEG. MPEG thanks with N11222 Responses to NB position statements on N1066. No clear conclusions could be drawn from the diverse responses. Furthermore, neither MPEG nor ISO can guarantee that a standard developed with the goal of being RAND or royalty-free will actually be RAND or royalty-free since the analysis of patents is outside of the scope and competence of ISO and MPEG.

MPEG issued document N11221 Possible future actions on standardization with Type 1 licensing where the legal issues are summarized and discussed. Type 1 licensing refers to option 1 of the joint patent declaration form, where an intellectual property holder can indicate that he will not charge for his IP. Laymen refer to this type of licensing as royalty-free.

54

Figure 8 - Potential architecture for MMT over TCP/UDP

Figure 9 - Potential architecture for MMT over IP with interfaces for cross layer optimization

However, MPEG believes that 20 years after its publication some technology will become royalty-free. Since parts of MPEG-1 and MPEG-2 were published in 2013 and 2014, candidates are a MPEG-2 Part 2 baseline profile carved out of MPEG-2 Part 2, MPEG-1 Part 3 Layer 2 baseline profile carved out of the MPEG-1 part 3 Layer 2, a MPEG-1 Part 3 Layer 3 baseline profile carved out of the MPEG-1 part 3 Layer 3, and a MPEG-2 Part 1 baseline profile carved out of the MPEG-2

55

part 1. These candidates would be compatible with existing equipment. Alternatively, MPEG may define a new set of standards which are believed to be RF provided such standards provide sufficient differentiation to be successful in the market place.

56

Annex F – Systems report

Source: Young-Kwon Lim, Chair

1 List of output documents

No. Title TBP AvailableX 13818-1 MPEG-2 Systems

11130 Study Text of ISO/IEC 13818-1:2007/PDAM 5 Transport of JPEG2000

No 10/01/22

11131 Study Text of ISO/IEC 13818-1:2007/PDAM 6 MVC operation point descriptor

No 10/01/22

X 14496-5 Reference Software11132 Request for ISO/IEC 14496-5:2001/AMD 28 Reference

Software for LASeR Adaptation ToolsNo 10/01/22

11133 Text of ISO/IEC 14496-5:2001/PDAM 28 Reference Software for LASeR Adaptation Tools

No 10/01/22

X 14496-11 Scene description and application engine11134 Study Text of ISO/IEC 14496-11:2005/FPDAM 7

ExtendedCore2D ProfileNo 10/01/29

11135 Technologies under Consideration for further improvements of BIFS

No 10/02/05

X 14496-12 ISO File Format11136 Request for ISO/IEC 14496-12:2008/AMD 2 Sub-track

selection & switchingNo 10/01/22

11137 Text of ISO/IEC 14496-12:2008/PDAM 2 Sub-track selection & switching

No 10/01/22

X 14496-14 MP4 File Format11138 Text of ISO/IEC 14496-14:2003/FDAM 1 Handling of MPEG-

4 audio enhancement layersNo 10/01/22

X 14496-15 AVC File Format11139 Text of ISO/IEC 14496-15 2nd edition No 10/01/22

X 14496-20 LASeR& SAF11140 Updated Workplan for service example of LASeR Adaptation

& PMSINo 10/01/22

11175 Technology under consideration for using advanced user interaction in LASeR

No 10/01/22

X 14496-22 Open Font Format11141 Study Text of ISO/EC 14496-22:2009/FPDAM 1 Support for

many-to-one range mappingsNo 10/01/22

11142 Text of ISO/IEC 14496-22:2009/DCOR 1 No 10/01/22X 21000-2 Digital Item Declaration

11143 Text of ISO/IEC 21000-2:2005/FPDAM 1 Presentation of digital item

No 10/01/22

X 21000-4 Intellectual Property Management and Protection Components

57

11144 Text of ISO/IEC 21000-2:2005/FPDAM 2 Protection of presentation element

No 10/01/22

X 21000-19 Media Value Chain Ontology11145 DoC on ISO/IEC FCD 21000-19 Media Value Chain Ontology No 10/01/2211146 Text of ISO/IEC FDIS 21000-19 Media Value Chain Ontology No 10/01/2211147 Workplan for Media Value Chain Ontology Reference

SoftwareNo 10/01/22

X 23000-5 Media streaming application format11148 DoC on ISO/IEC CD 23000-5 2nd Edition Media streaming

application formatNo 10/01/22

11149 Text of ISO/IEC FCD 23000-5 2nd Edition Media streaming application format

No 10/02/05

X 23000-6 Professional Archival Application Format11150 Text of ISO/IEC 23000-6:2009/DCOR 1 Professional archival

application formatNo 10/03/05

X 23000-9 Digital Multimedia Broadcasting Application Format11151 Text of ISO/IEC 23000-9:2008 FDAM 1 Conformance and

reference softwareNo 10/02/05

11152 DoC on ISO/IEC 23000-9:2008 FPDAM 2 Harmonization on MPEG-2 TS storage

No 10/01/22

11153 Text of ISO/IEC 23000-9:2008 FDAM 2 Harmonization on MPEG-2 TS storage

No 10/01/22

X 23000-10 Video surveillance application format11154 DoC on ISO/IEC 23000-10:2009 FPDAM 1 Conformance and

reference softwareNo 10/01/22

11155 Text of ISO/IEC 23000-10:2009 FDAM 1 Conformance and reference software

No 10/01/22

X 23000-11 Stereoscopic Video Application Format11156 Study Text of ISO/IEC 23000-11/FPDAM 1 Stereoscopic

Video AF Ref. Soft and Conf.No 10/01/22

X 23000-12 Interactive Music AF11157 DoC on ISO/IEC FCD 23000-12 Interactive Music AF No 10/01/2211158 Text of ISO/IEC FDIS 23000-12 Interactive Music AF No 10/01/2211159 Request for ISO/IEC 23000-12/AMD 1 Conformance and

Reference SoftwareNo 10/01/22

11160 Text of ISO/IEC 23000-12 PDAM 1 Conformance and Reference Software

No 10/01/22

11161 Workplan for the Interactive Music AF Conformance & Reference SW

No 10/01/22

X 23006-1 MXM Architecture and Technologies11162 DoC on ISO/IEC FCD 23006-1 MxM Architecture and

TechnologiesNo 10/01/22

11163 Text ISO/IEC FDIS 23006-1 MxM Architecture and Technologies

No 10/02/26

X 23006-2 MXM APIs11164 DoC on ISO/IEC FCD 23006-2 MXM APIs No 10/01/2211165 Text of ISO/IEC FDIS 23006-2 MXM APIs No 10/02/26

X 23006-3 MXM Conformance & Reference Software11167 DoC on ISO/IEC FCD 23006-3 MXM Conf. & Ref. SW No 10/01/2211168 Text of ISO/IEC FDIS 23006-3 MXM Conf. & Ref. SW No 10/02/26

58

X 23006-4 MXM Protocols11169 DoC on ISO/IEC FCD 23006-4 MXM Protocols No 10/01/2211170 Text of ISO/IEC FDIS 23006-4 MXM Protocols No 10/02/26

X 23007-1 Widgets11172 Study Text of ISO/IEC FCD 23007-1 Widgets No 10/01/2211173 Items Under Consideration for ISO/IEC 23007-1 AMD1 No 10/02/05

X 23007-2 Advanced User Interaction Interface11174 WD of ISO/IEC 23007-2 Advanced User Interaction Interface No 10/01/22

X 23005-2 Control Information11176 Study Text of ISO/IEC FCD 23005-2 Control Information No 10/02/2611177 WD of ISO/IEC 23005-2/AMD1 Adaptation Preferences No 10/02/05

X 23005-3 Sensory Information11178 Study Text of ISO/IEC FCD 23005-3 Sensory Information No 10/01/22

X 23005-4 Virtual World Object Characteristics11179 Study Text of ISO/IEC FCD 23005-4 Virtual World Object

CharacteristicsNo 10/02/26

X 23005-5 Data Formats for Interaction Devices 11180 Study Text of ISO/IEC FCD 23005-5 Data Formats for

Interaction DeviceNo 10/02/26

11181 WD of ISO/IEC 23005-5/AMD1 Multipoint Interaction No 10/01/29X 23005-6 Common Types and Tools

11182 Request for subdivision of ISO/IEC 23005-6 Common Types and Tools

No 10/02/22

11183 Text of ISO/IEC FCD 23005-6 Common Types and Tools No 10/02/2611184 Items under consideration for ISO/IEC FCD 23005-6/AMD1

Streaming supportNo 10/02/05

X 23005-7 Conformance & Reference Software11185 Request for subdivision of ISO/IEC 23005-7 Conformance

and Reference SoftwareNo 10/01/22

11186 Text of ISO/IEC CD 23005-7 Conformance and Reference Software

No 10/01/22

X Management11187 Terms of References for Joint Collaboration Team on AIT No 10/01/22

X Assets and Standing Documents11105 MPEG Schema Assets Updates No 10/01/2211109 MPEG URIs and MIME Types No 10/01/22

X SVN support11188 Guide to the MPEG Subversion Repository No 10/01/2211189 List of non-MPEG members allowed to access the MPEG

SVN repositoryNo 10/01/22

X Promotion11190 Ideas on ISO/IEC 23007-1 MPEG-U Widgets Video. No 10/01/22

X Liaison11191 Liaison statement to SMTPE on JPEG2000 over MPEG-2 TS No 10/01/2211192 Liaison statement template on AIT No 10/01/2211193 Liaison statement template on MMT No 10/01/2211194 Liaison statement to SC 29/WG 1 on PA- AF No 10/01/2211195 Liaison statement to IEC TC 100 and ITU-T SG 16 on RII No 10/01/2211196 Liaison statement to W3C on Widgets No 10/01/2211197 Liaison statement to ISO/TC 223 on Video Surveillance No 10/01/22

59

11198 Liaison statement to JTC 1/SC 38 No 10/01/2211199 Liaison statement to IEC TC 100 on Common Control

Interface No 10/01/22

11166 Liaison statement to ITU-T SG 16 on Collaboration on AIT No 10/01/22

2 General Input Documents

2.1 AHG reports

Session Number Title Source DispositionGeneral m17090 Ad Hoc Group on Scene

RepresentationYoung-Kwon Lim, Jaeyeon Song, Cyril Concolato

Accepted

General m17091 Ad Hoc Group on MPEG File Formats

David Singer Accepted

General m17092 Ad Hoc Group on Application Format

Kyuheon Kim, Hui Yong Kim

Accepted

General m17093 Ad Hoc Group on Font Format Representation

Vladimir Levantovsky

Accepted

General m17095 Ad Hoc Group on MXM Filippo Chiariglione, Christian Timmerer, Victor Rodriguez, Marius Preda

Accepted

General m17096 Ad Hoc Group on MPEG-V Marius Preda Accepted

All AHG reports are accepted.

2.2 General technical contributions

2.3 Demo PA-AF reference software IMAF reference software

2.4 FAQThe FAQ were updated as needed.

2.5 AOBNone.

60

3 MPEG-2 Systems (13818-1)

3.1 Topics

3.1.1 ISO/IEC 13818-1:2007 AMD 5 Carriage of JPEG2000 over MPEG-2

3.1.2 ISO/IEC 13818-1:2007 AMD 6 Extension to AVC video descriptor and 61ignalling of operation points for MVC

3.2 Contributions

Session Number

Title Source Disposition

MPEG-2 m17115

Table of Replies on ISO/IEC 13818-1:2007/FDAM 4 [SC 29 N 10859]

ITTF via SC 29 Secretariat

Noted. No action required from systems.

MPEG-2 m17290

Comments on PDAM 6 of MPEG-2 Systems: Transport of Multiview Video

Ying ChenPeisong ChenMarta Karczewicz

Noted. No consensus on including the suggestions into study text of 13818-1/PDAM 6.

MPEG-2 m17179

Request for assigning an additional stream type in MPEG-2 Systems

JNB Noted. See m17161 for comment.

MPEG-2 m17161

Proposal of an additional stream type assignment in MPEG-2 Systems

Shuichi AokiYukihiro Nishida

Noted. Additional information requested on benefit of MPEG assigned stream_type over user_private stream type.

Liaison m17333

SMPTE liaison on JP2K over M2T

Walt Husak Accepted and included into Study Text of 13818-1/PDAM5. (N11130)

3.3 Summary of discussions

61

3.4 Action Points ITU-T Rec. H.222.0 (05/2006)/Cor.2 (03/2009)|ISO/IEC 13818-1:2007/Cor.2:2009

published (2009-12-15) ITU-T Rec. H.222.0 (05/2006)/Cor.3|ISO/IEC 13818-1:2007/Cor.3:200X to be published ITU-T Rec. H.222.0 (05/2006)/Amd.3 (03/2009)|ISO/IEC 13818-1:2007/Amd.3:2009

published (2009-11-01) and corrected (2009-12-01) ITU-T Rec. H.222.0 (05/2006)/Amd.3 (03/2009)/Cor.1|ISO/IEC

13818-1:2007/Amd.3:2009/ Cor.1:200X to be published ITU-T Rec. H.222.0 (05/2006)/Amd.4|ISO/IEC 13818-1:2007/Amd.4:200X to be published ISO/IEC 13818-1:2007/PDAM5 ballot until 2010-02-25 ISO/IEC 13818-1:2007/PDAM6 ballot until 2010-02-18

4 MPEG-4 System (14496-1)

4.1 Topics

4.1.1 ISO/IEC 14496-1:200X 4th edition

4.1.2 ISO/IEC 14496-1:200X AMD 4 LASeR in MPEG-4 System and RA

4.2 ContributionsNone

4.3 Summary of discussions

4.4 Action Points ISO/IEC 14496-1:200X/FPDAM 1 ballot until 2010-03-19

5 MPEG-4 Conformance (14496-4)

5.1 Topics

5.2 ContributionsSession Number Title Source Disposition

File Format

m17113 Table of Replies on ISO/IEC 14496-4:2004/FDAM 37 [SC 29 N 10855]

ITTF via SC 29 Secretariat

Noted

5.3 Summary of discussions Approved (100% support)

62

5.4 Action Points ISO/IEC 14496-4:2004/Amd.37:2009 published (2009-12-15)

6 MPEG-4 Reference Software (14496-5)

6.1 Topics

6.1.1 ISO/IEC 14496-5:2007 AMD 23 Synthesized Texture Reference Software

6.2 Contributions

Session Number Title Source DispositionGeneral m17117 Table of Replies on ISO/IEC

14496-5:2001/FDAM 25 [SC 29 N 10868]

ITTF via SC 29 Secretariat

Noted

6.3 Summary of discussions Approved (100% support)

6.4 Action Points ISO/IEC 14496-5:2001/FDAM 23 ballot until 2010-02-11 ISO/IEC 14496-5:2001/Amd.25:2009 Published (2009-12-15)

7 MPEG-4 BIFS (14496-11)

7.1 Topics

7.1.1 ISO/IEC 14496-11:2005/AMD 7 ExtendedCore2D Profile

7.1.2 Exploration- Remote and Collaborative work- Haptic interaction

7.2 ContributionsSession Number Title Source DispositionScene m17328 Electronic Attachments of

ISO/IEC 14496-11:2005 AMD7Jean Le Feuvre Accepted

(N11134)Scene m17269 Towards adoption of

collaborative BiFS technologies for use in immersive environments

Bojan JoveskiIain-James MarshallMihai MitreaFrançoise PreteuxPieter SimoensAbdeslam

Accepted (N11135)

63

TanguengayteBart Dhoedt

Scene m17272 Data setup for a comparative study between BiFS & LASeR performances for thin client player

Bojan JOVESKIMihai MITREAFrançoise PRETEUXIain-James MARSHALLPieter SIMOENSBart DHOEDT

Noted

Scene m17275 Cooperative Multi User Mpeg Technologies for Business Tools

Iain James MarshallAbdeslam TaguengayteErick Fremont

Noted

Scene m17348 FRNB Comment on ISO/IEC 14496-11:2005 AMD7

Jean Le Feuvre Cyril Concolato on behalf of FRNB

Accepted (N11134)

7.3 Summary of discussionsM17272: This contribution follows a contribution presented in Xian highlighting differences in bandwidth consumption between BIFS and LASeR. This contribution proposes captures of X11 exchanges and associated BIFS and LASeR binary representations.Recommendation: The group should investigate the files and report as part of its mandate.

M17275: This contribution asks MPEG to extend BIFS with a “communication mechanism for the transport of user interaction in the form of mouse events and keyboard input” for collaborative applications.Recommendation: The group notes the contribution and welcomes industrial interest in this area.

M17269: The contribution emphasizes that the use of ECMAScript to send user interactions back to the server is not suitable for real-time back channel communication. The proponents analyzed previous work in BIFS (Multi-User) and indicate that it would satisfy their needs. The proponents are willing to work actively on it. Recommendation: the group recognizes the interest in such an issue and proposes to output a TuC document using previous Multi-User technology and describing the new context (collaborative applications).

M17328: Contribution giving electronic attachments (XMT) for the BIFS Digital Radio profile. Recommendation: Issue a study text and resolution for NB to take this study into account.M17348: The contribution raises compression problems related to the new nodes because of the BIFS escaping mechanism. The contribution proposes to include the Proto tool in the profile and to limit its complexity by disallowing nested protos.Recommendation: The group agrees provided that a proper restriction (coding only, no nested) is clearly stated. We recommend issuing a study text and resolution for NB to take this study into account.

7.4 Action Points ISO/IEC 14496-11:2005/FPDAM 7 ballot until 201-04-14

64

8 MPEG-4 ISO Base File Format (14496-12)

8.1 Topics

8.1.1 Exploration Subtrack selection and switching Adaptive progressive download

8.2 ContributionsSession Number Title Source Disposition

File Format

m17294 Two issues with movie fragments

David Singer Accepted (N11137)

File Format

m17297 Two minor issues with the proposed amendent to Part 12

David Singer Accepted (N11137)

File Format

m17298 Study on file format video requirements

Takehiko Nakano Accepted (N11137)

File Format

m17320 Video Track Selection and Switching based on Temporal Subsets

Ying ChenMarta KarczewiczRahul Panchal

Noted

8.3 Summary of discussionsm17294 Two issues with movie fragments (part 12)The first issue, thank you. We could really do with some feedback from others who have used this defaulting (if any), and a sample file. Let’s see what putting it into the amendment brings out.The second problem is understood, but we are aware that there are a number of ways to solve this problem (some under discussion in other bodies), and there is an issue with what happens if (for example) we want to ‘splice in’ a new fragment, or we want to start ‘dropping’ fragments into a new recording file. Either of these would mean that the absolute times that are indicated here would need to be adjusted. We’ll put this paragraph into the amendment text, in order to provoke comment and further feedback.m17297 Two minor issues with the proposed amendment to Part 12The first issue is further discussed in the 17298; the proposed solution here (relying on ordering) is not good, as current protect/de-protect loops know of no such rule.The second issue, agreed; editors to integrate.m17298Study on file format video requirements (part 12)Thank you; we will make clear that the method is optional. And indeed, allowing the scheme information (SEI) without the 4CC transform documents the behavior without breaking backward compatibility.Alas, existing protection programs don’t know that they should encapsulate existing ‘sinf’s any more than they know they should order them (as proposed in 297). We need to use a different code for the restricted info box (other than ‘sinf’, maybe ‘rinf’).The concern about various methods possibly being used seems to be handled by the format; all those SEIs should be in the SEI information box. But it answers this open question:The SEI message here [should/must] [not?] be also stored either in the bitstream or in the AVC Configuration Record.with: yes, they should be if the stream is an AVC stream, as then they are in the right place (for example, if the stereo method changes in stream — which is probably not a good idea!).Thank you for the careful read, thought, and recommendations.

65

m17320 Video Track Selection and Switching based on Temporal Subsets (part 12 or 15)We are pleased to note that we think this is currently supported by part 15, for AVC. An application would define that it permits sample entry type ‘avc2’ for use with AVC bitstreams, define a brand code that required that support and also support for the ‘SVCExtractor’ toolset. Then this technique can be done either:a) having a ‘full’ bitstream at the full frame rate, and extracting out the subset lower frame rate tracks; orb) having the lowest frame rate track, and then extracting those frames into the next higher – a track that also has the additional frames needed – and so on.This is also supported in one track, by the new sub-track selection mechanism in the upcoming part 12 (using sample groups). Each subset of frames in the one track is identified as a separate sample group, each sub-track is defined as one or more sample groups (e.g. group 1, 1+2, 1+2+3), and then they can be selected or switched between.

8.4 Action Points ISO/IEC 14496-12:2008/Amd.1:2009 Published (2009-11-15)

9 MPEG-4 File Format (14496-14)

9.1 Topics

9.1.1 ISO/IEC 14496-14:2003 AMD 1 Handling of MPEG-4 Audio enhancement layers

9.2 ContributionsSession Number Title Source Disposition

File Format

m17105 Summary of Voting on ISO/IEC 14496-14:2003/FPDAM 1 [SC 29 N 10833]

SC 29 Secretariat Accepted (N11138)

9.3 Summary of discussionsm17105 All approved.

9.4 Action Points

10 MPEG-4 AVC File Format (14496-15)

10.1 Topics

10.1.1

66

10.2 Contributions

Session Number Title Source DispositionFile

Formatm17141 Table of Replies on ISO/IEC

14496-15:2004/FDAM 3ITTF via SC 29 Secretariat

Noted

10.3 Summary of discussionsm17141 All Accepted

10.4 Action Points ISO/IEC 14496-15:2004/Amd.3 to be published

11 LASeR & SAF (14496-20)

11.1 Topics

11.1.1 Exploration Advanced User Interaction Interface

11.2 Contributions

Session Number Title Source Disposition

Scene m17198 Proposed text for WD of 14496-20 LASeR AMD2 Reference SW

Seo-Young Hwang Accepted (N11133)

Scene m17199 a demonstration of MPEG-4 LASeR AMD2

Seo-Young Hwang Accepted (N11140)

Scene m17337 Use of MPEG-V Part 5 Sensed Information in LASeR

Jihun ChaInjae LeeSeong-Yong LimHanKyu LeeYounf-Kwon Lim

Accepted (N11175)

11.3 Summary of discussionsM17199: Contribution proposing a description of the demonstration and according bitstreams for LASeR Adaptation. Recommendation: The group acknowledges the contribution and will update both the Workplan and Service scenario and the Conformance document to include the table below and the associated bit streams. Amd.2 New Feature Bit stream availableDisplaySizeChanged EventMemoryStatus EventDelta attribute in ExternalValueEventLASeRHeader new attributes

67

AdaptiveUpdateGroupparsingSwitchminDisplaySize attributeminMemory attributeminResolution attributeminSize/minSizeBehaviour attributepriority attributeconstraintFilter

M17198: New reference software for LASeR proposed by Samsung Electronics and Kyunghee University with ISO license. The software is developed in C++. It contains an encoder and the player. The perimeter of that implementation needs to be checked to determine the overlap with the previous reference software (Java).Recommendation: Thank Samsung Electronics and Kyunghee University. Produce CD of RS. Mandate of the group to evaluate the software to check the completeness of the RS and decide whether it replaces the existing RS or not.

M17337: Analysis of relevance of Sensed Information attributes for scene. Proposal of a LASeR ExternalSensorEvent IDL and of 17 associated Events. Most of the events would require script to be used. The proposal is not final, more work is needed on Device Commands, on the possibility to use ExternalValueEvent. And the necessity of such proposal needs to be compared with respect to a solution using MPEG-U. Recommendation: we propose to update the AIU document (new name TuC) and we welcome more contributions on this topic for the next meeting.

11.4 Action Points ISO/IEC 14496-20:2008/FDAM 2 ballot until 2010-02-11 ISO/IEC 14496-20:2008/FDAM 3 ballot until 2010-XX-XX

12 Open Font Format (14496-22)

12.1 Topics

12.1.1 ISO/IEC 14496-22:200X AMD 1 Support for many-to-one range mappings

12.2 ContributionsSession Number Title Source Disposition

General m17315 Corrigenda Items for ISO/IEC 14496-22 “Open Font Format”

Sairus Patel Accepted (N11142)

.

12.3 Summary of discussionsm17315 This contribution proposed several minor corrigenda items as follows:

Changes to name ID 4 (Full font name) ‘kern’ table clarifications CFF table clarifications

68

12.4 Action Points ISO/IEC 14496-22:2009/FPDAM 1 ballot until 2010-03-02

13 MPEG Query Format (15938-12)

13.1 Topics

13.1.1 ISO/IEC 15938-12:2008 COR 2 missing semantics

13.1.2 ISO/IEC 15938-12:2008 AMD 1 MPQF Conf. and Ref. SW.

13.1.3 ISO/IEC 15938-12:2008 AMD 2 Semantic Enhancement

13.2 Contributions

Session Number Title Source Disposition

13.3 Summary of discussions

13.4 Action Points ISO/IEC 15938-12:2008/Cor.2:200X to be published ISO/IEC 15938-12:2008/FPDAM 1 ballot until 2010-04-16 ISO/IEC 15938-12:2008/PDAM 2 ballot until 2010-02-02

14 MPEG-21 DID (21000-2)

14.1 Topics

14.1.1 ISO/IEC 21000-2:2005 AMD 1 Presentation of Digital Item

14.2 Contributions

Session Number Title Source DispositionScene m17195 Proposed technical solutions for

the Presentation item in MPEG-21

Ian BurnettMohamad Raad

Accepted (N11143)

Scene m17342 Revised text of ISO/IEC 21000-2/PDAM 1: Presentation of Digital Item

Xiaocong Zhou (xczhou@jdl.ac.cn )Tiejun Huang (tjhuang@pku.edu.cn)

Accepted (N11143)

69

14.3 Summary of discussionsm17195 This contribution proposes two alternatives for presentation elements for DID as an extension of DescriptorType. This contribution also analyzed several editorial issue of PDAM.

m17342 Editor's input for FPDAM.

14.4 Action Points

15 MPEG-21 IPMP Components (21000-4)

15.1 Topics

15.1.1 ISO/IEC 21000-4:2006 AMD 2 Protection of Presentation element

15.2 Contributions

Session Number Title Source Disposition

15.3 Summary of discussions

15.4 Action Points

16 Media Value Chain Ontology (21000-19)

16.1 Topics

16.1.1 ISO/IEC 21000-19 Media Value Chain Ontology

16.2 ContributionsSession Number Title Source Disposition

MVCO m17116 Summary of Voting on ISO/IEC FCD 21000-19 [SC 29 N 10867]

SC 29 Secretariat Accepted (N11145 & N11146)

MVCO m17254 Proposal for a MVCO Reference Software Plan

Victor Rodriguez-DoncelJaime Delgado

Accepted (N11147)

16.3 Summary of discussionsm17116 Disapproval from UK and Approval with comments from Japan and Spain, All comments are processed appropriately.

70

m17254 Proposed workplan for MVCO reference software.

16.4 Action Points

17 Media Streaming AF (23000-5)

17.1 Topics

17.1.1 ISO/IEC 23000-5 2nd edition

17.2 Contributions

Session Number Title Source DispositionMAF m16804 Summary of Voting on ISO/IEC

CD 23000-5 [2nd Edition]SC 29 Secretariat Accepted

(N11148 & N 11149)

17.3 Summary of discussionsm16804 No comments.

17.4 Action Points

18 Professional Archival AF (23000-6)

18.1 Topics

18.1.1 ISO/IEC 23000-6:2009 AMD1 PA-AF Conf. and Ref. SW

18.2 Contributions

Session Number Title Source Disposition

Liaison m17126 Liaison Statement from SC 29/WG 1 [SC 29 N 10759]

SC 29/WG 1 via SC 29 Secretariat

Noted. (N11194)

MAF m17184 Proposed corrigendum to ISO/IEC 23000-6:2009 PA-AF

Noboru HaradaHouari Sabirin Hendry Takehiro MoriyaYutaka KamamotoMunchuri Kim

Accepted (N11150)

71

18.3 Summary of discussionsM17184: Accepted the proposals as follows:- Consistency in namespace: change into PA-AF- ContentEncoding has been updated from ‘audio/x-mp4als’ to ‘x-mp4als’.- Dsig:Signature is moved from IPMPInfoDescriptor to ContentInfoM17126:- Liaison letter requesting IPR statement

18.4 Action Points ISO/IEC 23000-6:2009/FDAM 1 ballot until 2010-XX-XX

19 DMB AF (23000-9)

19.1 Topics

19.1.1 ISO/IEC 23000-9:2008 AMD1 DMB AF Conf. and Ref. SW

19.1.2 ISO/IEC 23000-9:2008 AMD2 DMB AF Harmonization on MPEG-2 TS Storage

19.2 Contributions

Session Number Title Source DispositionMAF m17323 Text, conf. file, and ref. SW for

S-DMB in DMB-AF (23000-9/Amd1)

Hui Yong KimYong Han KimJungHui LeeHeon Ju Park

Accepted (N11151)

MAF m17106 Summary of Voting on ISO/IEC 23000-9:2008/FPDAM 2 [SC 29 N 10834]

SC 29 Secretariat Accepted (N11152 & N11153)

MAF m17326 Clarification on OD/BIFS box in DMB-AF FPDAM2 (23000-9/Amd2)

Hui Yong KimMyung Seok KiHan-Kyu LeeYong Han Kim

Accepted (N11153)

19.3 Summary of discussionsM17106: KNB CommentsM17323: Conf. & Ref. SW supporting for S-DMB has been uploaded. However, the Ref. Sw requires the bug-more fixing time. We will revisit the Ref. Sw in the Systems plenay, and make a decision whether FDAM 1 is produced or not. M17326: Proposed responses to m17106

72

19.4 Action Points

20 Video Surveillance AF (23000-10)

20.1 Topics

20.1.1 ISO/IEC 23000-10:2009 AMD1 VS AF Conf. and Ref. SW

20.1.2 Exploration Advanced visual surveillance AF

20.2 ContributionsSession Number Title Source Disposition

MAF m17108 Summary of Voting on ISO/IEC 23000-10:2009/FPDAM 1 [SC 29 N 10838]

SC 29 Secretariat Accepted (N11154 & N11155)

Liaison m17123 ISO/TC 223’s Resolutions and ISO/WD 22311 [SC 29 N 10876]

ISO/TC 223 via SC 29 Secretariat

Noted (N11197)

20.3 Summary of discussionsM17108:

JNB1. In the sentence "The VSV parses the VSAF file and displays it's contents" in subclause 7.3, "it's" should be corrected to "its".2. Figure AMD1.1, which is currently missing, should be inserted.

USAThe conformance test set should be as comprehensive as possible and should be checked for correctness; and the associated text should be refined as necessary to ensure comprehensiveness and editorial maturity. The reference software capability should be as comprehensive as possible and all identified bugs to be corrected, if feasible.

20.4 Action Points

21 Stereoscopic Video AF (23000-11)

21.1 Topics

21.1.1 ISO/IEC 23000-11 AMD1 SV AF Conf. and Ref. SW

21.1.2 ISO/IEC 23000-11 AMD2 Additional composition type

73

21.2 Contributions

Session Number Title Source DispositionMAF m17157 Study Text of ISO/IEC 23000-

11/FPDAM1 Stereoscopic Video AF: Conformance and Reference Software

Next Generation Broadcasting Forum (Korea)

Accepted (11156)

21.3 Summary of discussionsM17517: Editorial changes have been accepted.No changes in the workplan

21.4 Action Points ISO/IEC 23000-11:2009 published 2009-11-15 ISO/IEC 23000-11:2009/FPDAM 1 ballot until 2010-03-19

22 Interactive Music AF (23000-12)

22.1 Topics

22.1.1 ISO/IEC 23000-12 Interactive Music AF

22.1.2 ISO/IEC 23000-12 AMD1 Conformance and Reference Software

22.2 Contributions

Session Number Title Source DispositionMAF m17107 Summary of Voting on ISO/IEC

FCD 23000-12 [SC 29 N 10835]SC 29 Secretariat Accepted

(N11157 & N11158)

MAF m17200 Editor’s study on ISO/IEC 23000-12 FCD Interactive music application format

Inseon JangHui Yong KimJeongil SeoLaurent PrimauxOwen LagadecEmmanuel Bouix

Accepted (N11158)

MAF m17201 Proposed text for WD of ISO/IEC 23000-12 Interactive Music AF Conformance and Reference SW

Inseon JangJeongil SeoKyeongok Kang

Accepted (N11160)

MAF m17340 Comments on Study of ISO/IEC FCD 23000-12 Interactive Music AF (N10970)

Yongwei ZhuRongshan YuSusanto Rahardja

Noted

MAF m17341 A proposal for the support of Yongwei Zhu Noted

74

audio equalization and interactivity in IM AF

Rongshan YuSusanto Rahardja

22.3 Summary of discussionsM17200: Editorial changes are accepted.M17107: KNB Comments have been reviewed and accepted. DoC will be produced.M17201: it needs to describe more specifically the conformant points in the player, which will be delivered to the Systems plenary for the approval. Request of AMD1 and Text of PDAM is going to be expected.M17340/17341: Proposed the efficient encoding of dynamic volume change and the equalization functionalities. There is no consensus in the group for having the functionalities of an equalization and an efficient encoding of dynamic volume change. We need to study on this issue and will make a decision for the AMD2 in the next meeting, Germany.

22.4 Action Points

23 MXM Architecture (23006-1)

23.1 Topics

23.1.1 ISO/IEC 23006-1 MXM Architecture and technologies

23.2 Contributions

Session Number Title Source DispositionMXM m17144 Summary of Voting on ISO/IEC

FCD 23006-1SC 29 Secretariat Accepted

(N11162 & N11163)

MXM m17219 Austrian NB comments on ISO/IEC FCD 23006-1

Christian Timmerer(on behalf of ANB)

Accepted (N11162 & N11163)

MXM m17299 A further study on media identification engine for MXM

Hyungyu KimMinsoo ParkHwa Seon ShinYong-Hwan KimByeongho ChoiEuee S. Jang

Noted

MXM m17329 Abstracts for MXM Christian Timmerer Accepted (N11163)

75

23.3 Summary of discussionsm17299 The contribution was reviewed and it was acknowledged the need for such an API. The contributors are welcome to submit extensions to the current MediaFrameworkEngine and OrchestratorEngine APIs to support the requirements that were identified instead of defining a new MXM Engine

m17329 The abstracts will be sent to ISO as they areas requested by the secretariat.

23.4 Action Points

24 MXM APIs (23006-2)

24.1 Topics

24.1.1 ISO/IEC 23006-2 MXM APIs

24.2 Contributions

Session Number Title Source DispositionMXM m17145 Summary of Voting on ISO/IEC

FCD 23006-2SC 29 Secretariat Accepted

(N11164 & N11165)

MXM m17220 Austrian NB comments on ISO/IEC FCD 23006-2

Christian Timmerer(on behalf of ANB)

Accepted (N11164 & N11165)

MXM m17182 Proposal for revised generic metadata APIs on MXM

Wonsuk LeeSeungyun Lee

Accepted (N11165)

MXM m17284 FootPrint API for MXM Ivica ArsovLuyen van NgoMarius Preda

Accepted (N11165)

24.3 Summary of discussionsm17284 The contribution was reviewed and the proposed FootPrint API was accepted as part of the MediaFramework APIs

24.4 Action Points

76

25 MXM Conf. & Ref. SW (23006-3)

25.1 Topics

25.1.1 ISO/IEC 23006-3 MXM Conformance and Reference Software

25.2 Contributions

Session Number Title Source DispositionMXM m17146 Summary of Voting on ISO/IEC

FCD 23006-3SC 29 Secretariat Accepted

(N11167 & N11168)

MXM m17221 Austrian NB comments on ISO/IEC FCD 23006-3

Christian Timmerer(on behalf of ANB)

Accepted (N11167 & N11168)

25.3 Summary of discussions

25.4 Action Points

26 MXM Protocol (23006-4)

26.1 Topics

26.1.1 ISO/IEC 23006-4 MXM Protocols

26.2 ContributionsSession Number Title Source DispositionMXM m17147 Summary of Voting on ISO/IEC

FCD 23006-4SC 29 Secretariat Accepted

(N11169 & N11170)

MXM m17222 Austrian NB comments on ISO/IEC FCD 23006-4

Christian Timmerer(on behalf of ANB)

Accepted (N11169 & N11170)

26.3 Summary of discussions

26.4 Action Points

77

27 MPEG-U Widgets (23007-1)

27.1 Topics

27.1.1 Package, Delivery and Presentation of Widgets

27.1.2 Communication

27.2 Contributions

Session Number Title Source DispositionMPEG-U m17210 Comments on ISO/IEC 23007-1

FCD MPEG-U WidgetsCyril ConcolatoKyungmo Park

Accepted (N11172)

MPEG-U m17317 Proposed text for security section of MPEG-U specification

Nhut NguyenJaeyeon SongKyungmo Park

Jean Le Feuvre

Accepted (N11173)

MPEG-U m17214 Ideas on ISO/IEC 23007-1 MPEG-U Widgets Video.

Cyril ConcolatoKyungmo Park

Accepted (N11190)

MPEG-U m17331 About MPEG-U and W3C Cyril ConcolatoJean Le Feuvre

Accepted (N11196)

27.3 Summary of discussionsM17210: Contribution proposing different fixes for the FCD text.Recommendation: produced study of FCD and resolution for NB votes.

M17317: This contribution proposes updates to previous contributions. It proposes:• To use W3C Digital Signature for Widget Securityo It is understood that support for Dig. Sig. is already provided by the W3C spec. by means of reserved file names in the ZIP package. MPEG should adapt this mechanism for example for ISOFF packaging or other transports (such as MPEG-2 TS).• To use XML Encryption for Widget Securityo The encryption of the whole widget seems to be out of scope because it does not imply any change in the widget manager. However, we need to think about encrypting part of the widget.• To use a new proposed mechanism ‘Credential Token’ for Inter-Widget communication security. This mechanism is asymmetrical, putting heavy computation on a server and leaving the client with small tasks to do.• To use OMTP Application Security Framework for Client Security

Recommendation: The group recommends issuing an IuC document to prepare a possible amendment on security.

M17214: the contribution presents some ideas for a promotional video for MPEG-U.Recommendation: output document to record the ideas.

78

M17331: the contribution raises two issues with regards to the reusability of MPEG-U by the W3C: royalty free and editing.Recommendation: send a liaison to the W3C, and ask MPEG members to send patent statement and license declaration forms highlighting the royaltee free issue.

27.4 Action Points ISO ISO/IEC FCD 23007-1 ballot until 2010-03-02

28 Advanced User Interaction Interface (23007-2)

28.1 Topics

28.1.1 Advanced User Interaction Interface

28.2 Contributions

Session Number Title Source DispositionMPEG-U m17203 Data format for multi-pointing

AUI deviceJihun ChaSungyoung LimInjae LeeHankyu LeeYoung-kwon Lim

Accepted (N11174)

28.3 Summary of discussionsM17203: the contribution presents a description of a multipoint sensor. The addition of this new sensor in MPEG-V was not accepted as a whole by MPEG-V experts, however it is needed for advance interactions in scenes. Recommendation: we accept to add this tool to MPEG-U Part 2 and leave Part 2 at WD stage at this meeting.

28.4 Action Points

29 MPEG-U Conformance and Reference Software (23007-3)

29.1 Topics

29.1.1 Conformance and Reference Software

29.2 Contributions

79

Session Number Title Source DispositionMPEG-U m17213 Proposal for updated text on

ISO/IEC 23007-3 MPEG-U Conf. & Ref. Software

Cyril ConcolatoKyungmo Park

Withdrawn

29.3 Summary of discussions

29.4 Action Points

30 MPEG-V Architecture (23005-1)

30.1 Topics

30.1.1 ISO/IEC 23005-1 MPEG-V Architecture

30.1.2 Exploration on Haptics

30.2 Contributions

Session Number Title Source DispositionMPEG-V m17283 Streaming needs for MPEG-V Marius Preda Accepted

(N11184)MPEG-V m17301 Consideration for massive real-

time dataJae-Joon HanSeungju HanWonchul BangJames D. Kim

Accepted (N11183)

30.3 Summary of discussionsm17283 The contribution proposes a binary format for updating the sensor/actuators data. It consists in an update mask that should be standardized for each sensor type. The mask indicates which component of the sensor/actuator data should be updated at each frame. The new values are transmitted into an array of update values. Notes: Current definition of the base types includes the timing information. The alternatives solutions are to use TeM which is a mechanism standardized in MPEG-7 Part 1 for transmitting and updating XML instances. There exists as well a binary equivalent for BiM (MPEG-B Part 1).The streaming feature in MPEG-V should be addressed considering the need of compactness and easiness of building the applications. Provide a comparative list of advantages and disadvantages between the solution based on update mask and TeM

m17301 When many sensors are existent into an MPEG-V environment, the amount of captured data may be important and overload the processing power of the adaptation engine. The

80

contribution proposes to add a priority to the sensors. The adaptation engine will consider the sensors with respect to their priority up to its processing capacity.

30.4 Action Points ISO/IEC FCD 23005-1 ballot until 2010-03-02

31 Control Information (23005-2)

31.1 Topics

31.1.1 ISO/IEC 23005-2 Control Information

31.2 Contributions

Session Number Title Source DispositionMPEG-V m17300 User Sensor Adaptation

PreferenceSeungju HanJae-Joon HanWonchul BangJames D. Kim

Accepted (N11177)

MPEG-V m17313 Proposal text for the study of FCD of MPEG-V Part2

Kyoungro Yoon Accepted (N11176)

31.3 Summary of discussionsm17300 The contribution refers to the possibility to adapt the manner how the sensed information is used in the adaptation engine, dictated by user preferences. Two use cases are presented: (1) The light is sensed in real world, the user may provide a set of parameters to specify the levels. The virtual world light will be changes accordingly the levels indicated by the users. To support this a SensorAdaptationReference base type is proposed (2) For the intelligent camera the user may choose the set of features that he/she wants to display. Even the intelligent camera is able to track all the features, the user has the ability to switch off some of them. To support this, a Boolean map indicates what are the features that the user wants to track.Accept the concept. However, since MPEG-21 DIA contains a rich text of adaptation preference (User Characteristics, Terminal Capabilities, Natural Environment Capabilities, …)., there is a need of checking MPEG-21 schema to avoid duplication.

31.4 Action Points ISO/IEC FCD 23005-2 ballot until 2010-04-14

81

32 Sensory Information (23005-3)

32.1 Topics

32.1.1 ISO/IEC 23005-3 Sensory Information

32.2 Contributions

Session Number Title Source Disposition

32.3 Summary of discussions

32.4 Action Points ISO/IEC FCD 23005-3 ballot until 2010-04-14

33 Virtual World Object Characteristics (23005-4)

33.1 Topics

33.1.1 ISO/IEC 23005-4 Virtual World Object Characteristics

33.2 Contributions

Session Number Title Source DispositionMPEG-V m17311 Proposal of Identification

Scheme for Virtual ObjectsKyoungro YoonSoohan KIMMyungsu LeeWoo Chool ParkHae Moon SeoChoi Jae Wan

Acceptd (N11179)

33.3 Summary of discussionsm17311 The contribution proposes a set of attributes to identify the ownership and licence associated to a VO. There were additional discussions on the possibility to have multiple authors of a content that may work incrementally. It was discussed to include a "credits" field as a container of all the authors (similarly as for computer programs where several developers contribute)

33.4 Action Points ISO/IEC FCD 23005-4 ballot until 2010-04-14

82

34 Reference Software (23005-5)

34.1 Topics

34.1.1 ISO/IEC 23005-5 Reference Software

34.2 ContributionsSession Number Title Source Disposition

MPEG-V m17121 Draft Text of ISO/IEC FCD 23005-5 Data Formats for Interaction Device

Kyoungro YoonJaeyeon SongJihun Cha

Accepted (N11180)

MPEG-V m17122 Ideas on MPEG-V part 5: Data Formats for Interaction Devices

Kyungmo ParkJihun Chakyoungro YoonJae-joon HanSeoyoung HwangSanhyung JooYoungKwon Lim

Accepted (N11180)

MPEG-V m17310 Proposal text for the study of FCD of MPEG-V Part5

Kyoungro YoonJaeyeon SongJihun Cha

Accepted (N11180)

34.3 Summary of discussionsm 17122 New structure describing the relationship between 23005-5 and MPEG-U

34.4 Action Points ISO/IEC FCD 23005-5 ballot until 2010-04-14

35 Conformance Testing (23005-6)

35.1 Topics

35.1.1 ISO/IEC 23005-5 Reference Software

35.2 ContributionsSession Number Title Source Disposition

MPEG-V m17132 Updated MPEG-V Part 3 Reference Software

Markus WaltlChristian Timmerer

Accepted (N11186)

MPEG-V m17133 Updated MPEG-V Part 3 Conformance

Markus WaltlChristian Timmerer

Accepted (N11186)

MPEG-V m17172 Conformance Test added with Rigid Body Motion Effect

B. S. ChoiE. S. LeeJang

Accepted (N11186)

83

HanYoon

MPEG-V m17302 MPEG-V Part 2 Reference Software

E.S. LeeB.S. ChoiJ.H. JangD.W. HanK.R. ParkK. YoonH. S. Choi

Accepted (N11186)

MPEG-V m17305 Updated MPEG-V Part 3 Conformance to Support Haptic Effects

Jeha RyuYeongmi Kim

Accepted (N11186)

35.3 Summary of discussionsm17133 The contribution introduces a set of validation rules formulated to be compliant with schematron. The validation rules themselves are standardized in MPEG-V Part 3, the paper presenting only their formalization. Several conformance bitstream are also included.

m17172 The contribution proposes to update the validation schema to include Sensory Effect Vocabulary. There are some additional rules for Rigid Body Motion.The contribution triggered additional discussions on the manner how the motion is described in Part 3.In order to avoid additional rules related to the direction, add in the study text of Part 3 the definition of the rigid body motion with the direction specified by two angles. Add as well the default values for motion data (pitch, roll, yaw, …)Check the names of the rigid Body motion related types in Part 5 and Part 3 (current situation is that different types have the same name). It is necessary to clarify the meaning of duration=0 for an effect.

m17302 The contribution introduces a reference software for Part 2 built in a same manner as the existent RefSoft of Part 3. In addition, the utility software is able to Create, Parse and Modify objects obtained from Part 3. The utility software is donated and it should be published together with the RefSoft.Create a unique XSD by putting together all the XSDs (for the Parts 2, 3, 4 and 5) and create the RefSoft starting from the unified XSD. The overall XSD (that will import the others) will be published in Part 1 of MPEG-V.

m17305 The contribution specifies several rules for haptic effects (5) needed to validate the content. Action Points Accepted. The validation rules should also be described in Part 3 (as a textual description).

36 Exploration – Advanced IPTV Terminal

36.1 Topics

36.1.1 Context and Objectives

36.1.2 Requirement and candidate technologies

36.1.3 Terminologies

36.1.4 CfP

84

36.2 Contributions

Session Number Title Source DispositionAIT m17098 Advanced IPTV Terminal (AIT):

Context and ObjectivesLeonardo Chiariglione

Accepted (N11230)

AIT m17099 Advanced IPTV Terminal (AIT): Requirements, candidate technologies and protocols

Leonardo Chiariglione

Accepted (N11228)

AIT m17100 Advanced IPTV Terminal (AIT): Use case based testing of Basic Services

Leonardo Chiariglione

Accepted (N11231)

AIT m17101 Advanced IPTV Terminal (AIT): Call for Proposals

Leonardo Chiariglione

Accepted (N11229)

AIT m17120 AIT Testing of Basic Services for Speech QA and Advertisements Use Cases

Miran ChoiEuisok ChungMyung-Gil JangYunkeun Lee

Accepted (N11231)

AIT m17129 A top-down approach in the definition of AIT Basic Services

Luca AielloLeonardo ChiariglioneMarco MilaneseGiancarlo Ruffo

Accepted (N11228)

AIT m17134 OIPF Services and Functions Leonardo Chiariglione

Noted

AIT m17135 Overview of the Universal Business Language version 2.0 (UBL 2.0)

Leonardo ChiariglioneVito U. Vavalli

Noted

AIT m17136 An Integrated Management Supervisor for Advanced IPTV Terminal (AIT)

Christian Timmerer Noted

AIT m17148 Advanced IPTV Terminal (AIT): Context and Objectives

AIT AHG Accepted (N11230)

AIT m17149 Advanced IPTV Terminal (AIT): Requirements, candidate technologies and protocols

AIT AHG Accepted (N11228)

AIT m17150 Advanced IPTV Terminal (AIT): Call for Proposals

AIT AHG Accepted (N17101)

AIT m17151 Adavanced IPTV Terminal – Toward a joint ISO/ITU project

AIT AHG Noted

AIT m17159 An Example of Media Streaming AF: IPTV Marketplace (IPTV-MP)

Riccardo Chiariglione Vincenzo GiarratanaEmiliano LeporatiSergio MatoneAndrea PignatielloFederico PaganiniEdoardo Radica

Noted

85

AIT m17192 Walkthrough of AIT Use Case : Distance Learning

Jin Young Lee Accepted (N11231)

AIT m17193 Walkthrough of AIT Use Case : Traffic/Accident Live-cast

Jin Young Lee Accepted (N11231)

AIT m17232 Comments on MPEG AIT Requirements

Truong Cong Thang Accepted (N11228)

AIT m17243 Comments on Advanced IPTV Terminal (AIT)

Christian TimmererMichael Grafl

Accepted (N11228)

Liaison m17109 Liaison Statement from ITU-T SG 16 on Study Activities on Advanced IPTV Terminal [SC 29 N 10849]

ITU-T SG 16 via SC 29 Secretariat

N11192

Liaison m17130 Liaison Statement from ITU-R SG 6/WP 6B [SC 29 N 10911]

ITU-R SG 6/WP 6B via SC 29 Secretariat

N11192

Liaison m17152 Liaison Statement from Broadband Forum [SC 29 N 10937]

Liaison Statement from Broadband Forum via SC 29 Secretariat

N11192

36.3 Summary of discussions

m17098 Proposed revision for Context and Objectives

m17099 Proposed revision for Requirement

m17100 Proposed use cases are accepted to be included in the use case document. Walktrough section will have another column identifying relevant “elementary services.” Mapping to elementary services, protocols will be removed. IPTV marketplace use case will be harmonized with use case from mXXXX.

m17101 Proposed revision for CfP

m17192 & m17193 Accepted. Same modification as m17100 is required.

m17129 Proposal for an approach to define basic services for AIT

m17120 Concerning speech interface use case, it is agreed to modify speech processing is done by third party. Then, this use case will be about accessibility. People have difficulty to use conventional user interface such as remote controller, text, keyboard can access that service via third party speech processing service provider. Context-based advertisement use case will be merged with selfTV use case in m17100.

m17232 It has not been fully understood by the group that “Negotiate Content” is another elementary service. It seems that ‘negotiation’ in this proposal is done by human based on descriptions about the content.

86

m17136 Proposed service provider seems to be a real service implementation relying on other elementary service provider. However, proposed requirements are valuable to be added. It is also agreed to have use case highlighting proposed service (adaptation management).

m17243 Proposing many editorial comments

m17148, m17149, m17150 and m17151 Revised documents from Torino AHG.

36.4 Action Points CfP

37 Exploration – MMT

37.1 Topics• Transport- and file format friendly stream format • Cross layer optimization between video and transport layer• Error resilience for MPEG streams• Conversion between transport mechanisms • Content adaptation to different networks

37.2 Contributions

Session Number Title Source DispositionMMT m17314 MMT Vision Alex Giladi Accepted

(N11225)MMT m17194 Comments on MMT

requirementsJin Young LeeSeong-Jun BaeSoon-heung JungJeong Ju Yoo

Accepted (N11223)

MMT m17197 MMT Requirements Sungryeul Rhyu Accepted (N11223)

MMT m17234 Proposed Updates to MMT Use Cases and Requirements

Truong Cong Thang Accepted (N11226)

MMT m17154 Proposal of additional MMT use cases and requirements

Shuichi AokiKatsunori AokiHiroyuki Hamada

Accepted (N11226)

MMT m17321 Additional use case for MMT(informative)

Doug Young SuhYongil KwonJae Yeon Song

Accepted (N11226)

MMT m17189 Extension of NAL for MMT Doug Young Suh NotedMMT m17330 Cross Layer Optimization (CLO)

for reliable video delivery over mobile wireless networks

Yongju ChoHankyu Lee

Noted

MMT m17334 Industry Viewpoints of Internet TV over IP networks: Trends and

Seongho ChoKyungmo Park

Noted

87

TechnologiesMMT m17339 Future media adaptation and

delivery (MMT)Zhenyu Wu Stephane Gouache Guillaume Bichot

Noted

Liaison m17130 Liaison Statement from ITU-R SG 6/WP 6B [SC 29 N 10911]

ITU-R SG 6/WP 6B via SC 29 Secretariat

N11193

Liaison m17346 Liaison Statement from Open IPTV Forum (OIPF)

Open IPTV Forum via SC 29 Secretariat

N11193

Liaison m17351 SMPTE Liaison on MMT Kilroy Hughes N11193

37.3 Summary of discussions

37.4 Action Points CfP

38 Liaison

38.1 List of input liaison lettersSession Number Title Source DispositionLiaison m17114 Establishment of JTC 1/SC 38,

Distributed Application Platforms and Services [SC 29 N 10856]

JTC 1/SC 38 via SC29 Secretariat

N11198

Liaison m17124 IEC NP: Common control interface for networked digital audio and video products – Part 5-1: Transmission over networks – General (62379-5-1)

IEC TC 100 via SC 29 Secretariat

N11199

Liaison m17125 IEC NP: Common control interface for networked digital audio and video products – Part 5-2: Transmission over networks – Signalling (62379-5-2)

IEC TC 100 via SC 29 Secretariat

N11199

Liaison m17312 Liaison Statement from IEC TC 100 [SC 29 N 10966]

IEC TC 100 via SC 29 Secretariat

N11195

Liaison m17347 IEC CDV 62605 Noted.

38.2 List of output liaison lettersm17312 Inviting expert to joint work between ITU-T and IEC TC 100 about Right Information Interoperability. This work might require extension of REL standard. There will be additional requirement coming form them by the next MPEG meeting. We will list the experts on this area to be involved.

88

Cf. Liaison output.

39 Resolutions of Systems

Cf. WG11 resolution. Publish of ISO/IEC 14495-15 2nd edition Ask JNB further input on additional stream type

40 Action Plan

40.1 Contribution to MPEG Homepage

Topic Short description

1 pager Presentation

MPEG-V part 1 Jean JeanMPEG-V part 2 Kyungro KyungroMPEG-V part 3 Christian ChrisitianMPEG-V part 4 Marius MariusBIFS (Digital Radio Profile) Cyril Cyril (updating

existing BIFS 1-pager)

Digital Item Presentation Tiejun TiejunSVC FF Karsten KarstenMVC FF Miska MiskaMPEG-U Cyril Cyril CyrilMXM part 1 Christian Chrisitian Christian(editor)MXM part 2 Christian Chrisitian Christian(editor)MXM part 3 Chrisitian Chrisitian Christian(editor)MXM part 4 Chrisitian Filippo Christian(editor)PA AF Noboru NoboruDMB AF Hui-Yong Hui-YongVS AF Gero GeroStereoscopic AF Kugjin KugjinIM AF Inseon InseonOpen Font Format Extension Vladimir VladimirEnhanced MPEG-7 Query Format

Mario

Protection of Digital Item TiejunAdvanced IPTV Terminal Xin

89

41 References

41.1 Program of work Refer “Program of Work” section in SC29 Web Site : http://www.itscj.ipsj.or.jp/sc29/

41.2 Timeline of standards under development

Pr

Pt

Edit.

Project Description

CfP WD CD FCD FDIS

2 1 2007

AMD5 Transport of JPEG2000 09/07

09/10

10/04

10/10

2 1 2007

AMD6 MVC operation point descriptor 09/07

09/10

10/04

10/10

4 1 2004

AMD4 LASeR in MPEG-4 systems & RA

09/07

09/10

10/04

4 1 200x

4th ed. ???

4 5 2001

AMDxx

AVC File Format Ref. Soft TBS

4 5 2001

AMDxx

SVC File Format Ref. Soft TBS

4 5 2001

AMDxx

MVC File Format Ref. Soft TBS

4 11

2005

AMD7 BIFS ExtendedCore2D Profile 09/02

09/07

09/10

10/04

4 14

2003

AMD1 Handling of MPEG-4 audio enhancement layers

09/02

09/07

10/01

4 22

2008

AMD1 Support for many-to-one range mappings

09/04

09/10

10/04

4 22

2008

COR1 Bug fixes 10/01

10/07

7 12

2008

AMD1.

MPQF reference software 09/07

09/10

10/04

7 12

2008

AMD2 Semantic enhancement 09/07

09/10

10/04

10/10

21

2 2002

AMD1.

Presentation element 08/10

09/04

09/10

10/04

21

4 2006

AMD2.

Protection of Presentation Information

08/10

09/04

09/10

10/04

21

19

200x

1st Ed. Media Value Chain Ontology 08/07

08/10

09/07

10/01

A 5 200x

2nd Ed. MS AF 08/01

09/02

10/01

10/07

A 6 2009

COR1 PA AF 10/01

10/07

A 8 200x

AMD1 PVP AF Soft. And Conf. TBS

90

A 9 2009

AMD1 DMB AF Soft. And Conf. 09/02

10/01

A 9 2009

AMD2 DMB AF MPEG-2 Storage 09/02

09/07

10/01

A 10

200x

AMD1 VS AF Conf. & Ref. SW 08/07

09/07

10/01

A 11

200x

AMD1 SVAF Ref. Soft. And Conf. 09/02

09/07

09/10

10/04

A 11

200x

AMD2 Additional composition type 09/07

A 12

200x

1st Ed. Interactive Music AF 09/02

09/07

10/01

A 12

200x

AMD1 IM AF Conf. and RS 10/01

10/04

10/10

B 2 200x

AMD1 FRU Ref. Soft. And Conf.

M 1 200x

1st ed. MxM Architecture 08/07

09/02

09/07

10/01

M 2 200x

1st ed. MxM APIs 08/07

09/02

09/07

10/01

M 3 200x

1st ed. MxM Conf. & Ref. SW 08/07

09/02

09/07

10/01

M 4 200x

2nd Ed. MxM Protocols 09/02

09/07

10/01

U 1 200x

1st ed. Widgets 08/10

09/04

09/07

09/10

10/04

U 2 200x

1st ed. Advanced User Interaction Interface

10/01

U 3 200x

1st ed. Conf. & Ref. SW 08/10

09/04

V 1 200x

200x Architecture 09/02

09/07

09/10

10/04

V 2 200x

200x Control Information 09/02

09/07

09/10

10/04

V 3 200x

200x Sensory Information 09/02

09/07

09/10

10/04

V 4 200x

200x Virtual world object characteristics

09/02

09/07

09/10

10/04

V 5 200x

200x Data formats for interaction devices

09/02

09/07

09/10

10/04

V 6 200x

200x Conformance testing and reference software

09/02

41.3 Standing Documents

Pr Pt Documents No. Meeting1 1 MPEG-1 White Paper – Multiplex Format N7675 05/07 Nice1 1 MPEG-1 White Paper – Terminal Architecture N7676 05/07 Nice1 1 MPEG-1 White Paper – Multiplexing and N7677 05/07 Nice

91

Synchronization2 1 MPEG-2 White Paper – Multiplex Format N7678 05/07 Nice2 1 MPEG-2 White Paper – Terminal Architecture N7679 05/07 Nice2 1 MPEG-2 White Paper – Multiplexing and

SynchronizationN7680 05/07 Nice

2 11 MPEG-2 White Paper – MPEG-2 IPMP N7503 05/07 Poznan4 1 MPEG-4 White Paper – MPEG-4 Systems N7504 05/07 Poznan4 1 MPEG-4 White Paper – Terminal Architecture N7610 05/10 Nice4 1 MPEG-4 White Paper – M4MuX N7921 06/01 Bangkok4 1 MPEG-4 White Paper – OCI N8148 06/04 Montreux4 6 MPEG-4 White Paper – DMIF N8149 06/04 Montreux4 11 MPEG-4 White Paper – BIFS N7608 05/10 Nice4 12 MPEG-4 White Paper – ISO File Format N8150 06/04 Montreux4 14 MPEG-4 White Paper – MP4 File Format N7923 06/01 Bangkok4 15 MPEG-4 White Paper – AVC FF N7924 06/01 Bangkok4 13 White Paper on MPEG-4 IPMP N7505 05/07 Poznan4 13 MPEG IPMP Extensions Overview N6338 04/03 München4 17 White Paper on Streaming Text N7515 05/07 Poznan4 18 White Paper on Font Compression and Streaming N7508 05/07 Poznan4 20 Presentation Material on LASER N6969 05/01 Hong-

Kong4 20 White Paper on LASeR N7507 05/07 Poznan4 22 White Paper on Open Font Format N7519 05/07 Poznan7 1 MPEG-7 White Paper - MPEG-7 Systems N7509 05/07 Poznan7 1 MPEG-7 White Paper – Terminal Architecture N8151 06/04 Montreux21 9 MPEG-21 White Paper – MPEG-21 File Format N7925 06/01 BangkokA X MPEG Application Format Overview N9421 07/10 ShenzhenA X MAF Overview Document N9840 08/04

ArchampsA X MAF Overview Presentation N9841 08/04

ArchampsB X MPEG-B White Paper – BinXML N7922 06/01 BangkokE X MPEG Multimedia Middleware Context and

ObjectivesN6335 04/03 München

E X 1rst M3W White paper N7510 05/07 PoznanE X 2nd M3W White Paper : Architecture N8152 06/04 MontreuxE X Tutorial on M3W N8153 06/04 MonreuxE X M3W White Paper : Multimedia Middleware

ArchitectureN8687 06/10 Hanzhou

E X M3W White Paper : Multimedia API N8688 06/10 HanzhouE X M3W White Paper : Component Model N8689 06/10 HanzhouE X M3W White Paper : Resource and Quality N8690 06/10 Hanzhou

92

ManagementE X M3W White Paper : Component Download N8691 06/10 HanzhouE X M3W White Paper : Fault Management N8692 06/10 HanzhouE X M3W White Paper : System Integrity

ManagementN8693 06/10 Hanzhou

93

41.4 Mailing Lists Reminder

Topic Information Kindly Hosted by

General Systems List

Reflector : gen-sys@lists.uni-klu.ac.atSubscribe: http://lists.uni-klu.ac.at/mailman/listinfo/gen-sysArchive: http://lists.uni-klu.ac.at/mailman/private/gen-sys/

Klagenfurt University

File FormatReflector : mp4-sys@lists.uni-klu.ac.atSubscribe: http://lists.uni-klu.ac.at/mailman/listinfo/mp4-sysArchive: http://lists.uni-klu.ac.at/mailman/private/mp4-sys/

Klagenfurt University

LASeRReflector : mpeg-laser@lists.uni-klu.ac.atSubscribe: http://lists.uni-klu.ac.at/mailman/listinfo/mpeg-laserArchive: http://lists.uni-klu.ac.at/pipermail/mpeg-laser/

Klagenfurt University

MAFReflector : maf-sys@lists.uni-klu.ac.atSubscribe: http://lists.uni-klu.ac.at/mailman/listinfo/maf-sysArchive: http://lists.uni-klu.ac.at/mailman/private/maf-sys/

Klagenfurt University

AITReflector: jiptv@lists.uni-klu.ac.atSubscribe: http://lists.uni-klu.ac.at/mailman/listinfo/jiptvArchive: http://lists.uni-klu.ac.at/mailman/private/jiptv/

Klagenfurt University

MetaverseReflector: metaverse@lists.uni-klu.ac.atSubscribe: http://lists.uni-klu.ac.at/mailman/listinfo/metaverseArchive: http://lists.uni-klu.ac.at/mailman/private/metaverse/

Klagenfurt University

MXMReflector: mxm@lists.uni-klu.ac.atSubscribe: http://lists.uni-klu.ac.at/mailman/listinfo/mxmArchive: http://lists.uni-klu.ac.at/mailman/listinfo/mxm

Klagenfurt University

94

Annex G – Video report

Source: Jens Ohm and Gary Sullivan, Chairs

1 MPEG-4 part 2 maintenanceVarious editorial improvements were made in the editing period to the draft corrigendum 4. Further checking is planned until the 92nd meeting in particular related to the pseudo code on vertical field MV conversion and scaling in quarter-pel MC. Further, as various bug fixes have been performed on the reference software, a cleaned-up version that is intended to become a new edition is planned to be provided for the next meeting. An AHG was appointed (N11116, as recorded in N11076) to further the work until the 92nd meeting.

Document reviewed:m17083 Ad Hoc Group on Maintenance of MPEG-4 Visual related

Documents, Reference Software and ConformanceYi-Shin Tung, Jens-Rainer Ohm

2 Development of AVC

The video subgroup held a session jointly with VCEG to review the comments received during the ISO/IEC ballot process related to DCOR1 and the corresponding ITU-T AAP consent. All issues were clarified, such that the text of the final corrigendum can be provided within a short editing period. It is planned to not publish the corrigendum separately, but rather to integrate it into a new edition which will also include Amd.1 (which is currently under FDAM ballot). An appropriate resolution was produced to request implementation of these actions.

Documents reviewed:m17140 Summary of Voting on ISO/IEC 14496-10:2009/DCOR 1 SC 29 Secretariat

Documents approved:No. Title TBP Available11082 Disposition of comments on ISO/IEC 14496-10:2009/DCOR 1 N 10/01/2211083 Text of ISO/IEC 14496-10:2009/COR 1 N 10/02/1511084 Text of ISO/IEC IS 14496-10:201X (6th edition) N 10/03/15

3 MPEG-7 Visual

3.1 MPEG-7 Visual related workThe MPEG-7 breakout group was active during the whole week. Input documents related to the Visual part in 15938-3 are listed in the table below.

m17185 Suggestion of pre-filtering descriptor for efficient searching the long-length video

Weon-Geun OhJu-Kyong JinJu-hee ChoSang-il NaDong-Seok Jeong

m17186 Proposal on Video Signature Tools for fast matching (VCE-1) Sang-il NaWeon-Geun OhJu-Kyong JinJu-hee Cho

95

Dong-Seok Jeongm17231 CE Results on Video Signature Tools (VCE-1 & VCE-2) Paul Brasnett

Kota IwamotoStavros PaschalakisMiroslaw Bober

m17233 Proposal for Study on ISO/IEC 15938-3/FPDAM4 Video Signature Tools Paul BrasnettKota IwamotoStavros PaschalakisRyoma OamiMiroslaw Bober

m17235 CE Results on Video Signature Tools (VCE-3) Paul BrasnettNikola SprljanStavros Paschalakis

m17236 Results On Image Signature Conformance Testing Paul BrasnettStavros PaschalakisMiroslaw Bober

The main work topics were:

– Video Signature Tools: Review of Core Experiment results and issuance of a Study of FPDAM;

– Image Signature Tools: Finalization of conformance;

– Photo Player MAF: Finalization of conformance.

The main decisions on these subjects were as follows:

• Video Signature Tools: The Study of FPDAM4 (N11085) adopts the following changes shown to be beneficial by Core Experiments:

– Additional bags-of-words with improved matching precision

– Multiple signatures for regions

– Efficient binary representation

• Visual XM version 38 (N11086) contains matching methods related to the technology of Amd.4. Normative elements that were put into the Study text were removed.

• As the only remaining experiment in N11087, CE4 is retained, which is related to further improvements of the matching technology

• For Image Signature Tools (15938-3/Amd.3), the related conformance amendment (15938-7/FDAM5 and related DoC (N11089/N11088) were issued. The tolerance specification problem previously commented on by the JNB was resolved – it was determined that by defining a tolerance of deviation in terms of the Hamming distance, the numeric precision of various computing platforms can be accomodated, whereas the matching precision is not significantly affected .

• For Photo Player MAF (23000-3), FDAM2 for Conformance Testing and DoC (N11091/N11090) were issued as planned. All NB comments were accepted, though there was nothing of critical essence.

An AHG was appointed (N11118, as recorded in N11076) to further the work until the 92nd meeting.

3.2 Output documents related to MPEG-7 Visual

No. Title TBP Available11085 Study Text of ISO/IEC 15938-3/FPDAM 4 Video Signature

ToolsN 10/02/05

96

11086 MPEG-7 Visual XM 38 N 10/02/0511087 Description of Core Experiments in Video Signature Description

developmentN 10/01/22

11088 Disposition of Comments on ISO/IEC 15938-7/FPDAM 5 N 10/01/2211089 Text of ISO/IEC 15938-7/FDAM 5 Conformance Testing for

Image Signature ToolsN 10/02/05

11090 Disposition of Comments on ISO/IEC 23000-3/FPDAM 2 N 10/01/2211091 Text of ISO/IEC 23000-3/FDAM 2 Conformance Testing for

Photo Player MAFN 10/02/05

4 Reconfigurable Video Coding (RVC)

4.1 General status of workThe main part of RVC work during the week in Kyoto was devoted to improving understanding and text of the ongoing Amd.1 (software and conformance). A better understanding about the meaning of conformance testing was achieved, in particular

• Conformance testing specification is necessary for algorithmic FUs (Functional Units), in particular describing the normative input/output dataflow behaviour and related test patterns with the necessary precision. This also relates to the parser.

• Some behaviour of management (control) FUs could be implementation-specific – as long as it does not concern the invoking of FU networks. It is still under discussion whether and which conformance will be needed, or if it is implicit that by defining codec-level conformance sufficient evidence is given that the management FUs also work properly.

• Conformance at the codec level is necessary for combinations of FUs that have defined by MPEG coding standards. In the current first phase of RVC (re-implementing existing standards' profiles/levels), this implicitly exists.

Therefore, a solution without a specification for conformance testing at the control FU level may work for the moment, but for an operational (and particularly extensible) RVC framework it will not be sufficient, and a much better scheme is needed – in which management/control parts need to be normative.

About RVC Simulation Model (RSM): It was discussed that besides the available tools that derive an RVC implementation directly from the CAL description, other implementations of RVC (e.g. written in C/C++) would be possible, with advantages mentioned to potentially give better support in relevant operating environments (e.g. for parallel processing). Further, C/C++ could be easier to debug in available professional testing environments. To get better understanding about potential benefits of having multiple reference software implementations, the proposed C/C++ HOPES framework (see M17309 and M17344) will be investigated in a Core Experiment to be added to RSM – provided that the framework is fully compliant to RVC including the support of FND (FNL) and FU implementation.

Adding a second branch of (non-normative) software implementation would have • PROs: Being able to check the RVC concepts on an broader basis, and giving users alternative

help in implementation,• CONs: No interoperability (probably) between the different software frameworks particularly at

FU level, larger effort of maintenance.

97

The new RVC Work Plan (N11093) is as follows:

• Development of not-yet-operational FU conformance elements, such that FDAM1 can be finalized in April 2010; a new Study document is issued on the parts that have become available in the meantime;

• PDAM2 (AVC High Profile) is now expected for April 2010 – the biggest challenge is still the CABAC implementation, which was to be expected.

An AHG was appointed (N11117, as recorded in N11076) to further the work until the 92nd meeting.

4.2 Input contributions

Doc. No.

Title Authors

m17118 Table of Replies on ISO/IEC FDIS 23001-4 [SC 29 N 10869]

ITTF via SC 29 Secretariat

m17119 Table of Replies on ISO/IEC FDIS 23002-4 [SC 29 N 10870]

ITTF via SC 29 Secretariat

m17143 Summary of Voting on ISO/IEC 23002-4:200X/FPDAM 1

SC 29 Secretariat

m17309 Case study of 3DMCe and SC3DMC implementation in RVC framework using HOPES

Seungwook Lee, Bonki Koo, Ming-Xiao Chen, S. Kim, Daiyong Kim, Euee S. Jang

m17318 Demo : An MPEG RVC decoder based on LLVM

Jérôme Gorin, Matthieu Wipliez, Mickaël Raulet, Marco Mattavelli, Françoise Préteux

m17319 MPEG-4 AVC conformance testing status report

Mickaël Raulet

m17322 MPEG-4 SP conformance testing status report with Btype

Ihab Amer, Mariam Mostafa Saleh, Marco Mattavelli, Mickaël Raulet

m17325 RVC Conformance testing for IQ/IDCT and intra prediction of MPEG-4 AVC

Chris Lee, He-Yuan Lin , Tsung-Yuan Huang, Jia-Wei Liang

m17343 RVC Conformance Testing Result on MPEG-4 SP and RSM Debugging Report

Hyungyu Kim, Minsoo Park, Sowon Kim, Euee S. Jang

m17344 HOPES: Retargetable parallel-programming framework in C and C++

Hyunok Oh, Euee S. Jang

m17349 Coordinator's Report on RVC RSM Management

Hwa Seon Shin

m17352 Comments on RVC conformance and development

Euee S. Jang, Gwo Giun Lee

4.3 Conformance testing (reviewed during Sunday AhG meeting) 4 input contributions were provided:

Doc. No.

Title Authors

m17319 MPEG-4 AVC conformance testing status Mickaël Raulet

98

reportPoints & Recommendations

Patches for collecting golden references for AVC FUs (14 FUs) are provided.

Most FU-level conformance testing in ALGO-FU level is complete except a few FUs.

OpenDF supports RVC-CAL and wider set of CAL constructs. OpenDF implementation does not report well where variable initializations are missing and where Lists are not initialized when you are trying to access them.

[Recommendation] need to discuss how conformance is described in the document with Chris.

m17322 MPEG-4 SP conformance testing status report with Btype

Ihab Amer, Mariam Mostafa Saleh, Marco Mattavelli, Mickaël Raulet

Points & Recommendations

‘Btype’ based conformance testing report. Btype is not currently supported in VTL. [Recommendation] This work has to be merged with ‘without

BYPE’.m17325 RVC Conformance testing for IQ/IDCT and

intra prediction of MPEG-4 AVCChris Lee, He-Yuan Lin , Tsung-Yuan Huang, Jia-Wei Liang

Points & Recommendations

We need to harmonize the format of conformance testing document.

m17343 RVC Conformance Testing Result on MPEG-4 SP and RSM Debugging Report

Hyungyu Kim, Minsoo Park, Sowon Kim, Euee S. Jang

Points & Recommendations

Some functionalities such as RVLC are not implemented in RSM.

Most conformance testing results are comparable to m17322.

FU verification and conformance testing status

MPEG-4 AVC CBP FUs

28 ALGO FUs

The bitstreams containing the following features are not yet supported:

Frame cropping (the exact status for that aspect is unknown)

MMCO (it impacts on the parser and the Algo_MMCO FU.

MPEG-4 SP FUs

12 ALGO FUs

The bitstreams containing the following features are not yet supported:

Reversible VLC (it impacts on the parser only)

Short_header (it impacts on the parser only)

HEC and ResyncMarker (it impacts on the parser and some management FUs)

4.4 RVC development Two input contributions:

Doc. No.

Title Authors

m17344 HOPES : Retargetable parallel-programming Hyunok Oh, Euee S. Jang

99

framework in C and C++Points & Recommendations

HOPES framework is recommended to be added as additional language to implement RVC simulation model (RSM).

The proponents of HOPES are required to make the framework fully conforming to RVC, including the support of FU network description - FND / FU network language - FNL and FU implementation.

m17352 Comments on RVC conformance and development

Euee S. Jang, Gwo Giun Lee

Points & Recommendations

Based on the contribution, there has been much discussion on how conformance testing should be carried out.

In RVC conformance, two steps are identified: FU verification stage: this stage is to verify if the FU

implementation in VTL is correct. If an FU is verified, it is only then subject to conformance testing.

FU conformance testing stage: Based on the verification of FU, conformant input/output patterns are generated.

4.5 RSM This mandate has been discussed through the email reflector.

Doc. No.

Title Authors

m17349 Coordinator's Report on RVC RSM Management

Hwa Seon Shin

Points & Recommendations

Reviewed.

4.6 RGC Two input contributions:

Doc. No.

Title Authors

m17309 Case study of 3DMCe and SC3DMC implementation in RVC framework using HOPES

Seungwook Lee, Bonki Koo, Ming-Xiao Chen, S. Kim, Daiyong Kim, Euee S. Jang

Points & Recommendations

FUs for 3DMCe are designed and implemented in HOPES platform.

4.7 Demo

One input contribution:

Doc. No.

Title Authors

m17318 Demo : An MPEG RVC decoder based on LLVM

Jérôme Gorin, Matthieu Wipliez, Mickaël Raulet, Marco Mattavelli,

100

Françoise PréteuxPoints & Recommendations

Reviewed and this demo has been presented during Monday plenary.

Output Documents:

No. Title TBP Available11092 Study Text of ISO/IEC 23002-4/FPDAM 1 Video Tool Library

Conformance and Reference SoftwareN 10/02/28

11093 Description of Core Experiments in RVC N 10/01/2211094 RVC Work Plan N 10/01/22

5 Explorations – 3D Video

The goal of the current 3D video exploration work is to generate interpolated views from available videos of multiview camera configurations. The target application is mostly seen for upcoming generations of various (auto-) stereoscopic displays, either requiring multiple views internally or providing means for baseline adjustment. In the new format, only a low number (1-3) of video sequences would be transmitted, but rendering of additional views would be enabled by associated depth information.

The activity currently concentrates on preparing test sets and anchor coding for an upcoming Call for Proposals (CfP). By the Xi’an meeting, new more challenging test sequences (in terms of content activity and camera movement) had been provided which were investigated in the period before the Kyoto meeting to complement the existing more static set. Extensive subjective viewing was carried out in Kyoto. Out of the 6 test sequences, good quality of view interpolation was already achieved for two, one more gives results of fair (only some visible artifacts) quality, whereas the remaining three require still considerable improvement. This result is remarkable in so far that until now, only fully-automatic depth estimation was applied. It is expected that by semi-automatic or manual interaction good quality can be achieved for at least four sequences, such that definitely the new material can well be used for testing in the Call.

Good progress was also made in the definition AVC/MVC (both for video and depth maps) coding of anchors for the old, more static test sequences. All results were investigated in subjective viewing, and only a small number of cases needs redefinition of rate points (e.g. when quality was too good/bad at low and high rate points). In the period between the 91st and 92nd meetings, the first anchor encoding will also be performed for the new test sequences mentioned above, to the extent that good depth maps are available or are becoming available between the meetings.

After all, the timeline decided in Xi’an can be confirmed as follows:

• Finalize anchor coding for old sequences – April 2010

• Final depth maps + preliminary anchor coding for new sequences – April 2010

• Draft CfP (internal) – April 2010

• Final Anchor coding for new sequences – July 2010

• Preliminary CfP (public) – July 2010

101

• Final CfP – Oct. 2010

It is planned to provide a report on the results of depth estimation, view interpolation and anchor coding as performed in the exploration experiments, which is expected to help prospective proponents better understand the current status of technology, and also to be a promotion for 3D video. A draft version (internal) was also issued in Kyoto.

An AHG was appointed (N11119, as recorded in N11076) to further the work until the 92nd meeting.

Documents reviewed in AHG (see AHG report m17086)

m17155 3DV/FTV EE results of depth estimation and coding experiment on "lovebird1" sequence

Gun BangNeung-joo HwangDonggyu SimHyunho JoGi-Mun UmWon-Sik CheongNamho HurJinwoong Kim

m17174 Preprocessing methods used for Poznan 3D/FTV test sequences Jakub StankowskiKrzysztof KlimaszewskiOlgierd StankiewiczKrzysztof WegnerMarek Domanski

m17175 Newspaper sequence - Results of 3DV/FTV Exploration Experiments with depths and view synthesis

Olgierd StankiewiczKrzysztof WegnerKrzysztof Klimaszewski

m17176 First version of depth maps for Poznan 3D/FTV test sequences Marek DomanskiOlgierd StankiewiczKrzysztof Wegner

m17188 Distortion Model of Virtual Views based on texture and depth compression

Hui Yuan Ming liFuzheng YangJunjyan HuoZhibin Li

m17190 Model based Optimal Bit allocation between texture and depth Hui YuanYilin ChangMing LiFuzheng YangJunyan HuoZhibin Li

m17191 3DV/FTV EE4 results on Pantomime sequence Shinya ShimizuHideaki Kimata

m17205 3DV/FTV EE1 report on Champagne Tower sequence Masayuki TanimotoToshiaki Fujii Mehrdad Panahpour Tehrani Menno Wildeboer

m17206 3DV/FTV EE4 report on Champagne Tower sequence Masayuki TanimotoToshiaki Fujii Mehrdad Panahpour Tehrani Menno Wildeboer

m17207 3DV/FTV EE1 report on Kendo and Balloons sequences Masayuki TanimotoToshiaki Fujii Mehrdad Panahpour Tehrani Menno Wildeboer

m17208 Depth Estimation for Moving Camera Test Sequences Masayuki TanimotoToshiaki Fujii Mehrdad Panahpour Tehrani Menno Wildeboer

m17217 Refinement results on 3DVC EE4 for Beergarden MVD2 Pablo CarballeiraJulián CabreraFernando JaureguizarGianluca CernigliaroJuan CasalNarciso García

m17218 Refinement results on 3DVC EE4 for Newspaper MVD3 Pablo Carballeira

102

Julián CabreraFernando JaureguizarGianluca CernigliaroJuan CasalNarciso García

m17223 Results of EE1 on "Cafe" Sequence Cheon LeeMinkoo KangYo-Sung Ho

m17224 Results of EE4 on "Pantomime" Sequence Cheon LeeSang-Beom LeeYo-Sung Ho

m17225 3-D Video Generation using Multi-depth Camera System Eun-Kyung LeeYun-Suk KangJae-Il JungYo-Sung Ho

m17226 3DV EE4 Results on BeerGarden sequence Patrick LopezDong Tian

m17244 EE4 Coding Experiment Results Using Book_Arrival Test Sequence

Jaewon SungByeong-Moon Jeon

m17248 3D Video Coding Results of Exploration Experiments Gerhard TechKarsten Müller

m17250 3D Video Coding Results of Exploration Experiments on BookArrival

Dong TianPo-Lin LaiPatrick Lopez

m17255 3DV EE4 Report on Book_arrival Sequences Yin ZhaoLu Yu

m17256 PSPNR Tool 2.1 Yin ZhaoLu Yu

m17259 3DV EE Results fons brulsm17260 Cross validation report on M17231 Karol Wnukowiczm17262 Cross validation report on M17235 Karol Wnukowiczm17274 Results of EE4 on Mobile Sehoon Yea

Anthony Vetrom17293 3DV EE4 Results on Newspaper sequence Jaejoon Lee

Seok LeeHoCheon WeyDu Sik Park

m17295 Report of 3DV Exploration Experiment1 Takanori Senoh Kenji Yamamoto Ryutaro OiTomoyuki MishinaTaiichiro Kurita

m17296 Improvement of Depth Estimation Takanori SenohKenji YamamotoRyutaro OiTomoyuki MishinaTaiichiro Kurita

m17303 3DV/FTV EE4 results of coding experiment on "lovebird1" Qifei WangXiangyang JiQionghai DaiNaiyao Zhang

m17304 3D Video Coding EE1 Results for Poznan_Hall Test Sequence Qifei WangMingjin YangXiangyang JiQionghai Dai

m17316 A depth estimation method for edge precision guarantee of synthesized view

Xiaoxian LiuYuan Hui

Output documents:

No. Title TBP Available11095 Description of Exploration Experiments in 3D Video Coding N 10/01/2211201 Draft Report on Experimental Framework in 3D Video Coding N 10/01/22

103

6 Explorations – High-Performance Video Coding

The main focus on the subject of High-Performance Video Coding was the finalization of the Call for Proposals. Terms of Reference (N11112) had been negotiated between the management of the parent bodies of the upcoming Joint Collaborative Team (JCT) on video coding, and were reviewed and approved. Accordingly, the preparation of the final CfP text was conducted jointly with VCEG. There were no substantial problems identified in the previous draft CfP text; however considering that 31 pre-registrations had been received, and that the testing relating to the CfP is expected to become a major effort, careful consideration of the overall timeline was made, and in particular the issue of payment for the testing fee was clarified (see responses to NBs, N11115). The final registration declaration period was opened immediately after the Kyoto meeting.

As the previous version of the document on Vision, Applications and Requirements of High Performance Video Coding (as of Lausanne, February 2009) was partially incomplete and outdated, a new version (N11096) was issued to accompany the CfP. It clarifies numerous aspects in the vision section, with higher compression as main target, however broadening the list of possible applications, e.g.

• Home cinema, Digital Cinema, Broadcast

• Surveillance

• Real-time communications, video chat, video conferencing

• Mobile streaming, broadcast and communications

• Storage, Camcorders

• Video On Demand, Internet streaming, download and play

• 3D video, telepresence

• Content production and distribution

• Medical imaging

The requirements section was updated – mainly to remove unclear and vague descriptions for various aspects, mostly without changing the substance. Some non-mandatory (“should”) requirements were added, e.g. support for lossless, support for alpha channels. Unnecessary restrictions on frame rate were removed. Some discussion was held on the issue of potential needs for support of interlaced-scan video; however no significant change was made to the requirements document in that regard . HVC remains intended to provide mandatory support only for progressive scan. For interlaced-scan video, it remains unclear whether there will need to be specific support in the scope of HVC applications, and if so, whether the available tools for progressive-scan encoding cannot be adequately used for interlaced-scan video with sufficiently high coding efficiency (e.g. using field coding).

Several contributions had been submitted with descriptions of specific algorithmic technology features that may be useful in the future work on the project (M17163, M17180, M17181). These were presented and discussed, and the participants were suggested to continue the study of such design aspects toward progress in preparation of CfP responses and for the subsequent work on the project.

For a smooth start of the collaboration with ITU-T, the following actions were proposed:

• Recommending establishment of JCT based on N11112, and nomination of chair from ISO/IEC

104

• Recommending to issue CfP jointly

• Recommending to start the joint activity by holding a joint meeting in Dresden during 2010/04/15 – 2010/04/23 in order to evaluate the responses to the CfP and initiate steps towards selection of technology

An AHG was also appointed (N11120, as recorded in N11076) to further the work until the 92nd meeting.

Input Documents reviewed:

m17162 Comment on Call for Proposals on HVCRequested that:

– After Pre-registrationInformation on payment recipient will be conveyed to pre-registered organization if requested.

– After Formal registration Invoice will be issued after confirming; no possibility of refunding.

– Payment of the fee:Registered organization shall inform CfP contact person if any delay of payment completion would happen due to procedural issue.

These issues were requested to be clarified in the final CfP

National Body of Japan

m17183 UKNB Comments on Call for Proposals on HVCRequest to- give more clear statement about the importance of UHDTV, to avoid misinterpretation due to the fact that 4Kx2K is not included in subjective assessmentThis issue should be worded better in the final CfP- Use decoding time only as rough indicator of complexityComment noted, but ranking of proposals is to be done by group consensus only after the results of CfP have been evaluated These issues were requested to be clarified in the final CfP- Proceed with VCEG collaboration, stick to the timeline

UK National Body

m17173 7680 x 4320 format test sequences for HVCOffer 8Kx4K 60 fps sequences, 4:2:0 format. 5s each. Locomotive train, Nebuta festivalNative resolution of chip is quincunx (red, blue and 2 green channels). Full-resolution 4:4:4 not available currently.Signing of NDA was requested by the contributor – with the contributor organizing distribution, MPEG cannot take responsibility on this(In discussions at the meeting, the NDA request seemed problematic for potential use of the material in MPEG activities.)Longer sequences (10 s) as appropriate for subjective testing could be provided

Shinichi SakaidaAtsuro IchigayaYasutaka MatsuoTakahiro ToyodaKazuhisa IguchiYoshiaki Shishikui

m17240 AVC Anchor Streams of Class-A for CfP on HVCComment: Excel sheets with rates and per-frame PSNR values should be provided for all anchors (before end of the week)

Kazuo SugimotoShun-ichi SekiguchiKeiichi ChonoAtsuro IchigayaKazuhisa IguchiTakahiro NishiSteffen Wittmann

m17162 Comment on Call for Proposals on HVCRequest that:

– After Pre-registrationInformation on payment recipient will be conveyed to pre-registered organization if requested.

– After Formal registration Invoice will be issued after confirming no possibility of refunding.

– Payment of the fee:Registered organization shall inform CfP contact person if any delay of payment completion would happen due to procedural issue.

These issues must be clarified in the final CfP

National Body of Japan

m17183 UKNB Comments on Call for Proposals on HVCRequest to

UK National Body

105

- give more clear statement about the importance of UHDTV, to avoid misinterpretation due to the fact that 4Kx2K is not included in subjective assessmentThis issue should be worded better in the final CfP- Use decoding time only as rough indicator of complexityComment noted, but ranking of proposals is to be done by group consensus only after the results of CfP have been evaluated These issues must be clarified in the final CfP- Proceed with VCEG collaboration, stick to the timeline

m17173 7680 x 4320 format test sequences for HVCOffer 8Kx4K 60 fps sequences, 4:2:0 format. 5s each. Locomotive train, Nebuta festivalNative resolution of chip is quincunx (red, blue and 2 green channels). Full-resolution 4:4:4 not available currently.Signing of NDA is requested – Contributors will organize distribution, MPEG cannot take responsibility on thisLonger sequences (10 s) as appropriate for subjective testing could be provided

Shinichi SakaidaAtsuro IchigayaYasutaka MatsuoTakahiro ToyodaKazuhisa IguchiYoshiaki Shishikui

m17240 AVC Anchor Streams of Class-A for CfP on HVCComment: Excel sheets with rates and per-frame PSNR values should be provided for all anchors (before end of the week)

Kazuo SugimotoShun-ichi SekiguchiKeiichi ChonoAtsuro IchigayaKazuhisa IguchiTakahiro NishiSteffen Wittmann

m17163 Motion Compensated Prediction by Subsampled Block Matching for Zoom Motion ContentsTraditionally only MC for translation motion; other types typically much more complex. Use pre-computed zoom-in and zoom-out frames as additional references. Use the sub-pixel interpolated frames with various re-sampling ratios (typically those which are close to 1, e.g. 8/9 or 9/8 if up-sampling by factor of 8 is done). Turned off all KTA coding tools (using 1/8 pixel MV resolution). BR saving average around 5% for 1/8 pel, 2% for 1/4 pel MC. Additional reference frames are used for signaling.

Lai-Man PoKa-Man WongKa-Ho NgKwok-Wai CheungChi-Wang TingYu LiuKa-Man ChengYan Huo

m17180 Advanced Direct Mode for Bi-directionally Predictive Block CodingSelection of reference blocks for spatial direct is modified depending on block position. Then Motion of a spatial adjacent (as in spatial direct) is used to determine the co-located block, taking into account the motion shift. MV Difference in reference frame also taken into account. Done in both forward and backward directions. Likelihood value is determined for each of the 3 cases, and the case with highest is selected. Advanced direct mode is signaled by additional flag. Old direct mode should not be used. Then, overall bit rate savings compared to alpha anchor is 2.7%; highest for class B (around 3.5). Gain higher for low bit rates.

Siu Wan-Chi (PolyU)Kam Yan-Ho (PolyU)Liu Yu (ASTRI)Cheng Ka Man (ASTRI)Huo Yan (ASTRI)

m17181 Variable Block Size Skip Mode and New Partition Modes for Inter-predictionNew MB modes that also allow combination of two 8x8 blocks and one 8x16 block. Skip/nonskip mode also separately for 8x16 and 8x8 block types. Competition based MV selection method (spatial and temporal predictor) investigated, but not used. Comparison against gamma anchor. Average BR reduction 2.4%, more at low bit rates.

Kam Yan-Ho (PolyU)Siu Wan-Chi (PolyUChan Yui-Lam (PolyU)Hui Wai-Lam (PolyU)Fu Changhong (PolyU)Liu Yu (ASTRI)Cheng Ka Man (ASTRI)Huo Yan (ASTRI)

Output documents:

No. Title TBP Available11096 Vision, Applications and Requirements of High Performance

Video CodingY 10/01/22

11112 Terms of Reference of the Joint Collaborative Team on Video Coding Standard Development

10/01/22

11113 Joint Call for Proposals on Video Compression Technology Y 10/01/22

106

107

Annex H – Audio report

Source: Schuyler Quackenbush, Chair

1 Opening Audio Plenary.............................................................................................................22 Administrative matters...............................................................................................................2

2.1 Communications from the Chair 22.2 Approval of agenda and allocation of contributions 22.3 Creation of Task Groups 22.4 Approval of previous meeting report 22.5 Review of AHG reports 22.6 Joint meetings 22.7 Received National Body Comments and Liaison matters 22.8 Plenary Discussion 2

3 Record of AhG meetings...........................................................................................................23.1 AhG Meeting on USAC -- Sunday 0900-1800 2

4 Task group activities..................................................................................................................64.1 Joint meetings 6

4.1.1 Audio for HVC Thursday 1400-1500..............................................................................64.2 Task Group discussions 7

4.2.1 MPEG-2, MPEG-4, Audio Conformance, Reference Software, MPEG Surround.........74.2.2 MPEG-D Spatial Audio Object Coding..........................................................................74.2.3 MPEG-D Unified Speech and Audio Coding................................................................11

5 Meeting deliverables................................................................................................................185.1 Plenary discussions 185.2 Responses to Liaison and NB comments 195.3 Recommendations for final plenary 195.4 Establishment of Ad-hoc Groups 195.5 Approval of output documents 195.6 Press statement 195.7 Agenda for next meeting 195.8 All other business 195.9 Closing of the meeting 19

Annex A Participants.................................................................................................................20Annex B Audio Contributions and Schedule.............................................................................21Annex C Task Groups...............................................................................................................22Annex D Output Documents......................................................................................................23Annex E Agenda for the 92nd MPEG Audio Meeting...............................................................24

108

1 Opening Audio PlenaryThe MPEG Audio Subgroup meeting was held during the 91st meeting of WG11, January 18-22, 2010 in Kyoto Japan. The list of participants is given in Annex A.

2 Administrative matters2.1 Communications from the ChairThe Chair summarised the issues raised at the Sunday evening Chair’s meeting, proposed task groups for the week, and proposed agenda items for discussion in Audio plenary.

2.2 Approval of agenda and allocation of contributionsThe agenda and schedule for the meeting was discussed, edited and approved. It shows the documents contributed to this meeting and presented to the Audio Subgroup, either in the task groups or in Audio plenary. The Chair brought relevant documents from Requirements, Systems to the attention of the group. It was revised in the course of the week to reflect the progress of the meeting, and the final version is shown in Annex B.

2.3 Creation of Task GroupsTask groups were convened for the duration of the MPEG meeting, as shown in Annex C. Results of task group activities are reported below.

2.4 Approval of previous meeting reportThe 90th Audio Subgroup meeting report was registered as a contribution, and was approved.

2.5 Review of AHG reportsThere were no requests to review any of the AHG reports.

2.6 Joint meetingsThe joint meetings held are shown below.Groups What Where Day TimeA, V, R Audio for HVC Audio Thu 1400 -

1500

2.7 Received National Body Comments and Liaison mattersThe NB Liaison statements generated at the meeting are as shown below.No. Title

11216 Response to Liaison from World DMB Forum

11217 Response to Liaison from ITU-T SG 16 on Enhanced Low Delay AAC

11218 Response to Liaison from ITU-R SG 6/WP 6B

2.8 Plenary DiscussionThere was none.

3 Record of AhG meetings

109

3.1 AhG Meeting on USAC -- Sunday 0900-1800JungHoe Kim, Samsung, presentedm17227 Proposed change of the IPD sign in USAC JungHoe Kim

Eunmi OhWerner OomenHeiko PurnhagenJulien Robilliard

This contribution is a joint proposal that requests the sign of IPD in phase coding of MPEG Surround have the same sense as in HE-AAC V2. New reference bitstreams reflecting this change can be made available shortly after the end of the 91st meeting, as will modified text in the next USAC WD and modified reference encoder and decoder sourc.It was the consensus of the AhG to accept the proposal.JungHoe Kim, Samsung, presentedm17228 Proposed informative encoder description of phase coding

in USACJungHoe KimEunmi Oh

The contribution shows how one could construct an encoder using phase coding of IPD parameter. Prior to the next meeting Samsung will provide reference source code for the MPEG Reference Encoder. It was the consensus of the AhG to integrate the contribution into an informative annex of the next USAC WD.Hyunkook Lee, LG, presentedm17292 Report on the USAC reference encoder Hyunkook Lee

Sungyong YoonThis contribution proposes several bugfixes for the USAC encoder

ICCQuant in sac_enc.c to correct limit of for loop OttBoxCalcIPD in sac_ipd.c to correct sence of IPD sign (this is corrected by m17228) OttBoxCalcIPD in sac_ipd.c to correct order of arctan2 function. OttBox sac_enc.c to correct L/R phase measurement.

Samsung and FhG are willing to review and improve these encoder-related modules.It was the consensus of the AhG to draft a workplan to

Incorporate these updates Make further improvements Check performance via a listening test

Werner Oomen, Philips, presentedm17278 Corrections to Unified Stereo Coding Erik Schuijers

Heiko PurnhagenPontus CarlssonWerner OomenJulien Robilliard

The contribution proposes a number of corrections: Align MPEG Surround decorrelation/residual sign to be as in HE-AAC V2 parametric

stereo. This is exactly what has been requested by Samsung in m17227. Although the result of adding in the residual signal will change (due to the sign change), this is not expected to have any quality impact.

Correct errors in the Unified Stereo Coding encoder description in the WD informative annex.

Removal of gain clipping constant in MPEG Encoder and Decoder Reference Software. Philips has done informal listening test that confirm that the change does not impact audio quality.

110

New text, reference code, bitstreams and decoded waveforms will be available prior to the next MPEG meeting.JungHoe Kim, Samsung, requested that there be a listening test to check the impact of the clipping change. The presenter proposed that an informal listening session could be conducted during the MPEG week. Heiko Purnhagen, Dolby, did not expect the sign change of the residual to have an impact on audio quality. Mohamad Raad, RaadTech, asked the magnitude of the errors that the gain clipping in the current code imposes. Heiko Purnhagen, Dolby, noted that it is merely a unnecessary limitation in the USAC decoder. There is no such decoder gain limitation in e.g. HE-AAC parametric stereo. The Chair noted that the technology proponents should of course check that legal bitstreams (i.e. conformant bitstreams) never cause a normative decoder to “blow up,” e.g. to divide by zero in the course of calculating the output waveforms.It was the consensus of the AhG to accept the first two corrections into USAC WD6. The proposed change to gain clipping will continue to be studied and will be discussed at the next meeting.Heiko Purnhagen, Dolby, presentedm17273 Educational information on Unified Stereo encoding Heiko Purnhagen

Pontus CarlssonWerner OomenErik Schuijers

The contribution presents guidance for constructing a USAC encoder that supports unified stereo coding. The Chair expressed a great interest in getting some baseline “plumbing” as reference encoder source code, and noted that the educational text assumes that certain modules are present, which may not be the case in the MPEG Reference Encoder. It was agreed to draft a workplan to identify missing software modules and to identify resources to provide such code. The Chair requested that experts from Dolby assist in identifying missing encoder modules. Experts from Dolby, Phlips, Samsung and FhG will help draft the workplan that identifies modules that possibly must be incorporated into WD4 to support the unified stereo CE. Pierrick Phillipe, Orange Labs, requested more information concerning the derivation of alpha that is used in calculating the downmix and residual. An example method to calculate alpha was requested. There was considerable additional discussion on other encoder options that might be realized and which are not covered on the educational text. The CE proponents will work with interested experts to modify the education text such that it addresses these concerns. It was the consensus of the AhG to incorporate this document into the WD6 informative annex and additionally to draft a workplan on enhancing the MPEG Reference Encoder with the aim that it contains appropriate framework to support the unified stereo tool.JungHoe Kim, Samsung, presentedm17230 Comments on reference software of MPEG Surround and

reference software using MPEG Surround toolJungHoe KimMiyoung KimEunmi Oh

This contribution raises the issue as to whether the current MPEG Reference Encoder is sufficient to support the RM0 and additional CE functionality. It specifically notes modules in MPEG Surround that would be needed to enable full functionality.The Chair encouraged interested parties to consider the issues raised. This will be discussed again later in the MPEG week. Based on the consensus of the group, items may be added to a workplan with the goal of enhancing the functionality of the MPEG Reference Encoder.Kristofer Kjörling, Dolby, presentedm17165 Report on cross-check listening test for the USAC CE on

Unification of USAC Windowing and Frame TransitionsKristofer KjörlingLars Villemoes

The contribution reports results of listening tests on the USAC CE technology operating at 12kbps and 24kbps for mono signals. For both tests, the absolute scores did not reveal any differences. Differential analysis for 12 kb/s displayed

in the mean over all 15 items, where both A and C are better than B;

111

in four instances where A is better than B, (“Wedding speech”, “twinkle ff51”, “HarryPotter”; and “phi7”);

in two instances where C is better than B, (“Wedding speech” and “HarryPotter”); in one instance where C is worse than B, (“te1 mg54 speech”).

Differential analysis for 24 kb/s displayed in the mean over all 15 items, where A is better than B; in three instances where A is better than B, (“louis raquin 15”, “te1 mg54 speech”, and

“HarryPotter”); in one instance where C is better than B, (“louis raquin 15”); in one instance where C is worse than B, (“phi7”);

Jeongook Song, LG, presentedm17209 YSU-LG Listening test for CE on Unification of USAC

Windowing and Frame TransitionsJeongook SongChang-Heon LeeHenney Oh

The contribution reports results of a listening test conducted at Yonsei University on the USAC CE technology operating at 12kbps for mono signals. Systems under test were WD4, WD4+FAC and WD4+FAC+FDNS. Absolute score analysis did not reveal any differences and differential analysis was not presented.Taejin Lee, ETRI, presentedm17216 ETRI Listening Test Results for CE on Unification of

USAC Windowing and Frame TransitionsTaejin LeeSeungkwon BeackMinje KimKyeongok Kang

The contribution reports results of listening tests on the USAC CE technology operating at 12kbps and 24kbps for mono signals. Systems under test were WD4, WD4+FAC and WD4+FAC+FDNS. For both tests, the absolute scores did not reveal any differences. JungHoe Kim, Samsung, presentedm17229 Crosscheck report on Unification of USAC Windowing

and Frame TransitionsJungHoe KimEunmi Oh

The contribution reports results of a listening test on the USAC CE technology operating at 12kbps for mono signals. Systems under test were WD4, WD4+FAC and WD4+FAC+FDNS. For this tests, the absolute scores did not reveal any differences. Max Neuendorf, FhG, presentedm17167 Completion of Core Experiment on unification of USAC

Windowing and Frame TransitionsMax NeuendorfBruno BessetteRoch LefebvrePhilippe GournayStefan BayerJeremie Lecomte

This contribution reviews the technical details of the USAC Windowing and Frame Transition CE. The presentation gave an overview of the technology and refers the interested reader to the contribution text. It also gives information on complexity and reports on a listening test at FhG/Voiceage. Finally, listening test results for the pooling of all data is presented.The following shortcomings of WD4 are noted:

Frame grid and window grid are not aligned Not every transform is critically sampled since some transitions require samples to be

discarded Many window shapes are sub-optimal. Some transforms are not a power of 2, entailing additional programming complexity.

112

It then presents the transitions using the CE technology Frame grid and window grid are aligned All transforms are critically sampled Nearly all window shapes are optimal. All transforms are a power of 2.

The key to realizing these simplifications are Exchange of LP weighting and IMDCT in the TCX branch of the decoder Application of the LP weighting in the MDCT coefficient domain using the Frequency

Domain Noise Shapping (FDNS) tool. Using Forward Aliasing Cancellation (FAC) tool to cancel time domain aliasing in IMDCT

when the adjacent frame is LP-ACELP.

Mohamad Raad, Raadtech, questioned whether the FDNS tool uses the appropriate interpolation. He noted that the goal is to match the actual signal target (short-time spectrum) rather than have a LPC interpolation scheme. The Chair asked Mohamad Raad and interested proponent experts to convene a break-out to discuss this in greater detail and report back to the group.The contribution presents the instructions that would be needed on an idealized DSP to implement the modules that comprise the CE proposal. The result is that the complexity of WD4 vs WD4+CE is approximately the same. Pierrick Philippe requested time for additional study of what is presented in the contribution, and will report back to the group any further observations he may have. The presenter noted that ROM and RAM requirements for WD4 vs WD4+CE are not significantly different.The presenter showed listening test results for the pooled listening test data. For 12 kb/s mono there are 54 listeners at 6 test sties. When doing a differential analysis, the mean score for WD4+CE is better than that for WD4 at the 95% level of significance; that the scores for 7 items are better at the 95% level of significance and that none are worse. Note that here CE is FDNS+FAC.For 24 kb/s mono there are 36 listeners at 4 test sties. When doing a differential analysis, the mean score for WD4+CE is better than that for WD4 at the 95% level of significance; that the scores for 7 items are better at the 95% level of significance and that none are worse.When doing absolute analysis, the pooled data show that the mean score of WD4+CE is not different from that of WD4 at the 95% level of significance.Mohamad Raad, Raadtech, requested that the distribution of listener scores for each test site be presented. The Chair requested that differential analysis for individual test sites be presented. This data plus comments on complexity plus any other view on statistics or the decision process on this CE will be presented on Tuesday afternoon.Taejin Lee, ETRI, presentedm17215 Report on TCX Improvements Taejin Lee

Seungkwon BeackMinje KimKyeongok Kang

The contribution reviews the CE technology, which is a flexibile TCX overlap that depends on next frame’s TCX mode. A new technology proposed in this contribution is to have the transition length be responsive to transients in the overlap region, i.e. shorter overlap when transients are present. It contends that this increased the quality of the TCX mode for musical signals. Listening test results for TCX with transient protection (tr) were presented, showing:

12 kb/s mono: one better, none worse, global mean not different 20 kb/s mono: 3 better, one worse, global mean not different

The technology requires one additional encoding stage without LPC processing to determine the next frame’s TCX window type. The Audio Subgroup will draft a workplan to coordinate progress in this CE.

113

4 Task group activities4.1 Joint meetings4.1.1 Audio for HVC Thursday 1400-1500

The Requirements Chair presented a list of HVC application scenarios. They are listed hear and discussion for each is recorded.Home Cinema – It is envisioned that HVC visual displays will be 2 meters wide. This gives the possibility of an easy deployment of more speakers integrated into the video display.Since NHK targets its Hi-Vision technology at the home cinema market, an NHK expert gave a short presentation on the NHK Hi-Vision technology. Due to the large video display, there is the need for a stable and very wide angle sound stage. Hence, the NHK system uses 10 front speakers in three layers (high, mid, low). This audio-visual presentation is able to tightly link sound cues to visual cues. NHK uses a seven “tall boy” 3-elment speaker cabinets for the home cinema setup. This is captured in the following diagram. If the video screen is 1 meter tall this implies a viewing distance of under 1 meter, and this clearly places the audience in the audio near field.

HNK is working with other standards bodies: SMPTE 2036-2008 “UHDTV” and ITU-R WB6C Recommendation ITU-R BS.[3DSound]. The latter supports a hierarchy of loudspeaker presentations. An MPEG opportunity would be to compress a 22 channel audio program and to render to 22.2 or to a lower hierarchy of loudspeakers (e.g. 12.2). Theatre Cinema – HVC competes with the current digital cinema rollout, hence this is not considered a primary target market for HVC.Real-time Communications – such systems would most likely run at 60 Hz or 16 ms per frame, so realistic systems might have one-way latency of 45 ms (three frame intervals). Audio experts noted

DepthhhhWidth

Elevation

Two dimensional sound localization over the screen

Three dimension

Viewing angle 100°

Envelopment

114

that the one-way latency of AAC-LD is approximately 20 ms and the one-way latency of SAOC LD is 26 ms (without SBR tool).Mobile Streaming – These applications are have error resilience for e.g. mobile air interface links. Generally these are with Internet Protocol packetization and associated lower level error checking.Camcorders – It is not clear what it the standardization challenge for audio.Streaming, storage, download – In these applications most likely random access is a primary concern.3D Video or telepresence – These entail multiview displays in which views change with viewing angle. For audio, different head placement might result in different sound field.

4.2 Task Group discussions4.2.1 MPEG-2, MPEG-4, Audio Conformance, Reference Software, MPEG Surround

Ferenc Kraemer, Dolby, presentedm17239 Proposed corrections to MPEG Surround conformance and

reference softwareFerenc KraemerHeiko Purnhagen

The contribution proposes DCOR on 23003-1/AMD 1/DCOR 1, Corrections to MPEG Surround Conformance DCOR on 23003-1 AMD 2/DCOR 2, Corrections to MPEG Surround Reference Software.

This corrects errors in time alignment of HE-AAC and MPEG Surround parameters, and also adds README files in the reference software to better explain the implementation of carriage of MPEG Surround as buried data in PCM downmix.

It was the consensus of the Audio subgroup to issue the two DCOR at this meeting.Markus Multrus, FhG, presentedm17247 Bugfixes to MPEG-4 SLS Reference Software Fabian Haussel

Ralf GeigerThe contribution proposes to correct a number of errors in the SLS reference software.It was the consensus of the Audio subgroup to issue a Study on DCOR at this meeting.

4.2.2 MPEG-D Spatial Audio Object Coding

SAOC patent statementThe Chair noted that since SAOC progresses to FDIS, companies that feel that they hold patents that read on the specification are required to submit patent statements. The appropriate form for the patent statement and the party to which the form should be submitted can be found here:

Go to SC29 website: http://www.itscj.ipsj.or.jp/sc29/Click on link “Procedures”Click on link “Common Patent Policy for ITU-T/ITU-R/ISO/IEC”Click on link “Patent statement and licensing declaration form for ITU-T/ITU-R Recommendation | ISO/IEC Deliverable.” This is the patent statement form and includes submission instructions.

Leonid Terentiev, FhG, presentedm17263 Changes for editorial consistency of SAOC FCD text Jonas Engdegård

Heiko PurnhagenJürgen HerreAndreas HölzerLeonid TerentievCornelia FalchOliver HellmuthJeroen Koppens

This contribution proposes numerous editorial corrections such as ISO template formatting and spelling errors. It also proposes addition of missing syntax elements. Finally, it proposes a small

115

addition to the informative annex that provide guidelines to normalize the relative energy of the audio objects in the downmix.It was the consensus of the Audio subgroup to incorporate the suggested changes into the SAOC FDIS text.Leonid Terentiev, FhG, presentedm17264 Report on corrections for SAOC Jonas Engdegård

Heiko PurnhagenJürgen HerreAndreas HölzerLeonid TerentievCornelia FalchOliver HellmuthMaria Luis ValeroJeroen Koppens

The contribution proposes numerous minor technical changes: Change formulas to insure that decoder calculations will never be subject to numerical

instability (e.g. division by zero) Correct bitstream so that low delay syntax is in line with high-quality syntax

It was the consensus of the Audio subgroup to incorporate the suggested changes into the SAOC FDIS text.Henney Oh, LG, presented

m17285 Proposed corrections on MPEG SAOC text Henney OhThe contribution proposes two categories of changes:

Minor technical corrections Editorial changes for consistency and clarity

In each category numerous changes and corrections are proposed. A break-out group will review the contribution and the result of that work will be reviewed later in the week (e.g. when reviewing the DoC on SAOC FCD ballot. Henney Oh, LG, presented

m17286 LG-ETRI Crosscheck listening test report on SAOC DCU Henney OhJeongil Seo

The contribution reviewed the test methodology. It was noted that this is NOT a MUSHRA test, in that there is no hidden reference and no anchors. The results of the listening test were that the mean score for the DCU system was greater than that of the “NoLim” system at the 95% level of significance. However, the DCU system was not different from the downmix system. Finally, the contribution notes that it was decided during the AhG period that the cross-check test outcome was positive and therefore, as agreed at the 90th MPEG meeting, the DCU technology would be incorporated into the Study on SAOC FCD text.Henney Oh, LG, presented

m17287 Information and comments on SAOC DCU Henney OhThe contribution notes three problematic issues in the SAOC specification:

First, it gave an example of how the current DCU specification can produce results that are very far from what the user has requested as an output mix. Since this issue was identified only recently, there was not sufficient time to develop a satisfactory solution.

Second, the contribution notes that it is essential to exclude the Enhanced Audio Object (EAO) from the DCU process

Third, the contribution gives an example GUI that will display what the DCU module actually implemented. In this respect, the contribution requests to standardize an interface between DCU a possible GUI control.

Fourth, that it be possible to switch off the DCU at the decoder.

116

Finally, it suggests that the DCU quality evaluation should use a strict MUSHRA methodology.

Juergen Herre, FhG, pointed out that gDCU is typically chosen to be small (e.g. 0.3). In this case, the example of the contribution (in which gDCU is 1.0) will never occur. There was considerable discussion of the other points raised by the contribution. Jeongil Seo, ETRI, presentedm17187 Comments on the Usage of DCU in SAOC Jeongil Seo

Kyeongok KangFirst, the presenter demonstrated an implementation of the Interactive Music Application Format (IMAF) that uses SAOC, and particularly showed a GUI that provides visual feedback of the DCU decision.The contribution is joint work of ETRI and Audizen. It notes that there are applications in which a an over-ride of DCU control may be what the user wishes (e.g. if the user wants to hear only the guitar so to be better able to learn the guitar part of a song). Hence the contribution requests that there be a DCU “on-off” switch at the SAOC decoder.Leonid Terentievm17267 Additional information on SAOC DCU Jonas Engdegård

Heiko PurnhagenJürgen HerreCornelia FalchLeonid TerentievOliver Hellmuth

The contribution proposes to Rename DCU-related bitstream elements to better express their functionality Add a syntax element that permits either static (i.e. once in header) or dynamic (i.e.

periodically in the frame information) update of DCU parameters. Clarify the semantics of DCU to better express the intended purpose of the DCU.

These proposals were discussed, and it appears that there are differing opinions as to whether the DCU information specified in the bitstream shall be normative and mandatory or whether a decoder, via local user control, might over-ride or modify the DCU controls and DCU processing.The Chair recommended that interested experts discuss in a break-out points presented in the five previous contributions and report back to the Audio subgroup.Friday morning report:Please find the report of this break-out group under the Plenary Discussions, Section 5.1.Heiko Purnhagen, Dolby, presentedm17266 Provisions for MBO handling in SAOC Jonas Engdegård

Heiko PurnhagenJürgen HerreLeonid TerentievCornelia FalchOliver Hellmuth

This contribution proposed new text to clarify how MBO rendering in done in the SAOC specification. Specifically, two situations are treated

MEPG Surround is embedded in SAOC bitstream which is in turn typically embedded in the downmix bitstream. If the MPEG Surround presentation has the same number of channels as the SAOC output, the MPEG Surround is decoded and added to the SAOC output, otherwise the MPEG Surround information is discarded and only the SAOC processing is applied.

MPEG Surround and SAOC are independent, typically as independently embedded in the downmix bitstream. In this case, a decoder that implements only MPEG Surround can decode and present the MPEG Surround information. A decoder that implements only

117

SAOC can decode and present the SAOC information. A decoder that implements both then both are decoded subject to the restrictions detailed in the contribution.

There was some discussion on the “decoding flowchart” proposed in the contribution. Henney Oh, LG, noted that it may be desirable to discard the MPEG Surround information even if its number of channels matches the number of channels of the rendering matrix output of SAOC. The Chair recommended that interested experts discuss this proposal in a break-out and report back to the Audio subgroup.Mid-week report:The break-out group reported back that there were changes to the proposed text in the contribution and also additional informative text about how to utilize the MBO feature in various application scenarios (e.g. karaoke).It was the consensus of the Audio Subgroup to incorporate the revised text on MBO into the SAOC FDIS text.Gregory Pallone, Orange Labs, presentedm17327 Cross check of proposed SAOC quantization scheme

improvementPierrick PhilippeGregory Pallone

The contribution presented cross-check listening test results. The test used the MUSHRA methodology and absolute score analysis showed that one item is better for the new quantization scheme, none is worse and that the mean score averaged over all items is not different.Oliver Hellmuth, FhG, presentedm17268 Proposal for improvement of SAOC parameter

quantization schemesJonas EngdegårdHeiko PurnhagenAndreas HölzerJohannes HilpertJürgen HerreOliver Hellmuth

The contribution notes that the following situation may occur: There are two microphones at a telecom location, one for each of two talkers.

One talker is active and there is some leakage into the other microphone. The result is two objects containing the same signal but at very different levels. This situation is an extreme case that tests the dynamic range of the quantization scheme such that, in the worst case, the lower level signal is quantized to zero.

It proposes to use the MPEG Surround CLD quantization table for the SAOC OLD parameters.The results of a listening test on the performance of the proposed quantizer are presented, which showed two items better, none worse and that the average over all items is better. It further noted that for one item, Telco, an improvement of more than 30 MUSHRA points is achieved. This result is consistent with the previous contribution.It was the consensus of the Audio subgroup to incorporate the changes in this contribution into the SAOC FDIS text.Henney Oh, LG, presentedm17288 Report on lossless coding in SAOC, LD-SAOC and LD-

MPSHenney Oh

The contribution reports on lossless parameter coding in SAOC, LD-SAOC and LD-MPS: Grouped PCM, Piliot-based, differential in frequency, backward differential in time and forward differential in time. These coding methods can be followed by Huffman coding as 1 dimensional, frequency-paired 2 dimensional and time-paired 2 dimensional. The compression efficiency of each of these tools was investigated. For example, it reports that the bit savings per lossless coding tool in SAOC-RM using the SAOC CfP items is as follows:

Tool Additional compression provided by tool (%)

118

Huff2DTP 0.00DiffTimeFw 0.00PCM 0.28Pilot 1.08Huff1D 2.16DiffFreq 3.43Huf2DFP 5.03DiffTimeBw 15.56

The contribution further noted that some tools with zero contribution to compression entail considerable storage requrements (e.g. Huff2DTP requires 5K Words of ROM table).The contribution requests removal of the following tools from SAOC, LD-SAOC and LD-MPS

Huff2DTP DiffTimeFw

There was discussion to understand the exact experimental setup used to measure the reported results. Juergen Herre, FhG, noted that when an application uses SAOC and MPEG-Surround, it is not possible to eliminate the Huff2DTP table since it is normative in MPEG Surround.The Chair observed that it seems to be two critical issues:

Is the contribution’s experimental method correct and appropriate. Is the data set used in the experiment appropriate

Chair suggested that interested experts join a break-out group to discuss this issue. He further noted that the primary mandate for the break-out is that whatever decision was made at the last meeting (i.e. on Pilot Coding) must be consistent with decisions made at this meeting.Friday morning report:Please find the report of this break-out group under the Plenary Discussions, Section 5.1.Gregory Pallone, Orange Labs, presentedm17202 Proposed

configuration for the SAOC verification tests

Gregory PallonePierrick Philippe

The contribution notes that Orange Labs believes that “High Definition” spatialized teleconferencing will be an important application for SAOC and proposes at test to show the performance of SAOC in this application. Specifically, it proposes the following test conditions which uses binauralization and presention via headphones:

Legacy Configuration SAOC A SAOC B SAOC C

Codec bit rate 3*N*Bm 2*N*Bm (N+1)*Bm (N+1)*BmSAOC bit rate 0 Bsaoc Bsaoc' Bsaoc'Latency Lm+Ls 2.Lm + Lsaoc 2.Lm + Lsaoc around Lm

Juergen Herre, FhG, noted that the contribution could be the basis for a tutorial on SAOC applications that could become an MPEG public document. The Chair suggested that there be a Draft Workplan for SAOC Verification Test from this meeting and a final Workplan for SAOC Verification Test from the 92nd meeting. The Draft Workplan should include “proof of concept tests” whose aim is identifying the correct operating points, and systems under test in the verification test. In addition, there may be draft Information on SAOC Applications document based on Orange Labs contribution m17202.Oliver Hellmuth, FhG, presentedm17265 Additional information on the SAOC verification test plan Jonas Engdegård

119

Heiko PurnhagenOliver HellmuthJürgen HerreJohannes HilpertLeonid TerentievAndreas HölzerCornelia FalchWerner Oomen

The contribution is a draft specification of the SAOC Verification Test. It envisions testing following scenarios:

Remix scenario (low bitrate) Karaoke scenario (high bitrate) Stereo teleconferencing scenario (loudspeakers) Multi-channel teleconferencing scenario (5.0 presentation via loudspeakers) Binaural rendering for teleconferencing (presentation via headphones)

Because of the number of tests, the contribution proposes only one or two items will per test scenario. Jeongil Seo, ETRI, indicated that he could make available additional test items. The presenter noted that there will be one rendering matrix per item. Henney Oh, LG, suggested that additional rendering matrix per item would be preferred.The Chair suggested that the contribution form the basis of an output document and that there be a breakout to further progress the work. In particular, additional items per test and a spreadsheet indicating envisioned test workload could be added.

4.2.3 MPEG-D Unified Speech and Audio Coding

Continued Discussion of Window TransitionsMohamad Raad, RaadTech, presented analysis of differential scores for each of the test sites. He presented a summary table showing which items were “better” at which test sites for the 12 kb/s and 20 kb/s mono operating point. Overall, there was good agreement between test sites in terms of which individual items were better at the 95% level of significance. This is shown in the following two tables, where green highlighting shows items for which there is consistent agreement of improvement across test sites and B indicates Better and N indicated Not different.12 kb/s/ mono:

VoiceAge FhG Dolby LG ETRI SamsungArirang_speech B N N N N Nes01 N N N N N NHarryPotter B N B N N NLouis_Raquin N B N B N NMusic_1 B N N B N NMusic_3 N N N N N NSalvation N N N N N NSpeechOverMusic_1 N N N N N NSpeechOverMusic_4 B B N N N Nte1_mg54_speech N N N N N Nte15 N N N N B Ntwinkle_ff51 B N B N N NWedding_speech B B B B B Nlion B N N N N Nphi7 B B B B N B

20 kb/s mono:

120

VoiceAge FhG Dolby ETRIArirang_speech B N N Nes01 N N N NHarryPotter B B B NLouis_Raquin B N B NMusic_1 B N N BMusic_3 N N N NSalvation N N N NSpeechOverMusic_1 N N N NSpeechOverMusic_4 B N N Nte1_mg54_speech N B B Bte15 N N N Ntwinkle_ff51 B N N NWedding_speech B N N Nlion B N N Nphi7 B B N N

It was the consensus of the Audio subgroup that the CE (i.e. FDNS+FAC technology) does provide a significant improvement in subjective audio quality.A second open issue from the Sunday’s AhG discussion concerns interpolation in the FDNS. This was discussed in the task group and the group reported back that this is not a problem. It was the consensus of the ASG that the FDNS interpolation is appropriate and is not an issue in adoption of tool.Issues of complexity were discussed Wednesday after MPEG plenary. For continuity in the Audio report, these discussions are noted here.Window Transition CE discussionPierrick Phillipe, Orange Labs, gave a verbal report on the complexity of the window transition CE technology, which was that he has checked the information in the contribution m17167 and confirms that the complexity information in the contribution is correct.The Chair noted that all identified open issues relating to this CE have been resolved and asked if there was consensus to adopt the CE technology. It was the consensus of the Audio subgroup to incorporate the window transition technology into USAC WD6.Oliver Wuebbolt, Thomson, presentedm17271 Spectral Noiseless Coding CE in USAC: Report on

evaluation of a combined proposal from Fraunhofer and Thomson

Oliver WuebboltMarkus Multrus

The contribution notes that moving from 4-tuple coding to 1-tuple arithmetic coding entailed a significant increase in computational complexity. Since the Thomson CE proposal was based on 1-tuple coding, it was not investigate further as a component in USAC arithmetic coding of spectral coefficients.Oliver Wuebbolt, Thomson, presentedm17249 Spectral Noiseless Coding CE: Crosscheck report Oliver WuebboltThis presented a cross-check on the performance of the modified CE proposal found in the next contribution (m17270). The presenter noted that the Thomson performance results (in terms of increase in compression efficiency) is identical to data found in m17270.Markus Multrus, FhG, presentedm17270 Updated proposal of the CE on the Spectral Noiseless

Coding in USACGuillaume FuchsJungHoe KimMarkus MultrusEunmi Oh

121

Nikolaus RettelbachVignesh Subbaraman

The contribution gives an overview of how the the proposed technology has changed relative to the proposal of the last meeting. The main contributions of the proposed technology isSpectral coding tool

Lower ROM table usage as compared to WD5 (16900 words reduced to 1500 words) Lower RAM usage as compared to WD5 (666 words reduced to 72 words per channel)

Overall Increase in compression efficiency (on average an increase of 1.87% with respect to the

entire bitstream length) Lower ROM table size for entire USAC decoder (37000 words reduced to 21500 words, or a

reduction of more than 40 %)

For the first bullet item, it notes that the spectral noiseless coding table size represents is 45% of the total table size in WD5. This is primarily due to the coding of 4-tuples (8^4 + ESC = 4097 alphabet size). Since typical DSP platforms in consumer devices have a cache size of 8 kBytes to 32 kBytes, a total table size of less than 2000 words is highly desirable. One could reduce the alphabet size by coding 1-tuples, although this increases the total number of symbols that entail arithmetic decoding. As a compromise, 2-tuple coding was used for the alphabet and the context. In addition, sign and magnitude are coded separately so that the tokens are magnitude only. Alphabet is 2x[0:3] + ESC = 17. In addition a new tool is used for coding the LSBs of the token (the “enhanced” version). The new proposal has a total ROM table usage that is comparable to the Huffman table size found in AAC. With respect to the computational complexity, the contribution showed that the complexity of the proposed arithmetic coding technology is comparable to that of the arithmetic coding tool in WD5.The contribution presents performance information on base and enhanced technology. The enhance technology gives some small additional compression at the cost of almost no additional storage complexity or computational complexity.David Virette, Huawei, noted that he is not convinced of the merit of the enhanced version. Eunmi Oh, Samsung, noted that the complexity of the enhancement is extremely low. She further noted that many CEs entail multiple tools and these are not “dissected.” The Chair suggested that discussion be continued after the contributions on the related CE from Huawei are presented.Pierrick Philippe, Orange Labs, presentedm17257 Cross check report for Huawei proposal on Spectral

Noiseless Coding for USACPierrick PhilippeGregory Pallone

The contribution reports compression information that is identical to that provided by Huawei in m17246.David Virette, Huawei, presentedm17246 Proposed CE on Spectral Noiseless Coding for USAC Wei Xiao

David ViretteHerve Taddei

The contribution proposes a technology that permits a continuous adaptation of coding spectral information tuple size between 4-tuples and 1-tuples. Specifically, 1, 2 or 4-tuples can be coded. The goal it to use larger tuple size when there is larger correlation between tuple elements (i.e. longer for tonal spectra, shorter for noise-like spectra). The proposal delivers increased compression efficiency ranging

Compression efficiency: ranging from 0.88% at 64 kb/s stereo to 2.03% at 12 kb/s mono. Lower ROM table size: reduced from 16900 words to 5334 words.

JungHoe Kim, Samsung, noted that at 64 kb/s the proposal does not satisfy bit buffer constraints when transcoding from WD3 bitstreams. Pierrick Philippe, Orange Labs, noted that adoption of the

122

FDNS and FAC tools, which changes the TCX window sizes may have an impact on the probability models used to construct the arithmetic coding tables.There was considerable additional discussion. It was agreed to bring this CE up again Friday (see Section 5.1). Hyunkook Lee, LG, presentedm17289 Progress report on the arithmetic coding CE for USAC Sungyong Yoon

Hyunkook LeeThis contribution proposes a revision of this CE in which there are random access frames in which global gain is coded as 8-bit PCM, otherwise it is coded as a differential value. The SF quantizer uses several contexts which are used adaptively. The technology is tested using WD2 which has a reset every 25 frames (approx every 1 second). The performance can be summarized as:

Increase in coding efficiency for differential global gain is between 0.00% (e.g. most speech items) and 1.02% (salvation, 12 kb/s mono), depending on the bitrate and test item. The average improvement in compression performance is (approx.) 0.35%.

Table size for the revised proposal is 345.5 32-bit words. RAM size required is approximately 26 32-bit words.

There was considerable discussion on the merit of this proposal. The Chair called for a show of hands as to who could NOT support adoption of this proposal. Many (more than 5) hands were raised. Based on this, the Chair concluded that there is not consensus within the group to adopt the proposed technology at this time.Markus Multrus, FhG, presentedm17361 Changes to WD5 for the CE on the Spectral Noiseless

Coding in USACMarkus MultrusJungHoe Kim

The contribution shows the new bitstream syntax that associated decoding semantics that are needed to support the FhG/Samsung Spectral Noiseless Coding CE (m17270). Since this is a late contribution (Wednesday of MPEG week before 2400 GMT), it was agreed to bring this CE up Friday morning so that interested experts have time to study the document (see Section 5.1). Kei Kikuiri, NTT DOCOMO, presentedm17251 NTT DOCOMO Listening Test Results for Harmonic

Transposer CE in USACKei Kikuiri

The contribution reports the results of a cross-check listening test on the Harmonic Transposer CE. When doing an absolute score analysis, it shows that the mean score for WD4+CE is not different from that of WD4 at the 95% level of significance. When doing differential analysis, it shows that

the mean score for WD4+CE is better that that of WD4bugfix for three items and also better when averaged over all items at the 95% level of significance.

David Virette, Huawei, presentedm17245 Huawei Listening Test Report on Harmonic Transposition Zhengzhong Du

Wei XiaoDavid ViretteHervé Taddei

The contribution reports the results of a cross-check listening test on the Harmonic Transposer CE. When doing an absolute score analysis, it shows that the mean score for WD4+CE is not different from that of WD4 at the 95% level of significance. When doing differential analysis, it shows that

the mean score for WD4+CE is better that that of WD4bugfix for one items but not different when averaged over all items at the 95% level of significance.

Kristofer Kjörling, Dolby, presentedm17166 WD text for USAC CE on Harmonic Transposer Per Ekstrand

Lars Villemoes

123

Sascha DischFrederik NagelStephan Wilde

The contribution presents syntax and semantics required for the CE technology.DiscussionKristofer Kjörling, Dolby, notes that the interesting comparison for discussion is WD4bugfix vs CE technology. He reviewed the Dolby performance test from the 90th meeting and then summarized the cross-check information from the previous contributions.It was the consensus of the Audio subgroup to incorporate the harmonic transposer technology into USAC WD6.Werner Oomen, Philips, presentedm17280 Further thoughts on USAC CE process Werner Oomen

Kristofer KjorlingHeiko PurnhagenBernhard GrillJohannes HilpertPhilippe Gournay

The contribution in a joint contribution from Dolby, FhG, VoiceAge and presents possible guidelines for use by Audio in their CE work. It is a response to a contribution at the 90th meeting (m16870). Some of the points raised are that

Complete proposals with clear merit should be acted on at the current meeting. In terms of length of discussion, proposals with clear merit should have sufficient discussion to identify and resolve open issues. As a consequence, discussion time on other CE proposals may need to be limited.

A table that compares the various CEs in a uniform way can provide useful guidance with respect to what CEs have the greatest merit.

There was good discussion on this topic. The Chair preseted USAC-CE.xls and asked proponents to review and correct the information as appropriate.Hyunkook Lee, LG, presentedm17291 Core Experiment Proposal on the quantization of spectral

coefficients of TCXKiho ChoSungyong YoonHyunkook LeeNam Soo Kim

This is a new CE proposal and the contribution is a first report on the technology. It proposes an additional non-uniform quantizer for use in quantizing TCX, such that TCX can switch between the two quantizers. The encoder used in the experiment was the MPEG Reference Encoder with mode information taken from the WD5 reference bitstreams. The contribution reports SNR improvement from using the switched quanitzer scheme. The Chair noted that the strategy of taking the encoder mode information from the WD5 reference bitstreams is an excellent idea and the presenter confirmed this greatly improved the quality of the MPEG Reference Encoder.The Audio subgroup looks forward to additional information at the next MPEG meeting.Kei Kikuiri, NTT DOCOMO, presentedm17252 Additional Information on Enhanced Temporal Envelope

Shaping CE for USACKei KikuiriAtsushi YamaguchiNobuhiko Naka

The contribution reports on progress of this CE. It reports on some new parameter values that drive the operation of the proposed technology. It reports significantly lower computational complexity and lower RAM requirements.Five additional items with non-stationary statistics (e.g. percussive signals) were included in a subjective performance test. The test results shows that

124

At 24 kb/s, 7 items were better and the mean score was better. Four of these items are from the original USAC test set.

At 16 kb/s, 7 items were better and the score was better. Two of these items are from the original USAC test set.

There was good discussion about the technology being proposed. The Chair suggested that a contribution to the next meeting that explains the latest proposed technology at a tutorial level would be most welcome. Kristofer Kjörling, Dolby, noted that USAC is at WD6 in which there are new tools that address coding of non-stationary signlas. Hence, new subjective tests should be WD6 vs WD6+CE.Interested experts will draft a workplan to coordinate cross-check of this proposal.Werner Oomen, Philips, presentedm17279 Update on CE on parametric stereo coding in USAC Erik Schuijers

Heiko PurnhagenPontus CarlssonWerner Oomen

The contribution notes that WD3 had a bug that put the parametric stereo coding CE at a disadvantage. It gives new subjective test results of WD5 vs WD5+CE. The results show

Absolute score analysis shows no difference between systems under test Differential score analysis shows that for C2 and C3 three items are better and C3 is better

in the mean.

The presenter feels that there is still more investigation to do and expects to bring additional information to the next meeting.Takehiro Moriya, NTT, presentedm17211 Crosscheck report of Huawei’s CE proposal for memory

and complexity reduction of USAC LPD modeTakehiro Moriya

The contribution is a cross-check on bit-exactness of the Huawei CE proposal and verifies complexity figures previously provided by Huawei. It confirms:

There is bit-exact reconstruction for all WD5 bitstreams and waveforms Complexity information is correct: reduction of ROM size from 2.64 Kbytes to 1.5 Kbytes

(reduction of 1.2 Kbytes); reduction of WMOPS is 25%, or 0.02% reduction with respect to overall decoder complexity.

The presenter feels that there is still more investigation to do and expects to bring additional information to the next meeting.David Virette, Huawei, presentedm17241 Progress report on improved indexing of the AVQ-based

LPC quantization for USACWei XiaoDavid ViretteHerve Taddei

The contribution gives WD syntax and semantics that are required to implement the CE technology. The primary advantage of the technology is to reduce the table size needed in the decoder.Bruno Bessette, VoiceAge, noted that that the AVQ tables are accessed 4 times per superframe, and hence that there is negligible benefit of having the AVQ table fit in processor cache.Philippe Gournay, VoiceAge, made a short presentation on how the WD5 AVQ tables might be reduced in size. He gave an example of optimizing one table

Table in WD5 is 226 4-byte values for 904 bytes total.

However, this table can be partitioned into three smaller tables: 37 unsigned int as 4-byte values 226 unsigned int 1-byte values

Using this technique, total storage size is reduced from 904 to 374 bytes (reduction of 530 bytes).

125

The Chair urged experts to consider the problem of how to evaluate this and similar proposals where increase in performance may be modest.David Virette, Huawei, presentedm17242 Progress report on Improved Pulse Indexing for ACELP in

USACDavid ViretteDejun ZhangFuwei MaHervé Taddei

The contribution gave performance information for a new database of speech items consisting of both clean speech and speech plus background noise. Increase in compression performance was given at 20 kb, 24 kb and 32 kb/s. It noted that for speech plus background noise the performance is lower because in this case only 50% of the frames are coded by ACELP. The contribution gives the required syntax and semantics changes to WD5 to support the CE technology.The presenter noted that the new database consisting of 37 files, approximately half are clean speech.The Chair asked whether ACELP mode is always used for the new speech database. The presenter noted that the coding mode mix was approximately as follows:

Clean speech: 50% ACLEP 50% TCX Speech + background noise: 25% ACELP and 75% TCX

Roch Lefebvre, VoiceAge, asked whether Huawei experts have an idea of how the saved bits might be used to provide coding gain.The Chair asked about using the saved bits. The presenter stated is unlikely that the saved bits can be used by quantizing in a higher rate ACELP codebook. Roch Lefebvre, VoiceAge, noted that this might likely result in only small run of frames in the higher-rate coding mode. Philippe Gournay, VoiceAge, noted that experiments at VoiceAge suggest that ~ 1% bit savings is not sufficient to realize a measurable increase in quality for TCX frames.Roch Lefebvre, VoiceAge, noted that this is the most optimal know solution for ACELP coding. Pierrick Philippe, Orange Labs, noted that the ACELP tool is mature in that no new CE has been proposed in a number of meetings, hence it may be time The Audio Subgroup agreed to draft a workplan on next steps, especially on how this technology might result in an increase in subjective quality.The Chair re-iterated the importance of preparing an overview of the compression CEs so as to treat all such CEs in a fair and transparent manner.Zhong Haishan, Panasonic, presentedm17261 Status report of time warping CE Zhong Haishan

Chong Kok SengZhou Huan Takeshi NorimatsuTomokazu IshikawaNeo Sua Hong

The contribution requests that a workplan be drafted to facilitate experiments on time warping, with the goal of bringing new information to the next meeting.Zhou Huan, Panasonic, presentedm17204 Updated Information on CE proposal of QMF Based Phase

Vocoder in eSBR ToolZhou HuanChong Kok SengZhong HaishanTakeshi NorimatsuTomokazu IshikawaNeo Sua Hong

This CE proposes a low complexity phase vocoder as a means to do QMF domain time stretching for use in spectral replication in the eSBR tool. The contribution reports details of complexity, in which the current proposal has approximagely 25% of the complexity of the WD5 FFT-based tool.

126

MUSHRA subjective listening test results were presented. Differential analysis shows no change in audio quality for a tool that has 75% lower complexity.Several parties expressed an interest in collaborating on this CE, and that effort will be coordinated with a workplan.Takehiro Moriya, NTT, presentedm17212 Core Experiment proposal on lossless coding of pitch lag

for ACELP in USACTakehiro MoriyaYutaka KamamotoNoboru Harada

The contribution notes that ACELP was designed for mobile communications with an error-prone air interface channel, while USAC is most likely used for IP transport, in which case error robustness is not as important an issue. Hence it proposed to use variable-length codes for the ACELP pitch lag. The proposal assumes that every ACELP superframe is a random access point, and does entropy coding for subsequent pitch lags within the superframe.At 12 kb/s mono, the CE technology is able to reduce bit rate by 2.2% for ACELP frames and 0.5% when averaged over all frames in the USAC test set. It requires 400 bytes of table and negligible RAM and processor cycles.The presenter noted that additional ideas that could yield further increase in compression efficiency. Roch Lefebvre, VoiceAge, observed that he would expect the CE technology to provide the greatest bit savings during stationary voiced intervals. Bruno Bessette, VoiceAge, suggested that it might be more beneficial to optimize the ACELP coding engine in the context of USAC and the new window transition technology that was adopted at this meeting.A workplan will be drafted to make progress on this CE.Finally, the presenter proposed an objective Figure of Merit for evaluation of CEs:

FoM = aR – bM – cCwhere

a, b and c are weighting factorsR is increase in compression efficiencyM is increase in memory usageC is increase in computational complexity

Pierrick Philippe, Orange Labs, presentedm17153 Contribution to the MPEG USAC Reference Encoder Pierrick PhilippeThe contribution describes a new module that is contributed to the MPEG USAC Reference Encoder. Included in the contribution is source code and informative text.A workplan on MPEG USAC Reference Encoder will coordinate integration of the module into the USAC SVN software repository.Max Neuendorf, FhG, presented m17253 Proposed Corrections to Reference Software and WD5 of

USACMax Neuendorf

The contribution notes two bugs in the USAC decoder reference software Channel Pair Elements are not implemented in the decoder A bug reported in MPEG Surround (m16985) should also be corrected in USAC

It was clarified that the USAC reference bitstreams never used channel pair elementsIt was the consensus of the Audio Subgroup to

Add full Channel Pair Elements capability to USAC decoder Correct bug reported in MPEG Surround (m16985) in USAC decoder

It was agreed that there will be a workplan on USAC Reference Software to Clarify if encoder can produce CPE and if not, incorporate that functionality. Correct MPEG Surround bug in encoder and decoder Benchmark performance of MPEG Reference Encoder

127

For second bullet item, bitstreams and decoded waveforms change, but it was the consensus of the ASG that no cross-check listening test is necessary.JungHoe Kim, Samsung, presentedm17230 Comments on reference software of MPEG Surround and

reference software using MPEG Surround toolJungHoe KimMiyoung KimEunmi Oh

The contribution reports on the status of the MPEG Surround reference software encoder and notes that projects that use MPEG Surround software, e.g. USAC, may be impacted.It requests workplans to identify what reference encoder tools are most worthwhile to be integrated into the reference software for:

MPEG Surround SAOC LD MPEG Surround combined with AAC ELD

5 Meeting deliverables5.1 Plenary discussionsSAOC ToolsJuergen Herre, FhG, make a report from the break-out group on evaluation of lossless coding tools in SAOC. The presentation discussed the relative contribution of the performance of the tools under consideration as they operate in the context of SAOC. Their recommendation was to remove the following tools:

TIME_DIFF_FW HUFF_2D_TP

The Chair noted that this recommendation is exactly what was requested in m17288, the contribution on this topic. It was the consensus of the Audio subgroup to accept this recommendation and incorporate appropriate changes into the SAOC FDIS.SAOC DCUJuergen Herre, FhG, make a report from the break-out group on the syntax and semantics of the SAOC DCU tool. He noted that there are two issues:In the first issue, it is proposes to support three modes:

no information of DCU so that DCU is not active DCU information is transmitted and DCU processing is mandatory DCU information is transmitted but DCU processing is not mandatory

In the second issue, it is noted that DCU processing negatively impacts SAOC functionality in the case that residual coding is present. For example, in a karaoke application, if there is a full residual for the vocal then the appropriate DCU processing of the vocal may be quite different from what it would be if there is not residual signal.The proposed DCU syntax and semantics were reviewed by interested experts. It was the consensus of the Audio subgroup to accept this recommendation and incorporate appropriate changes into the SAOC FDIS.USAC Spectral CEThe Chair re-opened the discussion on the FhG/Samsung arithmetic coding of spectral coefficients CE and asked if there was objection to making a decision at this time. Two experts voiced an objection to a decision now, and cited that the syntax and semantics for this CE was only available Wednesday (GMT) of the MPEG week. The Chair noted that there was not consensus in the Audio subgroup to make a decision on this CE. The Chair informed the group that he will call for a decision on this CE as the first item of business in Audio plenary at the 92nd MPEG meeting. Evaluation of USAC CEs

128

The Chair re-iterated the importance of developing an overview of USAC CEs to assist in evaluating the technical merit of all CEs in a fair and transparent manner. This is the most important AhG activity!Timeline for USAC standardizationThe Chair charged the Audio subgroup to consider whether it is likely that future USAC CEs might make significant changes in the USAC architecture. If this were to be the case, then it might be premature to take USAC to CE at the next meeting. The timeline for the USAC work will be revisited at the 92nd meeting.

5.2 Responses to Liaison and NB commentsLiaison statements generated by Audio were presented and approved.

5.3 Recommendations for final plenaryThe Audio recommendations were presented and approved.

5.4 Establishment of Ad-hoc GroupsThe ad-hoc groups shown in the following table were established by the Audio subgroup. Unless otherwise indicated, Ad Hoc group meetings will be held at the location of the next MPEG meeting on the weekend preceding that meeting.

No. Title Mtg11219 AHG on Audio Standards Maintenance No11220 AHG on MPEG Surround, SAOC, USAC Yes

5.5 Approval of output documentsAll output documents, shown in Annex D, were presented in Audio plenary and were approved.

5.6 Press statementThe Audio contribution to the press statement was prepared and reviewed.

5.7 Agenda for next meetingThe agenda for the next MPEG meeting is shown in Annex F.

5.8 All other businessThere was none.

5.9 Closing of the meeting The 91st Audio Subgroup meeting was adjourned Friday at 13:20.

129

Annex A ParticipantsThere were 51 participants in the Audio subgroup meeting, as shown in the following table.First Name Last Name Country AffiliationBruno Bessette CA Voiceage CorporationTi Eu Chan SG I2RToru Chinen JP Sony

Kiho Cho KRSeoul National University

Philippe Gournay CanadaVoiceAge Corp. / Univ. of Sherbrooke

Bernhard Grill DE Fraunhofer IISNoboru Harada JP NTTOliver Hellmuth DE Fraunhofer IISJürgen Herre DE Fraunhofer IISJeff Huang USA Qualcomm Inc.Tomokazu Ishikawa JP PanasonicYutaka Kamamoto JP NTTKyeong Ok Kang Korea ETRIKei Kikuiri JP NTT DOCOMOJunghoe Kim KR Samsung AITKristofer Kjörling SE DolbyFerenc Krämer DE DolbyChang-Heon Lee KR Yonsei UniversityHyunkook Lee KR LG electronicsTaejin Lee KR ETRI

Roch Lefebvre CanadaVoiceAge Corp. / Univ. of Sherbrooke

Te Li SG I2RTakehiro Moriya JP NTTMarkus Multrus DE Fraunhofer IISNobuhiko Naka JP NTT DOCOMOYasushige Nakayama JP NHKMax Neuendorf DE Fraunhofer IISMasayuki Nishiguchi JP SonyToshiyuki Nomura JP NECTakeshi Norimatsu JP PanasonicEunmi Oh KR SamsungHenney Oh KR LG Electronics

Werner Oomen NLPhilips Applied Technologies

Gregory Pallone FR Orange LabsPierrick Philippe FR Orange LabsHeiko Purnhagen SE DolbySchuyler Quackenbush USA ARLMohamad Raad Australia RaadTech ConsultingYuriy Reznik USA QualcommJulien Robilliard DE Fraunhofer IISJeongil Seo KR ETRI

130

Jeongook Song KR Yonsei UniversityLeonid Terentiev DE Fraunhofer IISDavid Virette CN Huawei TechnologiesKaoru Watanabe JP NHKOliver Wuebbolt DE ThomsonSungyong Yoon KR LG ElectronicsHao Yuan CN ZTE Corporation

Fan Zhang JPNTT/The Univ. of Tokyo

Qing Zhang CN Huawei Technologies

Huan Zhou SGPanasonic Singapore Laboratories

131

Annex B Audio Contributions and Schedule

Sunday0900-1800 AhG on USAC 12m17228 Proposed informative encoder description of phase coding

in USACJungHoe KimEunmi Oh

m17227 Proposed change of the IPD sign in USAC JungHoe KimEunmi OhWerner OomenHeiko PurnhagenJulien Robilliard

m17292 Report on the USAC reference encoder Hyunkook LeeSungyong Yoon

m17278 Corrections to Unified Stereo Coding Erik SchuijersHeiko PurnhagenPontus CarlssonWerner OomenJulien Robilliard

m17273 Educational information on Unified Stereo encoding Heiko PurnhagenPontus CarlssonWerner OomenErik Schuijers

m17230 Comments on reference software of MPEG Surround and reference software using MPEG Surround tool(PREVIEW)

JungHoe KimMiyoung KimEunmi Oh

m17165 Report on cross-check listening test for the USAC CE on Unification of USAC Windowing and Frame Transitions

Kristofer KjörlingLars Villemoes

m17209 YSU-LG Listening test for CE on Unification of USAC Windowing and Frame Transitions

Jeongook SongChang-Heon LeeHenney Oh

m17216 ETRI Listening Test Results for CE on Unification of USAC Windowing and Frame Transitions

Taejin LeeSeungkwon BeackMinje KimKyeongok Kang

m17229 Crosscheck report on Unification of USAC Windowing and Frame Transitions

JungHoe KimEunmi Oh

m17167 Completion of Core Experiment on unification of USAC Windowing and Frame Transitions

Max NeuendorfBruno BessetteRoch LefebvrePhilippe GournayStefan BayerJeremie Lecomte

m17215 Report on TCX Improvements Taejin LeeSeungkwon BeackMinje KimKyeongok Kang

Review of AhG Report1800- Chairs Meeting

132

Monday0900-1300 MPEG Plenary1300-1400 Lunch1400-1500 Audio Plenary

WelcomeReport on Sunday Chairs meetingReview main tasks for the week

SAOCDoC on FCDText of FDISVerification Test Workplan

USAC Ongoing and new CEsUSAC Reference Encoder

MaintenanceGeneral Documents

m17158 Report of 90th MPEG Audio Meeting S. Quackenbushm17088 Ad Hoc Group on Audio Standards Maintenance S. Quackenbushm17089 Ad Hoc Group on SAOC, USAC and MetaData S. Quackenbushm17102 Liaison Statement from World DMB Forum [SC 29 N

10820]World DMB Forum via SC 29 Secretariat

M17110 Liaison Statement from ITU-T SG 16 on Enhanced Low Delay AAC [SC 29 N 10851]

ITU-T SG 16 via SC 29 Secretariat

M17131 Liaison Statement from ITU-R SG 6/WP 6B [SC 29 N 10912]

ITU-R SG 6/WP 6B via SC 29 Secretariat

Maintenance1500-1800 SAOC 8m17263 Changes for editorial consistency of SAOC FCD text Jonas Engdegård

Heiko PurnhagenJürgen HerreAndreas HölzerLeonid TerentievCornelia FalchOliver HellmuthJeroen Koppens

m17264 Report on corrections for SAOC Jonas EngdegårdHeiko PurnhagenJürgen HerreAndreas HölzerLeonid TerentievCornelia FalchOliver HellmuthMaria Luis ValeroJeroen Koppens

m17285 Proposed corrections on MPEG SAOC text Henney Ohm17286 LG-ETRI Crosscheck listening test report on SAOC DCU Henney Oh

Jeongil Seom17287 Information and comments on SAOC DCU Henney Ohm17187 Comments on the Usage of DCU in SAOC Jeongil Seo

133

Kyeongok Kangm17267 Additional information on SAOC DCU Jonas Engdegård

Heiko PurnhagenJürgen HerreCornelia FalchLeonid TerentievOliver Hellmuth

m17266 Provisions for MBO handling in SAOC Jonas EngdegårdHeiko PurnhagenJürgen HerreLeonid TerentievCornelia FalchOliver Hellmuth

m17327 Cross check of proposed SAOC quantization scheme improvement

Pierrick PhilippeGregory Pallone

m17268 Proposal for improvement of SAOC parameter quantization schemes

Jonas EngdegårdHeiko PurnhagenAndreas HölzerJohannes HilpertJürgen HerreOliver Hellmuth

1800- HOD meeting

Tuesday0900-0930 MPEG Surroundm17239 Proposed corrections to MPEG Surround conformance and

reference softwareFerenc KraemerHeiko Purnhagen

MPEG-4m17247 Bugfixes to MPEG-4 SLS Reference Software Fabian Haussel

Ralf Geiger0930-1300 SAOC cont’d contributions 4m17288 Report on lossless coding in SAOC, LD-SAOC and LD-

MPSHenney Oh

m17202 Proposed configuration for the SAOC verification tests Gregory PallonePierrick Philippe

m17265 Additional information on the SAOC verification test plan Jonas EngdegårdHeiko PurnhagenOliver HellmuthJürgen HerreJohannes HilpertLeonid TerentievAndreas HölzerCornelia FalchWerner Oomen

SAOC DoC discussion1300-1400 Lunch 1400-1800 USAC cont’d contributions 16

Window transitions cont’dm17271 Spectral Noiseless Coding CE in USAC: Report on

evaluation of a combined proposal from Fraunhofer and Thomson

Oliver WuebboltMarkus Multrus

134

m17249 Spectral Noiseless Coding CE: Crosscheck report Oliver Wuebboltm17270 Updated proposal of the CE on the Spectral Noiseless

Coding in USACGuillaume FuchsJungHoe KimMarkus MultrusEunmi OhNikolaus RettelbachVignesh Subbaraman

m17257 Cross check report for Huawei proposal on Spectral Noiseless Coding for USAC

Pierrick PhilippeGregory Pallone

m17246 Proposed CE on Spectral Noiseless Coding for USAC Wei XiaoDavid ViretteHerve Taddei

m17289 Progress report on the arithmetic coding CE for USAC Sungyong YoonHyunkook Lee

1800- Chairs meeting

Wednesday0900-1100 MPEG Plenary1130-1200 Open issues in USAC

- gain clipping informal listening test - complexity of window transition CE- syntax of FhG/Samsung spectral coding proposal

m17361 Changes to WD5 for the CE on the Spectral Noiseless Coding in USAC

Markus MultrusJungHoe Kim

1200-1300 USACm17245 Huawei Listening Test Report on Harmonic Transposition Zhengzhong Du

Wei XiaoDavid ViretteHervé Taddei

m17251 NTT DOCOMO Listening Test Results for Harmonic Transposer CE in USAC

Kei Kikuiri

m17166 WD text for USAC CE on Harmonic Transposer Per EkstrandLars VillemoesSascha DischFrederik NagelStephan Wilde

m17280 Further thoughts on USAC CE process Werner OomenKristofer KjorlingHeiko PurnhagenBernhard GrillJohannes HilpertPhilippe Gournay

1300-1400 Lunch1400-1800 USAC m17291 Core Experiment Proposal on the quantization of spectral

coefficients of TCXKiho ChoSungyong YoonHyunkook LeeNam Soo Kim

m17252 Additional Information on Enhanced Temporal Envelope Kei Kikuiri

135

Shaping CE for USAC Atsushi YamaguchiNobuhiko Naka

m17279 Update on CE on parametric stereo coding in USAC Erik SchuijersHeiko PurnhagenPontus CarlssonWerner Oomen

m17211 Crosscheck report of Huawei’s CE proposal for memory and complexity reduction of USAC LPD mode

Takehiro Moriya

m17241 Progress report on improved indexing of the AVQ-based LPC quantization for USAC

Wei XiaoDavid ViretteHerve Taddei

m17242 Progress report on Improved Pulse Indexing for ACELP in USAC

David ViretteDejun ZhangFuwei MaHervé Taddei

1700- Social1730 Meet at Bldg 4 entrance1800 Bus departs to Noh play and then banquet. No shoes in Noh play (but keep them with you)! Can take JR from Ninjo station to Kyoto station.

Thursday0900-9300 USACm17261 Status report of time warping CE Zhong Haishan

Chong Kok SengZhou Huan Takeshi NorimatsuTomokazu IshikawaNeo Sua Hong

m17204 Updated Information on CE proposal of QMF Based Phase Vocoder in eSBR Tool

Zhou HuanChong Kok SengZhong HaishanTakeshi NorimatsuTomokazu IshikawaNeo Sua Hong

m17212 Core Experiment proposal on lossless coding of pitch lag for ACELP in USAC

Takehiro MoriyaYutaka KamamotoNoboru Harada

m17153 Contribution to the MPEG USAC Reference Encoder Pierrick Philippem17253 Proposed Corrections to Reference Software and WD5 of

USACMax Neuendorf

m17230 Comments on reference software of MPEG Surround and reference software using MPEG Surround tool

JungHoe KimMiyoung KimEunmi Oh

1300-1400 Lunch1400-1500 Joint meeting on audio for HVC1500-1800 Open IssuesFriday

136

0900-1300 Audio PlenaryReport on Thursday Chairs meetingRecommendations for final plenaryEstablishment Ad-hoc groups and review AhG Mandates

1000 Get document numbers1030 Submit AhG Mandates and Resolutions

Open issuesSAOC toolsSoftware workplans

Approve Responses to NB comments and LiaisonApproval of output documentsTitle: N10xxxFile: w10xxx (short title).doc (NOT *.docx!)Zip: w10xxx.zipAgenda for next meetingReview of Audio presentation to MPEG plenary A.O.B.Closing of the Audio meeting

1300-1400 Lunch1400- MPEG Plenary

137

Annex C Task Groups

1. MPEG-2 and MPEG-4 Audio, MPEG Audio Conformance, MPEG reference software, MPEG Surround

2. MPEG-D Spatial Audio Object Coding3. MPEG-D Unified Speech and Audio Coding4. Exploration: Meta-Data

138

Annex D Output Documents

No. Title TBP Available14496-5 – Reference Software

11202 Study on ISO/IEC 14496-5:2001/AMD 10:2007/DCOR 4, SLS No 10/1/22No. Title TBP Available

23003-1 – MPEG Surround11203 23003-1/AMD 1/DCOR 1, Corrections to Conformance No 10/2/1911204 23003-1 AMD 2/DCOR 2, Corrections to Reference Software No 10/2/1911205 Status of MPEG Surround Reference Software No 10/1/22No. Title TBP Available

23003-2 – SAOC11206 DoC on ISO/IEC FCD 23003-2:2010, Spatial Audio Object Coding No 10/1/2211207 ISO/IEC FDIS 23003-2: 2010, Spatial Audio Object Coding No 10/2/1911208 WD of MPEG SAOC Conformance and Reference Software No 10/2/1911209 Workplan on MPEG SAOC Reference Software No 10/1/2211210 Draft Workplan for SAOC Verification Test No 10/1/22

11211 Application Scenarios for SAOC TeleconferencingUse Cases and Workplan For Their Technical Evaluation

No 10/1/22

No. Title TBP Available23003-3 – Unified Speech and Audio Coding

11213 WD6 of USAC No 10/2/1911214 Workplan for USAC CEs No 10/1/2211215 Workplan on MPEG USAC Reference Software No 10/1/22No. Title TBP Available

Liaison Statements11216 Response to Liaison from World DMB Forum No 10/1/22

11217 Response to Liaison from ITU-T SG 16 on Enhanced Low Delay AAC

No 10/1/22

11218 Response to Liaison from ITU-R SG 6/WP 6B No 10/1/22

139

Annex E Agenda for the 92nd MPEG Audio Meeting

Agenda Item1. Opening of the meeting2. Administrative matters

2.1. Communications from the Chair2.2. Approval of agenda and allocation of contributions2.3. Review of task groups and mandates2.4. Approval of previous meeting report2.5. Review of AhG reports 2.6. Joint meetings2.7. Received national body comments and liaison matters

3. Plenary issues4. Task group activities

4.1. MPEG-1, MPEG-2, MPEG-4, and MPEG Surround4.2. Spatial Audio Object Coding4.3. Unified Speech and Audio Coding4.4. Audio for HVC

5. Discussion of unallocated contributions6. Meeting deliverables

6.1. Responses to Liaison and NB comments6.2. Recommendations for final plenary6.3. Establishment of new Ad-hoc groups6.4. Approval of output documents6.5. Press statement

7. Future activities8. Agenda for next meeting9. A.O.B10. Closing of the meeting

140

Annex I – 3DG report

Source: Marius Preda, Chair

1 Opening of the meeting

1.1 Approval of the agendaThe agenda is approved.

1.2 Goals for the weekThe goals of this week are:Review SC-3DMC contributions and issue the associated FDAM Discuss the software and conformance status for SC-3DMCStatus of software implementation for MP25 AMD1Status of conformance for MP25 AMD1Review contributions related to 3D graphics engines in MXMReview contributions related to 3D graphics aspects of MPEG-VReview contributions related to Representation of meshes with multiple attributes Investigate future developments of MPEG 3D Graphics Compression

Review RGC (reconfigurable graphics codec) contributionReview Liaisons Review the votesWeb-site

1.3 Standards from 3DGC

4 5 2001 Amd.26 Reference software for scalable complexity 3D mesh coding in 3DG compression model

09/10 10/04 10/10 3

4 5 2001 Amd.27 Scalable compl. 3DMC RS

09/02 09/10 10/04 3

4 16 200x Amd.1 Scalable complexity 3D mesh coding

08/01 08/10 09/02 09/07 10/01 3

4 16 200x Amd.2 Mesh representation with multiple attributes

10/01 10/04 10/10 11/01 3 NOTOK to go CD

4 25 2009 Amd.1 Scalable 09/07 09/10 10/04 10/10 3

141

complexity 3D mesh coding for 3DG compression model

4 27 200x Amd.2 Scalable compl. 3DMC conformance

09/02 09/10 10/04 3

4 27 200x Amd.3 Conformance for scalable complexity 3D mesh coding in 3DG compression model

10/01 10/04 10/10 3

1.4 Room allocation3DGC: 4T2F R3

142

1.5 Allocation of contributions

N° Title Schedule ObservationD1 Monday D1

MPEG Plenary 09:00~11:30

Lunch Break 13:00~14:00

3DG Plenary

Roll call, Agenda, Goals, FAQ, etc., Marius Preda14:00~15:0

0m17082 Report of AHG on 3DGC documents, experiments and software maintenance Francisco MoranResults of voting Marius Preda

Coffee Break 15:00~15:30

Scalable Complexity 3D Mesh Coding (SC-3DMC)

m17307 SC3DMC software integration on 3DGraphicsEngine in MXMSummary: the contribution introduces the implementation of the SC3DMC into MXM 3D graphics engine. All the three methods (TFAN, SVA and QBCR) are supported. Both encoder and decoder are included. A MXM library was compiled. Resolution: It is necessary to create the MXM APIs for SC3DMC. The Ogre player is agnostic to how the geometry is encoded, thus same application as demonstrated in London meeting should work.

Sowon Kim, Daiyong Kim, Seungwook Lee, Bonki Koo, Euee S. Jang

15:30 – 17:00

m17177 SC3DMC integration into IM1Summary: A new version of IM1 including SC3DMC is updated and is available on the SVN. The full set of conformance bitstreams is generated. Resolution: Accepted. Add the conformance files to the Part 27 (Conformance for AFX).

Khaled MAMOUTitus ZahariaMarius PredaFrançoise Prêteux

Player for SC3DMCDone in IM1. Work will continue for the player in Ogre. All

143

N° Title Schedule Observation

Software maintenance

m17308 Implementation and bug fixing of MPEG-4 3DMCe reference softwareSummary: A new project compliant with VS2008 was released. A GUI is also provided. It allows control of encoding parameters.Resolution: Add a new branch on the SVN in the directory Standalone/3DMC containing the encoder and decoder versions compliant with VS2008.

Seungwook LeeBonki KooDaiyong KimSowon KimEuee S. Jang

17:00 – 17:30

3DG in MXM

m17284 FootPrint API for MXMSummary: An update of the mediaFramework API that supports access and creation of MPEG-4 content including FootPrint is proposed.Resolution: to be discussed with MXM BoG.

Ivica ArsovLuyen van NgoMarius Preda

17:30 – 18:00

D2 Tuesday D2Multi-Resolution 3D Mesh Coding (MR-3DMC)

m17178 PTFAN: a multi-resolution extension for the TFAN codecSummary: Objectives are the spatial & quality scalability, lossless connectivity coding (no re-meshing) & near lossless geometry coding. State of the art: progressive mesh (base mesh + vertex split operations). Adv: progressive transmission & rendering, high quality intermediate LODs. Disadv: limited applicability (manifold meshes), low compression performances (index of the vertex to be refined 9-14 bpv, local topology update 5bpv). Progressive forest split: regroup the vertex split operations in a package (reduce the cost of refinement operations). Adv: better compression performances than progressive meshes (7-10 bpv). Disadv: LODs of lower quality. Patch coloring approach: vertex removal based on a patch. Adv: good compression performance. Connectivity 5-6 bpv. Disadv: low quality LODs. Valence based decimation approach: same as previous but keep the valence of the vertex around value 6. Adv: good compression performances (4bpv for connectivity). Disadv: low quality LODs for non uniform meshes, limited

Khaled MamouChristophe Dehais

09:00 – 12:00

144

applicability. Octree compression: Adv: good compression perf (2-10 bpv for connectivity). Disadv: Low quality LODs for smooth 3D meshes. Spectral coding: encode statically the connectivity and progressively the geometry. Adv: good compression performances. Disadv: high computational complexity, supports only quality scalability. Proposal of PTFAN: the connectivity is compressed in a monoresolution way. Then it is used to predict the geometry. PTFAN has compression performances 20-70% better than TFAN. Decoding times: PTFAN decodes 10k vertices / sec. Adv: high quality for intermediate LODs. m17164 Multi-resolution approach for 3D Mesh CompressionSummary: Overview of the encoding approach: the mesh is simplified and a set of removed vertices is obtained. The simplified mesh is segmented. A KL transform is applied on the removed vertices of a segment. Finally the coefficients are quantized and an entropy encoder is applied. The base mesh is encoded by using a mono-resolution approach. The base mesh is obtained by vertex removal. KLT is applied on prediction errors (with respect to the baricenter). KLT is applied on segments of the mesh that are obtained by using a normal approach. The results are presented with respect to the curves in the literature, comparing the effect of the quantization step. New 3D models are proposed and will be uploaded on the ftp site.

Minsu AhnJames Do Kyoon Kim

m17338 Test on multi-resolution mesh coding for CE 4Summary: investigation on the quality and resolution scalability. Depending on the model, there are different benefits in the quality over resolution scalability.

Feng LuXiangyang JiGuihua ErQionghai Dai

Wrap-up: - concrete motivations (use case scenarios that should clarify what are the features we are looking for) - database (what are the properties of the models)- comparison with other codecs - comparison method (PSNR, Resolution)

145

- platform for testingResolution: detail the CE with respect to the above mentioned points. Create an AhG treating them in details.

MPEG-V Part 3 Effect duration, Streaming

Christian Timmerer, Sang-Kyun Kim, Marius Preda

12:00 – 12:30

MPEG-V Part 4 Avatar as a Virtual Object Jae-Joon Han, Marius

Preda12:30 – 13:00

Lunch Break 13:00~14:00

MPEG-V/MPEG-U

m17203 Data format for MultiPointing Interface Summary: MultiPoint device is an extension of SensedInfoBaseTypeProposal for MoveType with two children: straight and rotate.Proposal of MultiPointingSensorCapability

Resolution: Extend the MotionSensorType and add hold/release (to be considered as an array). A new sensor called MultiPointingSensor will be created and added to Part 5.

14:00 – 16:00

Joint with S

Part 5:For the types defined in other standards, we refer to the sections where the original semantic was defined. We create subset of .xsd from other standards and add them in an annex. - Alternatives: 1. add the common types in Part 1 (vector, timing, …)2. add the common types in Part 53. create a new part for the common types

Marius Preda

m17283 Streaming needs for MPEG-V

146

alternatives TeM, BIM - BIM may be very complex when we need to be extensible- TeM- update Mask

Open Question: where to specify the streaming mechanism? Final resolution: use the same mechanisms as in MPEG-7 Visual, that is, defining a binary format for each sensor/actuator.

Coffee Break 16:00~16:30

Reconfigurable Graphics Coding

m17309 Case study of 3DMCe implementation in RVC framework using HOPES

Seungwook LeeBonki KooMing-Xiao ChenSowon KimDaiyong KimHyunok OhEuee S. Jang

16:30~17:00 Joint with V

MPEG-4 Part 5 & 27 Status on the AFX & Part 25 conformance and Reference Software Francisco Morán 17:00~18:0

0D3 Wednesday D3

MPEG Plenary 09:00~11:00

MXM

m17284 FootPrint API for MXMProvide the update for the Graphics3D Engine API for including FootPrint codec. Resolution: To Integrate it in the current version of the MXM API specification.

Ivica ArsovLuyen van NgoMarius Preda

11:00~11:30 Joint with S

Lunch Break 12:00~14:00

MPEG-V The streaming mechanism should be similar as in 15938-3 MPEG-7 Visual (section 4.2 and 3.9) Part 6 contains the indication on how the streaming is performed (TeM, BIM, BinaryRepresentation)

14:00 – 18:00

Joint with S

147

Part 5 review:

Part 1. ArchitecturePart 1 AMD 1 Streaming now Working DraftPart 3 reviewPart 2 reviewPart 4 reviewSoftware plan

D4 Thursday

Reconfigurable Graphics Coding

m17309 Case study of 3DMCe implementation in RVC framework using HOPES3DMCe implementation based on RGC. Implementation of the decoder, implementation of some FU for 3DMC and IC. The FUs are implemented based on HOPTES. RVC is using OpenDF (CAL). The FND (functional unit network description) – the XML is generated by HOPES. Implementation results show that the new implemtation takes 15% more than the original code (for 3DMCe)HOPES: retargetable parallel programming framework was introduced in 2004. HOPES allow native C and C++. HOPES is also proposed as alternative tool for RVC. Each task can be executed on different processors. HOPES license: provided for free to MPEG people.Supported Plateforme: Linux and WS. Resolutions- Include a resolution on the great interest in RVC and that we plan to start a new project- One mandate in the AhG related to the modalities to share the existent work with other members of 3DG- design the new CE and indicates the way how to use the framework

Seungwook LeeBonki KooMing-Xiao ChenSowon KimDaiyong KimHyunok OhEuee S. Jang

09:00~10:30 Joint with V

MPEG-4 Part 5 & 27

Status on the AFX & Part 25 conformance and Reference Software- Conformance for SC3DMC in part 25: the files were generated (encoded) and the conformance was established by decoding them and comparing with initial COLLADA files (visualization with a COLLADA player). To generate the files for cow, dance and eagle. Work continue to implement the SC3DMC in the MXM Graphics engine and use OGRE as a viewer for these files- Issue the study for AMD2- Issue the PDAM3

Seung 11:00~12:00

Lunch Break 12:00~14:0148

0

3DG Plenary Preparation for output documents related to MPEG-4 Parts 16, 25 and 27 9:30~13:00

MR-3DMC (CE, mandates of the AhG) 9:30~10:30D5 Friday D5

3DG Plenary Review 3DG output documents, AhGs and resolutions 09:30~12:00

Lunch Break 12:00~14:00

MPEG Plenary 14:00~

149

2 General issues

2.1 General discussion

2.1.1 Reference SoftwareIt is recalled that the source code of both decoder AND encoder should be provided as part of the Reference Software for all technologies to be adopted in MPEG standards. Moreover, not providing the complete software for a published technology shall conduct to the removal of the corresponding technical specification from the standard.Currently all the AFX tools published in the third edition are supported by both encoder and decoder implementation.

2.1.2 Web siteOrangeLabs announced interrupting the maintenance of the group web-site. A call for volunteers is now issued. In the meantime 3DGC contributors are asked to check the web-site and provide comments on the current version of the web-site.

3 Current Voting

150

Annex JDocument title Annex KDoC Annex LEditor of DoC

Annex M Annex N Annex O

4 General 3DG related activities

4.1 AhG on 3DG activitiesTitle Report of AHG on 3DGC documents, experiments and software maintenance

Authors Francisco MoranSummary See AhG reportResolution Accepted

4.2 Promotions

4.2.1 Web SiteTitle Status of www.mpeg-3dgc.com

AuthorsSummary The web site is not more maintained by OrangeLab.

Resolution Action Point: Transfer the web-site to other location and call for volunteers for maintenance.

4.3 Joint activities

4.3.1 MPEG-V - Information Exchange with Virtual Worlds (formally Metaverse)Several joints meetings were carried out during the week related to MPEG-V. The 3DG interests were related to avatar characteristics, virtual object characteristics, manners to control the avatar by using real devices and manners to attach haptic properties on virtual objects. However, all the 4 parts of MPEG-V were extensively reviewed during several joint meetings between 3DG and Systems.

The extensive summary of these activities is provided in MPEG-V AhG Report (m17096) and Systems final report as well as in the Disposition of Comments Reports related to MPEG-V outputted from this meeting.

4.3.2 MXMA joint meeting with MXM group took place to review the FootPrint related contribution. The recommendation of this contribution was accepted.

4.3.3 Reconfigurable Graphics CodingA joint meeting with Video RVC group took place to review the related contributions. The resolutions are reported in the table above.

151

4.4 Explorations

5 Liaison

Title No input/output liaison issued this meetingAuthors

SummaryResolution

6 Output documents and Resolutions of 3DGC

Part 5 Reference Software The 3DG subgroup recommends approval of the following documents

No. Title TBP Available14496-5  Reference Software

11121 Study Text of ISO/IEC 14496-5:2001/FPDAM 27 Reference Software for Scalable Complexity 3D Mesh Coding

No 10/01/22

The 3DG subgroup recommends that NBs review the Study Text of ISO/IEC 14496-5:2001/FPDAM 27 Reference Software for Scalable Complexity 3D Mesh Coding and the new version of the reference software implementation integrated in IM1 when casting their ballot on ISO/IEC 14496-5:2001/FPDAM 27.

Part 16 Animation Framework eXtension (AFX) The 3DG subgroup recommends approval of the following documents

No. Title TBP Available14496-16 Animation Framework eXtension (AFX)

11122 Description of 3DG Core Experiments No 10/01/22

11123 DoCR on ISO/IEC 14496-16:2009 FPDAM1 Scalable Complexity 3D Mesh Compression

No 10/01/22

11124 ISO/IEC 14496-16:2009 FDAM1 Scalable Complexity 3D Mesh Compression

No 10/01/22

11125 WD 2.0 of ISO/IEC 14496-16:2009 AMD2 Efficient representation of 3D meshes with multiple attributes

No 10/02/12

8.1.2 The 3DG subgroup thanks KNB for their comments on ISO/IEC 14496-16 AMD1.

Part 25 3D Graphics Compression ModelThe 3DG subgroup recommends approval of the following documents

No. Title TBP Available14496-25 3D Graphics Compression Model

152

Part 27 3DG ConformanceThe 3DG subgroup recommends approval of the following documents

No. Title TBP Available14496-27 3DG Conformance

11126 Study Text of ISO/IEC 14496-27:2009/FPDAM2 Conformance for Scalable Complexity 3D Mesh Coding

No 10/01/22

11127 Text of ISO/IEC 14496-27:2009/PDAM3 Conformance for Scalable Complexity 3D Mesh Coding in 3DG Compression Model

No 10/01/22

Establishment of 3DG Ad-Hoc Groups11128 AHG on 3DG documents, software maintenance and core experiments

Mandate: 1. Conduct the experiments on efficient representation of 3D meshes with multiple attributes2. Conduct the experiments on Reconfigurable Graphics Coding3. Maintain and edit 3DG documents4. Coordinate 3DG related conformance and reference software5. Coordinate editing of the www.mpeg-3dgc.com web site

Chairman: Francisco Morán BurgosDuration: Until 92nd MeetingMeetings Sunday before 92nd meetingReflector: Mpeg-3dgc AT gti. ssr. upm. esSubscribe: https://mx.gti.ssr.upm.es/mailman/listinfo/mpeg-3dgc

11129 AHG on Multi-Resolution 3D mesh Coding Mandate: 1. Complete the test database

2. Complete the use case scenarios3. Conduct the evaluation experiments4. Update the testing platform (MMW.com)

Chairman: Khaled Mamou, Minsu Ahn, Xiangyang JiDuration: Until 92nd MeetingMeetings Sunday before 92nd meetingReflector: Mpeg-3dgc AT gti. ssr. upm. esSubscribe: https://mx.gti.ssr.upm.es/mailman/listinfo/mpeg-3dgc

7 Closing of the MeetingSee you in Dresden.

153