Upload
dangthu
View
229
Download
8
Embed Size (px)
Citation preview
INTERNATIONAL ORGANISATION FOR STANDARDISATIONORGANISATION INTERNATIONALE DE NORMALISATION
ISO/IEC JTC 1/SC 29/WG 11CODING OF MOVING PICTURES AND AUDIO
ISO/IEC JTC 1/SC 29/WG 11 N9157Lausanne, CH – July 2007
Source: Leonardo Chiariglione Title: Report of 81st meetingStatus
Report of 81st meeting..........................................................................................................................1Annex A – Attendance list.................................................................................................................16Annex B – Agenda.............................................................................................................................22Annex C Input – contributions...........................................................................................................25Annex D – Output documents............................................................................................................37Annex E – Requirements report.........................................................................................................43Annex F – Systems report..................................................................................................................54Annex G – MDS report......................................................................................................................76Annex H – Video report.....................................................................................................................94Annex I – JVT report........................................................................................................................106Annex J – Audio report....................................................................................................................107Annex K – 3DG report.....................................................................................................................132Annex L – Test report.......................................................................................................................145Annex M – ISG report......................................................................................................................147Annex N – Liaison............................................................................................................................151
Report of 81st meeting
1 OpeningThe 81st MPEG Meeting was hosted by Swiss National Body and EPFL, and Swissmedia as local organizer 02-06 July 2007 at Campus of EPFL, CH-1015 Lausanne/Switzerland.
2 Roll call of participantsThe attendance list appears as Annex 1
3 Approval of agendaThe adopted agenda appears as Annex 2
4 Allocation of contributionsThe list of input contributions is given in Annex 3
1
5 Communications from ConvenorThere was no specific communication
6 Report of previous meetingThe following document was approved
8911 Report of 80th MPEG meeting
7 Processing of NB Position PapersNational Body position papers were presented, discussed and, where appropriate, responses provided:
9326 Responses to National Bodies
8 Work plan
1.1. Media coding
1.1.1. AAC-ELDThe following documents were approved
9237 Technology under consideration for AAC-ELD9238 Workplan for AAC-ELD9239 WD on ISO/IEC 14496-3, MPEG-4 Audio Fourth Edition
1.1.2. Advanced Video CodingThe following document was approved
9198 Text of ISO/IEC FDIS 14496-10:200X Advanced Video Coding (4th edition)
1.1.3. Scalable Video CodingThe following documents were approved
9196 Disposition of Comments on ISO/IEC 14496-10:2005 / FPDAM 39197 Text of ISO/IEC 14496-10:2005 / FDAM 3 Scalable Video Coding9199 Joint Scalable Video Model (JSVM) 119212 JSVM 11 Software9189 SVC Verification Test Plan Version 1
1.1.4. Multiview Video CodingThe following documents were approved
9163 Multiview Video Coding Requirements9213 Text of ISO/IEC 14496-10:200X / PDAM 1 Multiview Video Coding
2
9214 Joint Multiview Video Model (JMVM) 59215 JMVM 5 Software
1.1.5. Frame-based Animated Mesh Compression The following document was approved
9266 Text of ISO/IEC 14496-16:2006/PDAM2 (Frame-based Animated Mesh Compression)
1.1.6. 3D MultiResolution ProfileThe following document was approved
9267 Text of ISO/IEC 14496-16:2006/PDAM3 (3D MultiResolution Profile)
1.1.7. Binary Format for XML (Prefixes and Wild Card extensions)The following documents were approved
9296 DoC on ISO/IEC 23001-1/FPDAM2 (Prefixes and wild cards extensions)9297 Text of ISO/IEC 23001-1/FDAM2 (Prefixes and wild cards extensions)
1.1.8. Video Tool LibraryThe following documents were approved
9224 WD 5 of ISO/IEC 23002-4 Video Tool Library9225 Description of Core Experiments in RVC9226 RVC Simulation Model (RSM) V5.09227 RVC Work Plan9228 RVC Conformance Testing Working Draft 2.09229 Description of Exploration Experiments for Toolbox Extensions
1.1.9. Spatial Audio Object CodingThe following documents were approved
9249 ISO/IEC 23003-1:2007/DCOR 19250 Report on Spatial Audio Object Coding CfP Selection9251 First thoughts on SAOC Verification Test
1.1.10. Free Viewpoint TV codingThe following document was approved
9168 Preliminary FTV Model and Requirements9230 Description of Exploration Experiments in FTV
3
1.1.11. Audio and speech codingThe following documents were approved
9252 Report on Evaluation of Speech and Audio Framework9254 Framework for Exploration of Speech and Audio Coding9253 Workplan for Exploration of Speech and Audio Coding9255 Draft Call for Proposals on Joint Speech and Audio Coding
1.1.12. Ontologies
9325 Possible requirements for a new rights ontology
1.2. Composition coding
1.2.1. Lightweight Scene RepresentationThe following documents were approved
9284 Study Text of ISO/IEC 14496-20/FPDAM 2 (SVGT1.2 Support)9286 TuC for ISO/IEC 14496-20/Amd.29287 WD4.0 of ISO/IEC 14496-20 2nd Edition (1st Ed. + Cor 1 + Amd.1)9288 IuC for LASeR
1.3. Description coding
1.3.1. Visual Descriptions ExtensionsThe following document was approved
9218 Description of Core Experiments for MPEG-7 New Visual Extensions
1.3.2. Visual Signature ToolsThe following documents were approved
9216 Call for Proposals on Visual Signature Tools9217 MPEG-7 Visual XM Document version 31.0
1.3.3. Technologies for digital photo management using MPEG-7 visual toolsThe following documents were approved
9219 Disposition of Comments on ISO/IEC TR 15938-8:2002 / DAM 39220 Text of ISO/IEC TR 15938-8:2002/Amd.3 (Technologies for digital photo management
using MPEG-7 visual tools)
1.3.4. MPEG-7 Query FormatThe following documents were approved
4
9172 Study of ISO/IEC CD 15938-12 Query Format9173 TuC for MPEG Query Format v2.0
1.4. IPMP
1.4.1. IPMP XML MessagesThe following document was approved
9166 Requirements for Additional XML IPMP Messages9298 Study Text of ISO/IEC 23001-3/FCD (IPMP XML
Messages)
1.5. Digital Item
1.5.1. Schema files for MPEG-21 standardsThe following document was approved
9174 Schema Files for MPEG-21 Standards (v7)
1.5.2. Review of DIDThe following documents were approved
9175 DID Open Issues9176 Workplan for CE on DI Semantics
1.5.3. Security in Event Reporting
9180 Request for Amendment 1 of ISO/IEC 21000-15 Security in ER9181 ISO/IEC 21000-15:2006/PDAM 1 Security in ER
1.6. Transport and File formats
1.6.1. Carriage of SVC in MPEG-2 SystemsThe following documents were approved
9273 Request ISO/IEC 13818-1:2006/Amd.3 Carriage of SVC in MPEG-2 Systems9274 Text of ISO/IEC 13818-1:2006/PDAM3 Carriage of SVC in MPEG-2 Systems
1.6.2. ISO Base Media File FormatThe following document was approved
9307 TuC on ISO/IEC 14496-12
5
1.6.3. AVC File Format extensions for SVCThe following documents were approved
9324 DoC ISO/IEC 14496-15/PDAM 2 (SVC File Format)9283 Text of ISO/IEC 14496-15/FPDAM 2 (SVC File
Format)
1.6.4. AVC File Format extensions for MVCThe following document was approved
9308 TuC on ISO/IEC 14496-15 (MVC Extensions)
1.7. Multimedia architecture
1.7.1. Codec Configuration RepresentationThe following document was approved
9223 WD 5 of ISO/IEC 23001-4 Codec Configuration Representation
1.7.2. 3D Graphics Compression ModelsThe following document was approved
9270 WD 2.0 of ISO/IEC 14496-25
1.7.3. Media Streaming MAF ProtocolsThe following document was approved
9301 Study Text of ISO/IEC 29116-1/FCD Media Streaming MAF Protocol
1.7.4. IPTVThe following document was approved
9167 IPTV Requirements
1.7.5. Extensible Multimedia PlatformThe following document was approved
9302 A project to exploit MPEG standards in tune with industry practices and needs (Revised version)
1.7.6. MetaverseThe following document was approved
6
9169 Metaverse: Context and Objectives
1.8. Application formats
1.8.1. Musical Slide Show Application FormatThe following documents were approved
9289 Request of ISO/IEC 23000-4/ Musical Slide Show 2nd Edition9290 Text of ISO/IEC 23000-4/CD Musical Slide Show 2nd Edition
1.8.2. Media Streaming Application FormatThe following document was approved
9182 Study of ISO/IEC FCD 23000-5 Media Streaming MAF
1.8.3. Professional Archival MAFThe following document was approved
9165 Call for Requirements on Professional Archival MAF
1.8.4. Open Release Application FormatThe following document was approved
9183 Study of ISO/IEC FCD 23000-7 OR Application Format
1.8.5. Portable Video Player MAFThe following document was approved
9292 Study Text of ISO/IEC 23000-8/CD Portable Video Player
1.8.6. Digital Multimedia Broadcasting Application FormatThe following documents were approved
9293 Study Text of ISO/IEC 23000-9/FCD (MAF for DMB)9294 TuC on MAF for DMB
1.8.7. Video Surveillance MAFThe following document was approved
9295 Text of ISO/IEC 23000-10/CD (Video Surveillance MAF)
7
1.9. Reference implementation
1.9.1. Symbolic Music Representation Reference SoftwareThe following documents were approved
9279 DoC of ISO/IEC 14496-5/PDAM 16 Symbolic Music Rep. Reference Software9280 Text of ISO/IEC 14496-5/FPDAM 16 Symbolic Music Rep. Reference Software
1.9.2. MPEG-1 and -2 on MPEG-4 Reference SoftwareThe following document was approved
9248 Study on ISO/IEC 14496-5:2001/PDAM 20, MPEG-1 and -2 on MPEG-4 and BSAC Extensions
1.9.3. BSAC Extensions Reference SoftwareThe following document was approved
9248 Study on ISO/IEC 14496-5:2001/PDAM 20, MPEG-1 and -2 on MPEG-4 and BSAC Extensions
1.9.4. Reference Hardware DescriptionThe following document was approved
9187 Study of “ISO/IEC DTR 14496-9 3rd Edition Reference Hardware Description”
1.9.5. New Profiles for Professional Applications Reference SoftwareThe following document was approved
9194 Text of ISO/IEC 14496-5:2001 / PDAM 18 Reference Software for New Profiles for Professional Applications
1.9.6. SVC Reference SoftwareThe following document was approved
9195 Text of ISO/IEC 14496-4:2001 / PDAM 19 Reference Software for SVC
1.9.7. Geometry and Shadow Reference SoftwareThe following document was approved
9263 Study Text of ISO/IEC 14496-5:2001/ FPDAM13 (Geometry and Shadow RefSoft)
8
1.9.8. Frame-based Animated Mesh Compressions Reference SoftwareThe following documents were approved
9264 Request for amendment of ISO/IEC 14496-5:2001 (FAMC RefSoft)9265 WD1.0 of ISO/IEC 14496-5:2001 AMD21 (FAMC RefSoft)
1.9.9. LASeR Reference SoftwareThe following documents were approved
9281 DoC of ISO/IEC 14496-5/PDAM 17 LASeR v1 Reference Software9282 Text of ISO/IEC 14496-5/FPDAM 17 LASeR v1 Reference Software
1.9.10. MPEG-21 Reference SoftwareThe following document was approved
9177 MPEG-21 REL Profiles Software Implementation Plan v.79178 DoC for ISO/IEC FCD 21000-8 Reference Software 2nd Edition9179 Text of ISO/IEC FDIS 21000-8 Reference Software 2nd Edition
1.9.11. Photo Player MAF Reference SoftwareThe following document was approved
9221 Disposition of Comments on ISO/IEC 23000-3 / PDAM 1 9222 Text of ISO/IEC 23000-3 / FPDAM 1 Reference Software for Photo Player
MAF
1.9.12. Musical Slide Show MAF Reference SoftwareThe following document was approved
9291 WD1.0 of ISO/IEC 23000-4/Amd.1 MSS MAF Conf. and Ref. Software
1.9.13. M3W Reference SoftwareThe following documents were approved
9299 Text of ISO/IEC 23004-8/CD Reference Software and Conformance9300 M3W Reference Software and Conformance Plan
1.10. Conformance
1.10.1. Audio BIFS v3 ConformanceThe following document was approved
9275 Text of ISO/IEC 14496-4/FPDAM 22 AudioBIFS v3 Conformance
9
1.10.2. Symbolic Music Representation ConformanceThe following documents were approved
9240 DoC on 14496-4:2004/PDAM 29, SMR Conformance9241 ISO/IEC 14496-4:2004/FPDAM 29, SMR Conformance
1.10.3. New Profiles for Professional Applications ConformanceThe following document was approved
9191 Text of ISO/IEC 14496-4:2004/PDAM 30 Conformance Testing for New Profiles for Professional Applications
1.10.4. SVC Profiles ConformanceThe following document was approved
9192 Text of ISO/IEC 14496-4:2004/PDAM 31 Conformance Testing for SVC Profiles
1.10.5. MPEG-1 and -2 Audio in MPEG-4 ConformanceThe following document was approved
9244 Study on ISO/IEC 14496-4:2004/FPDAM 20, SLS and MPEG-1/2 on MPEG-4 Conformance
1.10.6. BSAC ConformanceThe following document was approved
9246 Status of BSAC Extension Conformance and Reference Software
1.10.7. Audio Scalable to Lossless ConformanceThe following documents were approved
9244 Study on ISO/IEC 14496-4:2004/FPDAM 20, SLS and MPEG-1/2 on MPEG-4 Conformance
9245 Status of SLS conformance
1.10.8. Geometry & Shadow ConformanceThe following document was approved
9258 Study Text of ISO/IEC 14496-4:2004/ FPDAM21 (Geometry and Shadow Conformance)
1.10.9. Frame-based Animated Mesh CompressionThe following documents were approved
10
9259 Request for Amendment of ISO/IEC 14496-4:2004 (FAMC Conformance)9260 WD 1.0 of ISO/IEC 14496-4:2004 AMD32 (FAMC Conformance)
1.10.10. MultiResolution Profile ConformanceThe following documents were approved
9261 Request for Amendment of ISO/IEC 14496-4:2004 (MultiResolution Profile Conformance)9262 WD 1.0 of ISO/IEC 14496-4:2004 AMD33 (MultiResolution Profile Conformance)
1.10.11. Laser ConformanceThe following documents were approved
9276 Study Text of ISO/IEC 14496-4/FPDAM 25 LASeR & SAF V1 Conformance
9277 Request for ISO/IEC 14496-4/Amd.27 LASeR V2 Conformance9278 Text of ISO/IEC 14496-4/PDAM 27 LASeR V2Conformance
1.10.12. Musical Slide Show MAF ConformanceThe following document was approved
9291 WD1.0 of ISO/IEC 23000-4/Amd.1 MSS MAF Conf. and Ref. Software
1.10.13. M3W ConformanceThe following documents were approved
9299 Text of ISO/IEC 23004-8/CD Reference Software and Conformance9300 M3W Reference Software and Conformance Plan
1.11. Maintenance
1.11.1. Systems coding standardsThe following document was approved
9285 Study of ISO/IEC 14496-20/DCOR2
1.11.2. Video coding standardsThe following document was approved
9193 Text of ISO/IEC 14496-5:2001/Amd.1/DCOR 1
1.11.3. Audio coding standardsThe following documents were approved
11
9235 ISO/IEC 14496-3:2006/AMD2:2006/DCor 3, ALS9236 Study on ISO/IEC 14496-3/DCOR 5, DST and MP3on4 and LTP9242 ISO/IEC 14496-4:2004/AMD13:2007/DCOR 1, LD AAC test sequences9243 ISO/IEC 14496-4:2004/DCOR 5, Audio Corrections9247 Study on ISO/IEC 14496-5:2001/AMD 10:2007/DCOR 1, BSAC and SLS, ALS Corrections
9 Liaison matters The following liaison statements were issued
9309 Liaison Statement to AES9310 Liaison Statement to ITU-T re Joint Speech & Audio Coding9311 Liaison Statement to 3GPP re Joint Speech & Audio Coding9312 Liaison Statement to 3GPP29313 Liaison Statement to IEC TC1009314 Liaison Statement to ITU-T IPTV Focus Group re "Toolbox for Content Coding"9315 Liaison Statement to SMPTE re RVC9316 Liaison Statement to SCTE9317 Liaison Statement to AVS9318 Liaison Statement to ITU-T SG9 re FTV9319 Liaison Statement to DVB9320 Liaison Statement to 3GPP TSG SA WG4 re DIMS/LASeR9321 Liaison Statement to OMA9322 Liaison Statement to ITU-T IPTV Focus Group re Presentation Formats for IPTV9324 Liaison Statement to WG1
The following document was approved
9327 List of Organisations with which MPEG entertains liaisons (as of July 2007)
10 Organisation of this meeting
1.12. Tasks for subgroupsTasks were assigned to subgroups as follows
S P AReqs
4 10 MVC20 Laser profiling
7 3 Video annotationImage and Video Signature Tools
21 2 New DID6 Rights ontology
A 6 Professional Archival MAFY Stereoscopic MAFZ Cross media interactive presentation
B 3 IPMP XML messages
12
C 3 Stereoscopic videoColourFTVIPTVJoint audio and speech codingMetaverse
Systems2 1 3 Carriage of SVC4 4 22 Audio BIFS conformance
23 Synthesised texture conformance24 File format conformance25 Laser v1 conformance26 Open Font Format Conformance27 Laser v.2 conformance
5 14 Open Font Format Reference Software16 Symbolic Music Representation Reference Software17 Laser Reference Software
15 1 SVC File Format20 1 Lightweight Scene Representation
21 9 1 Mime type registrationA 4 1 Musical Slide Show MAF conformance & RS
2 Protected Musical Slide Show MAF8 Portable Video Player MAF9 DMB MAF
10 Video Surveillance MAFB 1 2 Extension on encoding of wild cards
3 IPMP XML messagesE 8 M3W Reference Software and Conformance29116 1 MS MAF Protocols
Joint management of content description and presentationX MPEG eXtensible Middleware
MDS7 12 Query Format
Schemas21 2 Revisiting DID
8 1 Reference software18 1 Digital Item Streaming
SchemasA 2 Protected Music Player MAF
5 Media Streaming MAF6 Professional Archival MAF7 Open Release MAF
Video4 2 4 Simple Profile level 67 3 3 Visual Signature ToolsA 3 1 Photo Player Reference Software
2 Photo Player ConformanceB 4 Codec Configuration DescriptionC 2 Fixed-point 8x8 IDCT and DCT
13
4 Video Tool Library4 1 Video Tool Library Conformance
JVT 4 New AVC Profiles for Professional Applications Conformance New AVC Profiles for Professional Applications Reference SWScalable Video Coding ConformanceScalable Video Coding Reference SW
10 3 Scalable Video Coding4 Multi-View Video Coding
Audio 4 3 8 MP4 box for original audio file information3 9 AAC-ELD4 20 SLS conformance
29 SMR Conformance5 16 SMR Reference Software
15 BSAC and SLS Reference Software20 MPEG-1/-2 on MPEG-4 reference software
23 SMRA 6 Professional Archival MAFD 1 1 MPEG Surround Reference Software
2 MPEG Surround Conformance3 Spatial Audio Object Coding
X Audio and Speech Coding3DG
4 4 xx FAMC (Frame based Animated Mesh Compress.) Conformance21 Geometry and shadow Conformance32 Multiresolution profile conformance
5 xx FAMC (Frame based Animated Mesh Compress.) Reference software13 Geometry and shadow Reference Software21 Multiresolution profile Reference Software
16 2 Frame-based animated mesh compression3 3D Multiresolution profile
25 3D Graphics Compression modelTest
4 10 3 SVC verification tests ISG
4 9 2 Reference Hardware Description3 Reference Hardware Description
7 6 Reference softwareLiaison
JPEG
1.13. Joint meetingsThe following joint meetings were held
Groups What Day Where TimeReq. Vid Video and image signature reqs Mon Vid 15:00-16:00Req, Sys Laser profiling Mon Req 17:00-17:30
14
Req, Vid MVC, FTV, MPEG-C pt3, colour Tue Req 09:00-12:00Req, Mds, Sys, Vid MAFs Tue Req 14:00-16:00Req. Mds DID, IPMP messages, Ontology Tue Req 16:00-18:00Req, Aud FTV, Joint Audio & Speech Wed Aud 12:00-13:00Aud, ISG AAC-ELD Wed Aud 11:00-12:00Aud, Vid Decoder Description Thu Aud 14:00-15:00
11 Administrative matters
1.14. Schedule of future MPEG meetings The following meeting schedule was approved
# City Country yy mm dd-dd81 Lausanne CH 07 07 02-0682 Shenzhen CN 07 10 22-2683 Antalya TR 08 01 14-1884 Lausanne CH 08 04-05? 28-02?85 Hannover DE 08 07 21-2586 Seoul KR 08 10 13-17
1.15. Promotional activities The following documents were approved
9159 Lausanne press release9184 MPEG-21 DIA 2nd Edition Tutorial Presentation
12 Planning of future activitiesThe following document was approved
9156 List of ad hoc groups established at the 81st MPEG meeting
13 Resolutions of this meetingThese were approved
14 A.O.BThere was no other business
15 ClosingThe meeting closed at 2007/07/06T19:30
15
Annex A – Attendance list
Nr 1st NAME Last NAME AFFILIATION
CO
UN
TR
Y
217 Jeong Hnan AHN KR1 Taleb ANISSE ERICSSON AB SE
224 Olivier AVARO STREAMEZZO FR2 Bart BARENBRUG PHILIPS 3D SOLUTIONS NL3 Gero BASE SIEMENS AG CT IC2 MC DE4 Tanya BEECH QINETIQ UK
240 Pierfrancesco BELLINI UNIVERSITY OF FLORENCE IT236 Michele BELLUOMINI IT5 Miroslaw BOBER VISUAL INFORMATION
LABORATORYUK
6 Yann BODO JOOST TECHNOLOGIES B.V. NL7 Jan BORMANS IMEC BE8 Sebastien BRANGOULO JOOST TECHNOLOGIES B.V. NL9 Paul BRASNETT MITSUBISHI ELECTRIC ITE-VIL UK10 Bernard BROWER ITT US11 Sabina BRUFANI SISVEL SPA IT12 Fons BRULS PHILIPS NL13 Tim BRUYLANTS VRIJE UNIVERSITEIT BRUSSEL -
IBBTBE
14 Ian BURNETT UNIVERSITY OF WOLLONGONG AU15 Jihun CHA ETRI KR16 Hyouk Jean CHA LG ELECTRONICS KR17 Ti Eu CHAN INSTITUTE FOR INFOCOMM
RESEARCHSG
248 Wo CHANG NIST US18 Weizhong CHEN HUAWEI TECHNOLOGIES CO, LTD CN19 Yi-Wen CHEN NATIONAL CHIAO-TUNG
UNIVERSITY/ITRIUS
20 Filippo CHIARIGLIONE CEDEO.net IT21 Leonardo CHIARIGLIONE CEDEO.net IT22 Ik-Hwan CHO INHA UNIVERSITY KR218 Ayoung CHO KR222 Maeng-Sub CHO KR23 Hyon-Gon CHOO ETRI KR24 Takeshi CHUJOH TOSHIBA CORPORATION JP25 Sung-Moon CHUN ECT INC. KR26 Richard CLARK ELYSIUM LTD UK27 Daniel COMALRENA ENST-TELECOM PARIS FR28 Giovanni CORDARA TELECOM ITALIA IT29 Bill CROW MICROSOFT CORPORATION US234 Wiebe DE HAAN PHILIPS NL30 Saar DE ZUTTER GHENT UNIVERSITY - IBBT BE
16
31 Jaime DELGADO UNIVERSITAT POLITECNICA DE CATALUNYA
ES
32 Jwalant DESAI WIPRO TECHNOLOGIES IN33 Sylvain DEVILLERS FRANCE TELECOM FR34 Dandan DING ZHEIJIANG UNIVERSITY CN35 Stefan DOEHLA FRAUNHOFER IIS DE36 Mario DOELLER UNIVERSITY OF PASSAU DE233 Frédéric DUFAUX EPFL CH37 Jean-Claude DUFOURD STREAMEZZO FR38 Touradj EBRAHIMI EPFL CH39 Regis FARIA LSI-TEC BR40 Per FROJDH ERICSSON SE41 Toshiaki FUJII NAGOYA UNIVERSITY JP245 David FUSCHI IT230 Marc GAUVIN SDAE ES42 Ralf GEIGER FRAUNHOFER IIS DE43 Jean H.A. GELISSEN PHILIPS NL44 Diego GIBELLINO TELECOM ITALIA IT45 Aharon GILL ZORAN MICROELECTRONICS LTD IL46 Patrick GIOIA FRANCE TELECOM FR47 Daniele GIUSTO CNIT @ POLARIS IT48 Bernhard GRILL FRAUNHOFER IIS DE49 Marc GUEZ VUCHER SCPP FR50 Onur GULERYUZ DOCOMO USA LABS US51 Miska HANNUKSELA NOKIA CORPORATION FI52 Junichi HARA RICOH COMPANY, LTD JP53 Noboru HARADA NTT JP54 Shinya HASEGAWA SHARP CORP. JP55 Oliver HELLMUTH FRAUNHOFER IIS DE56 Tan HENDRY I & C UNIVERSITY KR57 Juergen HERRE FRAUNHOFER IIS DE58 Arianne HINDS RICOH IBM INFOPRINT
SOLUTIONS COMPANYUS
221 Kang HOGAB DRM Inside KR59 Haibin HUANG INSTITUTE FOR INFOCOMM
RESEARCHSG
243 Walt HUSAK Dolby US60 Chi Jung HWANG CHUNGNAM NATIONAL UNIV. KR61 Michael ISNARDI SARNOFF CORPORATION US62 Satoshi ITO TOSHIBA JP63 Takashi ITOH FUJITSU LABORATORIES LTD JP64 Kota IWAMOTO NEC CORPORATION JP238 Vincent JACQUET FR223 Song JAEYEON KR65 Euee Seon JANG HANYANG UNIVERSITY KR219 Dong Seok JEONG INHA University KR66 Jaebum JUN HANYANG UNIVERSITY KR67 Klaus JUNG LURATECH IMAGING GMBH DE68 Yang-Won JUNG LG ELECTRONICS KR69 Itaru KANEKO TOKYO POLYTECHNIC JP
17
UNIVERSITY70 Akihiko SUGIYAMA NEC CORPORATION JP71 Leong Mun KEW INSTITUTE FOR INFOCOM
RESEARCHSG
72 Byoungjun KIM HANGYANG UNIVERSITY KR73 Dong Soo KIM LG ELECTRONICS KR74 Hui Yong KIM ETRI KR75 Hyunkgyu KIM HANGYANG UNIVERSITY KR76 Jinwoong KIM ETRI KR77 Jong Lak KIM DSP GROUP INC. KR78 JungHoe KIM SAMSUNG AIT KR79 Kyuheon KIM KYUNGHEE UNIVERSITY KR80 Minsoo KIM DSP VIDEO KOREA KR81 Munchurl KIM I&C UNIVERSITY KR82 Tae Hyeon KIM LG ELECTRONICS KR83 Taehyun KIM DRM INSIDE KR84 Yong Han KIM UNIVERSITY OF SEOUL KR85 Youngseop KIM DANKOOK UNIVERSITY KR214 Sang-Kyun KIM Myongi University KR231 Jaeseung KIM KR237 Haeknang KIM KR86 Hideaki KIMATA NTT CORPORATION JP87 Kristofer KJOERLING CODING TECHNOLOGIES AB SE88 Patrick KLIE LEIBNIZ UNIVERSITAET
HANNOVERDE
89 Naoki KOBAYASHI NTT JP90 Takuyo KOGURE MATSUSHITA ELECTRIC IND. CO.
LTDJP
91 Asai KOHTARO MITSUBISHI ELECTRIC JP92 Adi KOUADIO EPFL CH93 Panos KUDUMAKIS QUEEN MARY UNIV. LONDON UK94 Chaker LARABI UNIVERSITY OF POITIERS FR95 Jean LEFEUVRE ENST-TELECOM PARIS FR96 Alex Chungku LEE HUMAX KR97 Hyunkook LEE LGE KR98 Sinwook LEE HANYANG UNIVERSITY KR99 Sun Young LEE HANGYANG UNIVERSITY KR103 Sangyoun LEE YONSEI UNIVERSITY KR104 Gun-Ill LEE SAMSUNG ELECTRONICS KR215 Tae-Jin LEE KR246 Sihyoung LEE KR100 Chee Mun Kelvin LEE INSTITUTE FOR INFOCOMM
RESEARCHSG
101 Gwo Giun LEE NATIONAL CHENG KUNG UNIVERSITY
US
102 Daniel LEE EBAY US105 Tilman LIEBCHEN LG ELECTRONICS DE106 Taebeom LIM KOREA ELECTRONICS
TECHNOLOGY INSTITUTEKR
229 Youg-Knon LIM Net & TV KR
18
107 He-Yuan LIN NATIONAL CHENG KUNG UNIVERSITY
US
108 Fernando LOPES ISEC/IPC - IT COIMBRA PT109 Ning LU INTEL CORP. US110 Ajay LUTHRA MOTOROLA US244 Khaled MAMMOU FR111 Masatsugu KITAMURA FOR MORE CONVENIENT AV LIFE JP112 Marco MATTAVELLI EPFL CH113 Neil MC KENZIE DEDICON NL114 James MEANY BOEING US115 Choi MIRAN ETRI KR116 Joerg MOHR FRAUNHOFER IIS DE213 Francisco MORAN
BURGOSUPM ES
117 Takehiro MORIYA NTT JP118 Fulvio MOSCHETTI EPO DE119 Karsten MULLER FRAUNHOFER HHI DE120 Markus MULTRUS FRAUNHOFER IIS DE121 Tokumichi MURAKAMI MITSUBISHI ELECTRIC
CORPORATIONJP
122 Tomakazu MURAKAMI HITACHI, LTD JP123 Johan MUSKENS PHILIPS NL124 Hiroya NAKAMURA JVC (VICTOR COMPANY OF
JAPAN, LIMITED)JP
125 Sua Hong NEO PANASONIC SINGAPORTE LABS PTE LTD
SG
241 Paolo NESI UNIVERSITY OF FLORENCE IT126 Jean François NEZAN IETR FR127 Didier NICHOLSON THALES FR128 Takashi NISHI OKI ELECTRIC INDUSTRY CO, LTD JP129 Toshiyuki NOMURA NEC JP130 Ryoma OAMI NEC CORPORATION JP131 Robert O'CALLAGHAN MITSUBISHI ELECTRIC ITE UK132 Tobias OELBAUM TECHNISCHE UNIVERSITAT
MUNCHENDE
133 Yukiko OGURA IPSJ/ITSCJ JP134 Henney OH LG ELECTRONICS KR135 Weon Geun OH ETRI KR210 Eunmi OH Samsung AIT KR136 Jens-Rainer OHM RWTH AACHEN UNIVERISTY DE137 Tatiana ONALI UNIVERSITY OF CAGLIARI IT235 Takao ONOYE JP138 Werner OOMEN PHILIPS APPLIED TECHNOLOGIES NL139 James ORWELL KINGSTON UNIVERSITY UK140 Hiroshi OSAWA JUGEMU CO, LTD JP141 Keunsoo PARK KOREAN BROADCASTING
SYSTEMKR
142 Fernando PEREIRA IST-IT PT143 Cristian PERRA UNIVERSITY OF CAGLIARI IT144 Marius PREDA INT FR
19
145 Françoise PRETEUX GET/INT FR146 Heiko PURNHAGEN CODING TECHNOLOGIES AB SE147 Honggang QI INSTITUTE OF COMPUTING
TECHNOLOGYCN
148 Schuyler QUACKENBUSH AUDIO RESEARCH LABS US242 Thomas RATHGEN TECHNISCHE UNIVERSITAT
ILMENAUDE
149 Mickael RAULET IETR IMAGE GROUP FR220 Yuriy REZNIK QUALCOMM Inc. SAN DIEGO US228 Justin RIDGE NOKIA US150 Eva RODRIGUEZ UNIVERSITAT POLITECNICA DE
CATALUNYAES
239 Davide ROGAI UNIVERSITY OF FLORENCE IT151 Robert ROSSI MICROSOFT US247 Janet ROUNTREE US152 Muham. Syah
HouariSABIRIN I&C UNIVERSITY KR
153 Masanori SANO NHK JP154 Peter SCHELKENS VRIJE UNIVERSITEIT BRUSSEL -
IBBTBE
155 Juergen SCHMIDT THOMSON DE156 Andreas SCHNEIDER CODING TECHNOLOGIES AB DE157 Markus SCHNELL FRAUNHOFER IIS DE158 Florian SCHREINER TECHNISCHE UNIVERSITAT
MUNCHENDE
159 Akihide SEI JEITA JP160 Shun-Ichi SEKIGUCHI MITSUBISHI ELECTRIC
CORPORATIONJP
161 Chong Kok SENG PANASONIC SINGAPORE SG162 Takanori SENOH NATIONAL INSTITUTE OF INFO &
COMM TECHJP
163 Hee-Cheol SEO ETRI KR216 Jeong-Il SEO KR226 Louis SHARPE US227 Xiaojin SHI US164 Osamu SHIMADA NEC CORPORATION JP165 Shinya SHIMIZU NTT JP166 Taichiro SHIODERA TOSHIBA JP167 David SINGER APPLE US168 Ralph SPERSCHNEIDER FRAUNHOFER IIS DE169 Sridhar SRINIVASAN MICROSOFT US170 Toshiyasu SUGIO MATSUSHITA ELECTRIC JP171 Gary SULLIVAN MICROSOFT CORPORATION US172 Huifang SUN MITSUBISHI ELECTRIC RESEARCH
LABSUS
173 Teruhiko SUZUKI SONY CORP. JP174 Norimatsu TAKESHI MATUSHITA ELECTRIC
INDUSTRIAL CO, LTDJP
175 Masayuki TANIMOTO NAGOYA UNIVERSITY JP176 Akiyuki TANIZAWA TOSHIBA CORPORATION JP
20
177 Frederik TEMMERMANS VRIJE UNIVERSITEIT BRUSSEL - IBBT
BE
178 Patric THEUNE PHILIPS 3D SOLUTIONS NL179 David THEVENIN EXPWAY FR180 Christian TIMMERER KLAGENFURT UNIVERSITY AT181 Steven TONDEUR VRIJE UNIVERSITEIT BRUSSEL BE225 Ruben Liesa TOUS ES182 Chun-Jen TSAI NCTU/ITRI US183 Chrisa TSINARAKI TUC/MUSIC GR184 Yi-Shin TUNG HON-HAI PRECISION IND.CO
(FOXCONN)US
185 Alexis TZANNES AWARE, INC. US232 Mauri VAANANEN NOKIA FI186 Jan VAN DER MEER PHILIPS NL187 Yuri VATIS LEIBNIZ UNIVERSITAT
HANNOVERDE
188 Frédéric VEXO EPFL - VRLAB CH189 David VIRETTE FRANCE TELECOM FR190 Ye-Kui WANG NOKIA FI191 Xin WANG CONTENTGUARD, INC. US192 Jiangtao WENG ORTIVA WIRELESS US212 Karol WHUHOWICZ PL193 Kai WILLNER NOKIA CORPORATION FI194 Lowell WINGER LSI CA195 Steffen WITTMANN PANASONIC DE196 Ingo WOLF DEUTSCHE TELEKOM DE197 Keun Yang WON ETRI KR198 Lianhuan XIONG HUAWEI TECHNOLOGIES CO, LTD CN199 Lijing XU HUAWEI TECHNOLOGIES CO, LTD CN200 Akio YAMADA NEC JP201 Yoshihisba YAMADA MITSUBISHI JP202 Tomoo YAMAKAGE TOSHIBA CORPORATION JP203 Tomoyuki YAMAMOTO SHARP CORP. JP211 Ye YAN QUALCOMM Inc. SAN DIEGO US204 Yoshiyuki YASHIMA NTT JP205 Jeong-Ju YOO ETRI KR206 Kyoungro YOON KONKUK UNIVERSITY KR207 Lu YU ZHEIJIANG UNIVERSITY CN208 Toni ZGALJIC UK209 Zhishou ZHANG INSTITUTE FOR INFOCOMM
RESEARCHSG
21
Annex B – Agenda
Item1 Opening 2 Roll call of participants 3 Approval of agenda4 Allocation of contributions 5 Communications from Convenor6 Report of previous meeting 7 Processing of NB Position Papers8 Work plan 1 Media coding 1 MPEG-4 Visual Simple Profile Level 6 2 AAC-ELD 3 New Profiles for Professional Applications 4 Scalable Video Coding 5 Multiview Video Coding 6 Geometry and Shadow 7 Fixed point implementation of DCT/IDCT 8 Bitstream Syntax Description Language 9 Video Tool Library 10 Spatial Audio Object Coding 11 Free Viewpoint TV coding 12 Audio and speech coding 2 Composition coding 1 Lightweight Scene Representation 3 Description coding 1 Schema definition 2 Visual Descriptions Extensions
Video annotation exploration 3 Technologies for digital photo management using MPEG-7 visual tools 4 Improvements to Geographic Descriptor 5 MPEG-7 Query Format 4 Systems support 1 Fragment Request Unit 5 IPMP 1 REL Open Release Profile 2 IPMP XML Messages 3 REL Distribution and Capture Profile 6 Digital Item 1 Schema files for MPEG-21 standards
2 Review of DID 7 Transport and File formats 1 Transport of MPEG Surround data in AAC 2 File Format extensions for Description of Timed Metadata 3 Flute Hint Track 4 AVC File Format extensions for FRExt 5 AVC File Format extensions for SVC 6 MP4FF box for Original Audio File Information
22
7 Digital Item File Format 8 Digital Item Streaming 8 Multimedia architecture 1 Codec Configuration Representation 2 3D Graphics Compression Models 3 Media Streaming MAF Protocols 4 Extensible Multimedia Platform 9 Application formats 1 Musical Slide Show Application Format 2 Media Streaming Application Format 3 Professional Archival MAF 4 Open Release Application Format 5 Portable Video Player MAF 6 Digital Multimedia Broadcasting Application Format 7 Video Surveillance MAF 10 Reference implementation 1 Symbolic Music Representation Reference Software 2 Reference Hardware Description 3 New Profiles for Professional Applications Reference Software 4 SVC Reference Software 5 File Format Reference Software 6 Morphing & Textures Reference Software 7 MPEG-J GFX Reference Software 8 LASeR Reference Software 9 Open Font Format Reference Software 10 MPEG-7 Systems Reference Software 11 MPEG-21 REL Reference Software 12 Photo Player MAF Reference Software 13 Musical Slide Show MAF Reference Software 14 Binary MPEG format for XML Reference Software 15 Prefixes and wild card extensions Reference Software 16 MPEG Surround Reference Software 17 M3W Reference Software 11 Conformance 1 Audio BIFS v3 Conformance 2 Symbolic Music Representation Conformance 3 MPEG-4 Visual Simple Profile Level 6 Conformance 4 New Profiles for Professional Applications Conformance 5 SVC Profiles Conformance 6 MPEG-1 and -2 Audio in MPEG-4 Conformance 7 BSAC Conformance 8 1-bit Oversampled Audio Conformance 9 Audio Scalable to Lossless Conformance 10 File Format Conformance 11 Geometry & Shadow Conformance 12 Synthesized Texture Conformance 13 MPEG-J GFX Conformance 14 Laser Conformance 15 Open Font Format Conformance 16 Perceptual 3D Shape Conformance 17 Improvements to Geographic Descriptor Conformance
23
18 Binary MPEG format for XML Conformance 19 MPEG Surround Conformance 20 M3W Conformance 21 Codec Configuration Representation Conformance 12 Maintenance 1 Systems coding standards 2 Video coding standards 3 Audio coding standards 4 Visual description coding standards 5 Audio description coding standards 6 MDS standards9 Liaison matters
10 Organisation of this meeting 1 Tasks for subgroups 2 Joint meetings
11 Administrative matters 1 Schedule of future MPEG meetings 2 Promotional activities
12 Planning of future activities13 Resolutions of this meeting 14 A.O.B 15 Closing
24
Annex C – Input contributions
No. Authors Title
14558 Wo Chang Document Register for SC29/WG11 Meeting Lausanne, Switzerland
14559 Gerrard Drury Giovanni Cordara AHG on Review of MPEG-21 DID
14560 Hideaki Kimata Karsten M.ler AHG on FTV (Free Viewpoint Television)
14561 Yi-Shin Tung Chung-Neng Wang AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance
14562 Euee S. Jang Yoshihisa Yamada AHG on Reconfigurable Video Coding
14563 Miroslaw Bober Ryoma Oami Robert O'Callaghan
AHG on MPEG-7 Visual and Photo Player MAF
14564Tobias Oelbaum Mathias Wien Vincent Bottreau Nathalie Cammas Alex Eleftheriadis Justin Ridge
AHG on SVC Verification Test
14565 Miroslaw Bober Jens-Rainer Ohm Thomas Wiegand AHG on Video Annotation
14566 Young-Kwon Lim Cyril Concolato AHG on Scene Representation
14567 David Singer Visharam Mohammed AHG on MPEG File Formats
14568 Young-Kwon Lim Hui Yong Kim Jean Cha AHG on MAF Under Development in Systems
14569 R. Sperschneider AHG on Audio Standards Maintenance
14570 S. Quackenbush Eunmi Oh AHG on SAOC CfP, AAC-ELD and Speech and Audio Exploration
14571 Kyoungro Yoon Mario Doeller AHG on MPEG-7 Query Format
14572 Jeong-Hwan Ahn Ning Lu AHG on 3DG documents, experiments and software maintenance
14573 3GPP TSG SA WG4 via SC 29 Secretariat Liaison Statement from 3GPP TSG SA WG4 [SC 29 N 8462]
14574 3GPP TSG SA WG4 via SC 29 Secretariat Liaison Statement from 3GPP TSG SA WG4 [SC 29 N 8463]
14575 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC FDIS 23000-3 [SC 29 N 8461]
14576 JTC 1 Secretariat via SC 29 Secretariat Summary of Voting on ISO/IEC TR 15938-8:2002/DAM 3 [SC 29 N 8485]
14577 IEC TC 100 via SC 29 Secretariat IEC CDV 61883-1 [SC 29 N 8507]
14578 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-10:2005/FDAM 1 [SC 29 N 8508]
25
14579 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC FDIS 21000-18 [SC 29 N 8509]
14580 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 15938-7:2003/FDAM 2 [SC 29 N 8517]
14581 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:2004/FPDAM 22 [SC 29 N 8518]
14582 SC 29 Secretariat Summary of Voting on ISO/IEC 23001-1:2006/FPDAM 2 [SC 29 N 8519]
14583 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-5:2001/PDAM 17
14584 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:2004/PDAM 29 [SC 29 N 8499]
14585 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-5:2001/PDAM 16 [SC 29 N 8503]
14586 ITU-R SG 6/WP 6J via SC 29 Secretariat Liaison Statement from ITU-R SG 6/WP 6J [SC 29 N 8520]
14587 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 21000-8 (2nd Edition) [SC 29 N 8558]
14588
Weon-Geun OhIk-Hwan ChoA-Young ChoJu-Kyoung JinWon-Keun YangJun-Woo LeeDong-Seok Jeong
Clarification of MPEG-7 VCE-6 testset
14589 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-2:2004/FDAM 3 [SC 29 N 8557]
14590 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 21000-7:2004/FDAM 2 [SC 29 N 8555]
14591 French National Body French NB comment on JPXML and MPEG-B BSDL
14592 Onur G. GuleryuzM. Reha Civanlar
Royalty Cost Optimization with Reconfigurable Video Coding
14593Weon-Geun OhHyeong-yong JeonChi-jung Hwang
Modification of VCE 6 Independent Data Set
14594Weon-Geun OhHyeong-yong JeonChi-jung Hwang
An Image Identifier based on Feature points for Complex conditions
14595
Inseon JangJeongil SeoSeungkwon BeackKyeongok Kang
Report on the SAOC RM0 Evaluation Test at ETRI
26
14596 Gero BäseThomas Rathgen
Study text of ISO/IEC 23000-10 WD Video Surveillance MAF
14597 Schuyler Quackenbush 80th MPEG Audio Report
14598 Schuyler Quackenbush Report on Spacial Audio Object Coding CfP Subjective Listening Test
14599 Schuyler Quackenbush Pooled Results of Speech and Audio Listening Tests.
14600 Teruhiko Suzuki Problem report on MPEG-4 visual reference software
14601 JTC 1 Secretariat via SC 29 Secretariat Summary of Voting on ISO/IEC DTR 14496-24 [SC 29 N 8546]
14602 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-4:2004/FDAM 17 [SC 29 N 8577]
14603 Chrisa TsinarakiStavros Christodoulakis MPEG-7 FASP Extension Proposal
14604Davide RogaiPierfrancesco BelliniPaolo Nesi
Cross-Media Interactive Presentation MAF
14605 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-3:2005/FDAM 5
14606 SC 29 Secretariat Summary of Voting on ISO/IEC ISO/IEC 23000-3/PDAM 1
14607 Jean-Claude Dufourd Study of ISO/IEC 14496-20/FPDAM2
14608 Jean-Claude Dufourd Update of LASeR Reference Software
14609 Jean-Claude Dufourd Study of ISO/IEC 14496-4/FPDAM25
14610 Jean-Claude Dufourd Report of LASeR related activities in other standards organizations
14611
Pedro CarvalhoHelder CastroMaria Teresa AndradeGiorgiana CiobanuChristian TimmererHermann Hellwagner
Input to AHG on Review of MPEG-21 DID
14612 Xin Wang Security and DRM Requirements for Professional Archival MAF
14613Noboru HaradaTakehiro MoriyaYutaka Kamamoto
Updated overviwe document for Professional Archival MAF
14614Harada Noboru Takehiro Moriya Yutaka Kamamoto
Proposed text to WD of Professional Archival MAF
14615 Tokumichi Murakami Requirement of Real-Color Video Coding for
27
Kohtaro AsaiShun-ichi SekiguchiShuic
Consumer Application
14616
Shun-ichi SekiguchiShuichi YamagishiYoshihisa YamadaKoht
On Performance Comparison between 4:4:4 coding and 4:2:0 coding
14617 David Singer Improved meta box support in the ISO file format
14618
Weon-Geun OhA-Young ChoIk-Hwan ChoJu-Kyoung JinJun-Woo LeeDong-Seok Jeong
Experiment Results of Image Identifier for Basic Group
14619Weon-Geun OhWon-Keun YangDong-Seok Jeong
Improved CE Results of MGST Based Descriptor for MPEG-7 VCE-6 Complex Condition
14620 Ye-Kui WangMiska M. Hannuksela On SVC file format
14621 Eva RodriguezJaime Delgado Derivative rights for the REL ORC Profile
14622 Eva RodriguezJaime Delgado Security requirements for Event Reporting
14623Jaime DelgadoEva RodriguezJordi Sesmero
Software implementation of security in Event Reporting
14624 Eva RodriguezJaime Delgado
Contribution to MPEG-21 REL Reference Software: Schema checker for the ORC
14625 Eva RodriguezJaime Delgado
Contribution to MPEG-21 REL Reference Software: Validation rules checker for the
14626
Taka Senohkenji YamamotoRyutaro OiTomoyuki MishinaMakoto Okui
Consideration of image depth information
14627
Maeng-Sub ChoJin-Seo KimBon-ki KooSang-Kyun Kim
Initiating a new application format for Consistent Color Reproduction
14628
Maeng-Sub ChoJin-Seo KimBon-Ki KooSang-Kyun Kim
Parameter set for effective and consistent color reproduction
14629 Gwo Giun Lee Functional units of AVC inter prediction for
28
He-Yuan LinMing-Jiun Wang RVC video tool library
14630Gwo Giun LeeHe-Yuan LinMing-Jiun Wang
A CAL-based conformance testing environment for RVC video tool library
14631 Hideaki KimataShinya Shimizu
Proposal on MVC Requrements for different cameras
14632Kenji OtoiYoshihisa YamadaKohtaro Asai
Proposed text of the RVC FUs for MPEG-4 AVC and MPEG-2
14633
Taejin LeeMinje KimJeongil SeoKyeongok KangYoungcheol ParkHochong Park Kim Rin Chul
Report on Speech and Audio Coding Listening Test at ETRI
14634Ying ChenYe-Kui WangMiska M. Hannuksela
On MVC file format
14635
Weon-Geun OhIk-Hwan ChoA-Young ChoJun-Woo LeeJu-Kyoung JinDong-Seok Jeong
New Proposal and experiment result for VCE-6
14636 Min-Jeong LeeHeung-Kyu Lee
Cross verification result for ETRI VCE-6 proposal
14637Sang-ki KimHyobin LeeSangyoun Lee
CE Report for VCE-5
14638
Yo-Sung HoKwan-Jung OhCheon LeeSangBeom LeeSan-Tae Na
Depth Map Generation and Depth Map Coding for MVC
14639Yo-Sung HoKwan-Jung OhCheon Lee
Geometrical Compensation for MVC
14640
Hee-Cheol SeoMiran ChoiHyunki KimMyung-Gil JangSoojong LimJeong HeoYeo-Chan Yoon
Weak Points of Current MPEG-7 Query Format Schema
29
14641Masanori SanoHideki SumiyoshiNobuyuki Yagi
A proposal for MP7QF based on QueryCondition part
14642 Pierfrancesco Bellini;Paolo Nesi Updated SMR conformance bitstreams
14643 Pierfrancesco Bellini;Paolo Nesi Updated SMR reference Software
14644 Houari SabirinMunchurl Kim
Proposed text for Protected Musical Slide Show MAF PDAM
14645 Houari SabirinMunchurl Kim
MPEG-7 core description profile and visual descriptors for Video Surveillance MAF
14646 Kazuya Takeda SLPA (Selective Listening Point Audio) for FTV Audio
14647 Toshiaki Fujii Proposal on EE for FTV
14648Toshiaki FujiiHideaki KimataShigeyuki Sakazawa
Requirements for FTV
14649 Hyouk Jean Chaon behalf of KNB
KNB preliminary comments on 23000-8 CD Portable video player MAF
14650NezanM. Raulet O. Déforges
PREESM in the RVC framework
14651Thomas RathgenPeter AmonAndreas Hutter
On the SVC File Format
14652
Khaled MamouNikolce StefanoskiTitus ZahariaJörn OstermannFrançoise Prêteux
FAMC’s layer-based scalable extension
14653
Khaled MamouNikolce StefanoskiTitus ZahariaJörn OstermannFrançoise Prêteux
FAMC: bitstream description for the layer-based scalable extension
14654
Khaled MamouTitus ZahariaFrançoise PrêteuxNikolce StefanoskiJörn Ostermann
FAMC with progressive transmission and scalable rendering functionalities
14655Raulet MickaëlPelcat MaximeBlestel Médéric
From AVC to SVC: minor and major modifications in a RVC decoder implementation
14656 Osamu Shimada A proposal for an additional SAOC
30
Toshiyuki NomuraAkihiko SugiyamaOsamu Hoshuyama
functionality of separating real-environment signals
14657Hyungyu KimChungku YieEuee S. Jang
Result of RVC CE 1.1
14658
Sunyoung LeeJaebum JunSinwook LeeByoungjun KimHyungyu KimChungku YieEuee S. Jang
CDDL-Based decoder description for constructing ADM and syntax parsing
14659 Hyon-Gon ChooFilippo Chiariglione Requirements for XML IPMP Messages
14660 Jean Le FeuvreJean-Claude Dufourd On LASeR BitStream Exchange
14661Matthias GruhneMario DoellerIngo Wolf
Proposal for the MP7QF Query Management Tools
14662 Jean Le FeuvreCyril Concolato BIFS and LASeR harmonisation
14663 Next Generation Broadcasting Standard Forum Korea Revised requirement for Stereoscopic MAF
14664 Next Generation Broadcasting Standard Forum Korea
Proposal for technical specification of Stereoscopic MAF
14665 Next Generation Broadcasting Standard Forum Korea
Requirement for Packaged media Stereoscopic MAF
14666 Hyon-Gon Choo;Filippo Chiariglione;
Study on ISO/IEC 29116 FCD Media Streaming MAF Protocol
14667 Jani PeltotaloMiska M. Hannuksela
Comments on Amd2 of ISO base media file format
14668JungHoe KimMiyoung KimEunmi Oh
Listening test results for Exploration of Speech and Audio Coding
14669Oliver HellmuthJuergen HerreLeonid Terentiev
Report on Spatial Audio Object Coding Subjective Tests at Fraunhofer IIS
14670
Miyoung KimJungHoe KimMyungHoon LeeJeongil Seo
Status of BSAC Extension Conformance and Reference Software
14671 Miyoung KimEunmi Oh
Crosscheck of FT Core Experiment on AAC-ELD
31
14672Mario DoellerMatthias Gruhne Ingo wolf
Proposal for additional Query Types and Operators for MP7QF
14673 Kelvin Lee Updated status of SLS conformance
14674 Jooyoung LeeHyon-Gon Choo Study of TuC on IPMP XML Messages
14675 Kota IwamotoRyoma Oami
Revision of the Core Experiment Description for VCE-7
14676K. GrünebergTh. Schierl Th. Wiegand
Proposal for MPEG-2 Transport Stream Extensions for Scalable Video Coding
14677 Kota IwamotoRyoma Oami
Suggestion of Dataset Size Reduction for VCE-7
14678
Jihun ChaYoung-Kwon LimWon-Sik CheongYeSun JoungKyungAe Moon
Request of user defined values for the predefined SLConfigDescriptor
14679 Kota IwamotoRyoma Oami Contribution to the Test Dataset for VCE-7
14680
Jihun ChaYoung-Kwon LimWon-Sik CheongYeSun JoungKyungAe Moon
First ideas on the harmonization of BIFS and LASeR
14681Gavin SchutzTeruhiko SuzukiMike Dolan
Reply to 29n8427 on MPEG-2 Systems DCOR1
14682Diego GibellinoGiovanni CordaraJean-Claude Dufourd
On LASeR Main Profile
14683 Gavin SchutzThomas Edwards
Liaison on 29n8430 - ISO Base Media File Format - URI Identified Metadata
14684 Jeroen KoppensWerner Oomen
Report on Spatial Audio Object Coding Subjective Tests at Philips
14685 Frans de BontWerner Oomen
MPEG-1/2 Layer 1/2 over MPEG-4 conformance bitstreams
14686 Gavin Schutz Liaison input on 29n8435 - RVC
14687 Karol Wnukowicz Cross verification report of the experiments on image signature (VCE-6)
14688 Jeroen KoppensWerner Oomen
Philips cross-check results of subjective quality of AAC-ELD
14689 Ruben Tous Proposal for new Query Operators in MP7QF
32
Jaime Delgado
14690 Ruben TousJaime Delgado
Proposal for the new JOIN operation in MP7QF
14691
Saar De ZutterFrederik De KeukelaereGerrard DruryChristian TimmererXin Wang
Editors' input to ISO/IEC FDIS 21000-8 Reference Software (2nd edition)
14692 Karol WnukowiczWladyslaw Skarbek
A proposal for image signature based on trajectory of features
14693 Andreas SchneiderHeiko Purnhagen Update on MPEG surround conformance
14694Andreas SchneiderHeiko PurnhagenAlex Groeschel
Proposed correction to MPEG-4 audio conformance
14695 Leonid Terentiev Report on Spatial Audio Object Coding Subjective Tests at Fraunhofer IIS
14696
Jonas EngdegårdLars VillemoesHeiko PurnhagenOliver HellmuthAndreas HölzerKarsten LinzmeierJeroen Breebaart
CT/Fraunhofer IIS/Philips Submission to the SAOC CfP
14697
Heiner Kirchhoffer Detlev Marpe Khaled Mamou Karsten Müller Thomas Wiegand
Proposed Modifications to Residual Coding Part of Frame-based Animated Mesh Compression
14698Stefan DöhlaHerbert ThomaHarald Fuchs
On CTS-Offset and hierarchical B-frames in ISO media file format
14699
Fons BrulsJan van der MeerChris Varekamp Arnaud BourgeYann Picard
Additional Requirements for stereoscopic video in MPEG-C part 3
14700
Fons Bruls Jan van der MeerChris Varekamp Arnaud BourgeYann Picard
Proposal to amendment MPEG-C Part 3
14701 Kristofer KjörlingHeiko Purnhagen
Proposed additional test-items for the speech and audio exploration.
14702 Kristofer Kjörling Additional corrections for the defect report
33
Heiko PurnhagenJeroen KoppensMatthias Neusinger
on MPEG Surround.
14703 Jonas EngdegårdHeiko Purnhagen
Report on Spatial Audio Object Coding Subjective Tests at Coding Technologies
14704 David VirettePierrick Philippe
Listening test results for Speech and Audio Coding exploration
14705 FrNB Preliminary comments on ISO/IEC 14496-3:2005/FPDAM9
14706Quqing Chen [email protected] Zhi-bo ChenLouis Chevallier
Requirement of Video Annotation
14707
Jaime DelgadoMarc GauvinEva RodriguezVictor Rodriguez
Requirements for a Machine Readable Rights Ontology
14708Davide RogaiPierfrancesco BelliniPaolo Nesi
Input to AhG on MPEG-21 DID Review
14709Fredrik HennPer EkstrandArijit Biswas
Coding Technologies cross-check of AAC-ELD subjective audio quality
14710
Marius Preda Ivica Arsov Blagica Jovanova Françoise Preteux
Compression performances of MPEG-4 3D Graphics for large databases
14711Marius Preda Blagica Jovanova Françoise Preteux
MPEG-4 3D graphics tools for third party scene representation
14712Marius Preda Remi Arnaud Francoise Preteux
Support for an RF profile for MPEG-4 3D graphics by COLLADA
14713 Paul BrasnettMiroslaw Bober
Further Improvements to the Image Identifier XM (VCE6)
14714 Xin Wang An Update on IPTV Requirements
14715 Florian Schreiner Chun Hui Suen
Contribution to ISO/IEC FCD 23000-7 Open release
14716 Yuriy A. ReznikRavi Chivukula
Listening test results for speech-audio coding explorations
14717 Jaeyeon SongYoung-kwon Lim The first ideas on LASeR in IPTV
14718Mauri VaananenJuha OjanperaMiikka Vilermo
On the conformance of AAC decoders with LTP tool
34
14719 Thomas Edwards Proposed SMPTE 2029 - Uniform Resource Names for SMPTE Resources
14720 David VirettePierrick Philippe
Additional information for AAC-ELD instantaneous block switching CE
14721 Lazar BivolarskiYuriy A. Reznik ISO/IEC 23002-2 in RVC Implementation
14722 Lazar Bivolarski ISO/IEC 23002-1 IDCT Implementation in CAL Testbed Update
14723Markus Schmidt Markus Schnell Ralf Geiger
Listening test results for AAC-ELD
14724 Markus Schnell Fredrik Henn Proposed Changes for AAC-ELD
14725 Ralf Geiger Jürgen Herre
On the sensitivity of T-Tests for MUSHRA Scores
14726
Ralf Geiger Markus Schnell Jürgen Herre Manfred Lutzky Kristofer Kjörling
Proposed Annex for AAC-ELD: Delayless Mixing
14727
Ralf Geiger Stephan Schreiner Virgilio Bacigalupo Markus Lohwasser Tobias Albert
On the Complexity of Block Switching
14728 Markus Schnell Ralf Geiger
Proposed Update on AAC-ELD Filterbank Description
14729
Ralf Geiger Ralph Sperschneider Manfred Lutzky Jürgen Herre Kristofer Kjörling Heiko Purnhagen
Proposed Profile for AAC-ELD
14730Hui Yong KimHyon-Gon ChooMunchurl Kim
(Editors' Input) Updated text of FCD 23000-9 MAF for DMB
14731
Eunmi OhJungHoe KimKiHyun ChooHosang SungMiyoung Kim
Response to CfI on speech and audio coding
14732 Seung Jun YangHui Yong KimHeekyung LeeHan-Kyu Lee
Updated proposal on TV-Anytime Metadata in ISO/IEC 23000-9 MAF for DMB
35
Munchurl KimYong Han Kim
14733Yang-Won JungHenney OhHyo Jin Kim
LGE Submission to SAOC CfP
14734
Henney OhYang-Won JungDongSoo KimHyunKook Lee
LGE Listening test report on SAOC RM selection
14735Henney OhYang-Won JungHyo Jin Kim
Comments on SAOC evaluation
14736 Sihyoung Lee, Seungji Yang, Yong Man Ro, Enhancement of PVP MAF for e-learning
14737
Dong Soo KimHyun-Kook LeeHee-Suk PangHenney OhYang-Won Jung
Listening Test results on Speech and Audio Exploration
14738 Kyoungro YoonMario Doeller
Report of the Ad-hoc Group on MPEG-7 Query Fomat
14739 Christophe Lucarz Simulator in the Eclipse environment for RVC
14740 ITU-T SG 9 via SC 29 Secretariat Liaison Statement from ITU-T SG 9 [SC 29 N 8597]
14741 DVB via SC 29 Secretariat Liaison Statement from DVB [SC 29 N 8598]
14742 French National Body French NB comment on AFX profiling
14743 Paul BrasnettMiroslaw Bober
VCE-6 Experimental Conditions following Reflector Discussions
14744 Kyoungro YoonMario Doeller
AHG's Input for SoCD on MPEG-7 Query Format
14745
Tae-Beom LimKyoungro yoonJongseol LeeSaim ShinSeokPil Lee
Proposal for arithmetic and comparison operators
14746Patrick GioiaAnne Le BrisRomain Cavagna
Report on CE2: Space Partitioning Implementation in IM1
14747 Joseph Thomas-Kerr Report on CE on RMC Bitstream Syntax Description
14748 Gero Bäse none Thomas Rathgen Video Surveillance MAF file and camera identification
36
14749 Chrisa TsinarakiStavros Christodoulakis
Shortcomings of the current MP7QF Query Output Format
14750 Chrisa TsinarakiStavros Christodoulakis MP7QF Conditions & Operators
14751 the DVD Forum via SC 29 Secretariat Liaison Statement from the DVD Forum [SC 29 N 8602]
37
Annex D – Output documents
No. Source Title
9154 Convener List of Documents from the Lausanne, Switzerland Meeting
9155 Convener Resolutions of the Lausanne, Switzerland
9156 Convener List of AHGs Established at the 81st Meeting in Lausanne, Switzerland
9157 Convener Report of the 81st Meeting in Lausanne, Switzerland
9158 Convener Guidelines for Electronic Distribution of MPEG and WG 11 Document
9159 Convener Press Release of the 81st Meeting in Lausanne, Switzerland
9160 Convener Meeting Notice of the 82nd Meeting in Shenzhen, China
9161 HoD Guide for WG 11 Meeting Hosts
9162 HoD MPEG 101
9163 Requirements Multiview Video Coding Requirements
9164 Requirements MAFs Overview
9165 Requirements Call for Requirements on Professional Archival MAF
9166 Requirements Requirements for additional XML IPMP Messages
9167 Requirements IPTV Requirements
9168 Requirements Preliminary FTV Model and Requirements
9169 Requirements Metaverse: Context & Objectives
9170 Convener AHG on FTV
9171 Convener AHG on Ontologies
9172 MDS Study of ISO/IEC CD 15938-12 Query Format
9173 MDS TuC for MPEG Query Format v2.0
9174 MDS Schema Files for MPEG-21 Standards (v7)
9175 MDS DID Open Issues
9176 MDS Workplan for CE on DI Semantics
9177 MDS MPEG-21 REL Profiles Software Implementation Plan v.7
9178 MDS DoC for ISO/IEC FCD 21000-8 Reference Software 2nd Edition
9179 MDS Text of ISO/IEC FDIS 21000-8 Reference Software 2nd Edition
9180 MDS Request for Amendment 1 of ISO/IEC 21000-15 Security in ER
9181 MDS ISO/IEC PDAM/1 21000-15 Security in ER
9182 MDS Study of ISO/IEC FCD 23000-5 Media Streaming MAF
9183 MDS Study of ISO/IEC FCD 23000-7 OR Application Format
9184 MDS MPEG-21 DIA 2nd Edition Tutorial Presentation
9185 Convener AHG on MPEG Query Format
38
9186 Convener AHG on Review of the MPEG-21 DI
9187 ISG Study of “ISO/IEC DTR 14496-9 3rd Edition Reference Hardware Description”
9188 Convener AHG on MPEG-4 Part 9: Reference Hardware Description Phase 1 and 2.
9189 Testing SVC Verification Test Plan Version 1
9190 Convener AHG number for the AHG on SVC Verification Testing
9191 Video Text of ISO/IEC 14496-4:2004/PDAM 30 Conformance Testing for New Profiles for Professional Applications
9192 Video Text of ISO/IEC 14496-4:2004/PDAM 31 Conformance Testing for SVC Profiles
9193 Video Text of ISO/IEC 14496-5/Amd.1/DCOR 1
9194 Video Text of ISO/IEC 14496-5:2001 / PDAM 18 Reference Software for New Profiles for Professional Applications
9195 Video Text of ISO/IEC 14496-4:2001 / PDAM 19 Reference Software for SVC
9196 Video Disposition of Comments on ISO/IEC 14496-10:2005 / FPDAM 3
9197 Video Text of ISO/IEC 14496-10:2005 / FDAM 3 Scalable Video Coding
9198 Video Text of ISO/IEC 14496-10:200X / FDIS Advanced Video Coding (4th edition)
9199 Video Joint Scalable Video Model (JSVM) 11
9200 Convener Terms of Reference
9201 Convener MPEG Standards
9202 Convener Table of unpublished FDIS
9203 Convener Work plan and time line
9204 Convener Work item assignment
9205 Convener MPEG Standard Editors
9206 Convener Software assets
9207 Convener Conformance assets
9208 Convener Content assets
9209 Convener URI assets
9210 Convener Standards under development for which a call for patent statements is issued
9211 Convener List of Organisations with which MPEG entertains liaisons
9212 Video JSVM 11 Software
9213 Video Text of ISO/IEC 14496-10:2005 / PDAM 4 Multiview Video Coding
9214 Video Joint Multiview Video Model (JMVM) 5
9215 Video JMVM 5 Software
9216 Video Call for Proposals on Image and Video Signature Tools
9217 Video MPEG-7 Visual XM Document version 31.0
9218 Video Description of Core Experiments for MPEG-7 New Visual Extensions
39
9219 Video Disposition of Comments on ISO/IEC TR 15938-8:2002 / DAM 3
9220 Video Text of ISO/IEC TR 15938-8:2002/Amd.3 (Technologies for digital photo management using MPEG-7 visual tools)
9221 Video Disposition of Comments on ISO/IEC 23000-3 / PDAM 1
9222 Video Text of ISO/IEC 23000-3 / FPDAM 1 Reference Software for Photo Player MAF
9223 Video WD 5 of ISO/IEC 23001-4 Codec Configuration Representation
9224 Video WD 5 of ISO/IEC 23002-4 Video Tool Library
9225 Video Description of Core Experiments in RVC
9226 Video RVC Simulation Model (RSM) V5.0
9227 Video RVC Work Plan
9228 Video RVC Conformance Testing Working Draft 2.0
9229 Video Description of Exploration Experiments for Toolbox Extensions
9230 Video Description of Exploration Experiment in FTV
9231 Convener AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance
9232 Convener AHG on Reconfigurable Video Coding
9233 Convener AHG on MPEG-7 Visual and Photo Player MAF
9234 Convener AHG on Video Annotation
9235 Audio ISO/IEC 14496-3:2006/AMD2:2006/Dcor 3, ALS
9236 Audio Study on ISO/IEC 14496-3/DCOR 5, DST and MP3on4 and LTP
9237 Audio Technology under consideration for AAC-ELD
9238 Audio Workplan for AAC-ELD
9239 Audio WD on ISO/IEC 14496-3, MPEG-4 Audio Fourth Edition
9240 Audio DoC on 14496-4:2004/PDAM 29, SMR Conformance
9241 Audio ISO/IEC 14496-4:2004/FPDAM 29, SMR Conformance
9242 Audio ISO/IEC 14496-4:2004/AMD13:2007/DCOR 1, LD AAC test sequences
9243 Audio ISO/IEC 14496-4:2004/DCOR 5, Audio Corrections
9244 Audio Study on ISO/IEC 14496-4:2004/FPDAM 20, SLS and MPEG-1/2 on MPEG-4 Conformance
9245 Audio Status of SLS conformance
9246 Audio Status of BSAC Extension Conformance and Reference Software
9247 Audio Study on ISO/IEC 14496-5:2001/AMD 10:2007/DCOR 1, BSAC and SLS, ALS Corrections
9248 Audio Study on ISO/IEC 14496-5:2001/PDAM 20, MPEG-1 and -2 on MPEG-4 and BSAC Extensions
9249 Audio ISO/IEC 23003-1:2007/DCOR 1
40
9250 Audio Report on Spatial Audio Object Coding CfP Selection
9251 Audio First thoughts on SAOC Verification Test
9252 Audio Report on Evaluation of Speech and Audio Framework
9253 Audio Workplan for Exploration of Speech and Audio Coding
9254 Audio Framework for Exploration of Speech and Audio Coding
9255 Audio Draft Call for Proposals on Joint Speech and Audio Coding
9256 Convener AHG on Audio Standards Maintenance
9257 Convener AHG on AAC-ELD, Speech and Audio Exploration and SAOC
9258 3DGC Study Text of ISO/IEC 14496-4:2004/ FPDAM21 (Geometry and Shadow Conformance)
9259 3DGC Request for Amendment of ISO/IEC 14496-4:2004 (FAMC Conformance)
9260 3DGC WD 1.0 of ISO/IEC 14496-4:2004 AMD32 (FAMC Conformance)
9261 3DGC Request for Amendment of ISO/IEC 14496-4:2004 (MultiResolution Profile Conformance)
9262 3DGC WD 1.0 of ISO/IEC 14496-4:2004 AMD33 (MultiResolution Profile Conformance)
9263 3DGC Study Text of ISO/IEC 14496-5:2001/ FPDAM13 (Geometry and Shadow RefSoft)
9264 3DGC Request for amendment of ISO/IEC 14496-5:2001 (FAMC RefSoft)
9265 3DGC WD1.0 of ISO/IEC 14496-5:2001 AMD21 (FAMC RefSoft)
9266 3DGC Text of ISO/IEC 14496-16:2006/PDAM2 (Frame-based Animated Mesh Compression)
9267 3DGC Text of ISO/IEC 14496-16:2006/PDAM3 (3D MultiResolution Profile)
9268 3DGC 3D Graphics Core Experiments Description
9269 3DGC 3D Graphics Compression FAQ 20.0
9270 3DGC WD 2.0 of ISO/IEC 14496-25
9271 3DGC DoC on ISO/IEC 14496-25
9272 Convener AHG on InvestigatingVideo Standardization by Applications
9273 Systems Request ISO/IEC 13818-1/Amd.3 Carriage of SVC in MPEG-2 Systems
9274 Systems Text of ISO/IEC 13818-1/PDAM3 Carriage of SVC in MPEG-2 Systems
9275 Systems Text of ISO/IEC 14496-4/FPDAM 22 AudioBIFS v3 Conformance
9276 Systems Study Text of ISO/IEC 14496-4/FPDAM 25 LASeR & SAF V1 Conformance
9277 Systems Request for ISO/IEC 14496-4/Amd.27 LASeR V2 Conformance
9278 Systems Text of ISO/IEC 14496-4/PDAM 27 LASeR V2Conformance
9279 Systems DoC of ISO/IEC 14496-5/PDAM 16 Symbolic Music Rep. Reference Software
9280 Systems Text of ISO/IEC 14496-5/FPDAM 16 Symbolic Music Rep. Reference Software
41
9281 Systems DoC of ISO/IEC 14496-5/PDAM 17 LASeR v1 Reference Software
9282 Systems Text of ISO/IEC 14496-5/FPDAM 17 LASeR v1 Reference Software
9283 Systems Text of ISO/IEC 14496-15/FPDAM 2 (SVC File Format)
9284 Systems Study Text of ISO/IEC 14496-20/FPDAM 2 (SVGT1.2 Support)
9285 Systems Study of ISO/IEC 14496-20/DCOR2
9286 Systems TuC for ISO/IEC 14496-20/Amd.2
9287 Systems WD4.0 of ISO/IEC 14496-20 2nd Edition (1st Ed. + Cor 1 + Amd.1)
9288 Systems IuC for LASeR
9289 Systems Request of ISO/IEC 23000-4/ Musical Slide Show 2nd Edition
9290 Systems Text of ISO/IEC 23000-4/CD Musical Slide Show 2nd Edition
9291 Systems WD1.0 of ISO/IEC 23000-4/Amd.1 MSS MAF Conf. and Ref. Software
9292 Systems Study Text of ISO/IEC 23000-8/CD Portable Video Player
9293 Systems Study Text of ISO/IEC 23000-9/FCD (MAF for DMB)
9294 Systems TuC on MAF for DMB
9295 Systems Text of ISO/IEC 23000-10/CD (Video Surveillance MAF)
9296 Systems DoC on ISO/IEC 23001-1/FPDAM2 (Prefixes and wild cards extensions)
9297 Systems Text of ISO/IEC 23001-1/FDAM2 (Prefixes and wild cards extensions)
9298 Systems Study Text of ISO/IEC 23001-3/FCD (IPMP XML Messages)
9299 Systems Text of ISO/IEC 23004-8/CD Reference Software and Conformance
9300 Systems M3W Reference Software and Conformance Plan
9301 Systems Study Text of ISO/IEC 29116-1/FCD Media Streaming MAF Protocol
9302 Systems A project to exploit MPEG standards in tune with industry practices and needs (Revised version)
9303 Convener Ad Hoc Group on Scene Representation
9304 Convener Ad Hoc Group on MPEG File Formats
9305 Convener Ad Hoc Group on MAF Under Development in Systems
9306 Convener AHG on 3DG documents, experiments and software maintenance
9307 Systems TuC on ISO/IEC 14496-12
9308 Systems TuC on ISO/IEC 14496-15 (MVC extensions)
9309 Liaison Liaison Statement to AES
9310 Liaison Liaison Statement to ITU-T re Joint Speech & Audio Coding
9311 Liaison Liaison Statement to 3GPP re Joint Speech & Audio Coding
9312 Liaison Liaison Statement to 3GPP2
9313 Liaison Liaison Statement to IEC TC100
9314 Liaison Liaison Statement to ITU-T IPTV Focus Group re "Toolbox for Content Coding"
42
9315 Liaison Liaison Statement to SMPTE re RVC
9316 Liaison Liaison Statement to SCTE
9317 Liaison Liaison Statement to AVS
9318 Liaison Liaison Statement to ITU-T SG9 re FTV
9319 Liaison Liaison Statement to DVB
9320 Liaison Liaison Statement to 3GPP TSG SA WG4 re DIMS/LASeR
9321 Liaison Liaison Statement to OMA
9322 Liaison Liaison Statement to ITU-T IPTV Focus Group re Presentation Formats for IPTV
9323 Liaison Liaison Statement to WG1
9324 Systems DOCR on ISO/IEC 14496-15/PDAM 2 (SVC File Format)
9325 Requirements Possible Requirements for a New Rights Ontology
9326 Liasion Responses to National Bodies
9327 Liasion List of Organisations with which MPEG entertains liaisons (as of July 2007)
43
Annex E – Requirements report
Source: Fernando Pereira (Instituto Superior Técnico, Lisboa-Portugal)
Note: Requirements agenda for the Lausanne Jose MPEG meeting is annexed at the end of this report.
1. Requirements documents approved at this meeting
N 9163 MVC RequirementsN9164 MAFs OverviewN9165 Call for Requirements on Professional Archival MAFN9168 Preliminary FTV Model and RequirementsN9166 Requirements for Additional XML IPMP MessagesN9167 IPTV RequirementsN9169 Metaverse: Context and ObjectivesN9325 Revised Requirements for a Machine Readable Rights Ontology
2. MPEG-4
2.1. Multiview Video Coding (MVC) (joint with Video)14631, Hideaki Kimata, Shinya Shimizu, Proposal on MVC Requirements for different cameras The MVC requirements additions proposed in this contribution have been included in the MVC Requirements doc (N9163).
2.2. 4:4:4 Content Coding (joint with Video)14615, Tokumichi Murakami, Kohtaro Asai, Shun-ichi Sekiguchi, Shuic, Requirement of Real-Color Video Coding for Consumer Application This contribution claims that 4:4:4 coding is becoming more and more competitive regarding 4:2:0 coding, notably for consumer applications. As such, there is a need to study the 4:4:4 coding performance in existing AVC profiles with 4:4:4 coding capabilities. Based on collected evidence, actions may have to be proposed, e.g. a new level in existing profile or even a new profile.
2.3. Laser (joint with Systems)14682, Diego Gibellino, Giovanni Cordara, on LASeR Main ProfileThis contribution brought support to the definition of the Laser Main profile and to the removal of the Laser Full profile. Following this, it was decided to promote the Main profile to a Laser amendment. The current Laser profiling situation is thus:Version 1: MINI profile (FULL profile has been removed)Version 2: CORE profile hierarchical to MINI & MAIN profile hierarchical to CORE
44
3. MPEG-7
3.1. Video and Image Signatures (joint with Video)After MPEG identified the need for unique visual descriptions to support a number of applications related to the detection of duplicated visual media, experiments have shown that existing MPEG-7 visual descriptors do not fulfill all the requirements of a visual signature descriptor. Following this observation, requirements for image and video signatures have been defined, notably uniqueness, robustness, independence, fast matching, fast Extraction and compactness. Based on these requirements, a Call for Proposals with different deadlines for image (October 2007) and video (April 2008) signatures has been issued at this meeting.
3.2. Video Annotation (joint with Video)14706, Quqing Chen, Zhi-bo Chen, Requirement of Video AnnotationNone of the authors was present at the meeting to present this contribution.
4. MPEG-21
4.1. Digital Item Declaration14559, Gerrard Drury Giovanni Cordara, AHG on Review of MPEG-21 DIDThis contribution reported the conclusions of the AHG on MPEG-21 DID which targeted 1. Investigate whether the current DID (ISO/IEC 21000-2) requirements fit with today’s industry, and if not review the requirements.2. Collect information on how DID is currently used.3. Identify current deficiencies with DID and propose ways to address these deficiencies.4. Investigate feasibility of producing royalty-free DID.
14611, Pedro Carvalho, Helder Castro, Maria Teresa Andrade, Giorgiana Ciobanu, Christian Timmerer, Hermann Hellwagner, Input to AHG on Review of MPEG-21 DID This contribution reports an analysis of the fulfillment of the MPEG-21 DID requirements by the DID specification made by experts of the ENTHRONE project.
14708, Davide Rogai, Pierfrancesco Bellini, Paolo Nesi, Input to MPEG-21 DID ReviewThis contribution reports another analysis of the fulfillment of the MPEG-21 DID requirements by the DID specification made by experts of the AXEMIS project.
Following the contributions above, it was decided to: 1. Define the first DI Interoperability Experiment to learn while using ‘real DIs’ (see MDS report) 2. Issue a document with DID Open Issues, notably DI & file format and DI presentation (see
MDS report)
4.2. Rights Ontologies (joint with MDS)14707, Jaime Delgado, Marc Gauvin, Requirements for a Machine Readable Rights OntologyThis contribution proposed some requirements for a possible new rights ontology. Following the discussions, it was decided there was a need to define more precisely the requirements with examples and a need to understand the relation with existing relevant MPEG standards, notably REL and RDD. If possible, it would be useful to define the model used to derive the proposed requirements.
45
After a couple of joint meetings with MDS, it was decided to create an AHG with the task to discuss and refine the possible new requirements based on output document N9325. This document contains the result of the discussions made during the week in the sessions dedicated to the topic addressed in this document based on input document m14762. Its content does not currently reflect the consensus within MPEG.
5. MPEG-A
5.1. Professional Archival MAF14612, Xin Wang, Security and DRM Requirements for Professional Archival MAF 14613, Noboru Harada, Takehiro Moriya, Yutaka Kamamoto, Updated overview document for Professional Archival MAF
These contributions brought revised requirements for the Professional Archival MAF. However, it was still felt there is a further need to refine and focus the requirements for this MAF as well to gather enough critical mass for the technical development of this MAF. Recognizing that multimedia archival is an important application domain and Multimedia Applications Formats (MAFs) may play a relevant role in bringing some degree of interoperability to this domain, the Requirements subgroup is calling for requirements related to all applications in the area of multimedia archival. With that purpose, a Call for Requirements has been issued at this meeting (N9165).
5.2. Stereoscopic MAF14663, Next Generation Broadcasting Standard Forum Korea, Revised requirement for Stereoscopic MAF 14664, Next Generation Broadcasting Standard Forum Korea, Proposal for technical specification of Stereoscopic MAF 14665, Next Generation Broadcasting Standard Forum Korea, Requirement for Packaged media Stereoscopic MAF This set of contributions brought further input regarding the Stereoscopic MAF promoted to ‘under consideration’ at last meeting. The authors proposed two MAFs derived from the previous Stereoscopic MAF, the so-called ‘Mobile stereoscopic’ MAF and ‘High resolution stereoscopic’ MAF. Regarding, the so-called ‘Mobile stereoscopic’ MAF there is a need to complete the missing requirements; regarding the so-called ‘High resolution stereoscopic’ MAF, there is a need to bring precise requirements to understand its precise application domain target and the difference regarding the so-called ‘Mobile stereoscopic’ MAF.
5.3. Cross-Media Interactive Presentation MAF14604, Davide Rogai, Pierfrancesco Bellini, Paolo Nesi, Cross-Media Interactive Presentation This contribution proposed the Cross-Media Interactive Presentation MAF which by consensus was promoted to ‘under consideration’.
5.4. Summary on MAFsThe global MAF situation after the Lausanne Jose MPEG meeting is summarized in the MAFs Overview document (N9164) as follows:
1. MAFs Finalizeda. Music Player MAF (including protection) b. Photo Player MAF
46
c. Musical Slide Show MAF (without protection)2. MAFs Under Development
a. Photo Player MAF (under Video) b. Musical Slide Show MAF, including protection (under Systems) c. Media Streaming MAF (under MDS) d. Professional Archival MAF (under MDS) e. Open Release MAF (under MDS) f. Portable Video Player MAF (under Systems) g. MAF for Digital Multimedia Broadcasting (under Systems)h. Video Surveillance MAF (under Systems)
3. MAFs Under Considerationa. Advanced Surveillance MAFb. Protected Photo Player MAFc. Digital Video/Cinema MAFd. Stereoscopic MAFe. Cross-Media Interactive Presentation
The MAFs under consideration for which there was no input in recent meetings may be removed from this status at next MPEG meeting.
6. MPEG-B
6.1. XML IPMP Messages14659, Hyon-Gon Choo, Filippo Chiariglione, Requirements for XML IPMP Messages Ontologies This contribution proposed requirements for additional XML IPMP messages. XML IPMP Messages are simple and natural extensions to the current IPMP Information Descriptor defined in ISO/IEC 21000-4 (IPMP Components). XML IPMP Messages are extensions of binary IPMP-X messages to XML messages. The additional XML IPMP Messages requirements have been approved. Additional XML IPMP Messages will be specific in MPEG-B Part 3.
7. MPEG-C
7.1. Part 3
7.2. 14699, Fons Bruls, Jan van der Meer, Chris Varekamp, Arnaud Bourge, Yann Picard, Additional Requirements for stereoscopic video in MPEG-C part 3
This contribution proposed some changes to the requirements for Stereoscopic Video (MPEG-C part 3). Following the discussions, it was concluded that no changes to the requirements were needed.
8. Explorations
8.1. Freeviewpoint Television (FTV)14560, Hideaki Kimata, Karsten M.ler, AHG on FTV (Free Viewpoint Television)
47
14648, Toshiaki Fujii, Hideaki Kimata, Shigeyuki Sakazawa, Requirements for FTV14626, Taka Senoh, Kenji Yamamoto, Ryutaro Oi, Tomoyuki Mishina, Makoto Okui, Consideration of image depth informationThese contributions brought inputs for the improvement of the ‘Preliminary FTV Model and Requirements’ document from last meeting, notably in terms of:
FTV clear definition (notably difference regarding MVC) Application scenarios Basic technical approach FTV architecture and model Normative elements Requirements (overall and for each normative element)
Based on these contributions, a revised version of the ‘Preliminary FTV Model and Requirements’ document has been issued (N9168). This document still adopts a very much video centric point of view, and thus there is a strong need to improve and complete it from the audio (and eventually systems) perspective(s).
14646, Kazuya Takeda, SLPA (Selective Listening Point Audio) for FTV AudioThis contribution proposed audio FTV requirements and was presented in a joint meeting with the Audio subgroup. Following this joint meeting, the Audio subgroup drafted some FTV audio requirements which have been included in the revised version of the ‘Preliminary FTV Model and Requirements’ document.
14647, Toshiaki Fujii, Proposal on EE for FTV This contribution proposed an experiment for FTV. This input was instrumental to highlight the need to collect adequate FTV test material including accurate depth maps (or software able to extract these depth maps) and to define test conditions for the evaluation of FTV technologies.
An AHG has been created (N9170) with the purpose of improving the ‘Preliminary FTV Model and Requirements’ document, collect test material and define adequate test conditions.
8.2. Colour Reproduction Metadata14627, Maeng-Sub Cho, Jin-Seo Kim, Bon-ki Koo, Sang-Kyun Kim, Initiating a new application format for Consistent Color Reproduction 14628, Maeng-Sub Cho, Jin-Seo Kim, Bon-Ki Koo, Sang-Kyun Kim, Parameter set for effective and consistent color reproductionThese contributions addressed the problem of consistent colour reproduction in different types of displays proposing some metadata to address this problem. After discussion, it was concluded that these problem has been addressed in MPEG since a long time, notably in MPEG-1, MPEG-2, MPEG-4 and MPEG-7 for the colour description and in MPEG-21 DIA for the terminal capabilities description. The authors were encouraged to review the set of relevant available tools already specified by MPEG and make further contributions in the future if there are still needs in this area that have not been yet adequately addressed.
8.3. IPTV Requirements14714, Xin Wang, An Update on IPTV RequirementsThis contribution collects the requirements brought to MPEG by other bodies in the IPTV domain (based on the output document issued 2 meetings ago).
48
The number of requirements collected showed that MPEG needs to understand the IPTV landscape to understand what can be the core contribution of MPEG in the IPTV space.
14717, Jaeyeon Song, Young-kwon Lim, The first ideas on LASeR in IPTVThis contribution brought first ideas for Laser Requirements relevant for IPTV. One requirement has been included in the output IPTV Requirements document following the discussion of this document.
Following the discussions, it was decided to address the collected IPTV requirements in the following way: Top-Down by classifying the requirements according to the following categories:
o Not relevant for MPEG – Why ? Do we expect another body to do the work ? If yes, identify it … for possible liaison …
o Relevant for MPEG 2.1) Relevant for MPEG and already addressed – Where ? 2.2) Relevant for MPEG and to be addressed – How ? 2.3) Relevant for MPEG but not to be addressed – Why ?
Bottom-Up by directly identifying the issues more relevant for MPEG and for which there are available human resources, e.g. as already done with the Laser requirements
Following the work at this meeting, a revised version of the IPTV Requirements document has been issued (N9167).
8.4. Metaverse14760, Jean H.A. Gelissen, Metaverse Context and ObjectiveThis contribution proposed a new MPEG standardization activity based on the concept of metaverse. The Metaverse is a virtual (3D) world where people can work, interact, play, travel, learn and augment the real life. The broad acceptance of virtual words (serious games) and the relation to the real world brings emerging opportunities and challenges. A Metaverse activity would target the provision of a standardized global framework and associated interfaces, metadata definitions and the like, to enable the interoperability between virtual worlds, e.g. Second Life, and the real world.Following the discussions, it was decided to issue an output document (N9169) based on this input document with a disclaimer stating that this work is not yet endorsed by MPEG. However, MPEG recognized the importance of the issues addressed regarding opportunities for MPEG standardization and kindly asks MPEG members and the community at large to provide input contributions regarding the opportunities highlighted in this document by the next meeting.
49
9. 81st MPEG (Lausanne) Agenda Requirements
10. Room: Paris
TIME TOPIC ROOM
Monday
9:00-end Opening Plenary Meeting
Lunch
Opening and Requirements Agenda for the Week
14:00-15:00
IPTV Requirements
14714, Xin Wang, An Update on IPTV Requirements
14717, Jaeyeon Song, Young-kwon Lim, The first ideas on LASeR in IPTV
Reqs
15:00-16:00 Video and Image Identifier/Signature Requirements MPEG-7 Visual
BoG
17:00-18:00
Various (joint with Systems)
14682, Diego Gibellino, Giovanni Cordara, on LASeR Main Profile
14659, Hyon-Gon Choo, Filippo Chiariglione, Requirements for XML IPMP Messages
Reqs
18:00-20:00 HoDs Meeting HoD
50
Tuesday
9:00-12:00
Various (joint with Video)
Color
14615, Tokumichi Murakami, Kohtaro Asai, Shun-ichi Sekiguchi, Shuic, Requirement of Real-Color Video Coding for Consumer Application
14627, Maeng-Sub Cho, Jin-Seo Kim, Bon-ki Koo, Sang-Kyun Kim, Initiating a new application format for Consistent Color Reproduction
14628, Maeng-Sub Cho, Jin-Seo Kim, Bon-Ki Koo, Sang-Kyun Kim, Parameter set for effective and consistent color reproduction
MVC
14631, Hideaki Kimata, Shinya Shimizu, Proposal on MVC Requirements for different cameras
14626, Taka Senoh, kenji Yamamoto, Ryutaro Oi, Tomoyuki Mishina, Makoto Okui, Consideration of image depth information
FTV
14560, Hideaki Kimata, Karsten M.ler, AHG on FTV (Free Viewpoint Television)
14648, Toshiaki Fujii, Hideaki Kimata, Shigeyuki Sakazawa, Requirements for FTV
14647, Toshiaki Fujii, Proposal on EE for FTV
14740, Liaison Statement from ITU-T SG 9
MPEG-C Part 3
14699, Fons Bruls, Jan van der Meer, Chris Varekamp, Arnaud Bourge, Yann Picard, Additional Requirements for stereoscopic video in MPEG-C part 3
Stereoscopic MAF
14663, Next Generation Broadcasting Standard Forum Korea, Revised requirement for Stereoscopic MAF
14664, Next Generation Broadcasting Standard Forum Korea, Proposal for technical specification of Stereoscopic MAF
14665, Next Generation Broadcasting Standard Forum Korea, Requirement for Packaged media Stereoscopic MAF
Reqs
12:00-14:00 Lunch 14:00-16:00
MPEG-A
MAFs UNDER DEVELOPMENT (with MDS, Systems)
Professional Archival MAF
14612, Xin Wang, Security and DRM Requirements for Professional Archival MAF
14613, Noboru Harada, Takehiro Moriya, Yutaka Kamamoto, Updated overview document
Reqs
51
for Professional Archival MAF
MAFs UNDER CONSIDERATION (with MDS, Video, Systems)
Stereoscopic MAF
14663, Next Generation Broadcasting Standard Forum Korea, Revised requirement for Stereoscopic MAF
14664, Next Generation Broadcasting Standard Forum Korea, Proposal for technical specification of Stereoscopic MAF
14665, Next Generation Broadcasting Standard Forum Korea, Requirement for Packaged media Stereoscopic MAF
NEW MAF PROPOSALs (with MDS, Systems)
MAF on Cross-Media Interactive Presentation
14604, Davide Rogai, Pierfrancesco Bellini, Paolo Nesi, Cross-Media Interactive Presentation MAF
16:00-18:00
Various (joint with MDS)DID
14559, Gerrard Drury Giovanni Cordara, AHG on Review of MPEG-21 DID
14611, Pedro Carvalho, Helder Castro, Maria Teresa Andrade, Giorgiana Ciobanu, Christian Timmerer, Hermann Hellwagner, Input to AHG on Review of MPEG-21 DID
14708, Davide Rogai, Pierfrancesco Bellini, Paolo Nesi, Input to MPEG-21 DID Review
IPMP
14659, Hyon-Gon Choo, Filippo Chiariglione, Requirements for XML IPMP Messages
Event Reporting
14622, Eva Rodriguez, Jaime Delgado, Security requirements for Event Reporting
Ontologies
14707, Jaime Delgado, Marc Gauvin, Requirements for a Machine Readable Rights Ontology
Reqs
18:00-19:00 Liaison Meeting
Social Event
Wednesday
09:00-end plenary Plenary Meeting
12:00-13:00Various (joint with Audio)
14646, Kazuya Takeda, SLPA (Selective Listening Point Audio) for FTV Audio
Requirements for Joint Audio and Speech
Audio
52
Lunch
14:00-15:00Metaverse (joint with MDS)
14760, Jean H.A. Gelissen, Metaverse Context and ObjectiveReqs
15:00-17:00
Discussing DID (joint with MDS) Reqs
BoGs
Thursday
9:00-10:00
Feedback from FTV BoG
Refine the existing doc with basic approach, definition of FTV, applications scenarios and requirements
14740, Liaison Statement from ITU-T SG 9
also
14699, Fons Bruls, Jan van der Meer, Chris Varekamp, Arnaud Bourge, Yann Picard, Additional Requirement for stereoscopic video in MPEG-C part 3
Reqs
10:00-11:00
Feedback on Cfp on Visual Signatures
also
14706, Quqing Chen, Zhi-bo Chen, Requirement of Video Annotation
MPEG-7 Visual
11.00-12:00IPTV Requirements (joint with Systems)
Feedback on IPTV Requirements BoGReqs
12:00-13:00 Feedback on Ontologies BoG Reqs
Lunch
14:00-15:00Feedback on possible Call for Requirements for the Professional Archival MAF (joint
with MDS) Reqs
15:00-16:00 Feedback on DID (joint on MDS) Reqs
BoGs
18:00-end Chairs Meeting
53
Friday
9:00-9:15Concluding MPEG-4
MVC Requirements – Kimata san Reqs
- Concluding MPEG-7 Reqs
Concluding MPEG-21 Reqs
9:15-10:00
Concluding MPEG-AMAFs Overview - Florian
Professional Archival Call for Requirements – Noboru sanReqs
10:00-10:10Concluding MPEG-B
XML IPMP Messages Requirements - Filipo
10:10–11:00
Explorations
IPTV Requirements – Xin
Preliminary FTV Model and Requirements – Kimata san
AHG on FTV – Kimata san
Liaison to ITU-T SG 9 – Kimata san
Metaverse: Context & Objective – Jean + recommendation
AHG on Ontologies – Marc
Reqs
-12:00 -14:00 Lunch
14:00-end plenary Plenary Meeting
54
Annex F – Systems report
Source: Olivier Avaro (Streamezzo)Contributors: David Singer (Apple), Young-Kwon Lim (Net&TV), Jean Gelissen (Philips), Gero Baese (Siemens)
1 OverviewThe main outputs of the meeting from the Systems Sub-group perspective are:
No. Title TBP AvailableX 13818-1 MPEG-2 Systems9273 Request ISO/IEC 13818-1:2006/Amd.3 Carriage of SVC in MPEG-2 Systems No 06/07/079274 Text of ISO/IEC 13818-1:2006/PDAM3 Carriage of SVC in MPEG-2 Systems No 13/07/07X 14496-4 Conformance testing9275 Text of ISO/IEC 14496-4/FPDAM 22 AudioBIFS v3 Conformance No 06/07/079276 Study Text of ISO/IEC 14496-4/FPDAM 25 LASeR & SAF V1 Conformance No 06/07/079277 Request for ISO/IEC 14496-4/Amd.27 LASeR V2 Conformance No 06/07/079278 Text of ISO/IEC 14496-4/PDAM 27 LASeR V2Conformance No 06/07/07X 14496-5 Reference Software9279 DoC of ISO/IEC 14496-5/PDAM 16 Symbolic Music Rep. Reference Software No 06/07/079280 Text of ISO/IEC 14496-5/FPDAM 16 Symbolic Music Rep. Reference Software No 06/07/079281 DoC of ISO/IEC 14496-5/PDAM 17 LASeR v1 Reference Software No 06/07/079282 Text of ISO/IEC 14496-5/FPDAM 17 LASeR v1 Reference Software No 06/07/07X 14496-12 ISO Base Media File Format9307 TuC on ISO/IEC 14496-12 No 06/07/07X 14496-15 AVC File Format9324 DoC on ISO/IEC 14496-15/PDAM 2 (SVC File Format) No 06/07/079283 Text of ISO/IEC 14496-15/FPDAM 2 (SVC File Format) No 13/07/079308 TuC on ISO/IEC 14496-15 (MVC extensions) No 06/07/07X 14496-20 Lightweight Application Scene Representation9284 Study Text of ISO/IEC 14496-20/FPDAM 2 (SVGT1.2 Support) Yes 06/07/079285 Study of ISO/IEC 14496-20/DCOR2 No 06/07/079286 TuC for ISO/IEC 14496-20/Amd.2 No 06/07/079287 WD4.0 of ISO/IEC 14496-20 2nd Edition (1st Ed. + Cor 1 + Amd.1) Yes 06/07/079288 IuC for LASeR No 06/07/07X 23000-4 Musical Slide Show MAF9289 Request of ISO/IEC 23000-4/ Musical Slide Show 2nd Edition No 06/07/079290 Text of ISO/IEC 23000-4/CD Musical Slide Show 2nd Edition No 06/07/079291 WD1.0 of ISO/IEC 23000-4/Amd.1 MSS MAF Conf. and Ref. Software No 06/07/07X 23000-8 Portable Video Player9292 Study Text of ISO/IEC 23000-8/CD Portable Video Player No 06/07/14X 23000-9 Digital Multimedia Broadcasting Application Format9293 Study Text of ISO/IEC 23000-9/FCD (MAF for DMB) No 06/08/079294 TuC on MAF for DMB No 06/07/07X 23000-10 Video Surveillance MAF9295 Text of ISO/IEC 23000-10/CD (Video Surveillance MAF) No 13/07/07X 23001-1 Binary MPEG Format for XML9296 DoC on ISO/IEC 23001-1/FPDAM2 (Prefixes and wild cards extensions) No 06/07/079297 Text of ISO/IEC 23001-1/FDAM2 (Prefixes and wild cards extensions) No 13/07/07X 23001-3 IPMP XML Messages9298 Study Text of ISO/IEC 23001-3/FCD (IPMP XML Messages) No 13/07/07X 23004-8 Reference Software9299 Text of ISO/IEC 23004-8/CD Reference Software and Conformance No 06/07/079300 M3W Reference Software and Conformance Plan No 06/07/07X 29116-1 Media Streaming MAF Protocol
55
9301 Study Text of ISO/IEC 29116-1/FCD Media Streaming MAF Protocol No 13/07/07X Exploration9302 A project to exploit MPEG standards in tune with industry practices and needs
(Revised version)No 06/07/07
11. General issues
11.1. GeneralThe meeting report from Hangzou has been approved.The following demonstrations have been made:
None.
11.2. List of standards under developmentPr Pt Edit. Project Description CfP WD CD FCD FDIS
2 1 2006 Cor.1 Reference to AVC Specification
07/04 07/10
2 1 2006 Amd.3 SVC in MPEG-2 Systems 07/07 07/10 08/044 4 2004 Amd.23 Synthesized Texture
conformance06/07 07/01 07/04 07/10
4 4 2004 Amd.24 File Format Conformance 06/04 06/10 07/04 07/104 4 2007 Amd.25 LASeR V1 Conformance 06/04 06/10 07/04 07/104 4 2007 Amd.26 Open Font Format
Conformance07/04 07/10 08/01 08/07
4 4 2007 Amd.27 LASeR Amd.1 Conformance
06/10 07/07 07/10 08/04
4 5 2007 Amd.14 Open Font Format Ref. Soft 07/10 08/04 08/10 09/014 5 2007 Amd.16 Symbolic Music Rep. Ref.
Soft06/10 07/01 07/07 08/01
4 5 2007 Amd.17 LASeR Ref. Soft 06/10 07/01 07/07 08/014 15 2005 Amd.2 SCV File Format Extensions 05/10 06/07 07/07 08/014 20 2004 Cor.2 Profile Removal 07/04 07/104 20 2004 Amd.2 SVGT1.2 Support 05/10 07/04 07/1021 9 200x Amd.1 MP21 Mime Type 07/04 07/10 08/01A 4 200x Amd.1 MSS MAF Conf. and Soft 07/07 07/10 08/01 08/04A 4 200x Amd.2 Protected Musical Slide
Show07/04 07/07 07/10 08/04
A 8 200x 1st Ed. Portable Video Player MAF 06/10 07/04 07/10 08/01A 9 200x 1st Ed. Digital Multi. Broadcasting
MAF06/10 07/01 07/04 07/10
A 10 200x 1st Ed. Video Surveillance MAF 07/04 07/07 07/10 08/04B 3 200x 1st Ed. IPMP XML Messages 06/10 07/04 07/10E 8 200x 1st Ed. Ref. Soft. and Conformance 07/01 07/07 07/10 08/01
29116 1 200x 1st Ed. Media Streaming MAF Protocols
06/10 07/04 07/10
X 1 200x 1st Ed. MPEG eXtensible Middleware
TDB
56
11.3. Standing Documents
Pr Pt Documents No. Meeting1 1 MPEG-1 White Paper – Multiplex Format N7675 05/07 Nice1 1 MPEG-1 White Paper – Terminal Architecture N7676 05/07 Nice1 1 MPEG-1 White Paper – Multiplexing and
SynchronizationN7677 05/07 Nice
2 1 MPEG-2 White Paper – Multiplex Format N7678 05/07 Nice2 1 MPEG-2 White Paper – Terminal Architecture N7679 05/07 Nice2 1 MPEG-2 White Paper – Multiplexing and
SynchronizationN7680 05/07 Nice
2 11 MPEG-2 White Paper – MPEG-2 IPMP N7503 05/07 Poznan4 1 MPEG-4 White Paper – MPEG-4 Systems N7504 05/07 Poznan4 1 MPEG-4 White Paper – Terminal Architecture N7610 05/10 Nice4 1 MPEG-4 White Paper – M4MuX N7921 06/01 Bangkok4 1 MPEG-4 White Paper – OCI N8148 06/04 Montreux4 6 MPEG-4 White Paper – DMIF N8149 06/04 Montreux4 11 MPEG-4 White Paper – BIFS N7608 05/10 Nice4 12 MPEG-4 White Paper – ISO File Format N8150 06/04 Montreux4 14 MPEG-4 White Paper – MP4 File Format N7923 06/01 Bangkok4 15 MPEG-4 White Paper – AVC FF N7924 06/01 Bangkok4 13 White Paper on MPEG-4 IPMP N7505 05/07 Poznan4 13 MPEG IPMP Extensions Overview N6338 04/03 München4 17 White Paper on Streaming Text N7515 05/07 Poznan4 18 White Paper on Font Compression and Streaming N7508 05/07 Poznan4 20 Presentation Material on LASER N6969 05/01 Hong-
Kong4 20 White Paper on LASeR N7507 05/07 Poznan4 22 White Paper on Open Font Format N7519 05/07 Poznan7 1 MPEG-7 White Paper - MPEG-7 Systems N7509 05/07 Poznan7 1 MPEG-7 White Paper – Terminal Architecture N8151 06/04 Montreux21 9 MPEG-21 White Paper – MPEG-21 File Format N7925 06/01 BangkokB X MPEG-B White Paper – BinXML N7922 06/01 BangkokE X MPEG Multimedia Middleware Context and
ObjectivesN6335 04/03 München
E X 1rst M3W White paper N7510 05/07 PoznanE X 2nd M3W White Paper : Architecture N8152 06/04 MontreuxE X Tutorial on M3W N8153 06/04 MonreuxE X M3W White Paper : Multimedia Middleware
ArchitectureN8687 06/10 Hanzhou
E X M3W White Paper : Multimedia API N8688 06/10 HanzhouE X M3W White Paper : Component Model N8689 06/10 HanzhouE X M3W White Paper : Resource and Quality
ManagementN8690 06/10 Hanzhou
E X M3W White Paper : Component Download N8691 06/10 HanzhouE X M3W White Paper : Fault Management N8692 06/10 HanzhouE X M3W White Paper : System Integrity
ManagementN8693 06/10 Hanzhou
57
11.4. Mailing Lists Reminder
Topic Information Kindly Managed by
General Systems
List
Liste Reflector : [email protected]:
http://lists.uni-klu.ac.at/mailman/listinfo/gen-sysmailto:[email protected]?subject=subscribe
List-Archive: http://lists.uni-klu.ac.at/pipermail/gen-sysList-Help: mailto:[email protected]?subject=help
University of Klagenfurt
BiM
Liste Reflector : [email protected]:
http://lists.uni-klu.ac.at/mailman/listinfo/mpeg7-sysmailto:[email protected]?subject=subscribe
List-Archive: http://lists.uni-klu.ac.at/pipermail/mpeg7-sysList-Help: mailto:[email protected]?subject=help
University of Klagenfurt
File Format
Liste Reflector : [email protected]:
http://lists.uni-klu.ac.at/mailman/listinfo/mp4-sysmailto:[email protected]?subject=subscribe
List-Archive: http://lists.uni-klu.ac.at/pipermail/mp4-sysList-Help: mailto:[email protected]?subject=help
University of Klagenfurt
LASeR
Liste Reflector : [email protected]:
http://lists.uni-klu.ac.at/mailman/listinfo/mpeg-lasermailto:[email protected]?subject=subscribe
List-Archive: http://lists.uni-klu.ac.at/pipermail/mpeg-laserList-Help: mailto:[email protected]?subject=help
University of Klagenfurt
MAF
Liste Reflector : [email protected]:http://lists.uni-klu.ac.at/mailman/listinfo/maf-sysmailto:[email protected]?subject=subscribeList-Archive: http://lists.uni-klu.ac.at/pipermail/maf-sysList-Help: mailto:[email protected]?subject=help
University of Klagenfurt
MPEG-2 on File Format
#1: Please subscribe via http://lists.uni-klu.ac.at/mailman/listinfo/isoff-transport. Please use only that email address for posting messages with which you're subscribed. Otherwise the email won't be delivered. #2: The email address for posting messages is: [email protected]
University of Klagenfurt
58
#3: The archive is accessible via http://lists.uni-klu.ac.at/mailman/private/isoff-transport/ for list members only.
11.5. FAQThe FAQ were updated as needed.
11.6. AOBNone.
12. MPEG-2 Systems (13818-1)
12.1. 13818-1:2005 Amd.3 Carriage of SVC
12.1.1. Topics1. Transport of Scalable Video Coding
12.1.2. ContributionsM14676 and previous contribution from Marrakech in this topic: Proposal for MPEG-2 Transport Stream Extensions for Scalable Video Coding. A scaled-down version of the proposal was used to produce text of PDAM:
a. Removal of the concept and terminology of tierb. Re-use existing concepts in MPEG-2 Systems for scalability
Technical Work in Progress.
13. MPEG-4 Systems (14496-1)
13.1. 14496-1 XXX
13.1.1. Topics1. User Defined SLConfig Descriptor
13.1.2. ContributionsM14678 : Request of user defined values for the predefined SLConfigDescriptor. Decision to use the specification as it is but to use the MP4 RA for registering their pre-defined value.
Technical Work Finalized
14. MPEG-4 Conformance (14496-4)
14.1. 14496-4 Amd.22
14.1.1. Topics2. Audio BIFS Conformance
59
14.1.2. ContributionsM14581: Summary of Voting on ISO/IEC 14496-4:2004/FPDAM 22 [SC 29 N 8518].No comment. Text of FDAM was produced
Technical Work Finalized.
14.2. 14496-4 Amd.23
14.2.1. Topics1. Synthesized Texture Conformance
14.2.2. ContributionsNone.
Technical Work in Progress.
14.3. 14496-4 Amd.24
14.3.1. Topics1. File Format Conformance
14.3.2. ContributionsNone.
Technical Work in Progress.
14.4. 14496-4 Amd.25 LASeR V1 Conformance
14.4.1. Topics1. LASeR Conformance
14.4.2. ContributionsM14609: Study of ISO/IEC 14496-4/FPDAM25. Taken as input to produce updated version of the study.
Technical Work in Progress.
14.5. 14496-4 Amd.26 Open Font Format Conformance
14.5.1. Topics2. Open Font Format Conformance
14.5.2. ContributionsNone.
Technical Work in Progress.
14.6. 14496-4 Amd.27 LASeR V2 Conformance
14.6.1. Topics1. LASeR V2 Conformance
14.6.2. ContributionsNone.
Technical Work in Progress.
60
15. MPEG-4 Reference Software (14496-5)
15.1. 14496-5 Amd.14
15.1.1. Topics1. Open Font Format Reference Software
15.1.2. ContributionsNone
Technical Work in Progress.
15.2. 14496-5 Amd.16
15.2.1. Topics1. Symbolic Music Representation Reference Software
15.2.2. ContributionsM14585 : Summary of Voting on ISO/IEC 14496-5:2001/PDAM 16 [SC 29 N 8503]. See DoC.M14643 : Updated SMR reference Software. Open font format was integrated. Will be used as basis for producing the FPDAM.
Technical Work in Progress.
15.3. 14496-5 Amd.17
15.3.1. Topics1. LASeR Reference Software
15.3.2. ContributionsM14583 : Summary of Voting on ISO/IEC 14496-5:2001/PDAM 17. See DoC.M14608 : Update of LASeR Reference Software. Used as a basis for producing the FPDAM.
Technical Work in Progress.
16. ISO File Format (14496-12)
16.1. 14496-12/Amd.2
16.1.1. Topics1. Flute Hint Track
16.1.2. 14667 (Nokia) Comments on AMD2Thank you. The editor will take these into account when preparing the final publication version with the secretariat.
16.2. 14496-12 TuC
16.2.1. 14617 (Apple) Improved metabox supportThis looks interesting but more text and more study is needed:
61
a) when items are both protected and built from each other, what do the extent offset and length mean (before or after de-protection)?
b) when items are built from other items, can the targets in turn be built from items, or must they be from 'raw data' (we think the latter, like hints)
We'd like to include this in the TuC for Part12 and study how FFSec and Flute amendments could have been better (and could be in the future, via amendment), without delaying them.
16.2.2. 14698 (FhG) CTS Offsets and hierarchical B-FramesYes, this is a problem. We have two solutions:a) today's CTTS box, with a new 'offset' information which brings the CTS times back so that there is one at time zerob) a new CTTS box with signed offsets, such that one is at time 0, but with an offset box saying how far later in time to slide CTS times to align them with DTS (so that for every frame CTS is after DTS)Most people don't need CTS and DTS related, but some do.The editor to provide text into TuC on (a) if possible, as it doesn't involve re-designing, but adding (and there may be a system that already does this).The rules of how to behave in the absence of the offset need to be clear. We also need to be clear that (i) no two CTS timestamps can be the same (ii) one ends up at time 0.
16.2.3. 14683, 14719 (SMPTE) Liaison on URI-labeled metadataThank you. No response needed, it seems, and we will continue with this work.
16.3. Misc
16.3.1. 14657 AHG ReportOK.
16.3.2. High sample-rate audio conformance filesWe will patch the conformance files and submit a COR, and also in the TuC add a sentence that if the sampling rate cannot be represented in 16 bits, and the codec knows it anyway, write 0.
16.4. DVB unofficial Joint meeting
16.4.1. 14741 DVB LiaisonThank you. We will consider a response in the Friday plenary.
DVB has complex metadata storage needs. They have many kinds of metadata (DVB, TV Anytime, MPEG-7, etc.) so the support for multiple metadata containers might be needed. Also, metadata might be recorded off-air, and so temporally changing metadata may well be needed, and also it might be discontinuous (e.g. a play interrupted by a news broadcast). Timed metadata tracks, and multiple metabox support might be needed. An unofficial background document was supplied, which will be uploaded to MPEG as a supplementary document to the liaison.Questions of the validity (expiration) period of the metadata etc. arose, and particularly the interaction of timed metadata and movie fragments.It does seem as though multiple-metabox (meco) and multiple-track go together; if the metadata is combined into a DVB wrapper, then fewer, maybe one track would be needed.We explained I-based (each metadata sample stands alone), and "IP" metadata (difference frames) and searching. We also explained that movie fragments are not required to extend each track the same amount.DVB has a need for synchronized multiple timelines (which looks like it will take more exploration), derived from MHP?
62
If they go with separate boxes for different metadata kinds, there may be a need for a UUID handler type, so that proprietary unregistered metadata is possible.We indicated that our mp71 brand was probably a mistake; we explained brands as 'umbrellas', possibly having requirements on both files and readers.The DVB proposed MPEG-2 TS Hint Track was presented; then the DMB-MAF. They are similar in nature but different in detail; and they have different assumptions (single/multi-program, and encryption, for example).Multi-program streams effectively have no true ‘sync’ samples; can we provide an empty table?There are differences of detail here: what is a sample (sequence/GOP/packet)? Preceding and trailing bytes? Where is PMT/PAT? What is a sync sample? Do we allow constructors? and so on.What would we like to happen? It seems that there is general desire for a harmonious solution here and an eventual common ‘base’ specification at MPEG, which the DVB and DMB solutions could then build on.Finally, RTP recording. They want to specify a format for RTP recording that is technically identical to the RTP hint track but marked (so as to warn the reader) that they are recordings. There may be a few other points of detail (the track enabled bits etc.). Both formats (RTP and M2TS) might need “an error occurred here” (e.g. a special constructor).Proposal:We form a mailing list and mpeg ahg for “Transports and Recording in the ISO base media file format” (MP2TS and recorded RTP). Two volunteers form an analysis of differences in the M2TS proposals. We allow both DVB and DMB-MAF to go ahead on their regular schedule, and we start a fairly fast-track amendment to add an MPEG-2 TS Annex and a recorded RTP stream format to Part12.The reply liaison should attach the TuC for Part12.
17. MPEG-4 AVC File Format (14496-15)
17.1. 14496-15:2004/Amd.2
17.1.1. Topics1. SVC File Format Extensions
17.1.2. 14620 (Nokia) On the SVC File FormatIndeed, tierID goes to 16 bits, we make sure that underscores are consistent, and we deal with alignment.We accept a maximum distance on tl_switching in the group, which assures a switch (with zero implying a layer IDR). A metadata statement can say when it could be lower for a given picture.On recovery points, we agree that:
we will have a PRange box, reporting the max and min Pwe will have a DRangebox, reporting the max and min Din the DRange box, we will give the independent max T, Q for the max D, and the
independent min T,Q for the min DBoth boxes are mandatory.For Quality Layer, we agree to a metadata statement that applies to a single NAL Unit, which gives the value of the lowest Quality Layer that includes this NAL Unit. We welcome NB comments on generalizing this to make a statement about more than one NAL Unit at once (e.g. an aggregation or the whole sample). The config info box belongs as a statement in the sample entry.
63
On re-timing, this is still harder than it looks. We are not happy with metadata as it will repeat data endlessly, and also cross-linking tiers and metadata feels wrong.We're not happy with new sample tables because of issues with Part 12, movie fragments, etc.That means we'd better work out sample groups; we have a new sample group with a loop of tierID, DTSDelta pairs.On Iroi_type we certainly need a statement where it is defined, that timed metadata must be used to associate NAL units with a 24bit roi_id when iroi_type is equal to 2.
17.1.3. 14651 (Siemens/TUI) On the SVC File formatThank you. All accepted (at least in principle, with some rewording).
17.1.4. In EmailGoing through the latest version of the FF document, we found the following comments on the definition of the Operating point :
"an operating point is e.g. represented by specific values of DTQ" and "alternatively by a specific value of priority_id".
I understand that it is "e.g" but we would prefer the following type of formulation :"an operating point can be represented:
either by specific values of DTQ or by specific values of PDTQ or by specific values of P."
This would also cover the case where P is not mapped directly from DTQ but is carrying e.g. quality layers.
Regards, Isabelle.
OK, we can do an edit like this in the informative note that this is.
17.1.5. Open QuestionsFrom the JVT:
1. The NAL Unit header is re-organized and the fields re-named.2. There is a profile/level for the base layer, and a profile/level for the SVC streams3. There is a new SPS for SVC, NAL Unit type is 154. Is a stream with IDR only at the top layer a valid stream? Do we handle this case?5. Prefixes are generally allowed now; we don't need to restrict to VCL NAL Units.
New NU Header:nal_unit_header_svc_extension( ) { C Descriptor
reserved_one_bit All u(1)idr_flag All u(1)priority_id All u(6)no_inter_layer_pred_flag was layer_base_flag All u(1)dependency_id All u(3)quality_id All u(4) was u(2)temporal_id All u(3)use_ref_base_pic_flag was use_base_prediction_flag All u(1)discardable_flag All u(1)output_flag new All u(1)reserved_three_2bits All u(2)
}
Technical Work in Progress.
64
17.2. 14496-15:2004/Amd.3? MVC FF
17.2.1. Topics1. MVC File Format Extensions
17.2.2. 14634 (Nokia) On the MVC File FormatThank you. We need to call for requirements and ideas for the MVC File Format for the next meeting. In the meantime we take this as a TuC for Amd3 (MVC file format).
18. LASeR (14496-20)
18.1. 14496-20/Amd. 2
18.1.1. Topics1. Lightweight Application Scene Representation (SGVT1.2 Support)
18.1.2. ContributionsM14573 / M14574 / S4-070501 (not yet submitted): Liaison statements from 3GPP. See liaison answers.
M14610: Report of LASeR related activities in other standards organizations. For information.
M14607: Study of ISO/IEC 14496-20/FPDAM2. Adopted as a base of the study output in Lausanne.
M14660: On LASeR BitStream Exchange. Successful progress on bitstream exchange. Some clarifications were found while doing the bitstream exchange.
M14682: On LASeR Main Profile. Support for main. Accepted. Will be integrated in Amd.3.
M14662, M14680: BIFS and LASeR harmonization and First ideas on the harmonization of BIFS and LASeR. Areas of work were refined:
a) Going from LASeR scene <-> BIFS sceneb) Transcoding from LASeR profile <-> BIFS profilec) Definition of high level XML format from which BIFS and LASeR content can be produced.
Technical Work in Progress.
18.2. 14496-20/Cor 2
18.2.1. Topics1. Profile Removal
65
18.2.2. ContributionsNone.
Technical Work in Progress.
19. 21000-09 MPEG-21 File Format
19.1. MPEG-21 File Format Amendment
19.1.1. Topics1. Mime Type
19.1.2. ContributionsNone.
20. 21000-14 Conformance
20.1. MPEG-21 File Format Conformance
20.1.1. Topics1. Conformance
20.1.2. ContributionsNone.
21. MPEG-A MAF (23000)
21.1. 23000-4 Musical Slide Show MAF
21.1.1. Topics1. Protected Musical Slide Show MAF
21.1.2. ContributionsM14644: Proposed text for Protected Musical Slide Show MAF PDAM. Taken as input for producing text of 2nd edition. Clarification will be needed in the text to distinguish 1st edition to 2nd edition. This will be done by the definition of a new brand.
Technical Work in Progress.
21.2. 23000-8 Portable Video Player MAF
21.2.1. Topics1. Portable Video Player MAF
21.2.2. ContributionsM14649: KNB preliminary comments on 23000-8 CD Portable video player MAF. All comments were approved and study text was produced accordingly.
M14736: Enhancement of PVP MAF for e-learning. Broaden the scope of PVP MAF without putting irrealistic burden on the player. The contributions was accepted and editors will integrated in the study text.
66
Technical Work in Progress.
21.3. 23000-9 Digital Multimedia Broadcasting MAF
21.3.1. Topics1. Digital Multimedia Broadcasting MAF
21.3.2. ContributionsM14730: (Editors' Input) Updated text of FCD 23000-9 MAF for DMB. Taken as input for producing study text. Clarifications on what is optional / mandatory in the specification.
M14732: Updated proposal on TV-Anytime Metadata in ISO/IEC 23000-9 MAF for DMB. Used as basis to update the study text.
Technical Work in Progress.
21.4. 23000-10 Video Surveillance MAF
21.4.1. Topics1. Video Surveillance MAF 1st Edition
21.4.2. ContributionsM14596: Study text of ISO/IEC 23000-10 WD Video Surveillance MAF. Taken as input for production of CD text. Taken as input for production of CD text.M14748: Video Surveillance MAF file and camera identification. Noted.M14645: MPEG-7 core description profile and visual descriptors for Video Surveillance MAF. Agreement to use MPEG-7 in the break-out. Detailed discussion on what technology to include was discussed in break-out and document in study.
BoG Video Surveillance MAF- Software:
University Kingston could possibly provide software and also dedicate some time to work on it - could we have a software spec in an in and out sense by the end of the week? not enough time, spec for ref software will be started by James
- check photo player MAF design for binary representation of metadata- Study of SMAF text :
timed metadata possibility of the file format will not be used for metadata describing the content but only with the time/date of every frameuse of classification schemas should be allowed if those schemas are made availableMDS description on file level + MDS description on track level together will form a valid MPEG-7 filetrack start time and duration needed on track level in addition to VideoSegmentsVideoSegments will not be required to existthere will be a camera location description on the same level as the camera identification tagmetadata for content "a" will now become "user data" for free text annotation
- to be done in editing periodMAF fragment drawing to be changed (video track optional and optional metadata on track level to be added); file level metadata becomes two boxesfigure 5 will be improved by change of wording according the MAF file figure
67
possibly add 2CIF picture format (then picture aspect ratio box of ISO base file format would be needed)track level metadata box: camera identifier first bits for UUID further bits for user defined purposestimed metadata format to be included
- updates on MAF overview document (advanced surveillance MAF)no action this time
Technical Work in Progress.
22. MPEG-B
22.1. 23001-1 Binary Format Amd.2
22.1.1. Topics1. Extension on Encoding of Wild Cards
22.1.2. ContributionsM14582: Summary of Voting on ISO/IEC 23001-1:2006/FPDAM 2 [SC 29 N 8519] – MPEG-B. See DoC.
Technical Work Finalized.
22.2. 23001-1 Binary Format Cor.2
22.2.1. Topics1. Misc. Editorial Corrections on MPEG-B Part 1
22.2.2. ContributionsNone.
Technical Work in Progress.
22.3. 23001-3 Binary to XML Mapping of IPMP-X
22.3.1. Topics1. Binary to XML Mapping of IPMP-X
22.3.2. ContributionsM14659: Requirements for XML IPMP Messages. See req. report.M14674 : Study of TuC on IPMP XML Messages. Approved to be integrated in the study text of IPMP XML Messages.
Technical Work in Progress.
68
23. MPEG-E Multimedia Middleware (23004)
23.1. Multimedia Middleware
23.1.1. Topics1. MPEG Multimedia Middleware
23.1.2. ContributionsNone.
Technical Work in Progress.
24. Supplementary Media Technology (29116-1)
24.1. Media Streaming MAF Protocols
24.1.1. Topics1. Media Streaming MAF Protocols
24.1.2. ContributionsM14666: Study on ISO/IEC 29116 FCD Media Streaming MAF Protocol.
Technical Work in Progress.
25. ExplorationM14714: An Update on IPTV Requirements. Document reviewed jointly with requirements. Further work will be done in breakout.
M14717: The first ideas on LASeR in IPTV. Requirements on presentation format extracted from this technical solution and integrated in IPTV requirements. In particular:
- Requirements on scene representation format;- Requirements on convergence with mobile;- Requirements in dealing with multiple screen display.
Technical solution will be considered later when MPEG IPTV specification will be developed.
69
26. Latest References and Publication Status
Pr Pt Standard No. Issue Status Doc. With Purpose ISO Award
2 1 ISO/IEC 13818-1/Amd.7 Published 2000/12 Done2 1 ISO/IEC 13818-1:2000 (MPEG-2 Systems 2nd Edition) 00/12 Published 2000/12 Proposed2 1 ISO/IEC 13818-1:2000/COR1 (FlexMux Descr.) N3844 01/01 Pisa Published 2002/03 N/A2 1 ISO/IEC 13818-1:2000/COR2 (FlexMuxTiming_ descriptor) N4404 01/12 Pattaya Published 2002/12 N/A2 1 ISO/IEC 13818-1:2000/Amd.1 (Metadata on 2) & COR1 on Amd.1 N5867 03/07
TrondheimPublished 2003/12 Proposed
2 1 ISO/IEC 13818-1:2000/Amd.2 (Support for IPMP on 2) N5604 03/03 Pattaya Published 2004/03 N/A2 1 ISO/IEC 13818-1:2000/Amd.3 (AVC Carriage on MPEG-2) N5771 03/07
TrondheimPublished XXXX Proposed
2 1 ISO/IEC 13818-1:2000/Amd.4 (Metadata Application CP) N6847 04/10 Palma FDAM ITTF to be published N/A2 1 ISO/IEC 13818-1:2000/Amd.5 (New Audio P&L Sig.) N6585 04/07
RedmondFDAM ITTF to be published N/A
2 1 ISO/IEC 13818-1:2000/COR3 (Correction for Field Picture) N6845 04/10 Palma COR ITTF to be published N/A2 1 ISO/IEC 13818-1:2000/COR4 (M4MUX Code Point) N7469 05/07 Poznan COR ITTF to be published N/A2 1 ISO/IEC 13818-1:2000/COR5 (Corrections related to 3rd Ed.) N7895 06/01
BangkokCOR ITTF to be published N/A
2 1 ISO/IEC 13818-1:2006 (MPEG-2 Systems 3rd Edition) 06/xx Published ITTF TBP2 1 ISO/IEC 13818-1:2006/Amd.1 (Transport of Streaming text) N8369 06/07
KlagenfurtFDAM ITTF to be published TBP
2 1 ISO/IEC 13818-1:2006/Amd.2 (Carriage of Auxialiry Video Data) N8798 07/01 Marrakech
FDAM ITTF to be published TBP
2 11 ISO/IEC 13818-1:2003 (IPMP on 2) N5607 03/03 Pattaya Published 2003/12 Proposed4 1 ISO/IEC 14496-1 (MPEG-4 Systems 1st Ed.) N2501 98/10 Atl. City Published 1999/12 Done4 1 ISO/IEC 14496-1/Amd.1 (MP4, MPEG-J) N3054 99/12 Hawaii Published 2001/11 Done4 1 ISO/IEC 14496-1/Cor.1 N3278 00/03
Noordwijk.Published 2001/11 N/A
70
4 1 ISO/IEC 14496-1:2001 (MPEG-4 Systems 2nd Ed.) N3850 01/01 Pisa Published 2001/11 N/A4 1 ISO/IEC 14496-1:2001/Amd.1 (Flextime) Published 2002/10 Done4 1 ISO/IEC 14496-1:2001/Cor.1 N4264 01/07 Sydney COR ITTF N/A4 1 ISO/IEC 14496-1:2001/Cor.2 N5275 02/10 Shangai COR ITTF N/A4 1 ISO/IEC 14496-1:2001/Cor.3 N6587 04/07
RedmondCOR ITTF N/A
4 1 ISO/IEC 14496-1:2001/Amd.2 (Textual Format) N4698 02/03 Jeju Island
AMD ITTF N/A
4 1 ISO/IEC 14496-1:2001/Amd.3 (IPMP Extensions) N5282 02/10 Shanghai
Published 2004-05 N/A
4 1 ISO/IEC 14496-1:2001/Amd.4 (SL Extension) N5471 02/12 Awaji Published 2003/12 N/A4 1 ISO/IEC 14496-1:2001/Amd.7 (AVC on 4) N5976 03/10
BrisbannePublished 2004-08 N/A
4 1 ISO/IEC 14496-1:2001/Amd.8 (ObjectType Code Points) N6202 03/12 Hawaii AMD ITTF to be published N/A4 1 ISO/IEC 14496-1:200x/Amd.1 (Text Profile Descriptors) N7229 05/04 Busan PDAM ITTF Final Text
EditingN/A
4 1 ISO/IEC 14496-1:200x/Cor4 (Node Coding Table) N7473 05/07 Poznan PDAM ITTF to be published N/A4 1 ISO/IEC 14496-1 (MPEG-4 Systems 3rd Ed.) N5277 02/10
ShanghaiIS ITTF to be published Proposed
4 1 ISO/IEC 14496-1:200x/Amd.1 (Text Profile Descriptors) N7229 05/04 Busan PDAM ITTF Final Text Editing
N/A
4 1 ISO/IEC 14496-1:200x/Cor.1 (Clarif. On audio codec behavior) N8117 06/04 Montreux
COR ITTF Final Text Editing
N/A
4 1 ISO/IEC 14496-1:200x/Amd.2 (3D Profile Descriptor Extensions) N8372 06/07 Klagenfurt
PDAM ITTF to be published N/A
4 1 ISO/IEC 14496-1:200x/Cor.2 (OD Dependencies) N8646 06/10 Hangzhou
COR ITTF to be published N/A
4 1 ISO/IEC 14496-1:200x/Amd.3 (JPEG 2000 support in Systems) N8860 07/01 Marrakech
PDAM ITTF to be published N/A
4 4 ISO/IEC 14496-1:200x/Amd.22 (AudioBIFS v3 conformance) N9295 07/07 Lausanne
PDAM ITTF to be published N/A
4 4 ISO/IEC 14496-1:200x/Amd.17 (ATG Conformance) N8861 07/01 Marrakech
PDAM ITTF to be published N/A
4 5 ISO/IEC 14496-1:200x/Amd.12 (File Format) N9020 07/04 San Jose PDAM ITTF to be published N/A
71
4 6 ISO/IEC 14496-6:2000 Published 2000/12 N/A4 8 ISO/IEC 14496-8 (MPEG-4 on IP Framework) N4712 02/03 Jeju Published 2004-05 Proposed4 11 ISO/IEC 14496-11 (MPEG-4 Scene Description 3rd
Edition) N6960 05/01
HongKongFDIS SC29 Final Text
EditingProposed
4 11 ISO/IEC 14496-11/Amd.1 (AFX) N5480 02/12 Awaji FDAM ITTF Integration in 1st
Ed.N/A
4 11 ISO/IEC 14496-11/Amd.2 (Advanced Text and Graphics) N6205 03/12 Hawaii FDAM ITTF Integration in 1st
Ed.N/A
4 11 ISO/IEC 14496-11/Cor.1 N6203 03/12 Hawaii COR SC29 N/A4 11 ISO/IEC 14496-11/Cor.3 Valuator/AFX related correction N6594 04/07
RedmondCOR ITTF Integration in 1st
Ed.N/A
4 11 ISO/IEC 14496-11/Amd.3 Audio BIFS Extensions N6591 04/07 Redmond
FDAM ITTF Integration in 1st
Ed.Proposed
4 11 ISO/IEC 14496-11/Amd.4 XMT and MPEG-J Extensions N6959 05/01 HongKong
FDAM ITTF Integration in 1st
Ed.N/A
4 11 ISO/IEC 14496-11/Cor.3 (Audio BIFS Integrated in 3rd Edition) N7230 05/04 Busan COR ITTF Final Text Editing
N/A
4 11 ISO/IEC 14496-11/Cor.5 (Misc Corrigendum) N8383 06/07 Klagenfurt
COR SC29 N/A
4 11 ISO/IEC 14496-11/Amd.5 Symbolic Music Representation
N8657 06/10 Hangzhou
FDAM ITTF TBP
4 11 ISO/IEC 14496-11/Cor.6 (AudioFx Correction) N9021 07/04 San Jose COR SC29 N/A4 12 ISO/IEC 14496-12 (ISO Base Media File Format) N5295 02/10
ShanghaiPublished 2004-02 Proposed
4 12 ISO/IEC 14496-12/Amd.1 ISO FF Extension N6596 04/07 Redmond
FDAM ITTF FDAM 04/11/30 N/A
4 12 ISO/IEC 14496-12/Cor.1 (Correction on File Type Box)
N7232 05/04 Busan COR ITTF Final Text Editing
N/A
4 12 ISO/IEC 14496-12/Cor.2 (Miscellanea) N7901 06/01 Bangkok
COR ITTF Final Text Editing
N/A
4 12 ISO/IEC 14496-12/Cor.3 (Miscellanea) N9024 07/04 San Jose COR ITTF Final Text Editing
N/A
4 12 ISO/IEC 14496-12/Amd.1 (Description of timed metadata)
N8659 06/10 Hangzhou
FDAM ITTF N/A
72
4 12 ISO/IEC 14496-12/Amd.2 (Flute Hint Track) N9023 07/04 San Jose FDAM ITTF N/A4 13 ISO/IEC 14496-13 (IPMP-X) N5284 02/10
ShanghaiIS ITTF to be published Proposed
4 14 ISO/IEC 14496-14 (MP4 File Format) N5298 02/10 Shanghai
Published 2003-11 Proposed
4 14 ISO/IEC 14496-14/Cor.1 (Audio P&L Indication) N7903 06/01 Bangkok
COR ITTF Final Text Editing
N/A
4 15 ISO/IEC 14496-15 (AVC File Format) N5780 03/07 Trondheim
Published 2004-04 Proposed
4 15 ISO/IEC 14496-15/Amd.1 (Support for FREXT) N7585 05/10 Nice FDAM ITTF Final Text Editing
N/A
4 15 ISO/IEC 14496-15/Cor.1 N7575 05/10 Nice COR ITTF N/A4 15 ISO/IEC 14496-15/Cor.2 (NAL Unit Restriction) N8387 06/07
KlagenfurtCOR ITTF N/A
4 17 ISO/IEC 14496-17 (Streaming Text) N7479 05/07 Poznan FDAM ITTF TBP4 18 ISO/IEC 14496-18 (Font Compression and Streaming) N6215 03/12 Hawaii Published 2004-07 Proposed4 18 ISO/IEC 14496-18/Cor.1 (Misc. corrigenda and
clarification)N8664 06/10
HangzhouCOR ITTF N/A
4 19 ISO/IEC 14496-19 (Synthesized Texture Stream) N6217 03/12 Hawaii Published 2004-07 Proposed4 20 ISO/IEC 14496-20 (LASeR) N7588 05/10 Nice FDAM Editor TBP4 20 ISO/IEC 14496-20/Cor.1 (Misc. corrigenda and
clarification)N8666 06/10
HangzhouCOR ITTF N/A
4 20 ISO/IEC 14496-20/Amd.1 (LASeR Extension) N9029 07/04 San Jose FDAM ITTF N/A4 22 ISO/IEC 14496-22 (Open Font Format) N8395 06/07
KlagenfurtFDAM Editor Final Text
EditingTBP
7 1 ISO/IEC 15938-1 (MPEG-7 Systems) N4285 01/07 Sydney Published 2002/07 Done7 1 ISO/IEC 15938-1/Amd.1 (MPEG-7 Systems Extensions) N6326 04/03 Munich FDAM ITTF FDAM 04/11/28 N/A7 1 ISO/IEC 15938-1/Cor.1 (MPEG-7 Systems Corrigendum) N6328 04/03 Munich COR Editor N/A7 1 ISO/IEC 15938-1/Cor.2 (MPEG-7 Systems Corrigendum) N7490 05/07 Poznan COR ITTF N/A7 1 ISO/IEC 15938-1/Amd.2 (BiM extension) N7532 05/10 Nice FDAM ITTF N/A7 2 ISO/IEC 15938-2 (MPEG-7 DDL) N4288 01/07 Sydney Published 2002/02 Done7 7 ISO/IEC 15938-7/Amd.2 (Fast Access Ext. Conformance) N8672 06/10
HangzhouFDAM ITTF N/A
21 9 ISO/IEC 21000-9 (MPEG-21 File Format) N6975 05/01 FDIS ITTF FDIS 05/01/21 Done
73
HongKong21 16 ISO/IEC 21000-16 (MPEG-21 Binary Format) N7247 05/04 Busan FDIS ITTF FDIS 05/04/22 TBPA 1 ISO/IEC 23000-4 (Musical Slide Show MAF) N9037 07/04 San Jose FDIS ITTF TBPB 1 ISO/IEC 23001-1 (XML Binary Format) N7597 05/10 Nice FDIS ITTF TBPB 1 ISO/IEC 23001-1/Cor.1 (Misc. Editorial and technical
clar.)N8680 06/10
HangzhouCOR ITTF N/A
B 1 ISO/IEC 23001-1/Cor.2 (Misc. Editorial and technical clar.)
N9049 07/04 San Jose COR ITTF N/A
B 1 ISO/IEC 23001-1/Amd.1 (Reference Soft. & Conf.) N8886 07/01 Marrakech
FDAM ITTF N/A
B 1 ISO/IEC 23001-1/Amd.1 (Exten. On encoding of wild cards)
N9296 07/07 Lausanne
PDAM ITTF to be published N/A
B 2 ISO/IEC 23001-1 (Fragment Request Unit) N9051 07/04 San Jose FDIS ITTF TBPE 1 ISO/IEC 23008-1 Architecture N8892 07/01
MarrakechFDAM ITTF N/A
E 2 ISO/IEC 23008-2 Multimedia API N8893 07/01 Marrakech
FDAM ITTF N/A
E 3 ISO/IEC 23008-3 Component Model N8894 07/01 Marrakech
FDAM ITTF N/A
E 4 ISO/IEC 23008-4 Ressource & Quality Management N8895 07/01 Marrakech
FDAM ITTF N/A
E 5 ISO/IEC 23008-5 Component Download N9053 07/04 San Jose FDAM ITTF N/AE 6 ISO/IEC 23008-6 Fault Management N9054 07/04 San Jose FDAM ITTF N/AE 7 ISO/IEC 23008-7 System Integrity Management N9055 07/04 San Jose FDAM ITTF N/A
74
27. Resolutions of Systems
Cf. WG11 resolution.
28. List of Reviewed ContributionsN° Title Authors14567 AHG on MPEG File Formats David Singer Visharam Mohammed14573 Liaison Statement from 3GPP TSG SA WG4 [SC 29 N 8462] 3GPP TSG SA WG4 via SC 29 Secretariat14573 Liaison Statement from 3GPP TSG SA WG4 [SC 29 N 8462] 3GPP TSG SA WG4 via SC 29 Secretariat14574 Liaison Statement from 3GPP TSG SA WG4 [SC 29 N 8463] 3GPP TSG SA WG4 via SC 29 Secretariat14574 Liaison Statement from 3GPP TSG SA WG4 [SC 29 N 8463] 3GPP TSG SA WG4 via SC 29 Secretariat14581 Summary of Voting on ISO/IEC 14496-4:2004/FPDAM 22 [SC 29 N 8518] SC 29 Secretariat14582 Summary of Voting on ISO/IEC 23001-1:2006/FPDAM 2 [SC 29 N 8519] –
MPEG-BSC 29 Secretariat
14583 Summary of Voting on ISO/IEC 14496-5:2001/PDAM 17 SC 29 Secretariat14585 Summary of Voting on ISO/IEC 14496-5:2001/PDAM 16 [SC 29 N 8503] SC 29 Secretariat14596 Study text of ISO/IEC 23000-10 WD Video Surveillance MAF Gero Bäse et al.14604 Cross-Media Interactive Presentation MAF Davide Rogai et al.14607 Study of ISO/IEC 14496-20/FPDAM2 Jean-Claude Dufourd14608 Update of LASeR Reference Software Jean-Claude Dufourd14609 Study of ISO/IEC 14496-4/FPDAM25 Jean-Claude Dufourd14610 Report of LASeR related activities in other standards organizations Jean-Claude Dufourd14617 Improved meta box support in the ISO file format David Singer14620 On SVC file format Ye-Kui Wang et al.14634 On MVC file format Ying Chen et al.14643 Updated SMR reference Software Pierfrancesco Bellini et al.14644 Proposed text for Protected Musical Slide Show MAF PDAM Houari Sabirin et al.14645 MPEG-7 core description profile and visual descriptors for Video
Surveillance MAFHouari Sabirin et al.
14649 KNB preliminary comments on 23000-8 CD Portable video player MAF Hyouk Jean Cha et al.14651 On the SVC File Format Thomas Rathgen et al.14659 Requirements for XML IPMP Messages Hyon-Gon Choo et al.
75
14660 On LASeR BitStream Exchange Jean Le Feuvre et al.14662 BIFS and LASeR harmonization Jean Le Feuvre et al.14663 Revised requirement for Stereoscopic MAF Next Generation Broadcasting Standard Forum
Korea14664 Proposal for technical specification of Stereoscopic MAF Next Generation Broadcasting Standard Forum
Korea14665 Requirement for Packaged media Stereoscopic MAF Next Generation Broadcasting Standard Forum
Korea14666 Study on ISO/IEC 29116 FCD Media Streaming MAF Protocol Hyon-Gon Choo et al.14667 Comments on Amd2 of ISO base media file format Jani Peltotalo et al.14674 Study of TuC on IPMP XML Messages Jooyoung LeeHyon-Gon Choo14676 Proposal for MPEG-2 Transport Stream Extensions for Scalable Video
CodingK. Grüneberg et al.
14676 Proposal for MPEG-2 Transport Stream Extensions for Scalable Video Coding
K. Grüneberg et al.
14678 Request of user defined values for the predefined SLConfigDescriptor Jihun Cha et al.14680 First ideas on the harmonization of BIFS and LASeR Jihun Cha et al.14682 On LASeR Main Profile Diego Gibellino et al.14698 On CTS-Offset and hierarchical B-frames in ISO media file format Stefan Döhla et al14714 An Update on IPTV Requirements Xin Wang 14717 The first ideas on LASeR in IPTV Jaeyeon Song & al.14719 Proposed SMPTE 2029 - Uniform Resource Names for SMPTE Resources Thomas Edwards14730 (Editors' Input) Updated text of FCD 23000-9 MAF for DMB Hui Yong Kim et al.14732 Updated proposal on TV-Anytime Metadata in ISO/IEC 23000-9 MAF for
DMBSeung Jun Yang et al.
14736 Enhancement of PVP MAF for e-learning Sihyoung Lee, Seungji Yang, Yong Man Ro,14741 Liaison Statement from DVB [SC 29 N 8598] DVB via SC 29 Secretariat14748 Video Surveillance MAF file and camera identification Gero Bäse none Thomas Rathgen
76
Annex G – MDS report
Source: Ian Burnett, Chair
1.0 Introduction
MDS commenced with an overview of the weeks planned activities:
77
78
2.0 Notes on discussions on Input Documents
79
These contemporaneous notes summarise the activities of the MDS subgroup during the 81 st MPEG meeting. Over the week several break out activities dealt with tasks in the areas of the Digital Item, MPEG Query Format, and the Open Release MAF/REL Profile. Notes of these meetings are given at the end of this section.
14715 Florian Schreiner Chun Hui Suen Contribution to ISO/IEC FCD 23000-7 Open release
Input:This input analysed the requirements of the OR MAF in terms of the MPEG-7 metadata that might be utilised. The first detailed was the CreationCoordinates. They propose a LicenseURI being added to the Creation element from MDS. For the Agent element, a set of MDS descriptors were chosen. For Related Material, a series of mpeg7 namespace elements were chosen.Actions:It was suggested that the LicenseURI element might be taken from MPEG-21 IPMP Components. However, in any case it would b specific to the MAF rather than being generally an element that should be added to MPEG-7 MDS.OR MAF summary
CC seem happy with the OR MAF format based on email discussions Response to be sent Tuesday
MDS will create a resolution stating that our understanding is that CC are happy with the proposal and we will keep them up to date with the progress.
14603
Chrisa Tsinaraki Stavros Christodoulakis MPEG-7 FASP Extension Proposal
Input:This input describes a perceived inconsistency between the description model and the filtering model for MPEG-7 MDS FASP. It suggests an extension to bring the two inline. Actions:This proposal met with some opposition. It was suggested that text for MDS would be needed. However, it seems that it is unlikely that this proposal will achieve consensus.
14640
Hee-Cheol Seo Miran Choi Hyunki Kim Myung-Gil Jang Soojong Lim Jeong Heo Yeo-Chan Yoon Weak Points of Current MPEG-7 Query Format Schema
14641Masanori Sano Hideki Sumiyoshi Nobuyuki Yagi A proposal for MP7QF based on QueryCondition part
14661
Matthias Gruhne Mario Doeller Ingo Wolf Proposal for the MP7QF Query Management Tools
14672Mario Doeller Matthias Gruhne Ingo wolf
Proposal for additional Query Types and Operators for MP7QF
14689 Ruben Tous Jaime Delgado Proposal for new Query Operators in MP7QF14690 Ruben Tous Jaime Delgado Proposal for the new JOIN operation in MP7QF14744 Kyoungro Yoon Mario Doeller AHG's Input for SoCD on MPEG-7 Query Format
14745Tae-Beom Lim Kyoungro yoon Jongseol Lee Saim Shin SeokPil Lee Proposal for arithmetic and comparison operators
14749Chrisa Tsinaraki Stavros Christodoulakis Shortcomings of the current MP7QF Query Output Format
14750
Chrisa Tsinaraki Stavros Christodoulakis MP7QF Conditions & Operators
80
Input:These inputs were discussed in the BoG. Opportunity was given to present in the full MDS session, however contributors universally preferred to us the time to develop the QF work further.
14621 Eva Rodriguez Jaime Delgado Derivative rights for the REL ORC Profile
Input:This input considers how derivative rights should be made to work effectively in the ORC profile of the REL. The preferred option is to support ‘embed and aggregate rights’.Actions:This proposal seems to suggest that there is an issue with the ORC profile’s inclusion of derivative rights. Is there a need for this if the intention is to support the intention of CC licenses?
14624 Eva Rodriguez Jaime Delgado
Contribution to MPEG-21 REL Reference Software: Schema checker for the ORC
14625 Eva Rodriguez Jaime Delgado
Contribution to MPEG-21 REL Reference Software: Validation rules checker for the
Input:These adapt the REL reference software to the ORC profile needs.Actions:These will be included in the REL reference software (not the 2nd edition) and the OR MAF reference software.
14623
Jaime Delgado Eva Rodriguez Jordi Sesmero Software implementation of security in Event Reporting
Input:This software implements security for ER as per the input m14622 to requirements. The work addresses unfulfilled requirements for ER. The solution is given in m14622 and was described in the San Jose meeting.Actions:This requires an Amendment to Event Reporting. There will be a Request for the amendment and the PDAM will be issued from this meeting.
14691
Saar De Zutter Frederik De Keukelaere Gerrard Drury Christian Timmerer Xin Wang
Editors' input to ISO/IEC FDIS 21000-8 Reference Software (2nd edition)
Input:This input details the editorial changes for the reference s/w proposed FDIS which will be issued from this meeting.Actions:The document is being sent to the reflector for checking...According to the schedule in section 4 the remainder of input documents were considered in joint meetings, primarily with Requirements. The results and actions from those inputs is thus to be found in the Requirements subgroup meeting.
81
DIGITAL ITEM DECLARATION DISCUSSIONS81TH MPEG MEETING
2-6 JULY 2007
2. Recommendations
1. The input contributions be further discussed during the Lausanne meeting and a decision made as to whether the DID requirements require modifying.
2. Discuss and decide on whether it is the requirements on DID that are deficient or whether it is requirements on other parts of MPEG-21 or whether there is a need for some integration requirements.
3. If new requirements are identified above, decide where the work should take place.
3. Background
An AHG meeting was held before the beginning of the meeting. There were 4 mandates: 1. Investigate whether the current DID (ISO/IEC 21000-2) requirements fit with today's industry,
and if not review the requirements.
2. Collect information on how DID is currently used.
3. Identify current deficiencies with DID and propose ways to address these deficiencies.
4. Investigate feasibility of producing royalty-free DID.
During the Sunday AhG the mandates have been discussed and input document M14611 has been presented.
No discussions held about mandate 4.
Input on mandate 2 has been provided (6 known adoptions of MPEG-21 DID).
The discussion about mandate 1-3 leaded to several open issues that need to be further investigated during the week:
a) The role of MAFs is still to be clarified: with MAFs, the structure of DIs can be provided to guarantee interoperability for a certain application domain. It is still not clear whether some further work on the normative part of DID about the analysis of the structure of DIs can help for a wider adoption of MPEG-21 technology.b) Is it possible to provide a “normative decoder procedure” for a Digital Item as it is used for coding AV standards?c) DIs are generally used in the back end of server systems as a convenient container structure and users rarely realise they have a DI in front of them. For DIs to be used like an MP3 or an MPEG-2 video file, there is the key issue that DIs have no innate 'presentation' and hence users receiving them need to a) agree on a DI structure and its usage and then b) have an application aware of that DI structure. This is, of course, the nature of an 'agnostic'
82
standard such as the DI. Is it useful to standardise the 'back-end' storage/delivery of a DI and its constituent parts?d) What is the meaning of interoperability for DIs - is cross application-domain interoperability required? e) If the container is agnostic to usage then presentation is not usefully standardised. However, will users ever find DIs useful if there is no standard presentation?
4. Notes from 3 July 16-18 (joint MDS & Req session)
Input documents have been presented, providing a detailed analysis of the current DID requirements. The comments provided are reported in session Error: Reference source not found.Some hints emerged from the discussion: Interoperability:
o An example of interoperability provided. Interoperability inside DID seems to be reached only at a “namespace” level, for descriptors and resources encompassed by DID.
o A proposal was made: assessing interoperability of DIs starting from concrete examples: Axmedis and Enthrone DIs. They have been envisaged for different application scenarios, difficulties in fulfilling this request.
Deficiencies of current DID:o Difficulties with DI parsing.o Need to revisit relationship between file format and DI, especially when
protected resources are embedded in the DID. Open issues
o What is the correct way to mix XML DID and the needs for a FF.o Are profiles a possible solution to achieve interoperability among DIs?
(apparently not).o Are there any elements in the current DID standard difficult to use or applicable
to limited scenarios? (The example of “Choice/Selection” was cited, whose usage is limited to server applications).
5. Notes from 4 July 11-12 (MDS session)
Interoperability: o An example of interoperability provided. Interoperability inside DID seems to
be reached only at a “namespace” level, for descriptors and resources encompassed by DID.
o A proposal was made: assessing interoperability of DIs starting from concrete examples: Axmedis and Enthrone DIs. They have been envisaged for different application scenarios, difficulties in fulfilling this request.
Deficiencies of current DID:o Difficulties with DI parsing - The expected behaviour of an XML parser is to
resolve the XInclude before validating the XML structure against a given set of schemas (in the MPEG-21 case, the DIDL XML Schema);
o Need to revisit relationship between file format and DI, especially when protected resources are embedded in the DID - Problem of changing ISO FF for
83
accommodating the DID: the FF doesn’t keep the structure of the DI. In case resources are embedded into the file, problems raise in referencing and managing these resources.
o Streaming of the DI. Open issues
o What is the correct way to mix XML DID and the needs for a FF.o Are profiles a possible solution to achieve interoperability among DIs?
(apparently not).o Are there any elements in the current DID standard difficult to use or applicable
to limited scenarios? (The example of “Choice/Selection” was cited, whose usage is limited to server applications).
o Normative decoding procedure?o Presentation layero Semantics of DIs – Experiment Axmedis/Enthrone
6. Notes from 4 July 15-17 (joint MDS & Req session)
A CE on DI Semantics will be issued to assess interoperability between DI used in different application scenarios.A list of open issues will be drafted and circulated by email.
84
85
86
It should be noted that there was a lack of consensus on the extent of the OR MAF requirements. Some members wish to see the OR MAF cover existing open licensing scheme requirements. However, other MPEG experts are keen to see the OR MAF extended to cover broader requirements which encompass Rights such that there is a continuum from open licenses through to full DRM systems. No consensus on this was arrived at within the MDS group and discussions were not completed. One suggestion is to alter the name of the OR MAF. It is expected that NB comments may address these issues at the 82nd meeting and discussions will continue then.
3.0 MDS Output Documents and Resolutions – Lausanne 81st Meeting
Part 12 Query FormatThe MDS subgroup recommends approval of the following documents
No. Title TBP Available15938-12 MPEG-7 Query Format
9172 Study of ISO/IEC CD 15938-12 Query Format No 07/07/279173 TuC for MPEG Query Format v2.0 No 07/07/06
The MDS subgroup requests that, if at all possible, National Bodies might consider the Study of ISO/IEC CD 15938-12 Query Format when preparing their ballot comments on the CD.
7. Resolutions related to MPEG-21
GeneralThe MDS subgroup recommends approval of the following documents
No. Title TBP Available21000 General
9174 Schema Files for MPEG-21 Standards (v7) Yes 07/07/06
7.1.1.
The MDS subgroup notes that the document N9174 is a new version of an ongoing working document containing the ‘electronic’ versions of schemas for the current MPEG-21
87
parts at IS/FDIS. The MDS subgroup requests that the versions of the schemas be updated on the ITTF WWW site at http://standards.iso.org/ittf/PubliclyAvailableStandards/MPEG-21_schema_files/.
Part 2 Digital Item Declaration The MDS subgroup recommends approval of the following documents
No. Title TBP Available21000-2 Digital Item Declaration
9175 DID Open Issues No 07/07/069176 Workplan for CE on DI Semantics No 07/07/06
Part 5 Rights Expression Language The MDS subgroup recommends approval of the following documents
No. Title TBP Available21000-5 Rights Expression Language
9177 MPEG-21 REL Profiles Software Implementation Plan v.7 No 07/07/06
1.1.3. The MDS subgroup requests the addition of Xin Wang as an editor of ISO/IEC 21000-5 Amd3.
Part 8 Reference Software The MDS subgroup recommends approval of the following documents
No. Title TBP Available21000-8 Reference Software
9178 DoC for ISO/IEC FCD 21000-8 Reference Software 2nd Edition No 07/07/069179 Text of ISO/IEC FDIS 21000-8 Reference Software 2nd Edition No 07/07/27
The MDS subgroup thanks the National Bodies of Austria, Belgium, and Japan for their useful comments on ISO/IEC FCD 21000-8.
Part 15 Event reporting The MDS subgroup recommends approval of the following documents
No. Title TBP Available21000-15 Event reporting
9180 Request for Amendment 1 of ISO/IEC 21000-15 Security in ER No 07/07/069181 ISO/IEC PDAM/1 21000-15 Security in ER No 07/07/06
8. Resolutions related to MPEG-A
Part 5 Media Streaming Player Application FormatThe MDS subgroup recommends approval of the following documents
No. Title TBP Available23000-5 Media Streaming MAF
9182 Study of ISO/IEC FCD 23000-5 Media Streaming MAF No 07/07/06
88
Part 7 Open Release Application FormatThe MDS subgroup recommends approval of the following documents
No. Title TBP Available23000-7 Open Release Application Format
9183 Study of ISO/IEC FCD 23000-7 OR Application Format No 07/07/06
The MDS subgroup requests that, if at all possible, National Bodies might consider the Study of ISO/IEC FCD 23000-7 OR Application Format when preparing their ballot comments on the FCD.
9. Resolutions related to MPEG-B
PromotionThe MDS subgroup recommends to approve the following documents
No. Title TBP AvailablePromotion
9184 MPEG-21 DIA 2nd Edition Tutorial Presentation Yes 07/07/06
10.Ad hoc group form
9185 AHG on MPEG Query FormatMandate: To address the following issues:
1. Complete editing of the MPEG-7 Query Format SoCD2. Finalise text changes on the Base Data model for the Query Format3. Complete definition of new Query types4. Conclude syntactic definition of the Join operator
Chairman: Kyoungro Yoon (yoonk *at* konkuk.ac.kr)Mario Doeller (Mario.doeller_*at*_uni_passau.de)
Duration: Until 82nd Meeting Meetings AHG meeting will be held on the weekend prior to 82nd meeting. Other business
will be conducted by e-mail or telephone conference.Reflector: [email protected]: To subscribe send email to [email protected]
9186 AHG on Review of the MPEG-21 DIMandate: To address the following issues:
1. Investigate whether the current DID (ISO/IEC 21000-2) requirements satisfy current industry needs and if not review the requirements
2. Identify current deficiencies in the DI and propose solutions3. Investigate solutions to the issues identified in N9175: DID Open Issues 4. Conduct CE on DI Semantics according to N9176
Chairman: Giovanni Cordara (giovanni.cordara*at*telecomitalia.it)Co-Chair: Gerrard Drury (gerrard*at*enikos.com)
Duration: Until 82nd Meeting Meetings AHG meeting will be held on the weekend prior to 81st meeting. Other business
will be conducted by e-mail or telephone conference.
89
Reflector: [email protected]: To subscribe visit: http://listserv.imec.be/mailman/listinfo/mpeg-21
90
4.0 MDS Final Schedule – Lausanne 81st Meeting
v3.0
MPEG MDS Chair: Ian S Burnett
MPEG-7, MPEG-21, MAF v3.0 Number Source Title
Monday Morning (9h00-13h00) MPEG Plenary Plenary room
Monday Afternoon (13h30-20h00)
Kick-off of MPEG MDS activities (11h30-12h30) MDS Room Rome
Agenda, Goals and Issues for the Week for MDS Group Ian S Burnett
Review of AHG resolutions, CE results and action points (11h00-12h30) MDS Room Rome
14571 Kyoungro Yoon Mario Doeller AHG on MPEG-7 Query Format
14559Gerrard Drury Giovanni Cordara AHG on Review of MPEG-21 DID
14579 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC FDIS 21000-18 [SC 29 N 8509]
14587 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 21000-8 (2nd Edition) [SC 29 N 8558]
Define BoGs and Mandates (11h20-11h30) MDS Room Rome BoG1 = ? MPEG-7 QF OR MAF/REL Tues am Monday Afternoon (14h00-18h00) OR MAF (14h00 - 15h00) MDS Room Rome
14715 Florian Schreiner Chun Hui Contribution to ISO/IEC FCD 23000-7
Suen Open release MPEG-7 Query Format (15h00 - 18h00) MDS Room Rome
14603Chrisa Tsinaraki Stavros Christodoulakis MPEG-7 FASP Extension Proposal
14640
Hee-Cheol Seo Miran Choi Hyunki Kim Myung-Gil Jang Soojong Lim Jeong Heo Yeo-Chan Yoon
Weak Points of Current MPEG-7 Query Format Schema
14641Masanori Sano Hideki Sumiyoshi Nobuyuki Yagi
A proposal for MP7QF based on QueryCondition part
14661Matthias Gruhne Mario Doeller Ingo Wolf
Proposal for the MP7QF Query Management Tools
14672Mario Doeller Matthias Gruhne Ingo wolf
Proposal for additional Query Types and Operators for MP7QF
14689 Ruben Tous Jaime Delgado Proposal for new Query Operators in MP7QF
14690 Ruben Tous Jaime Delgado Proposal for the new JOIN operation in MP7QF
14744 Kyoungro Yoon Mario Doeller AHG's Input for SoCD on MPEG-7 Query Format
14745
Tae-Beom Lim Kyoungro yoon Jongseol Lee Saim Shin SeokPil Lee
Proposal for arithmetic and comparison operators
14749Chrisa Tsinaraki Stavros Christodoulakis
Shortcomings of the current MP7QF Query Output Format
14750Chrisa Tsinaraki Stavros Christodoulakis MP7QF Conditions & Operators
Tuesday Morning (9h00-13h00)
REL/ER/Refs/w (9h00 - 11h00) MDS Room Rome
14621 Eva Rodriguez Jaime Delgado Derivative rights for the REL ORC Profile
14624 Eva Rodriguez Jaime Delgado
Contribution to MPEG-21 REL Reference Software: Schema checker for the ORC
14625 Eva Rodriguez Jaime Delgado
Contribution to MPEG-21 REL Reference Software: Validation rules checker for the
14623Jaime Delgado Eva Rodriguez Jordi Sesmero
Software implementation of security in Event Reporting
14691
Saar De Zutter Frederik De Keukelaere Gerrard Drury Christian Timmerer Xin Wang
Editors' input to ISO/IEC FDIS 21000-8 Reference Software (2nd edition)
Joint with Video and ISG on BSDL for Part B RVC (11h00 - 13h00)
92
Tuesday Afternoon (14h00-18h00) MAFs (14h00 -16h00)
14612 Xin Wang Security and DRM Requirements for Professional Archival MAF
14613Noboru Harada Takehiro Moriya Yutaka Kamamoto
Updated overviwe document for Professional Archival MAF
14663Next Generation Broadcasting Standard Forum Korea
Revised requirement for Stereoscopic MAF
14664Next Generation Broadcasting Standard Forum Korea
Proposal for technical specification of Stereoscopic MAF
14665Next Generation Broadcasting Standard Forum Korea
Requirement for Packaged media Stereoscopic MAF
14604Davide Rogai Pierfrancesco Bellini Paolo Nesi
Cross-Media Interactive Presentation MAF
MDS/Reqts issues (16h00 - 18h00) Reqts
14559Gerrard Drury Giovanni Cordara AHG on Review of MPEG-21 DID
14611
Pedro Carvalho Helder Castro Maria Teresa Andrade Giorgiana Ciobanu Christian Timmerer Hermann Hellwagner
Input to AHG on Review of MPEG-21 DID
14708Davide Rogai Pierfrancesco Bellini Paolo Nesi
Input to AhG on MPEG-21 DID Review
14659Hyon-Gon Choo Filippo Chiariglione
Requirements for XML IPMP Messages
14707
Jaime Delgado Marc Gauvin Eva Rodriguez Victor Rodriguez
Requirements for a Machine Readable Rights Ontology
Wednesday Morning (09h00-13h00) MPEG Plenary (9h00-11h00) Plenary room DI Break Out Discussions
Wednesday Afternoon (14h00-17h45) MPEG Metaverse discussions(14h00-15h00) ReqtsDI discussions cont'd (15h00-17h00) ReqtsThursday Morning
93
(9h00-12h30)OR MAF Issues (10h30 - 11h30) RDD Reqts (12h00-13h00) Reqts Thursday Afternoon (14h00-19h00) Prof Archival Call (14h00-15h00) ReqtsDI Interoperability (15h00-16h00) ReqtsPlenary MDS and Reports of BoG (16h00 - 18h00) MDS Room Rome Further review of Output documents, AHGs, CEs, DoC, Std (18h00+++) MDS Room Rome Friday Morning (09h00-13h00)
Wrapping up (09h00 - 13h00) MDS Room Rome
Approval of resolutions, AHGs and Output documents
Friday Afternoon (14h00-21h00) MPEG Plenary Plenary room Contact: Ian S Burnett
x
94
Annex H – Video report
Source: Jens-Rainer Ohm, Gary J. Sullivan (Video), Miroslaw Z. Bober (MPEG-7 Visual)
1 MPEG-4 Video Software Corrigendum
Errors in MPEG-4 Video software (start code emulation in studio profile which was already corrected in the standard text) were reported in M14600. It was decided to go for a new corrigendum directly (no defect report before) because currently no other problems with studio profile software are envisaged.
Document reviewed:14600 Teruhiko Suzuki Problem report on MPEG-4 visual reference software
Documents approved:No. Title TBP Available
14496-5 Reference Software 9193 Text of ISO/IEC 14496-5:2001/Amd.1/DCOR 1 N 07/08/31
11. Development of AVC
The video subgroup approved the documents that were produced during the 24th JVT meeting which was held in parallel in Geneva. Main work items of JVT were
– Finalization of SVC amendment– Preparation of MVC PDAM– Preparation of software and conformance PDAM for New Professional Profiles– Preparation of software and conformance PDAM for Scalable Video Coding
By issuing the FDAM (N9197), the SVC amendment is finalized, further developments relate to software, conformance and performance of verification tests. Further issues being further explored by JVT in AHG study, core experiments or JSVM implementation relate to requirements that are not or not fully fulfilled by the current design, in particular
– Bit-depth scalability– Color sampling scalability– Fine-granular scalability
Application perspectives of such functionalities might require an update of the SVC applications & requirements document (probably next meeting).
The PDAM on Multiview Video Coding amendment (N9213) includes a well-aligned set of high-level syntax, HRD and buffer management specifications, fulfilling the MVC requirements such as view random access, view scalability, low-delay modes etc. The Joint Multiview Video Model (JMVM) 5 (N9214) includes further technology under consideration for improving compression performance, such as illumination compensation, combined motion/disparity vector encoding.
Documents approved:No. Title TBP Available
14496-4 Conformance testing95
9191 Text of ISO/IEC 14496-4:2004/PDAM 30 Conformance Testing for New Profiles for Professional Applications
N 07/07/06
9192 Text of ISO/IEC 14496-4:2004/PDAM 31 Conformance Testing for SVC Profiles
N 07/10/07
14496-5 Reference Software 9194 Text of ISO/IEC 14496-5:2001 / PDAM 18 Reference Software for
New Profiles for Professional ApplicationsN 07/07/13
9195 Text of ISO/IEC 14496-4:2001 / PDAM 19 Reference Software for SVC
N 07/10/07
14496-10 Advanced Video Coding9196 Disposition of Comments on ISO/IEC 14496-10:2005 / FPDAM 3 N 07/07/139197 Text of ISO/IEC 14496-10:2005 / FDAM 3 Scalable Video Coding N 07/09/159198 Text of ISO/IEC FDIS 14496-10:200X Advanced Video Coding
(4th edition)N 07/09/15
9199 Joint Scalable Video Model (JSVM) 11 N 07/09/159212 JSVM 11 Software N 07/09/159213 Text of ISO/IEC 14496-10:200X / PDAM 1 Multiview Video
CodingN 07/07/20
9214 Joint Multiview Video Model (JMVM) 5 N 07/07/209215 JMVM 5 Software N 07/08/10
12. MPEG-7 Visual
12.1. MPEG-7 Visual related work in San JoseThe MPEG-7 breakout group was active during the whole week. Input documents related to the Visual part in 15938-3 and Photo Player MAF (23000-3) are listed in the table below. All of these documents were reviewed and discussed.
14588
Weon-Geun OhIk-Hwan ChoA-Young ChoJu-Kyoung JinWon-Keun YangJun-Woo LeeDong-Seok Jeong
Clarification of MPEG-7 VCE-6 testset
14593Weon-Geun OhHyeong-yong JeonChi-jung Hwang
Modification of VCE 6 Independent Data Set
14594Weon-Geun OyyyhHyeong-yong JeonChi-jung Hwang
An Image Identifier based on Feature points for Complex conditions
14618
Weon-Geun OhA-Young ChoIk-Hwan ChoJu-Kyoung JinJun-Woo LeeDong-Seok Jeong
Experiment Results of Image Identifier for Basic Group
14619Weon-Geun OhWon-Keun YangDong-Seok Jeong
Improved CE Results of MGST Based Descriptor for MPEG-7 VCE-6 Complex Condition
14636 Min-Jeong LeeHeung-Kyu Lee Cross verification result for ETRI VCE-6 proposal
14637Sang-ki KimHyobin LeeSangyoun Lee
CE Report for VCE-5
14675 Kota Iwamoto Revision of the Core Experiment Description for VCE-796
Ryoma Oami
14677 Kota IwamotoRyoma Oami Suggestion of Dataset Size Reduction for VCE-7
14679 Kota IwamotoRyoma Oami Contribution to the Test Dataset for VCE-7
14687 Karol Wnukowicz Cross verification report of the experiments on image signature (VCE-6)
14692 Karol WnukowiczWladyslaw Skarbek
A proposal for image signature based on trajectory of features
14706Quqing Chen Zhi-bo ChenLouis Chevallier
Requirement of Video Annotation
14713 Paul BrasnettMiroslaw Bober Further Improvements to the Image Identifier XM (VCE6)
14743 Paul BrasnettMiroslaw Bober
VCE-6 Experimental Conditions following Reflector Discussions
Current Work Items Review of the CE’s results
VCE-5 - Evaluation of MPEG-7 Face Recognition Technology on IR Images
VCE-6 - Image Signatures VCE-7 – Video Signatures
Photo Player MAF S/W development – second version Awaiting bug fix – Systems promised to provide a solution within 2 weeks
Editorial Work Call for Proposals on Visual Signature Tools Visual CE Document XM Version 31 ISO/IEC 23000-3:2007/FPDAM 1 [PP Ref S/W] DoC on Part-8 Amd
Joint meeting with Requirements Review requirements and prepare CFP on Visual Signature Tools
VCE-5 Improved results on complex data (occlusion, etc) Equal error rate reduced to 21%
VCE6: Image Signatures - Simple Case XM method improved Last meeting: 98.86% detection at below 1ppm false alarm rate This meeting: 99.74% detection at below 0.1%ppm false alarm rate CfP requirement:
Complex Case (significant image cropping, etc) Good progress, but still above 1ppm target Expecting to reach the target next meeting
We make testing more demanding Independence test-set increased from 60k images to 100k images Detection test-set increased from ~4k to 10k base images Other changes under discussion
VCE7: Video Signatures - Work is focusing on test condition and data collection 25 hours of additional test data received from NEC – many thanks! We have approximately 40 hours of test data now Modified CE conditions to reduce content required to ~200 hours
97
KBS is considering making available some content for MPEG-7 testing
CfP on Image and Video Signature Tools Human fingerprints can be measured and recorded without having to alter the finger,
which is one of their great advantages. They provide a reproducible and reliable but passive means of identification – in contrast
to a tattoo, for example, which must be actively added. This distinction is also important in the identification of visual content: the Visual
Signature Tools will be based on intrinsic measurements like the fingerprint, rather than extrinsic labels like the tattoo.
The following test scenarios and materials are envisaged: Image Signatures:
Dataset of approx. 130.000 images Independence tested on 8.45 billion image pairs Robustness tested on 10.000 base images + their modified versions
Video Signatures 200 hours of video content required 10.000 longer clips 50.000 shorter clips
Currently, the following timelines are planned: Image Signature
Final Call for proposals: 2007.07.13 Submission deadline: 2007.10.10 (by 23.59 Hours GMT) Evaluation of answers: 2007.10.20 – 26 (During the 82nd MPEG meeting and the
weekend before: proponents are strongly advised to present their proposals in person.)
PDAM: 2007/10 FPDAM: 2008/04 FDAM: 2008/10 AMD: 2009/01
Video Signature Preliminary Call for test data & proposals: 2007.07.13 Collection of video test data: 2007.10.10 Finalisation of experimental conditions / Final Call for Proposals: 2008.01.18 Submission deadline: 2008.04.16 (by 23.59 Hours GMT) Evaluation of answers: 2008.04.26 – 05.02 (During the 84th MPEG meeting and
the weekend before: proponents are strongly advised to present their proposals in person.)
PDAM: 2008/04 FPDAM: 2008/10 FDAM: 2009/04 AMD: 2009/07
One input document on video annotation was considered (M14706). In this context, while all relevant types of metadata are available within the MPEG-7 framework, proper embedding, storage and transport of metadata with the video stream is a topic that requires further clarification for specific application domains.
12.2. Output documents related to MPEG-7 Visual
No. Title TBP Available98
15938-3 Visual9216 Call for Proposals on Visual Signature Tools N 07/07/139217 MPEG-7 Visual XM Document version 31.0 N 07/07/209218 Description of Core Experiments for MPEG-7 New Visual
ExtensionsN 07/07/06
15938-8 Extraction and Use of MPEG-7 Descriptions9219 Disposition of Comments on ISO/IEC TR 15938-8:2002 / DAM 3 N 07/07/139220 Text of ISO/IEC TR 15938-8:2002/Amd.3 (Technologies for
digital photo management using MPEG-7 visual tools)N 07/07/06
12.3. Output documents related to MPEG-A Photo Player MAF
No. Title TBP Available23000-3 Photo Player Application Format
9221 Disposition of Comments on ISO/IEC 23000-3 / PDAM 1 N 07/07/069222 Text of ISO/IEC 23000-3 / FPDAM 1 Reference Software for
Photo Player MAFN 07/07/27
13. 23002 MPEG-C Video Technologies
13.1. 23002-3
Document reviewed:
14700
Fons Bruls Jan van der MeerChris Varekamp Arnaud BourgeYann Picard
Proposal to amendment MPEG-C Part 3
It is stated that the simple stereo application which can currently be implemented by using MPEG-C part 3 could incur quality problems in cases where scenes with large depth changes (i.e. large occlusion areas) need to be processed. To overcome this limitation, it is proposed to transmit multiple videos for multiple foreground or background layers. An option to transmit „partial background“ only for the occluded areas (instead of encoding the background multiple times) is presented. Even though this partially resolves the problem of highly increased data rate, the idea seems not to be fully worked out yet. More study is needed, in particular- could smaller-size frames be used for the additional background- duplicate transmission of motion vectors – how much overhead does this cost?Since there would certainly not be a major change to the standard, and similar cases (requesting small improvements to existing standards under the perspective of well defined application requirements) are more frequently brought to the attention of the video subgroup, it was decided to install an „AHG on investigating video standards by application needs“ with the mandate to perform technical study on such issues.
13.2. 23001-4 and 23002-4 Reconfigurable Video Coding (RVC)
(High-level summary, for details on particular documents see ISG report)
General
14592 General Royalty Cost Optimization with Reconfigurable Video Coding
14650 General PREESM in the RVC framework14739 General Simulator in the Eclipse environment for RVC
99
Review of M14592 Information about the possible use of RVC w.r.t. licensing. Presents „rate-distortion-
royalty“ optimization curves (using Lagrangian methods). Registry needed for the purpose of implementation of royalty collection or allowing usage of tools. Tools could get paid based on their contribution to RD reduction. Interesting perspective for licensing RVC, but nothing technically to be done by MPEG.
Review of M14650 Multiprocessor platform for CALTROP project A working demo has given. The work will continue till the next meeting.
Review of M14739 Another simulator with Moses to replace Moses Recommendation: to put in RSM Implementation
Status of WD/RSM/Workplan (Marco) FU naming
Recommendation: to create a FAQ section on naming convention in VTL WD.
RVC repository structure VTL WD: FUs will be listed in one table listing RSM Implementation: will have two directories of FUs {algorithm, data
management} Recommendation: changes will be made to RSM Implementation (with an
editing period, Editor: Christophe) FU description format in VTL WD
Recommendation: to use ‘Pseudo code’ style format and to move ‘Cal-style’ format
Liaison with SMPTE
14686 General SMPTE liaison to JTC1/SC29/WG11 on RVC
todo
CE 1 (to be discussed on Tuesday)
14757 MPEG-B RVC Core Experiment Report on Extension to support non-MPEG standards
14657 MPEG-B Result of RVC CE 1.1
14658 MPEG-B CDDL-Based decoder description for constructing ADM and syntax parsing
14747 MPEG-B Report on CE on RMC Bitstream Syntax Description Review of M14757
Cal-based FU implementation started Will continue till next meeting
Review of M14657 Review of M14658 Review of M14747
Recommendation: to continue CE till next meeting with a thorough evaluation plan
CE 2 (to be discussed on Tuesday)
14629 MPEG-C Functional units of AVC inter prediction for RVC video tool library
14632 MPEG-C Proposed text of the RVC FUs for MPEG-4 AVC and MPEG-2
100
Review of M14629 Proposal of 5 FU descriptions (with CAL implementation) for inter prediction of
AVC Recommendation: to adopt the proposal in VTL WD
Review of M14632 Recommendation: to change the FU description in Pseudo code format and
adopt in VTL WD
EE related (to be discussed on Tuesday)
14756 MPEG-C RVC Exploration Experiments Report on new 8x8 Inverse Transform and Quantization Tools
Review of M14756 Will continue till next meeting
Conformance testing and implementation issues
14630 MPEG-C A CAL-based conformance testing environment for RVC video tool library
14655 MPEG-C From AVC to SVC: minor and major modifications in a RVC decoder implementation
14721 MPEG-C ISO/IEC 23002-2 in RVC Implementation14722 MPEG-C ISO/IEC 23002-1 IDCT Implementation in CAL Testbed Update Review of M14630
Recommendation: to adopt in conformance WD Review of M14655
Recommendation: – to reflect the SVC FU development plan to workplan– to setup an EE on SVC
Review of M14721 and M14722 Recommendation: to adopt FU description in VTL WD and RSM
Joint meeting with Systems on RVC and M3W Recommendation: to put an introductory section on the link between RVC framework
and M3W in MPEG-B WD
Discussion of Core Experiments and in particular the issue of parserTwo technologies:- CALML parser (where the linkage between BSDL and parser can be implemented
differently, such that only BSDL and CALML parser would establish conformance points)- CDDL parser- There would be a difference about normative conformance point – would the entire parsing
implementation be normative, or only the interfaces at BSDL and CALML- Delay CD on 23001-4 until implementation of CALML parser is available and CE have been
performed- Both parser concepts should be verified with CAVLC/CABAC- Delay CD on 23002-4 until it is more complete- CE document and work plan (incl. list of FU that will be in 23002-4) by end of week
• Codec Configuration Description (23001-4) – Issue of parser not finalized yet in CE– Implementation of CALML parser will be available shortly after meeting (concept
appears appropriate, but no proof by implementation yet)– Issue of CALML/BSDL vs. CDDL to be resolved in CE
101
– None of the two concepts has been implemented with more advanced entropy codecs such as CAVLC and CABAC
• A delay of 23001-4 CD by one more meeting cycle is requested
• CE1: Decoder Description Language• Candidates
– CDDL – XML-based DDL
• All participants have agreed on clear evaluation criteria (different in each of the sub-experiments), in particular to judge
– Language capability– Compactness– Implementation capabilities
• Video Tool Library (23002-4)– Decision taken to stay with pseudocode formulation – CAL based finite-state
machine formulation would better fit into non-normative annex showing concrete implementation
– Until now, only MPEG-4 SP is (almost) complete, but we expect more tools from other standards until October (see work plan)
– Issue of parser may have implication (additional FU definitions)• Also, delay by one more meeting cycle requested
Work plan:• Very precise analysis about current development status, and plans/commitments to
develop FUs– First version of library shall contain tools for MPEG-2 MP, MPEG-4 SP and ASP,
AVC BP and HP– Further FUs for SVC and Integer DCT/IDCT are already under investigation– Additional plan to investigate implementation of non-MPEG tools (AVS intra and
inter)• Major FU developments will be finalized until January• Additional tools for testing, code generation etc. under scope of work plan as well
Output document processing CCD WD 5.0 (Editor: CJ)
Introductory section on the link between RVC and M3W
VTL WD 5.0 (Editor: Yishin) FU naming: To create a FAQ section on naming convention in VTL WD The names of All FUs will be listed in one table and maintained. New FU descriptions
– M14629 Functional units of AVC inter prediction for RVC video tool library– M14632 Proposed text of the RVC FUs for MPEG-4 AVC and MPEG-2– M14721 ISO/IEC 23002-2 in RVC Implementation
RSM (Editors: Marco & Christophe) Restructuring of Toolbox
– two directories of FUs {algorithm, data management} Inclusion of Eclipse environment New FU implementations in CAL
– M14629 Functional units of AVC inter prediction for RVC video tool library102
– M14632 Proposed text of the RVC FUs for MPEG-4 AVC and MPEG-2– M14721 ISO/IEC 23002-2
Conformance WD 2.0 (Editor: Gwo Giun) M14630 A CAL-based conformance testing environment for RVC video tool library
New CE CE 1 decoder description language
– CE 1.1 Syntax Parser Formation and Description (Editor: Christophe/Hyungyu)– CE 1.2 Description of Network of FUs (Editor: Christophe/Hyungyu)– CE 1.3 Capability to support non-MPEG standards (Editor: Lu)
CE 2 Abstract FU description– CE 2.1 Description and implementation of FUs that are listed in VTL WD (Editor: Yishin )
Documents reviewed:
14592 Onur G. GuleryuzM. Reha Civanlar
Royalty Cost Optimization with Reconfigurable Video Coding
14629Gwo Giun LeeHe-Yuan LinMing-Jiun Wang
Functional units of AVC inter prediction for RVC video tool library
14630Gwo Giun LeeHe-Yuan LinMing-Jiun Wang
A CAL-based conformance testing environment for RVC video tool library
14632Kenji OtoiYoshihisa YamadaKohtaro Asai
Proposed text of the RVC FUs for MPEG-4 AVC and MPEG-2
14650NezanM. Raulet O. Déforges
PREESM in the RVC frameworkTool for rapid prototyping and deployment on different architectures. Supports parallelization and scheduling. Unlike other tools (e.g. Ptolemy, Moses), multiprocessor platforms are supported.
14655Raulet MickaëlPelcat MaximeBlestel Médéric
From AVC to SVC: minor and major modifications in a RVC decoder implementation
14657Hyungyu KimChungku YieEuee S. Jang
Result of RVC CE 1.1
14658
Sunyoung LeeJaebum JunSinwook LeeByoungjun KimHyungyu KimChungku YieEuee S. Jang
CDDL-Based decoder description for constructing ADM and syntax parsing
14686 Gavin Schutz Liaison input on 29n8435 - RVC
14721 Lazar BivolarskiYuriy A. Reznik ISO/IEC 23002-2 in RVC Implementation
14722 Lazar Bivolarski ISO/IEC 23002-1 IDCT Implementation in CAL Testbed Update
14739 Christophe LucarzSimulator in the Eclipse environment for RVCPresents a new simulation environment which overcomes some limitations that the Moses interface has.
14747 Joseph Thomas-Kerr Report on CE on RMC Bitstream Syntax Description
14756 Dandan Ding
RVC Exploration Experiments Report on new 8x8 Inverse Transform and Quantization ToolsPresents the textual and algorithm description of the tools that were implemented. IDCT and inverse quantization were exchanged successfully. No performance analysis (in concrete numbers) given.
103
14757 Dandan Ding
RVC Core Experiment Report on Extension to support non-MPEG standardsDescribes work items necessary to implement AVS intra decoder. In principle, the dataflow from the CAL model can be used, but all FUs like IDCT, scan, inverse quant., de-blocking filter would need to be exchanged replacing the existing VTL FUs. So far, only IDCT and IQ were implemented in the toolbox style. In the continuing CE, it would also be important to explore the common usage of parsing and VLD description mechanisms.
Output Documents:
No. Title TBP Available23001-4 Codec Configuration Representation
9223 WD 5 of ISO/IEC 23001-4 Codec Configuration Representation N 07/07/1323002-4 Video Tool Library
9224 WD 5 of ISO/IEC 23002-4 Video Tool Library N 07/07/209225 Description of Core Experiments in RVC N 07/07/069226 RVC Simulation Model (RSM) V5.0 N 07/08/039227 RVC Work Plan N 07/07/069228 RVC Conformance Testing Working Draft 2.0 N 07/07/209229 Description of Exploration Experiments for Toolbox Extensions N 07/07/06
14. Explorations – Free Viewpoint Television
A joint meeting on FTV was held with the Requirements SG. In this context, a certain level of clarification was achieved about what FTV actually is (in terms of representation between input and output):- Multiple videos from array of cameras in (plus additional data such as depth and camera
parameters)- Arbitrary views (as allowed by the available view range of cameras) out- FTV is a representation format (normative) plus (possibly non-normative) devices at
transmission and receiver end, such as view renderer or view projection/interpolation.- The goal of FTV is generation quasi continuous views, while MVC as currently standardized
by JVT is about best compressing a discrete set of views, which most probably will appear as a core element of FTV.
An actual technical solution for FTV is not decided (and will may only be decided after a possible CfP). According to the technical inputs that were brought so far, it is most likely that in addition to a representation of the input views, a method of depth representation will be required. Problems arising in this context are – the lack of test sequences with reliable depth data, and even the lack of a reliable method for
generating depth data,– the mutual influence between the quality of depth data, the quality of decoded video data an
the quality of view rendering,– the circumstance that no references are available for interpolated views, unnatural artifacts
may occur during view navigation, and in general the quality can only be judged by extensive viewing tests.
To get more insight into these issues, it was decided to set up an exploration experiment, which also could bring MPEG into an adequate position to perform a CfP (generation/gathering of test material, evaluation methodology):
104
– to get judgments about the quality of available test materials for the purpose of FTV testing (and define requirements for test materials and acquire new ones),
– to get more insight into the relationship of multiple view video coding, depth map representations and view synthesis,
– to generate results on various levels of quality to be used in the set up of evaluation procedures.
Documents reviewed
14626
Taka Senohkenji YamamotoRyutaro OiTomoyuki MishinaMakoto Okui
Consideration of image depth information (already presented in JVT & AHG)Requests that depth information should be given by actual object distance. See notes in JVT report.
14631 Hideaki KimataShinya Shimizu
Proposal on MVC Requirements for different camerasAdopted (was in principle already approved by last meeting)
14638
Yo-Sung HoKwan-Jung OhCheon LeeSangBeom LeeSan-Tae Na
Depth Map Generation and Depth Map Coding for MVC (already presented in JVT & AHG)
14639Yo-Sung HoKwan-Jung OhCheon Lee
Geometrical Compensation for MVC (already presented in JVT & AHG)
14647 Toshiaki Fujii Proposal on EE for FTV
14648Toshiaki FujiiHideaki KimataShigeyuki Sakazawa
Requirements for FTV
14740 ITU-T SG 9 via SC 29 Secretariat Liaison Statement from ITU-T SG 9 [SC 29 N 8597]
Output document:No. Title TBP Available
Exploration – Free Viewpoint TV Coding9230 Description of Exploration Experiment in FTV N 07/07/06
15. Other issues - Color
14615Tokumichi MurakamiKohtaro AsaiShun-ichi Sekiguchi
Requirement of Real-Color Video Coding for Consumer ApplicationClaims that „dirty color effects“ become visible in cases of 4:2:0 color coding. Even for consumer products, many cameras are equipped with 4:4:4 sensors. For 4:2:0 there is an upper bound in quality of color, even if rate is increased. Possibility of further improving 4:4:4 coding? No evidence is brought for that – in fact, this issue was already thoroughly investigated in the context of PP definitions.However, in principle everything is there from the new professional professional profiles. Proponent should check whether the appropriate level is available in new professional profiles.
14616 Shun-ichi SekiguchiShuichi YamagishiYoshihisa YamadaKoht
On Performance Comparison between 4:4:4 coding and 4:2:0 codingInvestigated performance 4:4:4 Predictive Profile vs. High Profile. Shows that even at bitrates that are suitable for consumer applications the „transition point“ from which 4:4:4 is better than 4:2:0 is at rates which are interesting for consumer applications. „Transition point“ between RGB and YUV coding seems to be at higher rates, however
105
(Question: Can YUV and RGB SNR be directly compared? The transformation is not lossless in case of 8 bit data).
14627
Maeng-Sub ChoJin-Seo KimBon-ki KooSang-Kyun Kim
Initiating a new application format for Consistent Color ReproductionRequest that colour information metadata should be transferred along with the video data. For example, color transformations that would be useful for specific monitor types. No evidence is brought that the tools avalable in the MPEG standards (-2,-4,-7,-AVC) are not sufficient for this purpose. It is not a matter of a MAF, because everything a display manufacturer does from the colour metadata should be his own business and non-normative.
14628
Maeng-Sub ChoJin-Seo KimBon-Ki KooSang-Kyun Kim
Parameter set for effective and consistent color reproduction
106
Annex I – JVT report
107
Annex J – Audio report
Source: Schuyler Quackenbush, Chair, Audio Subgroup
1 Opening of the meeting.............................................................................................................32 Administrative matters...............................................................................................................3
2.1 Approval of previous meeting report 32.2 Approval of agenda and allocation of contributions 32.3 Task Groups 32.4 Communications from the Chair 32.5 Joint meetings 32.6 Received National Body Comments and Liaison matters 3
3 Record of AhG meetings...........................................................................................................33.1 AhG Meeting on Spatial Audio Object Coding Sunday 1300-1700 3
4 Audio plenary, joint meeting and task group activities.............................................................64.1 Review of AHG reports 64.2 Received national body comments and liaison matters 64.3 Joint Meetings6
4.3.1 Audio, ISG on Complexity of AAC-ELD-BS CE Wed 1100-1200...............................64.3.2 Audio, Req on FTV and Speech and Audio Wed 1200-1300.........................................64.3.3 Audio, ISG on tools for video coding tools repository Thu 1400-1500..........................6
4.4 Task Group discussions 74.4.1 MPEG-4 ELD..................................................................................................................74.4.2 Speech and Audio Exploration......................................................................................104.4.3 SAOC.............................................................................................................................134.4.4 MPEG-1, MPEG-2, MPEG-4 and MPEG Surround audio, conformance, reference software..................................................................................................................................13
5 Meeting deliverables................................................................................................................145.1 Recommendations for final plenary 145.2 Establishment of Ad-hoc Groups 145.3 Approval of output documents 155.4 Responses to Liaison and NB comments 155.5 Press statement 15
6 Future activities.......................................................................................................................156.1 Schedule of future meetings 156.2 Agenda for next meeting 156.3 All other business 156.4 Closing of the meeting 15
Annex A Participants.................................................................................................................16Annex B Audio Contributions and Schedule.............................................................................17Annex C Task Groups...............................................................................................................20Annex D Output Documents......................................................................................................21Annex E Agenda for the 82nd MPEG Audio Meeting...............................................................22
108
16. Opening of the meetingThe MPEG Audio Subgroup meeting was held during the 81st meeting of WG11, July 2-6, 2007, Lausanne, Switzerland. The list of participants is given in Annex A.
17. Administrative matters17.1. Approval of previous meeting reportThe 80th Audio Subgroup meeting report was registered as a contribution, and was approved.
17.2. Approval of agenda and allocation of contributionsThe agenda and schedule for the meeting was discussed, edited and approved. It shows the documents contributed to this meeting and presented to the Audio Subgroup, either in the task groups or in Audio plenary. The Chair brought relevant documents from Requirements, Systems and MDS to the attention of the group. It was revised in the course of the week to reflect the progress of the meeting, and the final version is shown in Annex B.
17.3. Task GroupsTask groups were convened for the duration of the MPEG meeting, as shown in Annex C. Results of task group activities are reported below.
17.4. Communications from the ChairThe Chair summarised the issues raised at the Sunday evening Chair’s meeting, proposed task groups for the week, and proposed agenda items for discussion in Audio plenary.
17.5. Joint meetingsThe joint meetings with Audio over the course of the week are listed here and are reported on below.Groups What Where Day TimeAudio, ISG Complexity of AAC-ELD-BS CE Audio Wed 1100-
1200Audio, Req FTV – audio issues
Speech and AudioAudio Wed 1200-
1300Audio, ISG Video Codec Configuration
DescriptionAudio Thu 1400-
1500
17.6. Received National Body Comments and Liaison mattersThe NB Comments and Liaison documents for the meeting that require a response are as shown below.No. Title Response by
(There were none.)
18. Record of AhG meetings18.1. AhG Meeting on Spatial Audio Object Coding Sunday 1300-1700Jeongil Seo, ETRI, presented
14595
Inseon JangJeongil SeoSeungkwon BeackKyeongok Kang
Report on the SAOC RM0 Evaluation Test at ETRI
109
Oliver Helmuth, FhG, presented
Heiko Purnhagen, Coding Technologies, presented
Henney Oh, LGE, presented
Werner Oomen, Philips, presented
Schuyler Quackenbush, Audio Research Labs, presented
14598 Schuyler Quackenbush
Report on Spacial Audio Object Coding CfP Subjective Listening Test
It was suggested that the listening test analysis spreadsheet be enhanced to Present test_a_s separately from test_a_1, test_a_2 and test_a_3. Present per-signal results, but only for proponent systems. Present mean results (averaged over all signals), for all systems under test
The Chair noted that the following still have to be discussed as part of the evaluation process: Side information rate limit Complexity limits
Yang-Won Jung, LGE, presented
This proposal only covered technology for stereo to stereo signal remixing (test_c). It documented that
Side information rate limits were satisfied for all test items (not more than 85% of the 3 kb/s per object limit was used by any test item).
Complexity limits were satisfied (less than 12% of MPEG Surround decoding for the set of items in test_c).
It further discussed several unique features of the proposal: Does not need downmix matrix Only needs object signal that is desired to be controlled (e.g. vocal signal for karaoke
application) Very low complexity
Juergen Herre, FhG, presented
14669Oliver HellmuthJuergen HerreLeonid Terentiev
Report on Spatial Audio Object Coding Subjective Tests at Fraunhofer IIS
14703 Jonas EngdegårdHeiko Purnhagen
Report on Spatial Audio Object Coding Subjective Tests at Coding Technologies
14734
Henney OhYang-Won JungDongSoo KimHyunKook Lee
LGE Listening test report on SAOC RM selection
14684 Jeroen KoppensWerner Oomen
Report on Spatial Audio Object Coding Subjective Tests at Philips
14733Yang-Won JungHenney OhHyo Jin Kim
LGE Submission to SAOC CfP
14696
Jonas EngdegårdLars VillemoesHeiko PurnhagenOliver HellmuthAndreas HölzerKarsten LinzmeierJeroen Breebaart
CT/Fraunhofer IIS/Philips Submission to the SAOC CfP
110
This contribution highlighted aspects of the proposal system architecture and its supported functionality.Complexity is dominated by the decorrelator in the stereo pre-processor module. This decorrelator is comparable to those found in the MPEG Surround decoder (which may have up to 4). Hence, to a first approximation, the SAOC decoder has a complexity that is 20 % of the MPEG Surround decoder.Side-information bitrate was always below the limit of 3 kb/s per object. The average side information rate per object is 50% of the 3 kb/s /object or 9 kb/s per test item. Yang-Won Jung, LGE, presented
This contribution raises the question of how listeners grade the systems under test in the case that rendering was not accurate but sound quality was very good, as compared to when rendering was accurate but sound quality was not very good. It furthermore questions whether the technology submitted to the CfP is sufficiently good for key application areas (e.g. karaoke or teleconferencing) to be successful in the marketplace.The contribution suggests that there be two listening tests: one for overall quality and another for rendering accuracy. The Chair noted that the subjective tests done by the Audio Subgroup has always had to encompass more than one dimension of quality: testing of classical perceptual coders require that the listener judge the trade-off that may be made in the codec between output signal bandwidth and output signal distortion. Juergen Herre, FhG, suggested that listeners always have to incorporate multiple aspects of coder distortion into a single measure of subjective quality, and that two distinct tests, one for audio quality and one for rendering quality, would not be appropriate.The contribution asks for additional verification tests. The Chair asked the group whether this means do a test now or at the end of the standardization process. There was considerable discussion on how listening tests might specifically address the karaoke application.It was the consensus of the AhG that
There not be any additional testing at this time. The CE process should be modified to address issues raised by this contribution, e.g.
better listener instructions and listener training for the case of systems that have both audio coding artefacts and audio sound stage distortions.
The be an output document such as “First thoughts on verification test for SAOC” that captures tentative quality targets for performance of the finished SAOC specification.
Osamu Shimada, NEC, presented
This
contribution notes that objects may not be available as separate signals, and suggests that technology for separating objects into two signals, e.g. a mono signal with two talkers separated into two signals with one talker each, may be very useful for the teleconferencing application. It further showed how this concept could be integrated into the envisioned SAOC architecture.The Chair noted that this looked like an excellent first Core Experiment for SAOC.The Chair summed up the recommendations of the AhG as follows:
That the proposal from Coding Technologies, FhG and Philips be the SAOC Reference Model
14735Henney OhYang-Won JungHyo Jin Kim
Comments on SAOC evaluation
14656
Osamu ShimadaToshiyuki NomuraAkihiko SugiyamaOsamu Hoshuyama
A proposal for an additional SAOC functionality of separating real-environment signals
111
The CE process should be modified to address issues raised by this contribution, e.g. better listener instructions and listener training for the case of systems that have both audio coding artefacts and audio sound stage distortions.
The be an output document such as “First thoughts on verification test for SAOC” that captures tentative quality targets for performance of the finished SAOC specification.
19. Audio plenary, joint meeting and task group activities19.1. Review of AHG reportsThere were no requests to review any of the AHG reports.
19.2. Received national body comments and liaison mattersLiaison documents were reviewed and the drafting of the responses was delegated.
19.3. Joint Meetings 19.3.1. Audio, ISG on Complexity of AAC-ELD-BS CE Wed 1100-
1200
Marco Matavelli, ISG Chair, discussed a tool for assessing complexity of algorithms that is independent of implementation platform. This tool requires that the algorithm (e.g. AAC-ELD with and without the block switching tool) be implemented in ANSI C. The tool reports e.g. the frequency of usage of primitive C-language operators. Thursday at 2PM, the ISG Chair gave a demonstration of the complexity evaluation tool. This tool evaluates the number of arithmetic operations and number of memory accesses in a compiled program, and does so on a per-function The tool requires ANSI-C source code, which is then compiled using the tool, and the report generated by the tool. The Audio Subgroup will contact ISG for next steps.
19.3.2. Audio, Req on FTV and Speech and Audio Wed 1200-1300
Audio Chair presented text for requirements for joint speech and audio coding. The Requirements chair felt that the requirements were precise and consistent, and as such could be endorsed by Requirements.Masayuke Tanimoto, Nagoya University, presented14646 Kazuya Takeda SLPA (Selective Listening Point Audio) for FTV AudioThis contribution presented the basic concepts of Free Viewpoint TV (FVTV) as far as video capture, processing and presentation are concerned. It is anticipated that FTV will support pan and zoom functions in video presentation.It is desired that the audio component of an audio-visual presentation should remain consistent with the video presentation, so that the functionality of “zoom” and “pan” also should be supported. It was suggested that audio capture might be close-capture microphones at the sources, or distant microphones arrays, perhaps at the cameras.An audio demonstration from Nagoya Univeristy is available at http://www.sp.m.is.nagoya-u.ac.jp/~niwa/fvlp.html.Audio experts should review and add to N8944, “Preliminary Requirements for FTV,” which is expected to be re-issued at this meeting.
19.3.3. Audio, ISG on tools for video coding tools repository Thu 1400-1500
The ISG Chair gave a tutorial overview of the video tool repository, and also the CAL tool that permits the tool repository to be assembled into a working multimedia compression system. CAL is a dataflow language, in which “actors” are functional units that are “fired” when all data tokens are available. Actors encapsulate their own data state, and all input and output tokens are communicated with other actors via FIFOs. Ptollemy II and Moses are two frameworks that support CAL.
112
MPEG has developed an XML-based language (MPEG-B) that specifies the communication between CAL elements. CAL can be written either in the CAL language or in JAVA, but cannot be ANSI-C.
19.4. Task Group discussions19.4.1. MPEG-4 ELD
Werner Oomen, Philips, presented14688 Jeroen Koppens, Werner
OomenPhilips cross-check results of subjective quality of AAC-ELD
This contribution presented a listening test that assessed the performance of the following systems:Label Description Bitrate
[kbit/s]Delay [ms]
Ref Hidden reference - -3.5 kHz LP
3.5 kHz low-pass filtered test items - -
7.0 kHz LP
7.0 kHz low-pass filtered test items - -
AAC-LD MPEG-4 AAC-LD 32 42.6AAC-ELD
AAC-ELD as defined by ISO/IEC 14496-3:2005/FPDAM9, Enhanced low delay AAC'
32 33.3
G722.1C ITU-T G.722.1C 32 40AMR-WB
ITU-T G.722.2 24 25
The listening test results showed subjective quality as follows, where the ranking is significant at the 95% level of significance and where AAC-ELD is as specified in 14496-3:2005/FPDAM9, Enhanced low delay AAC:
AAC-ELD at 32 kb/s > AAC-LD at 32 kb/s > G.722-1 Annex C at 32 kb/s > AMR-WB at 24 kb/s
Heiko Purnhagen, Coding Technologies, presented14709 Fredrik Henn, Per Ekstrand,
Arijit BiswasCoding Technologies cross-check of AAC-ELD subjective audio quality
The listening test results showed subjective quality as follows, where the ranking is significant at the 95% level of significance, where AAC-ELD is as specified in 14496-3:2005/FPDAM9, Enhanced low delay AAC:
AAC-ELD at 32 kb/s > AAC-LD at 32 kb/s > G.722-1 Annex C at 32 kb/s > AMR-WB at 24 kb/s
Markus Schnell, FhG, presented14723 Markus Schmidt , Markus Schnell , Ralf Geiger Listening test results for AAC-ELDThe listening test results showed subjective quality as follows, where the ranking is significant at the 95% level of significance, where AAC-ELD is as specified in 14496-3:2005/FPDAM9, Enhanced low delay AAC:
AAC-ELD at 32 kb/s > AAC-LD at 32 kb/s > G.722-1 Annex C at 32 kb/s > AMR-WB at 24 kb/s
DiscussionThe Chair summarized the main point of these three contributions as follows:
ELD delivers superior performance relative to LD, and does so with lower delay. ELD delivers superior performance relative to other widely used state of the art codecs.
Ralf Geiger, FhG, presented14725 Ralf Geiger , Jürgen Herre On the sensitivity of T-Tests for MUSHRA Scores
113
The contribution noted that t-test may present a false conclusion due to statistical variation. Schuyler Quackenbush, ARL, presented this contribution on behalf of Yuriy Reznik, Qualcomm,14755 Yuriy Reznik Brief comment on complexity of MDCTThe main point of the contribution is that computation of a cascade of 8 shorter transforms should require approximately 30% less number of operations than computation of a longer transform. Ralf Geiger, FhG, presented14727 Ralf Geiger , Stephan Schreiner , Virgilio Bacigalupo ,
Markus Lohwasser , Tobias AlbertOn the Complexity of Block Switching
This contribution presents evidence on the complexity of actual implementations of codecs that implement block switching. It notes that, in practice, use of short blocks introduces an additional coding mode, plus the transitions to and from the short block modes, and that all of these modes need to be optimized.Specific numbers were presented, as follows:Complexity
AAC-LC on floating-point DSP had a Peak/Average ratio for block-switching coder of 125%
AAC-LC on fixed-point DSP had a Peak/Average ratio for block-switching coder of 115%
Code size AAC-LC on fixed-point DSP had a Code Size ratio for Long-only/Block-switching of
120%
DiscussionDavid Virette, France Telecom, noted that complexity relates to the specific set of tools that comprise the codec. The Chair noted that, while a complexity increase of 25% is significant, it will likely not prohibit adoption of technology in the marketplace. However, increase in complexity should be evaluated relative to the corresponding increase in performance.Markus Schnell, FhG, presented14724 Markus Schnell , Fredrik Henn Proposed Changes for AAC-ELDThis contribution proposes to make numerous small syntax changes that eliminate unused AAC-related syntax elements. They are:
Always include SBR configuration information when you transmit the ELD configuration information.
Eliminate unused AAC-related syntax elements, which can result in more than 1 kb/s savings when running the coder at a 48 kHz sampling rate.
Support both fine and coarse quantizers for SBR time-frequency grid.
The proposed changes retain the ability to generate the identical output waveforms as used in previous AAC-ELD listening tests, but with lower compressed rate.A consensus position on this contribution was deferred until discussion of 14705, Preliminary comments on ISO/IEC 14496-3:2005/FPDAM9 and resolution of its open issues.Ralf Geiger, FhG, presented14726 Ralf Geiger , Markus Schnell , Jürgen Herre ,
Manfred Lutzky , Kristofer KjörlingProposed Annex for AAC-ELD: Delayless Mixing
This contribution is a proposed informative annex on using frequency-domain mixing of AAC-ELD streams as a means of mixing without any additional delay. This only requires that an AAC-ELD bitstream be decoded and inverse quanitzed to obtain MDCT coefficients, which can be linearly combined to perform the mix. It also shows how SBR parameters can be combined in the parameter domain.Anisse Taleb, Ericsson, noted that, in practice, other aspects of an MXU transport system may dominate the delay due to the mixing operation.There was some discussion of the contribution text. The Chair summarized the requested edits as follows:
114
The referenced 3GPP specification is extremely short. Instead of referencing this, the text will be slightly reworded and included in the Informative Annex.
The word “essential” will be changed to “highly desirable” The words “without introducing additional …” will be changed to indicate “lowest
possible delay” Remove text that such as “no block switching” that might conflict with the possible
adoption of the AAC-ELD-BS Core Experiment technology.
A consensus position on this contribution was deferred until discussion of 14705, Preliminary comments on ISO/IEC 14496-3:2005/FPDAM9 and resolution of its open issues.David Virette, France Telecom, presented14720 David Virette, Pierrick
PhilippeAdditional information for AAC-ELD instantaneous block switching CE
This contribution gives information on the additional delay, additional complexity and increased in quality associated with the proposed block switching algorithm. A comparative listening test shows improvement for AAC-ELD-BS relative to AAC-ELD for signals es01, ei02, es03 and si02 at the 95% level of significance. The contribution presented several comparisons of complexity. They showed moderate increases or decreases of complexity, and concluded that the complexity of block switching was such that it did not preclude adoption in the marketplace. It further noted that quite successful audio codecs (e.g. MP3 and AAC) use block switching, so that block switching is obviously not an impediment to market adoption.Concerning applications that use frequency-domain mixing, the contribution showed how zero-delay mixing could be achieved via
Exploiting masking to conceal some pre-echo mixing errors Using predictive signal estimation to estimate areas where non-perfect reconstruction
would otherwise occur.
Quality issuesThe Chair asked interested experts, including Ralf Geiger and David Virette, to have a break-out that that verifies exactly what tools constitute the AAC-ELD-BS and AAC-ELD systems in the listening test presented in this contribution.Juergen Herre, FhG, noted that the differences relate to using the FhG encoder for one system and the FT encoder for the other as opposed using the FhG encoder for both systems. The impact of this lack of control in the experimental process will be studied by audio experts. The Chair requested that interested experts study these two issues and report back to the Audio Subgroup Wednesday at 2PM.Complexity issuesThe contribution reported increases in execution time for block switching versus long-only using the 3GPP aacPlus (HE-AAC-V2) encoder or decoder of less than 3%. However Bernhard Grill, FhG, said that this code is optimized for sound quality and not computational efficiency. However, Anisse Taleb, Ericsson, noted that the 3GPP complexity data uses weighted MOPS which maps very well to actual complexity of DSP implementations.Frequency-domain mixing issuesRalf Geiger, FhG, asked whether the pre-echo issues get better or worse as bitrate increases. Juergen Herre noted that there is some complexity increase due to window compensation steps and also to a signal estimation step when perfect reconstruction is not possible under the constraint of zero delay.JungHoe Kim, Samsun, presented14671 Miyoung Kim, Eunmi Oh Crosscheck of FT Core Experiment on AAC-ELDThis contribution presented a cross-check listening test using the same waveforms as was used in the previous contributions. Comparative listening test shows improvement for AAC-ELD-BS relative to AAC-ELD for signals es01, ei02 and si01, sm02 at the 95% level of significance. The statistic used was the two-sided t-test.
115
These results agreed with the France Telecom results for es01 and es02, but differed from the FT results for si01, si02 and sm02.David Virette, France Telecom, presented14705 FrNB Preliminary comments on ISO/IEC 14496-3:2005/FPDAM9This contribution presented a preview of what the FNB comments might be on the ballot on ISO/IEC 14496-3:2005/FPDAM9Support for Core Experiment for Enhanced Low Delay AACThe FNB supports adoption of this Core Experiment.SBR signalling and transportThe FNB does not support these changes, and additionally cannot support changes in the AAC-ELD syntax that diverges from the AAC syntax. SummaryThe Chair noted the open issues and proposed that the break-out groups report back Wednesday at 2PM and that discussion of this CE continue at that time.Report by break-outDavid Virette, France Telecom, presented a slide that summarized the results of the break-out.
WAV files have been generated using the bitstreams from the last meeting’s RM0. This is done in a way that is not compliant, such that the RM decoder cannot decode the bitstreams, but correctly synchronizes the based codec data with the SBR data. It was the consensus of the group that this does not materially affect the subjective quality results.
There is agreement that the block switching tool improves the quality of test item si02 (castenets). This is based on listening done at the MPEG meeting in which the comparison was done between the FT with block switching enabled and without blocks switching enabled. There is ongoing discussion as to the improvement of the speech items, since aspects of the listening tests presented in the contributions are
There is agreement that block switching has an impact on zero-delay mixing.
The Chair asked that this break-out continue but focus on discussing a process that will lead to a consensus position on this issue. He further noted that this issue must be resolved prior to writing the DoC on AAC-ELD FPDAM, which will be done at the next MPEG meeting.Further discussion and discussion in closing Audio plenaryThe chair explained to the French HoD that the France Telecom proposal has brought all information required by the core experiment methodology and fulfilled all required steps of this procedure (N7140). But the Chair added that it is up to the audio subgroup to decide whether the core experiment is accepted or not, and in the case of this core experiment on the Block Switching in AAC-ELD, there was no consensus in the audio subgroup to accept or reject the proposed technology.After considerable break-out discussion, the following was agreed to:
That the experimental method associated with the additional evidence brought by FT to this meeting was not an ideal controlled experiment (in that it was not Coder A vs. Coder A + Block Switching).
It was agreed by audio experts (including those from France Telecom and Fraunhofer) that Block Switching improves the quality of at least one item (si02), but that for other items (including speech items es01 and es02) the result was inconclusive.
That the quality of the proposed technology on speech items has to be further assessed to as a means to conclude this core experiment.
That the complexity information provided to this meeting is correct, although not all experts agree on the interpretation of this information.
It was the consensus position of the Audio Subgroup to take the following action: Draft a workplan in which FT and FhG collaborate to get additional performance
information Put all candidate technology contributed to this meeting into a “Technology under
consideration for AAC-ELD” document.
116
This position was acceptable to the French National Body.
19.4.2. Speech and Audio Exploration
Taejin Lee, ETRI, presented14633 Taejin Lee, Minje Kim, Jeongil Seo, Kyeongok
Kang, Youngcheol Park, Hochong Park , Kim Rin Chul
Report on Speech and Audio Coding Listening Test at ETRI
This presented results from a number of test sites, bit rates and M/S modes.JungHoe Kim, Samsung, presented14668 JungHoe Kim, Miyoung Kim,
Eunmi OhListening test results for Exploration of Speech and Audio Coding
This presented test results for 16, 20 and 24 kb/s rates for stereo. David Virette, France Telecom, presented14704 David Virette, Pierrick
PhilippeListening test results for Speech and Audio Coding exploration
This presented test results for 16, 20 and 24 kb/s rates for stereo. The contribution noted that the following signals appear to be the most critical:Mix content (critical for both codec)Mix02Mix03Mix04Mix09Music content (critical for AMR WB+)Mu02Mu05Mu08Mu12Speech content (critical for HE AAC v2)Sp02Sp03Sp04Sp05
Yuriy Reznik, Qualcomm, presented14716 Yuriy A. Reznik, Ravi
ChivukulaListening test results for speech-audio coding explorations
This presented test results for 16kb/s rates for stereo. Dong Soo, Kim, LGE, presented14737 Dong Soo Kim, Hyun-Kook Lee, Henney
Oh, Yang-Won JungListening Test results on Speech and Audio Exploration
This presented test results for 20 and 24 kb/s for both mono and stereo.Schuyler Quackenbush, Audio Research Labs, presented14599 Schuyler Quackenbush Pooled Results of Speech and Audio Listening Tests.This contribution pooled all the listening test data into a single pivot table. It presented results by
Test site for each rate and mode (mono or stereo), pooled over all test items and listeners. System under test, pooled over all sites, all test items and all listeners. System under test for each test item, pooled over all sites and all listeners
DiscussionThe following table summarizes the various bitrates and modes tested by the several test sites.
Test SiteBitrate
(kb/s)Mode (Mono/Stereo)
ETRI 16 M117
Kwangwoon 16 METRI 16 SKwangwoon 16 Sorange 16 SQCOM 16 SSAIT 16 SLGE 20 MUOS 20 MYonsei 20 MLGE 20 Sorange 20 SSAIT 20 SUOS 20 SYonsei 20 SLGE 24 MLGE 24 Sorange 24 SSAIT 24 S
The Chair will continue to revise the pooled data spreadsheet and bring it to the group for approval as part of an output document.Kristofer Kjörling, Coding Technologies, presented14701 Kristofer Kjörling, Heiko
PurnhagenProposed additional test-items for the speech and audio exploration.
This contribution purposes additional test items, as shown here:Item name Contents Length Sampling
rateMono/stereo
Music_1 Heavy metal drums and guitars 19.5 sec
48kHz Stereo
Music_2 Classical music, orchestra 13.0 sec
48kHz Stereo
Music_3 Wide stereo pop-recording, instrumental
16.3 sec
48kHz Stereo
Music_4 Wide stereo pop-recording, with vocals
22.2 sec
48kHz Stereo
Music_5 Wide stereo rock recording, guitar and vocals
24.7 sec
48kHz Stereo
speechOverMusic_1 Sports commentator 12.6 sec
48kHz Stereo
speechOverMusic_2 Female speech with background orchestra
11 sec 48kHz Stereo
speechOverMusic_3 Radio announcement 20.3 sec
48kHz Stereo
speechOverMusic_4 Radio commercial, children 17.0 sec
48kHz Stereo
speechOverMusic_5 Radio jingle 19.5 sec
48kHz Stereo
These items were intended to strengthen the speech over music items. Furthermore, the stereo items are felt to be superior to the current Framework items. The Chair noted that, with this contribution, there is a total of 38 item in the proposed test set.
118
It was noted that we could have different items for stereo and mono. The Chair proposed a listening breakout to take a first step toward selecting a test set.Eunmi Oh, Samsung, presented14731 Eunmi Oh, JungHoe Kim, KiHyun Choo, Hosang
Sung, Miyoung KimResponse to CfI on speech and audio coding
This presented performance of New Technology that performs joint speech and audio coding. It noted that the selected state of the art codecs do not perform well for certain items, and proposed that these might be selected as critical items. Anisse Taleb, Ericsson, noted that another means to identify critical items is to select the ones for which the performance of the two state of the art codecs are very different. The contribution noted that there is a need for efficient, low-rate coding in mobile applications. Furthermore, in this application area, signals can have mixed content (e.g. speech, music and speech plus music). Traditionally, there are two distinct coding schemes: perceptually-based coding using frequency-domain noise shaping, and source-model-based coding using short- and long-term linear predictive models. The contribution proposed using a Modulated Lapped Transform having a flexible time/frequency resolution that can be responsive to the instantaneous signal statistics. It was noted that the proposed technology could be viewed as a superset of the classic AAC architecture. The complexity and delay of the New Technology is comparable to that of the state of the art codecs. Eunmi Oh noted that the current Framework document does not indicate low delay as an objective. Numerous experts noted that there is listening test results were presented only for stereo signals. There was interest in seeing performance for mono signals as well. Anisse Taleb, Ericsson, noted that the performance of the core coding engine would be best revealed using mono signals.The listening test data for 16, 20 and 24 kb/s stereo showed that the New Technology was better than or not different than the performance of the Virtual Codec. DiscussionYuriy Reznik, Qualcomm, noted that the good performance at 16 kb/s was very encouraging. Other experts also indicated that the technology was very interesting.The Chair put to the group that the contribution prompts the Audio Subgroup to consider what the next steps should be in this exploration effort.Kristofer Kjörling, Coding Technologies, requested that the group be able to evaluate the Samsung technology during the AhG period. Bernhard Grill, FhG, further requested that mono performance be made available. The Chair noted that next steps could be
Selection of test set for use with a Call for Technology Further investigation of Samsung New Technology, e.g. with mono signals Consensus on Requirements for a Call for Technology
Ericsson indicated that it is willing to cross-check 16, 20 and 24 kb/s stereo NT performance. Qualcomm is also willing to participate in such a cross-check.Samsung is willing to make these available during the week. Samsung will consider making additional material available, and will respond on Thursday morning.
19.4.3. SAOC
Regis Faria, LSI-TEC, presented14753 Regis
FariaNew reference architecture for wide spatial audio object coding and spatial sound frameworks
This presented a much broader architecture for sound scene rendering. The Chair noted that MPEG creates specification at points of interoperability. The Chair encouraged the presenter to continue discussions with interested experts.SAOC RM0 Complexity
119
Juergen Herre, FhG, presented additional information on the complexity of the CT, FhG, Philips SAOC proposal. This is summarized in the following table. Note that, in all cases, the proposal is below the complexity benchmarks indicated in the SAOC Evaluation document.
PCU PCU PCU Max. % Act. %Test case SAOC Max. MPS (of MPS) (of MPS)
a) (stereo to 5.1) 5,70 7,5 25 30 22,80
a) (stream comb.) 0,76 7,5 25 30 3,05
b) (mono to binaural) 3,29 3,6 12 30 27,40
c) (stereo to stereo) 12,82 19,2 12 160 106,86
19.4.4. MPEG-1, MPEG-2, MPEG-4 and MPEG Surround audio, conformance, reference software
Werner Oomen, Philips, presented14685 Frans de Bont, Werner
OomenMPEG-1/2 Layer 1/2 over MPEG-4 conformance bitstreams
This contribution defines conformance streams for Layer I and II. These streams are available now. It is the consensus of the Audio Subgroup to append this text to a Study on ISO/IEC 14496-4:2004/FPDAM 20, SLS Conformance.Heiko Purnhagen, Coding Technologies, presented14694 Andreas Schneider, Heiko Purnhagen, Alex
GroeschelProposed correction to MPEG-4 audio conformance
This contribution makes the conformance text less ambiguous and more in line with the text in the audio specification. It was the consensus of the Audio Subgroup to issue this as a DCOR at this meeting. Kelvin Lee, I2R, presented14673 Kelvin
LeeUpdated status of SLS conformance
This contribution presents a report on progress in SLS conformance. The current status is that 28 bitstream types have been defined and are available. Of these, 24 have been cross-checked. Still to be done is to produce and cross-check 4 types bitstreams for SLS with AAC Scalable core. This conformance effort led to discovery of errors in the reference software, and the associated bugfixes will be incorportated into the ISO/IEC 14496-5:2001/AMD 10:2007/DCOR 1, BSAC and SLS.JungHoe Kim, Samsung, presented14670 Miyoung Kim, JungHoe Kim,
MyungHoon Lee, Jeongil SeoStatus of BSAC Extension Conformance and Reference Software
This contribution reports that all BSAC-related conformance bitstreams have been generated and all except one have been cross-checked. It is expected that this will be cross-checked during this MPEG meeting. Reference Software is available. It was the consensus of the Audio Subgroup to add this to AMD 20, and to add all other maintenance bugfixes, specifically corrections to Parametric Coding for High Quality Audio.Pierfrancesco Bellini;, UNFI, presented14642 Pierfrancesco Bellini;, Paolo Nesi Updated SMR conformance bitstreamsThis contribution reports that the following progress has been made:
All streams converted to MP4 files All XML is encoded with BIM
120
In SMR conformance, 23 bitstreams are defined, 17 available, 0 are cross-checked. The editor is working to engage companies to perform the cross-check.Kristofer Kjörling, Coding Technologies, presented14702 Kristofer Kjörling, Heiko Purnhagen, Jeroen
Koppens, Matthias NeusingerAdditional corrections for the defect report on MPEG Surround.
This proposed two categories of changes:1. Bitstream syntax changes that permit more sensible decoding of 7.1 channel bitstreams by
5.1 channel decoders in the case of residual data. 2. Minor editorial corrections to the MPEG Surround text.
It was the consensus of the Audio Subgroup to incorporate these changes into a DCOR from this meeting.Mauri Vaananen, Nokia, presented14718 Mauri Vaananen, Juha Ojanpera, Miikka
VilermoOn the conformance of AAC decoders with LTP tool
This contribution presented a method for reliable conformance testing of decoders using the LTP tool. Since the proposed change may affect fielded encoders and decoders, a study was done:
Old encoders New decoders k=15 conformance is achievable, at worst with reset every 80 frames
New encoders Old decoders k=15 conformance is achievable, at worst with reset every 60 frames
New encoders New decoders k=16 conformance is achievable in every case
The proposed change is to remove the 16-bit rounding in LTP feedback loop. Give guidance to encoders for how to control noise in fixed-point implementations.
It is consensus of the Audio Subgroup to put his change into a Study on DST and MP3on4 and LTP.Old BusinessRalph Sperschneider noted
That N7694 is an outstanding proposed DCOR on conformance, and the Audio Subgroup agreed that this is to be incorporated into the same DCOR.
That, similarly, N7691, is an outstanding proposed DCOR, but to 14496-3. On review was judged to be without merit and will not be pursued.
That AMD 13, Parametric coding for high quality audio, is missing some conformance test sequences. The Audio Subgroup agreed to issue a DCOR to correct this.
That additional text be added to Study on 14496-3/DCOR 5, DST and MP3on4 to correct advice concerning conversion from mp3on4 format to “classic” mp3 format bitstreams (i.e. using “variable rate” mode to directly decode MP4 access units).
20. Meeting deliverables20.1. Recommendations for final plenaryThe Audio recommendations were presented and approved.
20.2. Establishment of Ad-hoc GroupsThe following ad-hoc groups were established by the Audio subgroup:
No. Title Mtg9256 AHG on Audio Standards Maintenance No9257 AHG on AAC-ELD, Speech and Audio Exploration and SAOC Yes
121
20.3. Approval of output documentsAll output documents, shown in Annex D, were presented in Audio plenary and were approved.
20.4. Responses to Liaison and NB commentsThe responses to Liaison and NB comments were prepared and approved.
20.5. Press statementThere was no Audio part of the press statement.
21. Future activities21.1. Schedule of future meetingsAd Hoc group meetings are indicated in Section 20.2. Unless otherwise indicated, Ad Hoc group meetings will be held at the location of the next MPEG meeting on the weekend preceding that meeting.
21.2. Agenda for next meetingThe agenda for the next MPEG meeting is shown in Annex E.
21.3. All other businessThere was none.
21.4. Closing of the meeting The 81st Audio Subgroup meeting was adjourned Friday at 13:45, with the Chairs “MPEG Headache” intact
122
Annex A Participants
First Name Last NameCountry Affiliation
Taejin Lee KR ETRIPierfrancesco Bellini Italy DSI-UNIFITi Eu Chan SG I2RKok Seng Chong SG Panasonic
Jwalant Desai IndiaWipro Technologies
Regis Faria BR LSI-TECRalf Geiger DE Fraunhofer IISBernhard Grill DE Fraunhofer IISOliver Hellmuth DE Fraunhofer IISJürgen Herre DE Fraunhofer IISHaibin Huang SG I2RYang-Won Jung KR LG ElectronicsDong Soo Kim KR LG ElectronicsJunghoe Kim KR Samsung AIT
Kristofer Kjörling SCoding Technologies
Kelvin Lee SG I2RTilman Liebchen DE LG ElectronicsTakehiro Moriya JP NTTMarkus Multrus DE Fraunhofer IISSua Hong Neo SG PanasonicPaolo Nesi I UNIFI DSIToshiyuki Nomura JP NECTakeshi Norimatsu JP PanasonicEunmi Oh KR SamsungHenney Oh KR LG Electronics
Werner Oomen NLPhilips Applied Technologies
Heiko Purnhagen SECoding Technologies
Schuyler Quackenbush USA ARLYuriy Reznik USA Qualcomm
Andreas Schneider DECoding Technologies
Markus Schnell DE Fraunhofer IISJeongil Seo KR ETRIOsamu Shimada JP NECRalph Sperschneider DE Fraunhofer IISAnisse Taleb SE Ericsson AB
Lijing u CNHuawei Technologies
Mauri Vaananen FINNokia Res. Center
David Virette FR France Telecom
R&D
124
Annex B Audio Contributions and Schedule
Sunday Paris X1300-1800 AhG on SAOC14595 Inseon Jang, Jeongil Seo,
Seungkwon Beack, Kyeongok Kang
Report on the SAOC RM0 Evaluation Test at ETRI
X
14669 Oliver Hellmuth, Juergen Herre, Leonid Terentiev
Report on Spatial Audio Object Coding Subjective Tests at Fraunhofer IIS
X
14684 Jeroen Koppens, Werner Oomen
Report on Spatial Audio Object Coding Subjective Tests at Philips
X
14703 Jonas Engdegård, Heiko Purnhagen
Report on Spatial Audio Object Coding Subjective Tests at Coding Technologies
X
14734 Henney Oh, Yang-Won Jung, DongSoo Kim, HyunKook Lee
LGE Listening test report on SAOC RM selection
X
14598 Schuyler Quackenbush Report on Spacial Audio Object Coding CfP Subjective Listening Test
X
14733 Yang-Won Jung, Henney Oh, Hyo Jin Kim
LGE Submission to SAOC CfP
X
14696 Jonas Engdegård, Lars Villemoes, Heiko Purnhagen, Oliver Hellmuth, Andreas Hölzer, Karsten Linzmeier, Jeroen Breebaart
CT/Fraunhofer IIS/Philips Submission to the SAOC CfP
X
14735 Henney Oh, Yang-Won Jung, Hyo Jin Kim
Comments on SAOC evaluation
X
14656 Osamu Shimada, Toshiyuki Nomura, Akihiko Sugiyama, Osamu Hoshuyama
A proposal for an additional SAOC functionality of separating real-environment signals
X
Monday0900-1200 MPEG Plenary London1200-1300 Lunch1300-1400 Audio Plenary Coire
WelcomeApproval of previous meeting report
14597 Schuyler Quackenbush 80th MPEG Audio Report XAhG Reports
14569 R. Sperschneider AHG on Audio Standards Maintenance
X
14570 S. Quackenbush Eunmi Oh AHG on SAOC CfP, AAC- X
ELD and Speech and Audio ExplorationLiaisonOutgoing Liaison statements
To IEC TC100 re: work in MPEG and AES on specifications for the signaling / carriage of MPEG Surround side information over PCM channels
To ITU-T re speech and audio
1330-1800 AAC-ELD14688 Jeroen Koppens, Werner
OomenPhilips cross-check results of subjective quality of AAC-ELD
X
14709 Fredrik Henn, Per Ekstrand, Arijit Biswas
Coding Technologies cross-check of AAC-ELD subjective audio quality
X
14723 Markus Schmidt , Markus Schnell , Ralf Geiger
Listening test results for AAC-ELD
X
14725 Ralf Geiger , Jürgen Herre On the sensitivity of T-Tests for MUSHRA Scores
X
14755 Yuriy Reznik Brief comment on complexity of MDCT
X
14727 Ralf Geiger , Stephan Schreiner , Virgilio Bacigalupo , Markus Lohwasser , Tobias Albert
On the Complexity of Block Switching
X
14724 Markus Schnell , Fredrik Henn
Proposed Changes for AAC-ELD
X
14726 Ralf Geiger , Markus Schnell , Jürgen Herre , Manfred Lutzky , Kristofer Kjörling
Proposed Annex for AAC-ELD: Delayless Mixing
X
14720 David Virette, Pierrick Philippe
Additional information for AAC-ELD instantaneous block switching CE
X
14671 Miyoung Kim, Eunmi Oh Crosscheck of FT Core Experiment on AAC-ELD
X
14705 FrNB Preliminary comments on ISO/IEC 14496-3:2005/FPDAM9
X
Tuesday0900-1300 Speech and Audio14633 Taejin Lee, Minje Kim,
Jeongil Seo, Kyeongok Kang, Youngcheol Park, Hochong Park , Kim Rin Chul
Report on Speech and Audio Coding Listening Test at ETRI
X
14668 JungHoe Kim, Miyoung Listening test results for X
126
Kim, Eunmi Oh Exploration of Speech and Audio Coding
14704 David Virette, Pierrick Philippe
Listening test results for Speech and Audio Coding exploration
X
14716 Yuriy A. Reznik, Ravi Chivukula
Listening test results for speech-audio coding explorations
X
14737 Dong Soo Kim, Hyun-Kook Lee, Henney Oh, Yang-Won Jung
Listening Test results on Speech and Audio Exploration
X
14599 Schuyler Quackenbush Pooled Results of Speech and Audio Listening Tests.
X
14701 Kristofer Kjörling, Heiko Purnhagen
Proposed additional test-items for the speech and audio exploration.
X
14731 Eunmi Oh, JungHoe Kim, KiHyun Choo, Hosang Sung, Miyoung Kim
Response to CfI on speech and audio coding
X
1300-1400 Lunch1400-1600 MPEG-4 and MPS14670 Miyoung Kim, JungHoe
Kim, MyungHoon Lee, Jeongil Seo
Status of BSAC Extension Conformance and Reference Software
X
14673 Kelvin Lee Updated status of SLS conformance
X
14685 Frans de Bont, Werner Oomen
MPEG-1/2 Layer 1/2 over MPEG-4 conformance bitstreams
X
14694 Andreas Schneider, Heiko Purnhagen, Alex Groeschel
Proposed correction to MPEG-4 audio conformance
X
14718 Mauri Vaananen, Juha Ojanpera, Miikka Vilermo
On the conformance of AAC decoders with LTP tool
X
14642 Pierfrancesco Bellini;, Paolo Nesi
Updated SMR conformance bitstreams
X
14702 Kristofer Kjörling, Heiko Purnhagen, Jeroen Koppens, Matthias Neusinger
Additional corrections for the defect report on MPEG Surround.
X
14584 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:2004/PDAM 29 [SC 29 N 8499]
X
14585 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-5:2001/PDAM 16 [SC 29 N 8503]
X
1800-1830 Liaison Liaison statement to IEC TC100, ITU-T
127
1930- Social Bus 2 to Ouchy, 500M east along lake. Meet at fountain.
Wednesday0900-1100 MPEG Plenary London1100-1200 Joint meeting: Audio, ISG Complexity of AAC-ELD
CE on block switchingX
1200-1300 Joint meeting: Audio, Req Requirements for Speech and Audio coding
X
14646 Kazuya Takeda SLPA (Selective Listening Point Audio) for FTV Audio
X
1300-1400 Lunch1400 AAC-ELD Breakout reportContinued discussion X
1500- SAOC14753 Regis Faria New reference architecture for
wide spatial audio object coding and spatial sound frameworks
X
1600- Review and add to N8944, “Preliminary Requirements for FTV.”
X
Thursday0900-1000 Review of Req FTVPreliminary resolutions X0900-1000 Breakout:Speech and Audio listeningDraft output documents
1300-1400 Lunch1400-1430 Joint meeting: Audio, ISG RVC and CAL tutorialDemonstration of ISG complexity assessment tool.
X
1500-
1800- Chairs meeting
Friday Audio plenary0900-1300 Recommendations for final
plenaryX
Establishment of new Ad-hoc groups
X
AhG Mandates XGet document numbers X
1000 Approve Responses to NB comments
X
1030 Approval of output documents
X
128
Review of Audio presentation to MPEG plenary
X
Agenda for next meeting XA.O.B. XClosing of the Audio meeting
X
1300-1400 Lunch1400- MPEG Plenary London
129
Annex C Task Groups
1. MPEG-D SAOC2. Speech and Audio3. MPEG-4 AAC-ELD4. MPEG-4 audio, conformance, reference software5. MPEG-D MPS
130
Annex D Output DocumentsNo. Title TBP Available
14496-3 Audio9235 ISO/IEC 14496-3:2006/AMD2:2006/Dcor 3, ALS No 07/07/069236 Study on ISO/IEC 14496-3/DCOR 5, DST and MP3on4 and LTP No 07/07/069237 Technology under consideration for AAC-ELD No 07/07/069238 Workplan for AAC-ELD No 07/07/069239 WD on ISO/IEC 14496-3, MPEG-4 Audio Fourth Edition No 07/07/06
14496-4 Conformance testing9240 DoC on 14496-4:2004/PDAM 29, SMR Conformance No 07/07/069241 ISO/IEC 14496-4:2004/FPDAM 29, SMR Conformance Yes 07/07/06
9242 ISO/IEC 14496-4:2004/AMD13:2007/DCOR 1, LD AAC test sequences
No 07/07/06
9243 ISO/IEC 14496-4:2004/DCOR 5, Audio Corrections No 07/07/06
9244 Study on ISO/IEC 14496-4:2004/FPDAM 20, SLS and MPEG-1/2 on MPEG-4 Conformance
No 07/07/06
9245 Status of SLS conformance No 07/07/069246 Status of BSAC Extension Conformance and Reference Software No 07/07/06
14496-5 Reference Software
9247 Study on ISO/IEC 14496-5:2001/AMD 10:2007/DCOR 1, BSAC and SLS, ALS Corrections
No 07/07/20
9248 Study on ISO/IEC 14496-5:2001/PDAM 20, MPEG-1 and -2 on MPEG-4 and BSAC Extensions
No 07/07/06
23003-1 MPEG Surround9249 ISO/IEC 23003-1:2007/DCOR 1 No 07/07/069250 Report on Spatial Audio Object Coding CfP Selection No 07/07/279251 First thoughts on SAOC Verification Test No 07/07/06
Exploration – Audio and speech coding9252 Report on Evaluation of Speech and Audio Framework No 07/07/279253 Workplan for Exploration of Speech and Audio Coding No 07/07/069254 Framework for Exploration of Speech and Audio Coding No 07/07/069255 Draft Call for Proposals on Joint Speech and Audio Coding No 07/07/06
131
Annex E Agenda for the 82nd MPEG Audio Meeting
Agenda Item1. Opening of the meeting2. Administrative matters
2.1. Approval of agenda and allocation of contributions2.2. Communications from the Chair2.3. Joint meetings2.4. Review of task groups and mandates2.5. Approval of previous meeting report2.6. Review of AhG reports 2.7. Received national body comments and liaison matters
3. Plenary issues4. Task group activities
4.1. MPEG Maintenance, including MPEG-1, MPEG-2, MPEG-4, SMR and MPEG Surround issues
4.2. AAC-ELD4.3. Spatial Audio Object Coding4.4. Speech and Audio Exploration
5. Discussion of unallocated contributions6. Meeting deliverables
6.1. Recommendations for final plenary6.2. Establishment of new Ad-hoc groups6.3. Approval of output documents6.4. Responses to NB comments6.5. Responses to Liaison statements6.6. Press statement
7. Future activities8. Agenda for next meeting9. A.O.B10. Closing of the meeting
132
Annex K – 3DG report
Source: Marius Preda (INT)
1 Opening of the Meeting
21.5. Approval of the agenda
21.6. Goals for the weekThe goals of this week are:
Review FAMC results and edit the PDAM Review 3DGCM related contributions and edit the WD Review on-going AFX experiments Promote the 3DGC profiles Issue FDAM of Geometry and Shadow reference software Issue FDAM of Geometry and Shadow conformance Issue WD 1.0 of FAMC reference software Issue WD1.0 of FAMC conformance Review Liaisons to MPEG 3DG Review and promote 3DG related demonstrations Investigate future developments of MPEG 3D Graphics
The output documents related to 3D Graphics Compression are:
No. Title TBP Available14496-4 Conformance testing
9258 Study Text of ISO/IEC 14496-4:2004/ FPDAM21 (Geometry and Shadow Conformance)
No 07/07/06
9259 Request for Amendment of ISO/IEC 14496-4:2004 (FAMC Conformance)
No 07/07/06
9260 WD 1.0 of ISO/IEC 14496-4:2004 AMD32 (FAMC Conformance) No 07/07/06
9261 Request for Amendment of ISO/IEC 14496-4:2004 (MultiResolution Profile Conformance)
No 07/07/06
9262 WD 1.0 of ISO/IEC 14496-4:2004 AMD33 (MultiResolution Profile Conformance)
No 07/07/06
No. Title TBP Available14496-5 Reference Software
9263 Study Text of ISO/IEC 14496-5:2001/ FPDAM13 (Geometry and Shadow RefSoft)
No 07/07/06
9264 Request for amendment of ISO/IEC 14496-5:2001 (FAMC RefSoft) No 07/07/069265 WD1.0 of ISO/IEC 14496-5:2001 AMD21 (FAMC RefSoft) No 07/07/06
No. Title TBP Available14496-16 Animation Framework eXtension (AFX)
9266 Text of ISO/IEC 14496-16:2006/PDAM2 (Frame-based Animated No 07/08/06
133
Mesh Compression)
9267 Text of ISO/IEC 14496-16:2006/PDAM3 (3D MultiResolution Profile)
No 07/07/06
9268 3D Graphics Core Experiments Description No 07/07/069269 3D Graphics Compression FAQ 20.0 Yes 07/07/13
No. Title TBP Available14496-25 3D Graphics Compression Model
9270 WD 2.0 of ISO/IEC 14496-25 Yes 07/07/20
21.7. Standards from 3DG
Std Pt Edit. Project Description CfP WD CDPDAMDCOR
FCDFPDAM
FDISFDAMCOR
4 4 2004 Amd.21 Geometry and Shadow conformance
06/07 06/10 07/04 07/10
4 5 2001 Amd.13 Geometry and Shadow reference software
06/07 06/10 07/04 07/10
4 16 2006 Amd.2 Frame-based Animated Mesh Compression
07/01 07/07 07/10 08/04
4 16 2006 Amd.3 Multi-resolution Profile
07/01 07/07 07/10 08/04
4 25 200x 3D Graphics Compression Model
07/10 08/01 08/07
4 4 2004 Amd.32 FAMC conformance 07/07 07/10 08/04 08/104 5 2001 Amd.21 FAMC reference
software07/07 07/10 08/04 08/10
4 4 2004 Amd.33 Multi-resolution Profile conformance
07/07 07/10 08/04 08/10
21.8. Room allocation3DG : Berne
21.9. Allocation of contributions
N° Title Schedule ActivityD1 Monday D1
MPEG Plenary D1 09:00~11:30
MPEG General
3DG Plenary D1 11:30~13:00 3DG General
Roll call, Agenda, Goals, FAQ, Marius Preda
134
N° Title Schedule Activityetc., Clarify the status on www.mpeg-3dgc.org maintenance
14572Report of AHG on 3DGC documents, experiments and software maintenance
Jeong-Hwan AhnNing Lu
Lunch Break D1 13:00~14:00
Reference Software D1 14:00~14:15
Clarify the status on release version of the RefSoft all
3DGCM D1 14:15~15:30
14710 Compression performances of MPEG-4 3D Graphics for large databases
Marius Preda Ivica Arsov Blagica Jovanova Françoise Preteux
14712 MPEG-4 3D graphics tools for third party scene representation
Marius Preda Blagica Jovanova Françoise Preteux
Coffee Break 15:30~16:00
3DGCM D1 16:00~16:30
14711 Support for an RF profile for MPEG-4 3D graphics by COLLADA
Marius Preda Remi Arnaud Francoise Preteux
NB Comments D1 16:30~17:00
14742 French National Body French NB comment on AFX profiling FrNB
D2 Tuesday D2
Core Experiments D2 09:00~10:30 CE1
14652 FAMC’s layer-based scalable extension
Khaled MamouNikolce StefanoskiTitus ZahariaJörn OstermannFrançoise Prêteux
14654 FAMC with progressive Khaled Mamou
135
N° Title Schedule Activity
transmission and scalable rendering functionalities
Titus ZahariaFrançoise PrêteuxNikolce StefanoskiJörn Ostermann
14653FAMC: bitstream description for the layer-based scalable extension
Khaled MamouNikolce StefanoskiTitus ZahariaJörn OstermannFrançoise Prêteux
Coffee Break 10:30~11:00
Core Experiments D2 11:00~11:30 CE2
14746Report on CE2: Space Partitioning Implementation in IM1
Patrick GioiaAnne Le BrisRomain Cavagna
CE2
Profiles D2 11:30~11:45
Multi-Resolution Profile AMD 3
Lunch Break D2 12:00~14:00
Liaison D2 16:00~17:00
Liaison Statements LiaisonD3 Wednesday D3
MPEG Plenary D3 09:00~12:00
MPEG General
3DG Plenary D3 12:00~13:00
3DG General
14697
Proposed Modifications to Residual Coding Part of Frame-based Animated Mesh Compression
Heiner Kirchhoffer Detlev Marpe Khaled Mamou
Karsten Müller Thomas Wiegand
Lunch Break D3 13:00~14:30
136
N° Title Schedule Activity
FAMC PDAM 3 Editing all D3 14:30~18:00
D4 Thursday D4
3DGCM Editing D3 09:00~12:00
Lunch Break D4 12:00~14:00
Review of 3DG documents D4 14:00~18:00 3DG General
ISO/IEC 14496-16 AMD 3Multi-Resolution Profile all
Core Experiment CE 1 ReviewCE 2 Review
all
ISO/IEC 14496-16 AMD 2 FAMC allISO/IEC 14496-25 all
D5 Friday D53DG output documents preparation
D4 09:00~12:00 3DG General
AhGs and resolutions all
Lunch Break D5 12:00~14:00
MPEG Plenary D5 14:00~ MPEG General
21.10. Attendance list
Name Country CompanyJeong-Hwan Ahn Korea Samsung AITMarius Preda France INTFrançoise Prêteux France INTKhaled Mamou France INTPatrick Gioia France France Telecom
R&DEuee S. Jang Korea Hanyang Univ.Byoungjun Kim Korea Hanyang Univ.Francisco Moran Burgos
Spain UPM
Frederic Vexo Swiss EPFLJaeBum Jun Korea Hanyang Univ.SinWook Lee Korea Hanyang Univ.Karsten Muller Germany FHG-HHINing Lu US Intel
CorporationPatrick Klie Germany Leibniz
137
Universtat Hannover
Detlev Marpe Germany FHG-HHI
138
22. General issues
22.1. General Discussion
22.1.1. ExperimentsLast meetings resolutionFor each new specification development activity, 5 National Bodies should commit resources to that activity. Contributions should be made at each meeting from those NBs until that activity is finalized.3DGC will no longer have Exploration Experiments.3DGC will only have Core Experiments for any official experiments.The condition for the CE is to have at least 2 active participants (companies or universities having support from companies on that experiment) dedicating resources to do the work and making contributions at each meeting.If a participant does not make any contribution at a meeting, then that participant will not be considered as active.The activity in the CE does not necessarily imply adoption into the standard.
Clarify the status on www.mpeg-3dgc.org maintenance All
Samsung can maintain the web site up to end of 2007 only. Potential solutions: FT and UPM. Patrick Gioia will be the maintainer of the new web site (once transferred). FT will investigate on transferring the web site and on finding open source solutions for data protection.
14572 Report of AHG on 3DGC documents, experiments and software maintenance
Jeong-Hwan AhnNing Lu
The crosschecking was successful. New files were added in the zip file.
14710 Compression performances of MPEG-4 3D Graphics for large databases
Marius Preda Ivica Arsov Blagica Jovanova Françoise Preteux
An analysis of different binarisation tools for 3D graphics scene representation based on XML was provided as a result on an experiment performed on 1700 3D objects (database available for further experiments). The compression results of 3DMC were presented against different binarisation scheme.
Resolution- Refer 3DMCe as the compression tool for 3D mesh objects in Part 25.- Encourage contributions referring to other 3D mesh compression tools and analyzing their results on the proposed database.
14712 MPEG-4 3D graphics tools for third Marius Preda
139
party scene representation
Blagica Jovanova Françoise Preteux
An analysis of the MPEG-4 3D graphics tools that may be applicable to X3D and COLLADA was presented. Plug-in scheme are proposed for 3DMC and BBA to X3D and COLLADA content.
Resolution- Update the WD for referring to the following MPEG-4 ES: 3DMC and BBA.- Encourage contributions on implementation of ICs, FAMC and WSS.
14711 Support for an RF profile for MPEG-4 3D graphics by COLLADA
Marius Preda Remi Arnaud Francoise Preteux
This contribution presents a request on establishing one (or several) RF profiles for 3D Compression tools in Part 25.
Resolution:Consider the problem in 2 steps:- Start by building effective technical profile(s) without considering the royalties issue.- Cut the profiles built at previous step in such a way to ensure a RF status.
Remark: Investigate how MPEG can make awareness on RF profiles.
14742 French National Body French NB comment on AFX profiling FrNB
This contribution recommends initiating the discussion on the possibility to define RF profiles.
Resolution:See previous resolution.
14652 FAMC’s layer-based scalable extension
Khaled MamouNikolce StefanoskiTitus ZahariaJörn OstermannFrançoise Prêteux
Note: Presented by Patrick Klie.
The contribution presents the combination between LD and FAMC. The errors obtained by use of the skinning model in FAMC are here predicted based on layer based decomposition. This combination improves the performances of LD technique alone with 38%.
Resolution:
140
Extend the FAMC to include LD in order to ensure full resolution scalability.
14654 FAMC with progressive transmission and scalable rendering functionalities
Khaled MamouTitus ZahariaFrançoise PrêteuxNikolce StefanoskiJörn Ostermann
The contribution presents the scalability functionalities (resolution, quality) for different combinations between FAMC and LD.
Resolution:Support the following three combinations (when design the bitstream syntax):- Skinned based prediction + DCT + LD- Skinned based prediction + LIFT+ LD- Skinned based prediction + LDClose the CE. Continue the implementation in the RefSoft and provide the Conformance bitstreams.
14653 FAMC: bitstream description for the layer-based scalable extension
Khaled MamouNikolce StefanoskiTitus ZahariaJörn OstermannFrançoise Prêteux
This contribution presents the updates in the bitstream syntax that consider the integration of LD and FAMC.Resolution:- Investigate on the hierarchical decomposition of I, P, B.- Specify the simplification procedure in a normative Annex.- Specify the bitstream syntax for LD+DCT, LD+LIFT.- Review the entire document Thursday after noon.
14746 Report on CE2: Space Partitioning Implementation in IM1
Patrick GioiaAnne Le BrisRomain Cavagna
CE2
This contribution presents an implementation of the scene partition concepts in IM1.Scene graph partition is semantic data that are attached to different nodes in the scene graph in order to improve the transmission and rendering. For some scheme, the size of the data is big enough that dedicated compression methods may be necessary. Open issues are on the mechanism of attaching this information to the scene graph (a node is proposed) and the need of dedicated compression schema.
141
Resolution:Continue the investigation on the appropriate manner to represent the data with respect to targeted applications.
Multi-Resolution Profile AMD 3
No input contribution. The document is mature and we can proceed with conformance bitstream.
A plan for providing the bitstreams was set up.
14697Proposed Modifications to Residual Coding Part of Frame-based Animated Mesh Compression
Heiner Kirchhoffer Detlev Marpe Khaled Mamou Karsten Müller Thomas Wiegand
The document contains modification of the previous CABAC (normative changes, non-normative changes) as well as in improved method for encoder.Normative:- the DCT predictor is based on a couple (p, f) where p is a offset to an already transmitted coefficient and f is the size of the spectrum used for prediction.- signaling the predictor: if same predictor is used a flag is sent instead
- organize the significance map in blocks and propose the combination between unary code and exp-Golomb codes
Non-normative:- propose an encoder implementation that reduce the size of data to be transmitted (the encoder becomes more complex) by introducing a new cost function.
- overall improvement by CABAC 7%- overall improvement of the proposed encoder 9,9%- impact by CABAC wrt to coordinates residual is 11%-16%
Complexity issues: reduce the complexity twice with respect to the previous version of the arithmetic encoder. The optimized encoder software is made available by the contributors in the case that reference software for encoder will be provided with FAMC.
Resolution:Add the proposed modifications in the current FAMC.
FAMC PDAM 3 Editing all D3 14:30~18:00A new decoder schema was produced.The text should be carefully reviewed with respect to technical discussions reported above (editing period of 4 weeks)
3DGCM Editing D3 09:00~12:00
142
The 3DGC elementary streams were introduced in the document and the manner how to plug them to XMT, COLLADA and X3D was specified.The text should be carefully reviewed with respect to technical discussions reported above (editing period of 2 weeks)
23. AFX (14496-16) activities
23.1. Core Experiments
23.1.1. CE1. Mesh Animation CompressionLast meeting resolutionIn the next phase of the CE it will be investigated how the skinning model will be combined with the scalable approach. A switch may be used to choose between DCT, Wavelet compression of the errors and the scalable approach.Issue a new version of the working draft with the currently proposed technology (including streaming and CABAC).
23.1.1.1. Related contributions
Contributions m14652, m14654, m14653 address the issues of combining skinned based ptrediction and layer decomposition.
Contribution m14697 addresses the issue of CABAC integration.
Resolution for CE1Update the text of the bitstream description to integrate the above contributions.Close the CE.Initiate the activity on the Reference Software and Conformance.
23.1.2. CE2. Space PartitioningLast meeting resolutionPerform exploratory stage with the proposed work plan. (details can be found in the CE description)
23.1.2.1. Related Contributions
m14746 presents the results of implementation of different scene partition mechanisms in IM1.
Resolution for CE2Investigation of how attaching the semantic information to the scene graph (a node was initially proposed) and the need of dedicated compression schema.
23.2. Profiles
143
23.2.1. Proposal for 3D MultiResolution ProfileThe document is mature.
ResolutionPromote the document in PDAMRequest a new AMD for Conformance bistreams of this profile.
23.3. Promotions
none
24. GFX (14496-21) activities
24.1. Reference Software & Conformance
No activity on this issue.
25. 3D Graphics Compression Model (14496-25) activities
A selection of 3DGC elementary streams that may be applicable to other representation scheme was provided.The manner how to plug 3DMC and BBA was indicated for XMT, COLLADA and X3D.See also the comments on related contributions.
ResolutionAccept the list of streams.Accept the coupling mechanism of 3DGC and BBAUpdate the current WD.
26. Resolutions of 3DG
26.1. Output documents
26.1.1. The 3DG subgroup recommends to approve the following documents
No. Title TBP Available Editor14496-4 Conformance testing
9258Study Text of ISO/IEC 14496-4:2004/ FPDAM21 (Geometry and Shadow Conformance)
No 07/07/06 Jeong-Hwan Ahn
9259 Request for Amendment of ISO/IEC 14496-4:2004 No 07/07/06 Marius
144
(FAMC Conformance) Preda
9260 WD 1.0 of ISO/IEC 14496-4:2004 AMD32 (FAMC Conformance)
No 07/07/06 Khaled Mamou
9261 Request for Amendment of ISO/IEC 14496-4:2004 (MultiResolution Profile Conformance)
No 07/07/06 Marius Preda
9262 WD 1.0 of ISO/IEC 14496-4:2004 AMD33 (MultiResolution Profile Conformance)
No 07/07/06 Patrick Gioia
No. Title TBP Available14496-5 Reference Software
9263 Study Text of ISO/IEC 14496-5:2001/ FPDAM13 (Geometry and Shadow RefSoft)
No 07/07/06 Patrick Gioia
9264 Request for amendment of ISO/IEC 14496-5:2001 (FAMC RefSoft)
No 07/07/06 Marius Preda
9265 WD1.0 of ISO/IEC 14496-5:2001 AMD21 (FAMC RefSoft)
No 07/07/06 Khaled Mammou
No. Title TBP Available14496-16 Animation Framework eXtension (AFX)
9266
Text of ISO/IEC 14496-16:2006/PDAM2 (Frame-based Animated Mesh Compression)
No 07/08/06 Marius Preda, Titus Zaharia
9267 Text of ISO/IEC 14496-16:2006/PDAM3 (3D MultiResolution Profile)
No 07/07/06 Patrick Gioia
9268 3D Graphics Core Experiments Description No 07/07/06 Patrick Gioia
92693D Graphics Compression FAQ 20.0 Yes 07/07/13 Ning Lu,
Patrick Klie
No. Title TBP Available14496-25 3D Graphics Compression Model
9270 WD 2.0 of ISO/IEC 14496-25 Yes 07/07/20 Marius Preda
26.2. Resolutions The 3DGC subgroup recommends nominating Khaled Mamou (INT) as project editor of
ISO/IEC 14496-4/Amd 32 (FAMC conformance). The 3DGC subgroup recommends nominating Patrick Gioia (FT) as project editor of
ISO/IEC 14496-4/Amd 33 (MultiResolution Profile conformance). The 3DGC subgroup recommends nominating Khaled Mamou (INT) as project editor of
ISO/IEC 14496-5/Amd 21 (FAMC RefSoft). The 3DGC subgroup recommends nominating Mark Callow (HI Corporation) as project
editor of ISO/IEC 14496-21:2006/Cor.1.
26.3. Establishment of 3DG Ad-Hoc Groups
N9143 AHG on 3DG documents, experiments and software maintenance
Mandate: 1. Maintain and edit 3DG documents2. Coordinate 3DG CE activity3. Coordinate 3DG related conformance and reference software
145
Chairmen: Jeong-Hwan Ahn (Samsung AIT),Ning Lu (Intel Corporation)
Duration: Until 82nd Meeting Meetings Sunday before 82nd meetingReflector: mpeg-3dgc AT gti. ssr. upm. EsSubscribe: http://www.gti.ssr.upm.es/mailman/listinfo/mpeg-3dgc
27. Closing of the MeetingSee you in Shenzhen.
146
Annex L – Test report
Source: Tobias Oelbaum
Opening of the Meeting
Goals for the weekThe goals of this week are:
Finalize the verification test plan for SVC
Test Activities
Scalable Video Coding - Verification TestsThe SVC Verification Test Plan has been finalized. The test plan includes the description of the AVC anchors that will be generated, the coding conditions for anchor and SVC encoding, a description of the subjective tests that will be conducted and the respective timeline. A first part of the tests will be conducted beginning of October while a second part of the tests will be conducted in December. The reason for splitting the test into two parts is the high amount of encoding time that is needed for the HD test cases. The only coding technology that will be used as anchor is AVC. AVC anchors will be generated using the same version of the JSVM reference software that is also used to generate the SVC bitstreams. AVC anchor bitstreams will be generated according to three different simulcast settings that will show the gain that can be reached with SVC.Results of the verification test will be available at the 82nd and 83rd MPEG meeting.
Test SequencesNew HD test sequences were presented in document m14764 (late contribution). These test sequences were especially designed to contain many colours and colours at the extremes of the colour space to be used for colour-sensitive evaluation. Those sequences were produced by DECSDP (Digital Eizou Common Specification Development Project) and will be available for use inside MPEG.
Test Resolutions
Output Documents 9189 SVC Verification Test Plan Version 1.0
AdHoc GroupsThe following AHG was set up:
N8993 AHG on SVC Verification Test
147
Mandate:1. To discuss test setups based on applications scenarios of the SVC
profiles2. To refine the verification test document3. To prepare the verification test
Chairman: Tobias Oelbaum (TU München, [email protected])Mathias Wien (RWTH Aachen, [email protected])Associate Chairs:Vincent BottreauNathalie CammasAlex EleftheriadisJustin Ridge
Duration: Until 82nd Meeting Meetings Yes (Sunday before the 82nd Meeting)Reflector: [email protected]: To subscribe or unsubscribe, go to
http://mailman.rwth-aachen.de/mailman/listinfo/mpeg-svt
148
Annex M – ISG report
Source: Marco Mattavelli (EPFL)
1 OverviewThe main work items of the Implementation Studies Subgroup in Lausanne are:
1. The contributions to the Reconfigurable Video Coding (RVC) activity jointly with the video group for contribution review, review of results for the on going core experiments, editing of the RVC WD documents and work-plan, dissemination of the RVC technology to the audio group.
2. MPEG-4 Part 9 Reference HW description:
The editing of the Study of the Third Edition of the TR
Input contributions to ISG group w.r.t. the above items are summarized according to the following table:
Input Contributions to ISG subgroup jointly revised with the video group
Number
Category Title
14592 General/Reqs Royalty Cost Optimization with Reconfigurable Video Coding
14629MPEG-C Functional units of AVC inter
prediction for RVC video tool library
14630MPEG-C A CAL-based conformance
testing environment for RVC video tool library
14632 MPEG-C Proposed text of the RVC FUs for MPEG-4 AVC and MPEG-2
14650 MPEG-B PREESM in the RVC framework
14655MPEG-C From AVC to SVC: minor and
major modifications in a RVC decoder implementation
14657 MPEG-B Result of RVC CE 1.1
14658MPEG-B CDDL-Based decoder
description for constructing ADM and syntax parsing
14686 General SMPTE liaison to JTC1/SC29/WG11 on RVC
14721 MPEG-C ISO/IEC 23002-2 in RVC Implementation
14722MPEG-C ISO/IEC 23002-1 IDCT
Implementation in CAL Testbed Update
149
14739 MPEG-C Simulator in the Eclipse environment for RVC
14747 MPEG-B Report on CE on RMC Bitstream Syntax Description
14756MPEG-C RVC Exploration Experiments
Report on new 8x8 Inverse Transform and Quantization Tools
Detailed Report
27.1. The contribution to the activity on Reconfigurable Video Coding (RVC).
Most of the ISG time in Lausanne has been spent in joint meetings with Video for the RVC subgroup work. The main issues of discussion were the evaluation of the results of the on-going core experiments concerning the evolution and progress of the technology currently described in the WD. Major results reported are:
The update of the limitations and bugs of the implementation of the MPEG-4 SP in terms of CAL FUs.
The list of all implementations of FUs in CAL for MPEG-4, MPEG-2 and MPEG-4 AVC. The list of new FUs needed to implement SVC when AVC baseline FUs are available. New results of compression of DDL. No conclusive results were reported about the implementation of the flexible decoder based
for both technologies on the table: o BSDL bitstream descriptions and transformations to CALML and CAL.o DDL parser description and generation of a CDDL parser.
Update of proposed methodologies for the conformance testing of RVC FUs. Updates of the proposals for the efficient partitioning of FU for B-pictures, multiple
reference frames, intra prediction and for SVC. Update of the description of the RVC framework tool support and definition of future tool
support. Studies of new FU for the implementation of SVC. Example of usage of the CAL simulator and editors in the Eclipse environment for the
migration from Moses to a non-integrated component based simulation environment. Studies for the development of a CAL to C code generator.
Discussions were held to solve the problem of the FU naming convention. A final specification has been agreed and has been included in the WD as well as some examples and FAQ. A new section has been added to the WD.Another discussion was held to define an appropriate convention for the structure and naming of the MPEG Tool Repository. The final agreement was to include all FUs together in a unique directory without any partitioning into different categories. Only two categories “data management” and “algorithmic” has been retained. The new RSM will be structured according this decision within 4 weeks from the end of the Lausanne meeting.A long discussion was held about the form to be adopted for the Textual Documentation of FUs. Two hypotheses have been considered. The first is to provide a textual description that corresponds to the actual CAL implementation in the standard MPEG RVC Toolbox. This would have implied that documentation would have been in terms of “actions” activated by input “tokens” and the
150
associated state machine. The second was to provide simple textual description of the algorithm without any detail of the specific “actions” triggered by the I/O tokens. This second option is less precise and does not correspond to the CAL SW of the Toolbox, but results simpler to be provided and is already available for most of the FUs. This second option has been selected by the majority of the group. The decision however was that if precise documentation of “actions” and state machines this could have been included in VTL descriptions. Example will be included in the WD.
A joint meeting with System group was held to discuss the compatibility of the RVC framework with the Multimedia Middleware (M3W). The conclusion of the discussion was that for the moment the “wrapping” of the RVC process by the system layer is not specified in the RVC framework so this process of providing APIs compatible with the M3W specification is left to the implementer.
A tutorial of the current RVC technology has been presented to the audio group. The tutorial was followed by a long session of question and answers showing the interest of the RVC technology also for the audio group.
Concerning the promotion of the current WD to CD the groups decided to postpone the promotion to next October meeting so as to conclude the core experiments on the specification of the flexible parser.
27.2. The progress in the development of the MPEG-4 “Part 9 Reference Hardware Description”
The ISG activity at the Lausanne meeting concerning the Reference HW description has been limited since no new module submissions has been received at the meeting and has mainly been devoted to the editorial work for third edition of the technical report.
28. ResolutionsThe above activities have led to the following resolutions and output document approval.
Resolutions related to MPEG-4
Part 9 Reference Hardware Description
The Implementation Studies Subgroup recommends to approve the following documents
No. Title TBP Available14496-9 Reference Hardware Description
N9187 Study of “ISO/IEC DTR 14496-9 3rd Edition Reference Hardware Description”
N 07/07/06
Resolutions related to MPEG-B
The video and ISG subgroups recommend to approve the following documents
151
No. Title TBP Available23001-4 Codec Configuration Representation
9223 WD 5 of ISO/IEC 23001-4 Codec Configuration Representation N 07/07/13
Resolutions related to MPEG-C
Part 4 Video Tool Library
The video and ISG subgroups recommend to approve the following documents
No. Title TBP Available23002-4 Video Tool Library
9224 WD 5 of ISO/IEC 23002-4 Video Tool Library N 07/07/209225 Description of Core Experiments in RVC N 07/07/069226 RVC Simulation Model (RSM) V5.0 N 07/08/039227 RVC Work Plan N 07/07/069228 RVC Conformance Testing Working Draft 2.0 N 07/07/209229 Description of Exploration Experiments for Toolbox Extensions N 07/07/06
152
Annex N – Liaison
Source: Kate Grant, Chair
The Liaison group received the following input documents and discussed them at their meeting on Tuesday July 3rd
No. TitleLiaison Statements
14573 Liaison Statement from 3GPP TSG SA WG4Specific questions regarding their adoption of a functionally equivalent version of Activate/Deactivate14574 Liaison Statement from 3GPP TSG SA WG4Request to review a number of events and issue of namespace, and comment on alignment of text 14577 Liaison Statement from IEC TC100CDV under ballot for information, transmission protocol for audio-visual data and control commands which provides for the interconnection of digital audio and video equipment, using IEEE 139414586 Liaison Statement from ITU-R SG6 WP/6JAcknowledgment of information sent relating to colour spaces and thanks for action on information provided previously14681 Liaison Statement from SMPTESMPTE: no comments on latest draft of 13818-1:2006 DCOR114683 Liaison Statement from SMPTEComments on N9025 and information on use of URI-labelled metadata in SMPTE documents14686 Liaison Statement from SMPTESMPTE welcome regular participation in the RVC project (having published VC-1 and VC-3), will review work at September meeting14740 Liaison Statement from ITU-T SG9Provide draft J.ftvreq - system model and requirements for FTV video transmission14741 Liaison Statement from DVB (TM FF)DVB have identified the need to store transport streams (in addition to several other features) while defining a file format based on ISO Base Media and asking for guidance on current proposals14751 Liaison Statement from DVD Forum Confirmation that issues with 13818-1:2006 DCOR1 now resolved.14754 Liaison Statement from ITU-T IPTV Focus GroupInvite MPEG to provide text for the inclusion of MPEG 2 Video and MPEG 1 Layer 2 Audio into document under development “Toolbox for Content Coding" 14758 Liaison Statement from 3GPP TSG SA WG4LASeR / DIMS inconsistencies identified in latest DIMS version and MPEG asked toReference rather than copy similar text from DIMS, align definitions and comment on enclosed draft
The Liaison group received the following input documents after the Tuesday meeting:
14758 Liaison Statement Regarding potential changes to RDD to meet new requirements
153
from IFPI 14765 Additional material
from DVB re m14741
Overview of the requirements of metadata storage in the DVB file format and questions relating to the storage of metadata using the provisioning in the ISO base file format
The Liaison group prepared the following output documents:
No. TitleLiaison Statements
9309 Liaison Statement to AESRe: Appointment of new Liaison contact Erik Schuijers (MPEG -> AES) 9310 Liaison Statement to ITU-T re Joint Speech & Audio CodingInformation on N9254 Framework for Speech and Audio Coding and asking for comments9311 Liaison Statement to 3GPP re Joint Speech & Audio CodingInformation on N9254 Framework for Speech and Audio Coding and asking for comments9312 Liaison Statement to 3GPP2Information on N9254 Framework for Speech and Audio Coding and asking for comments9313 Liaison Statement to IEC TC100Request to IEC TC 100 to support the signalling and carriage of MPEG Surround side information over PCM channels via AES3.within its consumer specification IEC60958-3
9314 Liaison Statement to ITU-T IPTV Focus Group re "Toolbox for Content Coding"
Suggested draft text on MPEG-2 Video and MPEG-1 Layer 2 Audio for inclusion in the "Toolbox for Content Coding". 9315 Liaison Statement to SMPTE re RVCProvide update on RVC progress, latest version of workplan and WDs on Codec Configuration Representation and Video Tool Library for consideration at next meeting9316 Liaison Statement to SCTEProvide update on RVC progress, latest version of workplan and WDs on Codec Configuration Representation and Video Tool Library asking for comments9317 Liaison Statement to AVSProvide update on RVC progress, latest version of workplan and WDs on Codec Configuration Representation and Video Tool Library asking for comments9318 Liaison Statement to ITU-T SG9 re FTVUpdate on WG11 work on FTV, and on AHG progressing work on FTV Model and Requirements9319 Liaison Statement to DVBWG11 setting up an email reflector to discuss the MPEG-2 transport and RTP questions and welcome joint approach and the desire for industry harmonization. TuC document enclosed.9320 Liaison Statement to 3GPP TSG SA WG4 re DIMS/LASeRAligning some event descriptions and definitions, provide additional clarifications and attach current text for comment9321 Liaison Statement to OMAWG11 want to maintain the compatibility between RME (based on 3GPP DIMS technology) and ISO/IEC 14496-20 and collaborate actively with OMA to facilitate this.9322 Liaison Statement to ITU-T IPTV Focus Group re Presentation Formats for
IPTVInformation on BIFS and LASeR and some identified requirements for presentation engines. WG11 experts will participate in next meeting. 9324 Liaison Statement to WG1
154
Re: JPXML (and its relationship with MPEG-B BSDL) inviting WG 1 to collaborate. Also information on call for Requirements on the Professional Archival MAF.
Other Documents:9326 Response to National Bodies Responses to the French NB9327 List of Organisations with which MPEG entertains liaisons (as of
July 2007)Updated with latest information
155