Remote Collaborative Real-Time Multimedia Experience over ......ROMEO WP8 Page 1/71 Remote Collaborative Real-Time Multimedia Experience over the Future Internet ROMEO Grant Agreement

ROMEO WP8 Page 1/71

Remote Collaborative Real-Time Multimedia Experience over the Future Internet

ROMEO

Grant Agreement Number: 287896

D8.4.2

Report on the second ROMEO Workshop

Ref. Ares(2013)3156964 - 02/10/2013

ROMEO WP8 Page 2/71

Document description Name of document Report on the second ROMEO Workshop

Abstract This document describes the organizational activities along with the overall event that took place in Istanbul, Turkey on the 9

th of July 2013.

Document identifier D8.4.2

Document class Deliverable

Version 1.0

Author(s) Emine Cimen Öztürk (TTA), Canay Ozkan (TTA), Onur Altunbas (TTA), G. Papadogiannopoulos (UP)

QAT team Safak Dogan (US), Michael Weitnauer (IRT), Didier Doyen (TEC)

Date of creation 20-Aug-2013

Date of last modification 28-Sep-2013

Status Final

Destination European Commission

WP number WP8

Dissemination Level Public

Deliverable Nature Report

ROMEO WP8 Page 3/71

TABLE OF CONTENTS

1 INTRODUCTION ................................................................................................................ 5

1.1 Purpose of the Document ........................................................................................ 5 1.2 Scope of the Work ..................................................................................................... 5 1.3 Structure of the Document ....................................................................................... 5

2 WORKSHOP EVENT ......................................................................................................... 6

2.1 General Information .................................................................................................. 6 2.2 Workshop Location ................................................................................................... 7 2.3 Workshop Presentations .......................................................................................... 8

2.3.1 Opening Speech .................................................................................................. 9 2.3.2 Session on 3D Capture, Processing, and Coding ............................................... 9 2.3.3 Session on Quality of Experience (QoE) for Emerging 3D Multimedia Services .. ........................................................................................................................... 12 2.3.4 Session on 3D Multimedia Networking ............................................................. 16 2.3.5 Panel Session ................................................................................................... 18

3 WORKSHOP ATTENDANCE .......................................................................................... 20

4 CONCLUSION ................................................................................................................. 21

5 REFERENCES ................................................................................................................. 22

APPENDIX A: WORKSHOP PROGRAMME ........................................................................... 23

APPENDIX B: WORKSHOP CALL FOR PAPERS ................................................................. 25

APPENDIX C: GLOSSARY OF ABBREVIATIONS ................................................................. 26

APPENDIX D: WORKSHOP PRESENTATIONS ..................................................................... 29

ROMEO WP8 Page 4/71

LIST OF FIGURES

Figure 1 - Istanbul, Turkey ......................................................................................................................... 7

Figure 2 - Second ROMEO Workshop Hall - 1 ........................................................................................... 8

Figure 3 - Second ROMEO Workshop Hall - 2 ........................................................................................... 8

Figure 4 - Opening Speech by Prof. Ahmet Kondoz .................................................................................. 9

Figure 5 - Presentation of Matthias Laabs ............................................................................................... 10

Figure 6 - Presentation of Hyun Lim......................................................................................................... 10

Figure 7 - Presentation of Pedro Amado Assuncao ................................................................................. 11

Figure 8 - Presentation of Gözde Bozdağı Akar ....................................................................................... 12

Figure 9 - Presentation of Oğuz Sunay .................................................................................................... 13

Figure 10 - Presentation of Hugo Marques .............................................................................................. 14

Figure 11 - Presentation of Ilias Politis ..................................................................................................... 15

Figure 12 - Presentation of Cengiz Ultav ................................................................................................. 15

Figure 13 - Presentation of Didier Doyen ................................................................................................. 16

Figure 14 - Presentation of Asimakis Lykourgiotis ................................................................................... 17

Figure 15 - Presentation of Ilias Politis ..................................................................................................... 18

Figure 16 - Panel Discussion ................................................................................................................... 19

Figure 17 - Second ROMEO Workshop Attendance ................................................................................ 20

ROMEO WP8 Page 5/71

1 INTRODUCTION

1.1 Purpose of the Document

The purpose of D8.4.2 is to provide the description of the Second ROMEO Workshop organization. The authors aim to emphasize on the topics that were addressed during the event by the keynote speakers, the consortium members and the rest of the presenters, and the future dissemination action regarding the workshop proceedings.

1.2 Scope of the Work

The document provides a summary of the technical papers presented during the Workshop, and the detailed information on the 2

nd Workshop organization of the ROMEO project which

was organized by Türk Telekom (TTA). The workshop was held in Istanbul, Turkey on the 9th

of July 2013 and was considered a successful event from all its participants.

1.3 Structure of the Document

This deliverable is structured as follows:

Section 2 presents a brief summary of the invited talks and technical papers presented in the workshop as well as the general information on its organizational particulars.

Section 3 presents the attendees of the event.

Section 4 comprises the conclusion section.

Section 5 lists the links to the Workshop references.

ROMEO WP8 Page 6/71

2 WORKSHOP EVENT

2.1 General Information

ROMEO integrating project focuses on new methods for the compression and delivery of 3D multi-view video and spatial audio, as well as optimising the networking and compression jointly across the Future Internet. The main objective of this Workshop was to bring together researchers and developers from academia and industry with diverse experience and research areas to discuss the development of next generation 3DTV technologies, applications, and services covered by the ROMEO project. The Workshop consisted of plenary talks and research papers presentation sessions covering:

System Architectures and Transmission for 3DTV o Fixed and mobile 3D multimedia applications and systems o Hybrid distribution networks and technologies for 3D multimedia delivery,

including DVB and P2P architectures o Latest trends in 3D multimedia devices and terminals

3D Capture, Processing, and Coding o 3D audio-visual scene capture and reconstruction techniques o Video and audio coding for 3DTV o Error resilience and error concealment of 3D video o 3D visualisation techniques

3D Multimedia Networking o Multimedia transmission across heterogeneous networks o Content-aware 3D media networking and adaptation techniques o Cross layer optimisation techniques for 3D multimedia delivery o 3D video transmission over mobile access networks

Quality of Experience (QoE) for Emerging 3D Multimedia Services o Subjective quality evaluation o Objective quality metrics o Multimodal experience

Future Directions for 3D Multimedia Services o Connected TV applications and platforms o Interactive media processing for social groups o Standardisation activities for 3D multimedia services

ROMEO WP8 Page 7/71

Figure 1 - Istanbul, Turkey

2.2 Workshop Location

This second workshop was organized by Türk Telekom, and was held in Istanbul, Turkey on the 9

th of July 2013 (Figure 1). Istanbul is a very good candidate for workshop, conference,

and event organizations since there are plenty of universities, academics and students, as well as numerous national and international technology driving industrial forces.

The event took place at the Sheraton Maslak Hotel. Although Maslak district is at little distance to the heart of the touristic city, it presents itself as a major part of Istanbul that has plenty of businesses, academic establishments, and social centres. Most historic attractions are located around the Golden Horn (Halic – Old City) area, which is generally referred to as Sultan Ahmet, on the European wing of Istanbul. Taksim/Beyoglu is the main business area with plenty of shopping possibilities only at a short taxi ride from the Old City. The meeting venue was very well connected to Taksim/Beyoglu via the metro. The workshop halls can be seen in Figure 2 and Figure 3.

ROMEO WP8 Page 8/71

Figure 2 - Second ROMEO Workshop Hall - 1

Figure 3 - Second ROMEO Workshop Hall - 2

2.3 Workshop Presentations

The Workshop was divided into three main thematic sessions. The first was a session on 3D Capture, Processing, and Coding; the second was a session on Quality of Experience (QoE) for Emerging 3D Multimedia Services, and the third and final session was on 3D Multimedia Networking. The particular division enabled the researchers and professionals that attended the workshop to have a quite clear image on new methods for the compression and delivery of 3D multi-view video and spatial audio, as well as optimising the networking and compression jointly across the Future Internet.

ROMEO WP8 Page 9/71

2.3.1 Opening Speech

Ahmet Kondoz

Professor Kondoz (the Coordinator of ROMEO IP) gave a welcome speech by presenting the ROMEO project and its concept in view of recent activities, aims and perspectives envisioning a joint use of DVB-T2 and P2P overlay networks for live multimedia content sharing and collaboration among multiple users. A photo of his presentation is illustrated in Figure 4.

Figure 4 - Opening Speech by Prof. Ahmet Kondoz

2.3.2 Session on 3D Capture, Processing, and Coding

Matthias Laabs

Topic: Improving Temporal Image Signature Approach by Adding Face Conspicuity Map

Matthias Laabs from IRT explained in his presentation how a combination of the Temporal Image Signature approach (TIS) and face detection will allow detecting visually prominent features separately. He also mentioned that, this approach will also yield the location of human faces whereas both information could be used for further processing, such as intelligent video encoding considering its significance for the ROMEO project [1] (Figure 5).

ROMEO WP8 Page 10/71

Figure 5 - Presentation of Matthias Laabs

Hyun Lim

Topic: Virtual Sound Source Localisation Based on Wave Field Synthesis

Dr. Lim from University of Surrey and Dr. Xiyu Shi of Mulsys Limited presented an advanced spatial audio rendering methodology based on wave field synthesis technique, which provides several significant advantages over conventional approaches in the ROMEO project. The main distinctive feature of this methodology described was its ability to create a lifelike soundscape based on virtual audio objects in a space delivering a highly realistic audio experience through the whole given space [2] (Figure 6).

Figure 6 - Presentation of Hyun Lim


Pedro Amado Assuncao

Topic: Non-uniform Asymmetric Coding of Stereo Images

The above topic, which was presented by Professor Assuncao form Coimbra University in Portugal, proposed a non-uniform asymmetric coding method that defines regions in the auxiliary view of the stereo pair with different perceptual relevance in a way that could be useful at the ROMEO project [3] (Figure 7).

Figure 7 - Presentation of Pedro Amado Assuncao

Keynote Speaker Prof. Gözde Bozdağı Akar

Topic: Coding and Transmission of 3D Media

Professor Akar from the Middle East Technical University (METU) presented the next generation video coding standard, called HEVC including its features, its usage and the current challenges along with 3D video coding and transmission aspects [8] (Figure 8).


Figure 8 - Presentation of Gözde Bozdağı Akar

2.3.3 Session on Quality of Experience (QoE) for Emerging 3D Multimedia Services

Keynote Speaker Prof. Dr. Oğuz Sunay

Topic: QoE-Aware Multimedia Content Delivery over Next Generation Networks

In his presentation, Professor Sunay from Ozyegin University discussed several technical and economical issues about the future Video delivery architecture and how to achieve best Quality of Experience (QoE) considering ROMEO’s perspectives [7] (Figure 9).


Figure 9 - Presentation of Oğuz Sunay

Hugo Marques

Topic: A Scalable Approach for QoS Control in P2P Networking

Dr. Marques from Instituto de Telecomunicacoes gave a presentation on methods to guarantee Quality of Service (QoS) in the Future Internet technologies, so that the media packets delivered via the P2P overlay reach the end-users on time to allow for a proper synchronization of the multiple views transmitted through the ROMEO hybrid network [7] (Figure 10).


Figure 10 - Presentation of Hugo Marques

Ilias Politis

Topic: Machine Learning Models for Network Related 3D Video QoE

Dr. Politis from University of Patras presented to the audience a comparison of the efficiency and accuracy of machine learning based QoE models for 3D video streaming taking into account the spatial and temporal information of the video, the resolution, the quantization step size, as well as the parameters from the physical, the data link and the network layers regarding the ROMEO approach [8] (Figure 11).


Figure 11 - Presentation of Ilias Politis

Keynote Speaker Cengiz Ultav

Topic: Future of 3D Media: A Consumer Electronics Manufacturer’s Perspective

Mr Ultav from the Board of Directors of TTGV gave a keynote talk about the future of 3D media considering the multimedia industry and its perspectives in light of the new 3D technologies and requirements that appear every day [8] (Figure 12).

Figure 12 - Presentation of Cengiz Ultav

Didier Doyen


Topic: Depth Grading Processing to Control Quality of 3D Content

Mr Doyen from Technicolor gave a presentation on how to control the video quality of a 3D content using a depth grading technique. This technique applied at the post production side helps to smooth the transition between 3D scenes and by this way to enhance the user experience [8] (Figure 13).

Figure 13 - Presentation of Didier Doyen

2.3.4 Session on 3D Multimedia Networking

Asimakis Lykourgiotis

Topic: Cross-Layer Architecture for 3D Video Streaming

Mr Lykourgiotis from University of Patras presented the a cross-layer architecture and a cross-layer based packet scheduling algorithm based on the ROMEO approach, for real-time multimedia, specifically Scalable Video Coding (SVC) and Multiple Description Video Coding (MDC) for the LTE technology. This architecture takes into account the MDC technique and exchanging the appropriate inter-layer information for arranging LTE Scheduling, Resource Allocation, Link Adaptation, and Error Control schemes [10] (Figure 14).


Figure 14 - Presentation of Asimakis Lykourgiotis

Ilias Politis

Topic: Chunk Selection for Tree-based Layered Peer-to-Peer Streaming

In his presentation, Dr. Politis from University of Patras showed a flow control mechanism for tree-based mobile peer-to-peer live streaming in order to handle traffic flow among peers, so that fairness among competing sub-flows is preserved while video quality is maintained [11] (Figure 15).


Figure 15 - Presentation of Ilias Politis

2.3.5 Panel Session

Chair – Prof. Ahmet Kondoz

Arda Akman (TTA)

Enis Erkel (Advisor METU, KU)

Burak Demirtaş (ARCELIK)

Mete Aşcıoğlu (Digitürk)

Topic: Future Trends on 3D Immersive Media

As the concluding part of the 2nd

ROMEO Workshop, a panel session was organized to discuss on the subject of “Future Trends on 3D Immersive Media” from different aspects. To have a complete view on this topic, future of 3D media is analyzed taking into account four different points of view: network aspects, business aspects, consumer electronics side and content provider aspects. In this respect, Arda Akman from Türk Telekom Group, who had a strong technical background in the fields of wireline and wireless communications and networking, gave a talk about the networking aspects. Burak Demirtaş from Arçelik, one of the largest consumer electronics company in Turkey, explained how the consumer electronics side (i.e., televisions, set top boxes, etc), are affected by the future trends. Mete Aşçıoğlu, Head of Transmission in Digitürk, which is a content provider company in Turkey, focused on reflecting the views of content providers to 3D media. Enis Erkel, who has 20+ years of leadership experience in innovation, R&D and new business development in ICT sector, explained how the business strategies are affected by the theme of the panel (Figure 16).


Figure 16 - Panel Discussion


3 WORKSHOP ATTENDANCE

The Second ROMEO Workshop can be considered a great success in terms of attendance. Despite the fact that its date coincided with the very touristic season in Turkey, more than forty (40) individuals, professionals, scientists, researchers, and university students attended the workshop (Figure 17). Besides the members of the ROMEO consortium, audience members from several scientific organizations and companies attended the event, such as the Özyeğin University, the University of Coimbra, the Middle East Technical University, and the Board of Directors / TTGV. Furthermore, there have been attendees from different institutions at the final panel discussion session, where they provided their thoughts and ideas considering the ROMEO approach.

Figure 17 - Second ROMEO Workshop Attendance


4 CONCLUSION

The 2nd

ROMEO Workshop in Turkey, Istanbul was successfully accomplished. It provided an opportunity to the participants to exchange the ideas and join discussions on the topics that ROMEO project is mainly focused on, such as state of the art 3D audio-visual transmission technologies, video and audio coding trends, 3D multi-view media. During the interactive presentations and speeches, there were many different beneficial technical discussions on the subjects. The main points that were emphasized by the participants can be summarised as follows: Assoc. Prof. Oğuz Sunay elaborated on the point that video delivery architecture must not only be technically, but also economically feasible. Prof. Gözde Bozdağı pointed out the continuously increasing bandwidth demand of 3D media, which will always require special attention. Assistant Prof. Müge Sayıt mentioned that she had a PhD study on the subject of video streaming and P2P networks, which are also being studied within the scope of ROMEO project. She also mentioned that these topics were increasingly drawing attention of academics in Turkey. Enis Erkel, an advisor at METU and Koc University (KU), provided his opinions on 3D media, stating the fact that 3D media would have bigger impact in users’ daily lives in future. On the other hand, Mete Ascioglu, Head of Transmission at Digitürk, highlighted his concerns on 3D broadcast that instead of 3D media, multi-view broadcast would be popular in future. The common point of the Workshop participants’ consideration was that they found all of these discussions and feedbacks very useful for their future reference and studies.

Last but not least, the Workshop Publication Chair Dr Ilias Politis received positive feedback from the Springer Publications on his request of publishing a book on the workshop proceedings to make available at the disposal of wider audiences.


5 REFERENCES [1] Haroon Qureshi, Markus Ludwig, “Improving Temporal Image Signature Approach by

Adding Face Conspicuity Map,” 2nd

ROMEO WORKSHOP, http://www.ict-romeo.eu/Workshop2.html, Istanbul, Jul 2013.

[2] H. Lim, A. Kondoz, “Virtual Sound Source Localisation Based on Wave Field Synthesis,” 2

nd ROMEO WORKSHOP, http://www.ict-romeo.eu/Workshop2.html,

Istanbul, Jul 2013.

[3] L. Pinto, P. Amado Assuncao, “Non-uniform Asymmetric Coding of Stereo Images,” 2

nd ROMEO WORKSHOP, http://www.ict-romeo.eu/Workshop2.html, Istanbul, Jul

2013.

[4] Gözde Bozdağı Akar, Middle East Technical University, “Coding and transmission of 3D media,” 2

nd ROMEO WORKSHOP, http://www.ict-romeo.eu/Workshop2.html,

Istanbul, Jul 2013.

[5] Didier Doyen, Cedric Thebault, Thierry Borel, “Depth grading processing to control quality of 3D content,” 2

nd ROMEO WORKSHOP, http://www.ict-

romeo.eu/Workshop2.html, Istanbul, Jul 2013.

[6] Oğuz Sunay, Özyeğin University, “QoE-Aware Multimedia Content Delivery over Next Generation Networks”, 2



[7] Evariste Logota, Hugo Marques, Jonathan Rodriguez, Fernando Pascual, Manuel Nuñez, Ignacio Digón, “A Scalable Approach for QoS Control in P2P Networking,” 2

nd


[8] Asimakis Lykourgiotis, Athanasios Kordelas, Ilias Politis, Charalampos Mysirlidis and Tasos Dagiuklas, “Machine learning models for network related 3D video QoE,” 2

nd


[9] Cengiz Ultav, Vestel Electronics Member of Board of Directors / TTGV, “Future of 3D media: A Consumer Electronics Manufacturer’s Perspective,” 2

nd ROMEO

WORKSHOP, http://www.ict-romeo.eu/Workshop2.html, Istanbul, Jul 2013.

[10] Christos Thomos, Tasos Dagiuklas1, Ilias Politis, Stavros A. Kotsopoulos, Shahid Mumtaz, Valdemar Monteiro, Jonathan Rodriguez, “Cross-Layer Architecture for 3D Video Streaming,” 2



[11] Konstantinos Birkos, Christos Papageorgiou, Tasos Dagiuklas, Stavros Kotsopoulos, “Chunk Selection for Tree-based Layered Peer-to-Peer Streaming,” 2

nd ROMEO

WORKSHOP, http://www.ict-romeo.eu/Workshop2.html, Istanbul, Jul 2013.


APPENDIX A: WORKSHOP PROGRAMME

09:00-09:15 Opening Speech

Prof. Ahmet Kondoz

09:15-09:30 Paper presentation

Haroon Qureshi and Markus Ludwig

“Improving Temporal Image Signature Approach by Adding

Face Conspicuity Map”


Hyun Lim, Ahmet Kondoz and Xiyu Shi

“Virtual Sound Source Localisation Based on Wave Field

Synthesis”

09:45-10:15 Keynote Speech

Associate Prof. Dr. Oğuz Sunay, Özyeğin University

“QoE-Aware Multimedia Content Delivery over Next

Generation Networks”

10:15-10:30 Coffee Break


Luis Pinto and Pedro Assunção

“Non-Uniform Asymmetric Coding of Stereo Images”


Evariste Logota, Hugo Marques, Jonathan Rodriguez,

Fernando Pascual, Manuel Nuñez and Ignacio Digón

“A Scalable Approach for QoS Control in P2P Networking”


Prof. Gözde Bozdağı Akar, Middle East Technical University

“Coding and transmission of 3D media”


Christos Thomos, Tasos Dagiuklas1, Ilias Politis, Stavros A.

Kotsopoulos, Shahid Mumtaz, Valdemar Monteiro,

Jonathan Rodriguez

“Cross-Layer Architecture for 3D Video Streaming”


Charalampos Misirlidis, Athanasios Kordelas, Ilias Politis

and Tasos Dagiuklas

“Machine learning models for network related 3D video

QoE”


12:00-14:00 Lunch


Cengiz Ultav, Vestel Electronics Member of Board of

Directors / TTGV (Technology Development Foundatıon of

Turkey) Chairman of Board of Directors

“Future of 3D media: A Consumer Electronics

Manufacturer’s Perspective”


Konstantinos Birkos, Christos Papageorgiou, Tasos

Dagiuklas and Stavros Kotsopoulos

“Chunk Selection for Tree-based Layered Peer-to-Peer

Streaming”


Didier Doyen, Cédric Thébault, Thierry Borel

“Depth grading processing to control quality of 3D content”

15:00-15:15 Coffee Break

15:15-16:30 Panel Discussion - “Future Trends on 3D Immersive

Media”

Chair – Prof. Ahmet Kondoz

Arda Akman (TTA) – Network aspects

Enis Erkel – Business aspects

Burak Demirtaş (ARC) – Consumer electronics side

Mete Aşcıoğlu (Digitürk) – Content provider aspects


APPENDIX B: WORKSHOP CALL FOR PAPERS


APPENDIX C: GLOSSARY OF ABBREVIATIONS

A

AVC Advanced Video Coding

B

BIFS Binary Format for Scenes

C

CapEx Capital Expenditure

CSS Cascading Style Sheets

D

DoW Description of Work

DVB Digital Video Broadcasting

F

FOBTV Future of Broadcast Television

H

HbbTV Hybrid Broadcast Broadband Television

HDD Hard Disk Drive

HTML Hypertext Markup Language

I

IBC International Broadcast Conference

ICT Information and Communications Technology

IEEE Institute of Electrical and Electronics Engineers

IETF Internet Engineering Taskforce

IP Internet Protocol

IPTV Internet Protocol Television

K

KU Koç University

L

LTS Long Time Support

M

METU Middle East Technical University

MPEG Motion Picture Experts Group

MPEG LASeR MPEG-4 Lightweight Application Scene Representation

MVC Multiview Video Coding

N


NAB National Association of Broadcasters

O

OEM Original Equipment Manufacturer

OpEx Operational Expenditure

P

PHP PHP: Hypertext Preprocessor

P2P Peer to Peer

R

RAM Random Access Memory

S

SME Small and Medium Enterprises

SMPTE Society of Motion Picture and Television Engineers

SVC Scalable Video Coding

SVG Scalable Vector Graphics

T

TCP Transmission Control Protocol

TM Technical Module

TS Transport Stream

TTGV Technology Development Foundation of Turkey

U

UPnP Universal Plug and Play

URL Uniform Ressource Locator

V

VQEG Video Quality Experts Group

W

WLAN Wireless - LAN

X

XHTML Extensible HyperText Markup Language

B

BMP Bitmap

C

CA Consortium Agreement

D

DoW Description of Work

E


EC European Commission

G

GA Grant Agreement

GM General Meeting

J

JPEG Joint Photographic Experts Group image compression

P

PB Project Board

PC Project Coordinator

PNG Portable Network Graphics

Q

QAT Quality Assurance Team

QMR Quarterly Management Report

T

TIFF Tagged Image File Format

TIS Temporal Image Signature

W

WP Work Package


APPENDIX D: WORKSHOP PRESENTATIONS











































Documents

Remote Collaborative Real-Time Multimedia Experience over ......ROMEO WP8 Page 1/71 Remote Collaborative Real-Time Multimedia Experience over the Future Internet ROMEO Grant Agreement