Consultation Workshop “Future R&D Challenges on Networked

Media Systems”

Welcome and Context

Luis Rodríguez-RosellóDirector a.i “Converged Networks & Services”

Head of Unit “Networked Media Systems” DG-INFSO

Brussels, 19th of January 2010

EU R&D on Networked MediaThe current project portfolio and clusters

• Media Delivery Platforms and Content Delivery Networks: High quality TV via P2P; Digital Cinema, Next generation of P2P; IPTV and VoIP over IMS; Seamless content delivery; Scalable video coding

• User Centric Media: Shared interactive experiences; Community content (including co-creation); Dynamic personalisation and interaction; Seamless integration of UGC and professional content; Real-time context-aware media streaming; New forms of mobile music; Networked games environments; Interactive multimedia experiences

• 3D Media: Mobile 3D TV over DVB-H; Digital Cinema; Content generation and delivery of 3D digital TV; Spatial sound and vision; Feeling of physical presence

• Multimedia Search: P2P search; P2P tagged media; Multimedia content analysis; Automated annotation; Mixed-media queries; Data fusion; Location-based; Retrieval of 3D objects; Direct Search

The Work Programme 2009-2010:The Work Programme 2009-2010:what was called forwhat was called for

• Content-aware Networks and Network-aware ApplicationsContent-aware Networks and Network-aware Applications

Mass distribution, real time delivery and rendering, Mass distribution, real time delivery and rendering, representation, augmented worlds.representation, augmented worlds.

User generated content/social networks, Enriched media User generated content/social networks, Enriched media experiences (at the “Extended Home”, experiences (at the “Extended Home”, content and context-aware, content and context-aware, personalised, social media, real time). Optimal QoE. Users as producers, personalised, social media, real time). Optimal QoE. Users as producers, consumers, managers of content.consumers, managers of content.

• 3D Media Internet3D Media Internet

• Networked Search and RetrievalNetworked Search and Retrieval Large scale distributed MM content, interaction, dynamic Large scale distributed MM content, interaction, dynamic adaptation to context and application, personalised searchadaptation to context and application, personalised search

• Immersive Media Experiences beyond HDTV and Electronic CinemaImmersive Media Experiences beyond HDTV and Electronic Cinema Next generation MM and cinema: higher QoE (frame rates, contrast Next generation MM and cinema: higher QoE (frame rates, contrast range, colour, resolution, “spacialised” sound, 3D, innovative range, colour, resolution, “spacialised” sound, 3D, innovative 3D/multi-viewpoint coding…)3D/multi-viewpoint coding…)

Upcoming R&D on “Networked Media and Upcoming R&D on “Networked Media and 3D Internet” (1/2)3D Internet” (1/2)

• Content-aware Networks and Network-aware Applications:Content-aware Networks and Network-aware Applications: Networked Media “ecosystem”Networked Media “ecosystem”

Content-centric network architecture Content-centric network architecture

P2P architecture for User Generated ContentP2P architecture for User Generated Content

Network-controlled adaptive content deliveryNetwork-controlled adaptive content delivery

Optimization of bandwidth of HD-SD IPTV and Internet TV streamingOptimization of bandwidth of HD-SD IPTV and Internet TV streaming

Collaborative, social, context-aware and scalable media distributionCollaborative, social, context-aware and scalable media distribution

Optimization of content source selection and distribution (user Optimization of content source selection and distribution (user preferences, network statepreferences, network state

Compression and delivery of multi-view video and multi-channel audioCompression and delivery of multi-view video and multi-channel audio

European reference architecture for Future Media Internet

Contribution of Networked Media community to Web standards Contribution of Networked Media community to Web standards

Upcoming R&D on Networked Media and Upcoming R&D on Networked Media and 3D Internet (2/2)3D Internet (2/2)

New paradigms for realistic 3D communication over the New paradigms for realistic 3D communication over the Internet Virtual instantaneous transportation of peopleInternet Virtual instantaneous transportation of people Real time interaction between humans and virtual humansReal time interaction between humans and virtual humans Immersive and interactive TV (live events, ultra-high Immersive and interactive TV (live events, ultra-high resolution panoramas…)resolution panoramas…) 3D display and transmission of multi-view signals3D display and transmission of multi-view signals New forms for the creation and delivery of live media New forms for the creation and delivery of live media content (automatic capturing of the events in 3D, realistic, content (automatic capturing of the events in 3D, realistic, interactive and immersive play-back…)interactive and immersive play-back…) Virtual Centre of ExcellenceVirtual Centre of Excellence

• 3D Media Internet & Immersive Media Experiences3D Media Internet & Immersive Media Experiences

• Networked Search and RetrievalNetworked Search and Retrieval Open platform for multimedia and multimodal content Open platform for multimedia and multimodal content indexing, sharing, search and retrievalindexing, sharing, search and retrieval Use of events as the primary means to organise and index Use of events as the primary means to organise and index media: experiential, new social networking (event-based media: experiential, new social networking (event-based communities), personalised, automated media search and communities), personalised, automated media search and content retrievalcontent retrieval European coordination actionEuropean coordination action

Future Research Preparatory work for the Work Programme 2011-2012 in

Networked Media Systems

• Public consultation (closed 19th December 2009)• Workshop on future R&D challenges in Networked Media

Systems based on the results of the public consultation;• Topical Workshops

• Immersive media experiences• Broadcast driven Media in the Future Internet

Convergence Internet/Broadcasting+ …/ The Future of Digital Broadcasting…• Other Workshops (3D, User Centric Media…)• NEM Strategic R&D Agenda (vers. 7, Sept 2009)• Future Internet (R&D agenda, Public Private

Partnership - PPP) • R&D Challenge in ICT (Long-term issues): Future Media & 3D Internet• PPP: Linking technologies with applications: Smarter Infrastructures (smart

health, smart energy, smart living…); service architectures; user-centric open innovation schemes, closer to the market.