Upload
anand-anil
View
215
Download
0
Embed Size (px)
Citation preview
8/6/2019 3D IPTV - Networking Technologies and Impact Donny Tytgat
http://slidepdf.com/reader/full/3d-iptv-networking-technologies-and-impact-donny-tytgat 1/15
All Rights Reserved © Alcatel-Lucent 2009
3D IPTV
Networking technologies and impact
Donny Tytgat -- Bell Labs, Research
8/6/2019 3D IPTV - Networking Technologies and Impact Donny Tytgat
http://slidepdf.com/reader/full/3d-iptv-networking-technologies-and-impact-donny-tytgat 2/15
All Rights Reserved © Alcatel-Lucent 2009 – Alcatel-Lucent Confidential2 | 3DTV a future (r)evolution? | December 2009
Evolution in Screen technology
0
2
4
6
8
10
2000 2002 2004 2006 2008 2010 2012
B i t r a t e p e r s
t r e a m
[ M b p s
]
SDTV
HDTV720p
HDTV1080p
?
SDTV HDTV 720p HDTV 1080p
8/6/2019 3D IPTV - Networking Technologies and Impact Donny Tytgat
http://slidepdf.com/reader/full/3d-iptv-networking-technologies-and-impact-donny-tytgat 3/15
All Rights Reserved © Alcatel-Lucent 2009 – Alcatel-Lucent Confidential3 | 3DTV a future (r)evolution? | December 2009
3DTV: a possible future evolution?
Bigger Screens -- Higher Resolution ?
Adding a new dimension: 3D IPTV
8/6/2019 3D IPTV - Networking Technologies and Impact Donny Tytgat
http://slidepdf.com/reader/full/3d-iptv-networking-technologies-and-impact-donny-tytgat 4/15
All Rights Reserved © Alcatel-Lucent 2009 – Alcatel-Lucent Confidential4 | 3DTV a future (r)evolution? | December 2009
How does 3D coding works: Overview
Different Alternatives currently used & under study2D + Z coding
Multi-viewpoint coding (MVC)
Multi-viewpoint + depth (MVD)
Not a uniform technology yet for 3D media encoding &transmission, due to:
Advantages & disadvantage of each technology related to usedvisualization technology & acquisition
New applications are still in research phase (requirements too pre-mature)
8/6/2019 3D IPTV - Networking Technologies and Impact Donny Tytgat
http://slidepdf.com/reader/full/3d-iptv-networking-technologies-and-impact-donny-tytgat 5/15
All Rights Reserved © Alcatel-Lucent 2009 – Alcatel-Lucent Confidential5 | 3DTV a future (r)evolution? | December 2009
How does 3D coding works: 2D+Z (1)
2D+Z is a bandwidth efficient format for coding semi-3D contentFor a certain scene both 2D and depth information is providedInitial standardization ongoing in MPEG-C part 3
Advantages:
Backwards compatible with normal 2D TVsEasy to get data from synthetic content (Z-buffers)Nearby views can be easily extrapolated using this depth information10-20% overhead compared to 2D MPEG Bandwidth
2D+Z Encoding
8/6/2019 3D IPTV - Networking Technologies and Impact Donny Tytgat
http://slidepdf.com/reader/full/3d-iptv-networking-technologies-and-impact-donny-tytgat 6/15
All Rights Reserved © Alcatel-Lucent 2009 – Alcatel-Lucent Confidential6 | 3DTV a future (r)evolution? | December 2009
How does 3D coding works: 2D+Z (2)
2D+Z is a bandwidth efficient format for coding semi-3D content
Disadvantages:High processing required for generating depth-map from captured scenesNot possible to see occluded areas (You cannot look behind a corner)Occluded areas introduce annoying visual artefacts (Round edges and in highfrequency parts of the depth-map)Not suitable for visualisation systems with large viewing angles
Updates are under investigation to also add occluded information forreducing visual artefacts
2D+Z Encoding
8/6/2019 3D IPTV - Networking Technologies and Impact Donny Tytgat
http://slidepdf.com/reader/full/3d-iptv-networking-technologies-and-impact-donny-tytgat 7/15
All Rights Reserved © Alcatel-Lucent 2009 – Alcatel-Lucent Confidential7 | 3DTV a future (r)evolution? | December 2009
How does 3D coding works: MVC (1)
Multi-viewpoint codingIf 2 or more viewpoints are send over the network
Nearby views have lots of similarities.
Taking similarities into account will reduce the BW
BWMVC < n x BW single_viewpoint
Multi-viewpoint standardization is currently ongoing in JVT: as a extensionto H.264/AVC
Multi Viewpoint Coding
8/6/2019 3D IPTV - Networking Technologies and Impact Donny Tytgat
http://slidepdf.com/reader/full/3d-iptv-networking-technologies-and-impact-donny-tytgat 8/15
All Rights Reserved © Alcatel-Lucent 2009 – Alcatel-Lucent Confidential8 | 3DTV a future (r)evolution? | December 2009
How does 3D coding works: MVC (2)
H.264 Multi-viewpoint coding:
Hierarchical B-frames mechanisms is used for doing predictions betweenviewpoints
Example scheme for 8 viewpoints Example scheme for stereo
8/6/2019 3D IPTV - Networking Technologies and Impact Donny Tytgat
http://slidepdf.com/reader/full/3d-iptv-networking-technologies-and-impact-donny-tytgat 9/15
All Rights Reserved © Alcatel-Lucent 2009 – Alcatel-Lucent Confidential9 | 3DTV a future (r)evolution? | December 2009
How does 3D coding works: MVC (3)
Multi-viewpoint coding
Advantages:No view interpolation is required for visualization technologies which
require the raw views (e.g. glasses, parallax barrier,…)Occluded areas are recorded as well
With multiple views (e.g. 8) large viewing angle can be covered
Disadvantages:
High processing power is required if viewpoint interpolation is necessaryHigher bandwidth requirements, depending on occluded information
Expected bandwidth of 30%-80% per layer/viewpoint compared to 2D AVCBandwidth
8/6/2019 3D IPTV - Networking Technologies and Impact Donny Tytgat
http://slidepdf.com/reader/full/3d-iptv-networking-technologies-and-impact-donny-tytgat 10/15
All Rights Reserved © Alcatel-Lucent 2009 – Alcatel-Lucent Confidential10 | 3DTV a future (r)evolution? | December 2009
How does 3D coding works: Multi viewpoint + Depth
Multi Viewpoint + Depth (MVD):
Combination of 2D+Z and MVC
Multiple viewing angles are provided each with their depth-map
Requires less viewpoints & bandwidths than MVC (e.g. 3 views iso. 8)
Better quality for occluded areas
Larger viewing angle
Intermediate views can easily be interpolated
Can be compatible with multiple visualization technologies
… …
8/6/2019 3D IPTV - Networking Technologies and Impact Donny Tytgat
http://slidepdf.com/reader/full/3d-iptv-networking-technologies-and-impact-donny-tytgat 11/15
All Rights Reserved © Alcatel-Lucent 2009 – Alcatel-Lucent Confidential11 | 3DTV a future (r)evolution? | December 2009
What’s the future of 3D Coding
Most 3D displays are still very limited in the 3D viewing angle they provide
as this evolves, the required information of the scene increases
Less scene info More scene info
D a
t a s
i z e
Fixed Viewpoint Free ViewpointGeometry based
Coding
8/6/2019 3D IPTV - Networking Technologies and Impact Donny Tytgat
http://slidepdf.com/reader/full/3d-iptv-networking-technologies-and-impact-donny-tytgat 12/15
All Rights Reserved © Alcatel-Lucent 2009 – Alcatel-Lucent Confidential12 | 3DTV a future (r)evolution? | December 2009
Evolution towards full 3D
Applications and services are also evolving towards 3D
Second life Image metrics
Increasing 3D model quality
User generated content Dynamic interactions
Virtual worlds are becoming increasingly popular
Gaming, social networking, professional collaboration, etc.
GamingVirtualWorlds
3DCoding
8/6/2019 3D IPTV - Networking Technologies and Impact Donny Tytgat
http://slidepdf.com/reader/full/3d-iptv-networking-technologies-and-impact-donny-tytgat 13/15
All Rights Reserved © Alcatel-Lucent 2009 – Alcatel-Lucent Confidential13 | 3DTV a future (r)evolution? | December 2009
Impact of future 3D coding technologiesCoding gain will increase due to new geometry based encoding technologies
Requirement of low-latency, for allowing interactivity, might on the otherhand put a limit to coding gain
Average Bandwidth will still increase, but will probably not explode
However Peak Bandwidth will become a more important issue
Impact on the network
Future coding will need more stateinformation, e.g.3D Model informationTexture/Material information
8/6/2019 3D IPTV - Networking Technologies and Impact Donny Tytgat
http://slidepdf.com/reader/full/3d-iptv-networking-technologies-and-impact-donny-tytgat 14/15
All Rights Reserved © Alcatel-Lucent 2009 – Alcatel-Lucent Confidential14 | 3DTV a future (r)evolution? | December 2009
Conclusions
3DTV technologies is new user-experience / opportunity for IPTV
Screen technologies become more and more mature
3D Coding technologies are following this wave, however still in theirinitial shoes
3DTV will probably have moderated impact on average network bandwidth
Future 3D coding will probably have higher impact on required peak
bandwidths
Future opportunities:
Convergence of 3D entertainment, Gaming & 3D Virtual WorldsNew evolutions in IPTV Human – Machine interfaces
8/6/2019 3D IPTV - Networking Technologies and Impact Donny Tytgat
http://slidepdf.com/reader/full/3d-iptv-networking-technologies-and-impact-donny-tytgat 15/15
All Rights Reserved © Alcatel-Lucent 2009 – Alcatel-Lucent Confidential15 | 3DTV a future (r)evolution? | December 2009
www.alcatel-lucent.com