3D Video services - UniNa STiDuEunina.stidue.net/Elaborazione di Segnali...3D Television3D Television “Quality of Experience”: Very good 2D movies vs objectionable 3D (bad color

3D Video services

Marco Cagnazzo

Part III: Advanced servicesOverviewOverview

3D Vid t3D Video systems• History• Acquisition• Transmission (coding)• RenderingFuture services• Super Hi Vision systems• High speed cameras• High sensibility cameras

page 1 Marco Cagnazzo 27.05.2010 3D Video

3D imaging a very old story!3D imaging… a very old story!

The weighing of the heart scene from

Masaccio, Trinità (1425-1427), S t M i N ll Fi

P. Picasso, Les Demoiselles d'Avignon, 1907, MOMA, NYC

The weighing of the heart scene from the Papyrus of Ani, ca. 1200 B.C.

Flat imagesPerspective and

distance fogSanta Maria Novella, Firenze

g

Perspective

gMultiple views

Piero della Francesca? Leon Battista Alberti? Città ideale (1470 1475 circa)


Piero della Francesca?, Leon Battista Alberti?, Città ideale (1470-1475 circa), Galleria Nazionale delle Marche, Urbino.

Depth perceptionDepth perception

Bi lBinocular cues• Stereoscopic imaging: stereopsis

Monocular cues• Perspective• Motion parallax• Depth from motion• Distance fog and texture degradation• Object sizes


Stereoscopic imagingStereoscopic imaging

As soon as photography was born, stereoscopic devices were createddevices were created

1844 St b D id B t d i th t1844: Stereoscope by David Brewster, a device that could take photographic pictures in 3D.

1851: Improvement by Louis Jules Duboscq (picture of Queen Victoria displayed at The Great Exhibition)of Queen Victoria displayed at The Great Exhibition)


ExampleExample

Stereoscopic view of Manhattan, 1909


3D Movies3D Movies

1855 th Ki t i t d i th St1855: the Kinematoscope was invented, i.e. the Stereo Animation Camera

1915: The first anaglyph movie was produced

1922: the first public 3D movie was displayed - The Power of LovePower of Love

1935: the first 3D color movie was produced1935: the first 3D color movie was produced


Anaglyph imageAnaglyph image


3D Television3D Television

1947: Soviet Union developed 3D films: Robinson CrusoeCrusoe

’50 3D i d d B D il’50: many 3D movies were produced: Bwana Devil, House of Wax, Alfred Hitchcock’s Dial M for Murder (the movie was released in 2D because not all(the movie was released in 2D because not all cinemas were able to display 3D films)


3D Television3D Television“Quality of Experience”: Very good 2D movies vs objectionable 3D (bad color annoying glasses )(bad color, annoying glasses…)

90s-2000s: New technologies in acquisition, compression, and 90s 000s e tec o og es acqu s t o , co p ess o , a drendering

A f 2008 3D i i b d J bl h lAs of 2008, 3D programming is broadcast on Japanese cable channel BS 11 approximately four times per day.

Sky 3D channel in April 2010. The system will require a special "3D ready" television and Sky+HD DVR box

Starting on June 11th, 2010 ESPN will launch a new channel dedicated to 3D sports with up to 85 live events a year in 3Dp p y


3D TV Systems3D TV Systems

S

tion

g Decod

er

BR

Stereo camera

Multi user 3D TV

nt Produ

ct

eo Cod

ing

3D Video

D+D

IB

…

… …

Depthcamera

Single user 3D TV

3D Con

ten

3D Vide 3

er

Multi-camera setup

2D TV3

DVB

Decod

2D/3D conversion

2D TV

Video Depth Meta data


Video Depth Meta data

3D Video acquisition3D Video acquisition

StStereoscopy • 2 cameras mounted side by side, separated by the same distance as

between a person's pupils.

Multi-view capture uses arrays of many cameras to capture a 3D scene through multiple independent video streams.

Color+depth camera: capture normal video and a depth map estimatedColor+depth camera: capture normal video and a depth map, estimated with radar-like techniques (uses infrared)

M lti i d th N C l d thMultiview+depth: N Color+depth cameras


3D Video Acquisition: stereo camera3D Video Acquisition: stereo camera


3D Video Acquisition: color + depth3D Video Acquisition: color + depth


3D Video Acquisition: MVD3D Video Acquisition: MVD


Coding of 3D videoCoding of 3D videoEncode separately each view

Encode jointly view• Use other views to perform• Use other views to perform

prediction of current image

Encode a view and a depth map• Joint or separate coding of view

and depth• Scalable coding?Scalable coding?


3D Rendering:Anaglyph MethodAnaglyph Method


3D Rendering: Polarized MethodPolarized Method


3D Rendering:Alternate-frame sequencingAlternate-frame sequencing

E d f i f th l ft [ i ht] iEvery second frame is from the left [right] viewVideo is projected at twice the frame rateViewers wears glasses that shutter alternatively the left or the right eye


3D Rendering:Auto stereoscopic displayAuto stereoscopic display


Non-stereoscopic rendering methodsNon-stereoscopic rendering methodsMotion parallax Head tracking

No special screen nor glasses!No special screen nor glasses!


THANKS FOR YOUR ATTENTION!ATTENTION!

?? || \\ (1)?? || \\

______________ (1)Questions or comments

® Dario Rossi, Télécom-ParisTech

Contacts:Marco CAGNAZZO

Institut Télécom – Télécom ParisTech

Dép. Traitement Signal et Imagep g g

e‐mail: [email protected]

Documents

3D Video services - UniNa STiDuEunina.stidue.net/Elaborazione di Segnali...3D Television3D Television “Quality of Experience”: Very good 2D movies vs objectionable 3D (bad color