Embed Size (px)
DESCRIPTION
Talk given at GDC Europe in Cologne, NEM 2010 in Barcelona and 3D In Your Face in Bradford UK by Jens Schobel and Francesco Carucci.
Citation preview
CRYTEK
© 2010 Crytek GmbH
AAA Stereo-3D in CryEngine 3Jens Schobel ([email protected]) , Francesco Carucci ([email protected])
CRYTEK
© 2010 Crytek GmbH 2
Research project
CRYTEK
© 2010 Crytek GmbH 3
Research project
CRYTEK
© 2010 Crytek GmbH 4
Depth Perception
Research project
CRYTEK
© 2010 Crytek GmbH 5
Popping out of the screen
Research project
CRYTEK
© 2010 Crytek GmbH
Popping out of the screen
6
Your health is important
CRYTEK
© 2010 Crytek GmbH
Popping out of the screen
7
Your health is important
CRYTEK
© 2010 Crytek GmbH
Case study: HUD
8
WHERE do we place it?
CRYTEK
© 2010 Crytek GmbH
Case study: HUD
• Feels natural• Depth violations
Inside the screen
9
CRYTEK
© 2010 Crytek GmbH
Case study: HUD
• Feels cool• More tiring for the eyes
OUT OF the screen
10
CRYTEK
© 2010 Crytek GmbH
CASE STUDY: CONVEYING MOOD
• Color palette• Depth of field• Atmospheric effects
IN A 2D WORLD
11
CRYTEK
© 2010 Crytek GmbH
CASE STUDY: CONVEYING MOOD
• Stereo effect strength• Convergence distance
IN A STEREO 3D WORLD
12
CRYTEK
© 2010 Crytek GmbH
CASE STUDY: CONVEYING MOOD
• Stereo effect strength• Convergence distance• Change depth perception
IN A STEREO 3D WORLD
13
CRYTEK
© 2010 Crytek GmbH
CASE STUDY: Conveying mood
14
STEREO 3D AS ACOMMUNICATION TOOL
CRYTEK
© 2010 Crytek GmbH 15
VS
CRYTEK
© 2010 Crytek GmbH 16
1.5%
CRYTEK
© 2010 Crytek GmbH
• 30 fps per Eye for acceptable quality
Rendering Twice
17
STEREO IMAGE GENERATION
CRYTEK
© 2010 Crytek GmbH
• 30 fps per Eye for acceptable quality• dramatically reduced quality
Rendering Twice
18
STEREO IMAGE GENERATION
CRYTEK
© 2010 Crytek GmbH
• 30 fps per Eye for acceptable quality• dramatically reduced quality• lower resolution• less special effects
Rendering Twice
19
STEREO IMAGE GENERATION
CRYTEK
© 2010 Crytek GmbH
Rendering Twice
20
STEREO IMAGE GENERATION
Not an option
CRYTEK
© 2010 Crytek GmbH
STEREO IMAGE GENERATION
Screen space re-projection
21
• single pass pixel shader
CRYTEK
© 2010 Crytek GmbH
STEREO IMAGE GENERATION
Screen space re-projection
22
• single pass pixel shader• fully gather-based approach• no warped grid• no point sampling
CRYTEK
© 2010 Crytek GmbH
STEREO IMAGE GENERATION
Screen space re-projection
23
• single pass pixel shader• fully gather-based approach• no warped grid• no point sampling
• surprising depth strength possible
CRYTEK
© 2010 Crytek GmbH
STEREO IMAGE GENERATION
Screen space re-projection
24
• single pass pixel shader• fully gather-based approach• no warped grid• no point sampling
• surprising depth strength possible• full implementation by Nicolas Shulz (RnD)
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
High Level
25
• re-project pixel into left/right camera
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
High Level
26
• re-project pixel into left/right camera• in screen space
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
High Level
27
• re-project pixel into left/right camera• in screen space• offset based on pixel depth
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
High Level
28
• re-project pixel into left/right camera• in screen space• offset based on pixel depth• stereo parameters for adjusting
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
High Level
29
• re-project pixel into left/right camera• in screen space• offset based on pixel depth• stereo parameters for adjusting• resample backbuffer with bilinear filtering
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
30
• great quality with positive parallax
does it look good?
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
31
• great quality with positive parallax• no artifacts for opaque objects• transparent objects look acceptable• slight stretching at screen edges (easy to solve)
does it look good?
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
32
• good quality for negative parallax (popping out)
does it look good?
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
33
• good quality for negative parallax (popping out)• if no steep parallax gradient (no parallax change)
does it look good?
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
34
• good quality for negative parallax (popping out)• if no steep parallax gradient (no parallax change)
• artifacts for steep parallax gradient
does it look good?
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
does it look good?
35
• good quality for negative parallax (popping out)• if no steep parallax gradient (no parallax change)
• artifacts for steep parallax gradient• smooth out depth to solve
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
36
CRYTEK
© 2010 Crytek GmbH
STEREO IMAGE GENERATION
Outputting left/right
37
• PS3 Native HDMI 1.4 support
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
Outputting left/right
38
• PS3 Native HDMI 1.4 support• XBOX360 no native stereo support frame-compatible format (SBS, LBL, ...)
encode output format in a final pass
CRYTEK
© 2010 Crytek GmbH
SCREEN SPACE RE-PROJECTION
AUTOSTEREOSCOPIC
39
• Natively supported!• Output color and depth separation buffers
CRYTEK
© 2010 Crytek GmbH
• Nicolas Schulz - RnD• Michael Kopietz - RnD• Marco Corbetta - Crysis 2
THANKS TO…
CRYTEK
© 2010 Crytek GmbH
STEREO IMAGE GENERATION
Questions ?
41
ASK NOW
