28
Presenter: Dr. Xinxing Xia Postdoc Research Associate, Being There Centre, The University of North Carolina at Chapel Hill E-mail: [email protected]

Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

Presenter: Dr. Xinxing Xia

Postdoc Research Associate, Being There Centre,

The University of North Carolina at Chapel Hill

E-mail: [email protected]

Page 2: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

Outline

Introduction

Floating LF 3D Display System

Large-scale LF 3D Display System

Conclusions

2

Page 3: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

Spatial 3D display techniques attract a lot of

attention in recent years

– Volumetric 3D display

• Perspecta Spatial 3D SystemActuality Systems, Inc.

• Volumetric display system based on rotating LED array Zhejiang University

Introduction-3D Display

G.E. Favalora, Computer, 38[8], p.37–44 (2005).

G. E. Favalora, J. Napoli,et.al, Proc. SPIE 4712, 300-312 (2002).

X. Xie, X. Liu, and Y. Lin, J. Opt. A: Pure Appl. Opt. 11 045707 (2009).

X. Xie, X. Liu, and Y. Lin, SID’08 Technical Digest, p.1610-1613.

Y. Lin, X. Liu, X. Xie, X. Liu, H. Li, IMID’08 Technical Digest, p.1138-1141.

No Occlusion

3

Page 4: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

Occlusion-capable multi-view display

– 198 views, Actuality Systems, Inc.

– View-dependent

An interactive 360-degree display

– 288 views, USC ICT

– Monochrome

Layered 3D display

– 7×7 views, Media Lab,MIT

– Limited view range

Introduction-3D Display

O. S. Cossairt, J. Napoli, et.al., Appl. Opt. ,46[8], p.1244–1250(2007).

A. Jones, et.al., ACM SIGGRAPH 2007 emerging technologies, August 05-09, 2007, San Diego, California.

G. Wetzstein, , et.al., ACM Transactions on Graphics, 30[4], 95, (2011) 4

Page 5: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

Light field display

Volumetric display:reconstruct the location of spatial

points: V (x,y,z)

Light field(LF) display:reconstruct each ray emitting

from every spatial point: L (x,y,z,θ,φ)

– Horizontal only: L (x,y,z,θ)

Light Field Display

• Adding angular distribution

of the spatial points

• Occlusion-capable

5

Page 6: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

Introduction

Penetrable 3D display floating in the air

How to carry out?6

Page 7: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

System Configuration

– Color high-frame-rate projector

– Light field scanning screen

(directional-diffusing screen)

– Servo Motor and Driver

Floating 3D Display System

7

Page 8: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

Three-chip high-frame-rate

projector

– Light source: RGB LEDs

– SLM: three-chip high-frame-

rate DMDs

Floating 3D Display System

4545 45

Main Board

D4100×3

DMD

DMD

DMD

Green LEDRed LED

Blue LED

X-cube

TIR

TIR

TIR

SMA×6

Workstation

High-frame-rate SLM

(TI Discovery 4100 Kit)

• Resolution:1024×768

• Frame rate:32000 fps (Max)

8

Page 9: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

Light field scanning screen:

– Tilt angle:45°

– Diffusing angle:0.5°(H)×60°(V)

Synchronization of the screen

Floating 3D Display System

Servo driverHigh-frame-rate

projector

Initial phase signal

Angular pulse signal

9

Page 10: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

Principle of the display

3D point

Image generator

Screen

( Here, )

Viewpoints region

(Here, )

: ( , , )P P PP x y z

( , , ) 0f x y z

0 0 0: ( , , )Q x y z

0z

( , ) 0g x y

2 2 2 0Vx y R

10

Page 11: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

Principle of the display

Intersection of line QP and

viewpoints region to get one

viewpoint

Intersection of line VQ and

screen to get the image of

generator

0 0

0 0

( , ) 0

P P

x x y y

x x y y

g x y

: ( , , )V V VV x y z

0 0 0

0 0 0

( , , ) 0

V V V

x x y y z y

x x y y z y

f x y z

: ( , , )S S SS x y z

11

Page 12: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

Observed image from one viewpoint

Principle of the display

Not a image projecting at

one time, but a combined

image of different projecting

sub images

2

+1 +1

2

( )V

V

N

V i j i j i j i j i j

j N

I I S T T S

12

Scanning from SiTi to Si+1Ti+1

Where, ( arcsin( ))V S VN ceiling N R R

Page 13: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

Common display zone

– Observed from all

directions horizontally

Cone-shape area:

– Bottom:

circle region with radius

of Rs;

– Height HC:

HC = Rsh/(Rs+Rv)

Principle of the display

13

Page 14: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

14

The display prototype

Experiments & Results

Prototype system

specification

Size of the utilized screen Φ400mm

Rotation speed of the

screen

1800 r/min

Projection distance 3000 mm

Projection image number

in one revolution

700

Frame rate of the projector 21000 fps

Image resolution 1024×768

Depth of projecting image 1 bit × 3(halftone)

Refresh rate of displayed

3D scene

30 Hz

Page 15: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

The display on the prototype

– Reconstructed floating 3D scenes vs. Real box and doll

Experiments & Results

15

Page 16: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

Displayed video

Experiments & Results

16

Page 17: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

Display Week 2013,

Vancouver Convention Center,

Vancouver, BC, Canada17

Page 18: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

Introduction- Large-scale LF Display

Large-scale Display No Moving Elements

How to carry out?

Large-scale 360-degree light-field 3D display

1818

Page 19: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

System Configuration

– Projector Array

– Directional diffusing

screen

Large-scale 3D Display System

1919

Page 20: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

Optical characteristics of the

directional-diffusing screen

– Horizontally:

• In a small angle

• Dependent on:

angular pitch and so on

– Vertically:

• In a large angle

• Ensure viewer to watch

the full image

Characteristics- Screen

x

y

z

2020

Page 21: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

The spatial point Q reconstruction

– Ray to reconstruct the light , the same direction horizontally

– Light rays of a spatial point Q :

: the data of pixel

of the kth projector .

Principle of the display

PS QV

( , ) ( , )kI P i j

( , )kP i j ( , )i j

( , , )

( , , )

i f x y k

j g y z k

The relation between the point Q

and pixel (i, j) of the projecting

image from P

2121

Page 22: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

The display prototype

Experiments & Results

Directional diffusing

screen

Projector Array

22

Page 23: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

The display prototype

– Projector Array:DLP mini-projectors

• Resolution: 800×600

• Color depth: 24 bit

– Directional-diffusing Screen:

• 1.0°(H)×60.0°(V)

Experiments & Results

Size of the

diffuser

Number of

projectors

Radius of the

projector array

Projector’s

HFOV

3D Display

Zone

Φ3000mm 360(360°) 1700mm 17° Φ994mm

2323

Page 24: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

The display on the prototype

– Large-scale 3D display

Experiments & Results

(a) Left view (b) Middle view (c) Right view

Photos taken from different directions

2424

Page 25: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

The display on the prototype

– Large-scale 3D display vs. Real person

Experiments & Results

(a) (b)

The display system displaying different 3D scenes

2525

Page 26: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

Displayed video demo

Experiments & Results

26

Page 27: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

360-degree floating light field 3D display prototype

– A high-frame-rate color projector

– A flat light field scanning screen

– Mapping method from the rays of 3D points to the projecting images

360-degree large-scale light field 3D display prototype

– Ring-arranged projector array

– Cylindrical directional-diffusing screen

– Mapping method from the rays of 3D points to the projecting images

More improvement and research is needed

– Improving the color 3D image quality (grayscale, resolution, etc.)

– High-speed transmission of mass data for dynamic and interactive 3D display

Conclusions

27

Page 28: Presenter: Dr. Xinxing Xia - imiimi.ntu.edu.sg/NewsEvents/Events/PastSeminars/... · Spatial 3D display techniques attract a lot of attention in recent years –Volumetric 3D display

These works about 3D displays are all finished in MOI, Zhejiang University.