3DRSim - 3D Reconstruction Simulator

3DRSim3D Reconstruction Simulator

By Tharindu Mathew

Motivation

● Explore ideas to generate 3D

reconstructions of complex objects with a

single image

● Simulation allows us to experiment with a

large number of projectors and cameras

● Algorithms will be applicable in the real world

3D Reconstruction

Demo

● Let’s see it...

Challenges

● Coming up with a pattern and related

algorithm that will allow us to get a

correspondence with one image

Related Work

Rapid Shape Acquisition Using Color Structured Light and Multi-pass Dynamic Programming - Zhang et al.

(2002)

Pattern based on De Bruijn sequence

● B(k, n) => A k size alphabet where every local n sequence is

unique

● A Debruijn sequence of an alphabet of size 5, i.e. {a, b, c, d, e},

where any sequence of 3 is unique.

● Assign a color for each letter, ex: a = 101 (RGB), and pick an

initial color

● Generate colors by following: Ci+1 = Ci ⊕ Di

Approach

For each horizontal row,

1. detect edges

2. correspond each edge between

two images

3. for each corresponded edge, do

ray intersection

Results

Future Work

● Use homography to and allow for different

camera configurations

● Experiment with more robust methods

Learnings

● Render to texture, Projective Texture

Mapping, Coordinate multiple shaders/

viewports

● 3D reconstruction

Acknowledgements

● Prof. Daniel for many of the concepts and related math

● Many openGL tutorials

● Debruijn sequence generator - Used from here -

http://stackoverflow.com/questions/4008603/how-to-

compute-de-bruijn-sequences-for-non-power-of-two-sized-

alphabets

● A wrapper class for loading bitmaps based on this tutorial -

http://www.tomdalling.com/blog/modern-opengl/02-textures/

Questions?