Computer Vision for Augmented Reality

2014

T. Chateau1

1

Content

Institut PascalT. Chateau

1.Introduction!2.Detectors and Descriptors for

Augmented Reality!3.Geometry for Augmented Reality!4.Localization and Tracking for

Augmented Reality!

2

2

Introduction

Institut PascalT. Chateau

Augmented  reality  is  nowadays  a  wonderful  communica4on  tool    

3

3

Introduction

Institut PascalT. Chateau

Augmented  reality  is  nowadays  a  wonderful  communica4on  tool    

4

4

Introduction

Institut PascalT. Chateau

AR:  defini4on  

5

Defining characteristics [Azuma 97]!1.Combine real and virtual images (both

can be seen at the same time)!2.Interactive in real-time!3.Registered in 3D (virtual objects

appear fixed in space)!!

5

Introduction

Institut PascalT. Chateau

AR  Vs  RV  

6

Virtual reality: replaces reality!!!Augmented reality: enhances reality!!

6

Introduction

Institut PascalT. Chateau

AR:  how  does  it  works?  

7

7

Introduction

Institut PascalT. Chateau

AR:  how  does  it  works?  

8

8

Introduction

Institut PascalT. Chateau

AR:  how  does  it  works?  

9

9

Introduction

Institut PascalT. Chateau

AR:  how  does  it  works?  a  geometrical  point  of  view  

10

10

Introduction

Institut PascalT. Chateau

AR:  how  does  it  works?  a  geometrical  point  of  view  

11

To be estimated

11

Introduction

Institut PascalT. Chateau

AR:  how  does  it  works?  a  geometrical  point  of  view  

12

Scene  augmenta4on:  

Localiza4on  

Object  augmenta4on:  

Tracking  

12

Introduction

Institut PascalT. Chateau

AR:  how  does  it  works?  a  geometrical  point  of  view  

13

2D  localiza4on  

planar  geometry  

!

3D  localiza4on  

more  complex  geometry  

13

Introduction

Institut PascalT. Chateau

AR:  how  does  it  works?  a  geometrical  point  of  view  

14

The Classical AR localization process!1.Interest Point Detector !2.Descriptor!3.Matching!4.Pose Estimation !5.Augmented objects projection!!

14

Introduction

Institut PascalT. Chateau

AR:  how  does  it  works?  a  geometrical  point  of  view  

15

The Classical AR localization process!1.Interest Point Detector !

15

Introduction

Institut PascalT. Chateau

AR:  how  does  it  works?  a  geometrical  point  of  view  

16

The Classical AR localization process!2.)Descriptor!

! (z1,z2,z3,…,Zn)(…)

(…)

(…)…

16

Introduction

Institut PascalT. Chateau

AR:  how  does  it  works?  a  geometrical  point  of  view  

17

The Classical AR localization process!Matching!!

17

Introduction

Institut PascalT. Chateau

AR:  how  does  it  works?  a  geometrical  point  of  view  

18

The Classical AR localization process!Pose estimation!!

18

Introduction

Institut PascalT. Chateau

AR:  how  does  it  works?  a  geometrical  point  of  view  

19

The Classical AR localization process!Augmented objects projection!!

19