34
Making Augmented Reality Work Outdoors www.edxtech.com @edxtechnologies Keith Bray 1

Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

Making Augmented Reality Work Outdoors

www.edxtech.com

@edxtechnologies

Keith Bray

1

Page 2: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

How to go from this… To this?

Top-Down 2D Map View First Person AR View 2

Page 3: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

Or even just as simple as… this.

3

Page 4: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

Why do we want this?

4

Page 5: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

5

Page 6: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

6

Page 7: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

7

Page 8: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

Outdoor AR Problems • Anchor point detection • Where in the world am I? • How am I oriented? • GPS accuracy • Compass/orientation accuracy • Camera Field-of-views • Poor depth perception range • AR placement relative to the world • AR object orientation (3D vs 2D) • Obstruction of view

8

Page 9: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

9

Outdoor AR Use Case Example 1

Page 10: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

Where exactly do I dig to find this 1” x 1” cable or pipe?

10

Outdoor AR Use Case Example 2

Page 11: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

11

Page 12: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

Well, we have to fix some problems • GPS is inaccurate to ~3m (10 ft) • Compass can be off 5 degrees or more

Initial Thoughts: • Add external, more accurate GPS/GNSS • Replace GPS w/Computer Vision

(ARCore/ARKit) – see if this helps • AI / ML

12

Page 13: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

13

Page 14: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

14

Page 15: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

But what about GPS and compass accuracy?

15

Page 16: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

By default, it’s bad

16

Page 17: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

Distance Skewing

17

Page 18: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

Bad data in, bad data out

18

Page 19: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

19

Page 20: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

20

(Pa1, Pb1) (Pa2, Pb2) (Pa3, Pb3)

Some eq: 123x + 456y = Lat 789x + 654y = Lng

Multiple Linear Regression

Page 21: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

21

Page 22: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

How do we get good/great?

Combine lots of solutions • Apply Some math to subject’s location

• Use CV to adjust GPS error • Use GPS to adjust CV error

• Use a digital twin for AR projection • Use external GNSS if you can • Manual alignment also valid

22

Page 23: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

23

Page 24: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

24

Page 25: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

25

Page 26: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

26

Page 27: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

27

Page 28: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

Do things get better with fancy equipment?

28

Page 29: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

Expensive GPS/Camera equipment

29

Page 30: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

30

Page 31: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

31

Page 32: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

32

Page 33: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

33

Where to go from here?

AI | ML |Image recognition

Page 34: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View

Thanks you!

Keith Bray

@edxtechnologies www.edxtech.com

A geospatial computing company