61

Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye
Page 2: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye
Page 3: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Huh?

Page 4: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

NO! Reality is Volumetric

Rendering for an Interactive 360º Light Field Display, A. Jones, I. McDowall, Yamada H., M. Bolas, P. Debevec Siggraph, 2007

Page 5: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

AR is a Substance to Put Into the World

Harrison, Benko, Wilson, Omnitouch, UIST 2011, Microsoft Research and CMU

Page 6: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Not Looking Through Glass

Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011

Page 7: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Inlays Can Look You In The Eye

Page 8: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Inlays Everywhere

Page 9: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Sound is Volumetric Too

Page 10: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Pointsources -> Waves fields

Page 11: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Humans Hardwired for Wavefields

Krum, Suma, Bolas, 2012

Page 12: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Wavefields + Realty = Little Reflection

Achieving eye contact in a one-to-many 3D video teleconferencing system, A. Jones, M. Lang, G. Fyffe, X. Yu, J. Busch, I. McDowall, M. Bolas, P. Debevec

Page 13: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Reality is Framed

5

Page 14: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Frames Can Hurt

Page 15: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Frames Can Help

Cao, Bolas, E-Tech Submission 2008

Page 16: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Embrace the Frame

Paparazzi, Qualcomm AR Challenge Winner,

Page 17: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

White Plastic Conduit (diffuser)

Condition

Time (min)

150° FOV60° FOV + LED60° FOV

151051510515105

100

95

90

85

80

75

70

65

60

55

50

Accu

racy (

%),

+/-

1 S

EM

Distance Judgment Accuracy

Stretch the Frame

A. Jones, E. Swan, S. Ellis, M. Bolas

Page 18: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Reality is Malleable

8

Page 19: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Stretching Space

Impossible Spaces, Suma, Lipps, Finkelstein, Krum, Bolas, IEEE VR 2012

Page 20: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye
Page 21: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Inspired by: L. Kohli, Redirected Touching: Warping Space to Remap Passive Haptics, UNC EVE group, 3DUI 2010

Translates to Augmented

Page 22: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Does the Real World Get Warped?

Page 23: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye
Page 24: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Reality Comes in Second

Effects of Redirection on Spatial Orientation in Real and Virtual Environments, Evan Suma, David M. Krum, Samantha Finklestein, Mark Bolas,

IEEE Symposium on 3D User Interfaces, 2011

Page 25: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Reality is Toast

11

Page 26: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Augmentation is Weaved Into the Fabric of Modern Reality

Page 27: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

We Anticipate The Virtual

Bing’s Streetside View

Page 28: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

We Tune Away the Real

Page 29: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

We Function Better with the Virtual

Page 30: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

We Won’t Touch the Real

Page 31: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

We Prefer the Virtual

Page 32: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye
Page 33: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Pushing Pixels Out -> Pulling Reality In

Treating Virtual Information as a Substance to Inlay into the World

Realizing that ‘the World’ is a Framed and Malleable Construct the User Creates

Pulling Information from the Real World to Put It into the Virtual

Augmented Reality is the Last Bastion of Reality

Page 34: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Pull-In Body Language

Page 35: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Sense and Leverage Dexterity

Butler, et al., Microsoft Research, UIST 2011

Page 36: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Engaging Place with Virtual

Stein, Fisher, Million Story Building, SCA Interactive Media, 2011

Page 37: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

What Are The Affordances Of Reality or

My Phone Does Everything I Need

People Read Expressions, Stress, Intent, Desire Places Memories in Places, Situational Context Things Tangible, Links to Knowledge Ideas Blogs, Wikis, Ted Talks, KickStarter Projects

Page 38: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Reality is Mobile

14

Page 39: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

October 14, 2011

Page 40: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

April 10, 1989

Page 42: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye
Page 43: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye
Page 44: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye
Page 45: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Games Ate VR For Lunch

Page 47: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye
Page 48: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye
Page 49: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

17 Years later

Page 50: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

What is it that will give users a reason to engage with Augmented Data?

Page 51: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Oh.

Page 52: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Mobile

Page 53: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

AR Probe Into Culture

Page 54: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye
Page 55: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

“Best of E3”

Page 56: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Columbia: AR Windows Phones

Page 57: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye
Page 58: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye
Page 59: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Augmented What?

Reality is Volumetric

Reality is Framed

Reality Is Malleable

Reality is Toast

Reality is Mobile

Page 60: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye

Thank you

David Nelson, David Krum, Evan Suma, Thai Phan, Adam Jones, Palmer Luckey: USC ICT

Scott Fisher, Perry Hoberman: USC SCA

Peter Preuss, Seraphin Diaz: Qualcomm

Mary Whitton: UNC

ISMAR 2012: Blair MacIntyre and Greg Welch

Page 61: Huh?...Augmented Reality Using Personal Projection and Retroreflection David M. Krum, Evan Suma, Mark Bolas, Personal and Ubiquitous Computing, 2011 Inlays Can Look You In The Eye