91
Wednesday, May 25, 2011

Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Embed Size (px)

DESCRIPTION

My talk from ARE2011 on hand's free AR.

Citation preview

Page 1: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Wednesday, May 25, 2011

Page 2: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Signals, Challenges, & Horizons for Hand’s-Free Augmented Realitychris arkenberg @chris23

Wednesday, May 25, 2011

Page 3: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Wednesday, May 25, 2011

Page 4: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Augmented Reality is breaking out of the smartphone to become hand’s-free.

Wednesday, May 25, 2011

Page 5: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Design Fictions

@chris23

Blade Runner

Wednesday, May 25, 2011

Page 6: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Design FictionsCompelling narratives about the augmented reality experience

@chris23

Wednesday, May 25, 2011

Page 7: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Design FictionsCompelling narratives about the augmented reality experience

@chris23

Wednesday, May 25, 2011

Page 8: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Design FictionsCompelling narratives about the augmented reality experience

@chris23

They Live

Wednesday, May 25, 2011

Page 9: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Design FictionsCompelling narratives about the augmented reality experience

@chris23

They Live

Wednesday, May 25, 2011

Page 10: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Design FictionsCompelling narratives about the augmented reality experience

@chris23Terminator

Wednesday, May 25, 2011

Page 11: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Design FictionsCompelling narratives about the augmented reality experience

@chris23Terminator

Wednesday, May 25, 2011

Page 12: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Design FictionsCompelling narratives about the augmented reality experience

@chris23

Wednesday, May 25, 2011

Page 13: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Design FictionsCompelling narratives about the augmented reality experience

@chris23

Wednesday, May 25, 2011

Page 14: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Design FictionsCompelling narratives about the augmented reality experience

@chris23

Wednesday, May 25, 2011

Page 15: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Design FictionsCompelling narratives about the augmented reality experience

@chris23Stranger Than Fiction

Wednesday, May 25, 2011

Page 16: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Design FictionsCompelling narratives about the augmented reality experience

@chris23Stranger Than Fiction

Call of Duty: Modern Warfare

Wednesday, May 25, 2011

Page 17: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Design FictionsCompelling narratives about the augmented reality experience

@chris23Minority Report

Wednesday, May 25, 2011

Page 18: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Limitations of hand-held AR

@chris23

Wednesday, May 25, 2011

Page 19: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Limitations of hand-held ARInconvenient

@chris23

Wednesday, May 25, 2011

Page 20: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Limitations of hand-held ARInconvenient

Distracting

@chris23

Wednesday, May 25, 2011

Page 21: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Limitations of hand-held ARInconvenient

Distracting

Limited render real estate

@chris23

Wednesday, May 25, 2011

Page 22: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Limitations of hand-held ARInconvenient

Distracting

Limited render real estate

Dangerous

@chris23

Wednesday, May 25, 2011

Page 23: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Limitations of hand-held ARInconvenient

Distracting

Limited render real estate

Dangerous

Reinforces screen division

@chris23

Wednesday, May 25, 2011

Page 24: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Value of hand’s-free AR

@chris23DIOR 2011

Wednesday, May 25, 2011

Page 25: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Value of hand’s-free UXAlways present

@chris23

Wednesday, May 25, 2011

Page 26: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Value of hand’s-free UXAlways present

Full perspective

@chris23

Wednesday, May 25, 2011

Page 27: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Value of hand’s-free UXAlways present

Full perspective

Minimal screen barriers

@chris23

Wednesday, May 25, 2011

Page 28: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Value of hand’s-free UXAlways present

Full perspective

Minimal screen barriers

Out of the way

@chris23

Wednesday, May 25, 2011

Page 29: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Value of hand’s-free UXAlways present

Full perspective

Minimal screen barriers

Out of the way

@chris23

Miyagi prefecture

Wednesday, May 25, 2011

Page 30: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Value of hand’s-free UXAlways present

Full perspective

Minimal screen barriers

Out of the way

Intrinsically adaptive

@chris23

Wednesday, May 25, 2011

Page 31: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Current progress

@chris23

Wednesday, May 25, 2011

Page 32: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Current progress

@chris23

Wednesday, May 25, 2011

Page 33: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Current progressHeadsets

@chris23

Wednesday, May 25, 2011

Page 34: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Current progressHeadsets

Vuzix

@chris23

Wednesday, May 25, 2011

Page 35: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Current progressHeadsets

Vuzix

@chris23

Vuzix WRAP AR

Wednesday, May 25, 2011

Page 36: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Current progressHeadsets

Vuzix

@chris23

Wednesday, May 25, 2011

Page 37: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Current progressHeadsets

Microvision

@chris23

Wednesday, May 25, 2011

Page 38: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Current progressHeadsets

Microvision

@chris23

Urban Leader Tactical Response, Awareness & Visualization

Wednesday, May 25, 2011

Page 39: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Current progressHeadsets

Microvision

@chris23

Wednesday, May 25, 2011

Page 40: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Current progressHeadsets

Apple?

@chris23

Wednesday, May 25, 2011

Page 41: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Current progressHeadsets

Apple?

@chris23Design concept

Wednesday, May 25, 2011

Page 42: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Current progressHeadsets

Transcend goggles

@chris23Zeal Optics Transcend Ski Goggles

Wednesday, May 25, 2011

Page 43: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Current progressHeadsets

IPMS OLED

@chris23Frauhofer IPMS

Wednesday, May 25, 2011

Page 44: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Current progressHeadsets

Rio de Janeiro

@chris23

Wednesday, May 25, 2011

Page 45: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Current progressHeadsets

Rio de Janeiro

@chris23Rio “Robocop”

Wednesday, May 25, 2011

Page 46: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Current progressHeadsets - Summary

@chris23

Wednesday, May 25, 2011

Page 47: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Current progressWearable

@chris23

Wednesday, May 25, 2011

Page 48: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Current progressWearable

Transparent rendering

@chris23

Wednesday, May 25, 2011

Page 49: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Current progressWearable

Transparent rendering

Basic eye tracking

@chris23

Wednesday, May 25, 2011

Page 50: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Current progressWearable

Transparent rendering

Basic eye tracking

Synched to device & cloud

@chris23

Wednesday, May 25, 2011

Page 51: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Current progressWearable

Transparent rendering

Basic eye tracking

Synched to device & cloud

Location-aware

@chris23

Wednesday, May 25, 2011

Page 52: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Current progressWearable

Transparent rendering

Basic eye tracking

Synched to device & cloud

Location & context-aware

Active analysis & filtering

@chris23

Wednesday, May 25, 2011

Page 53: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Current progressContact Lenses

@chris23

Wednesday, May 25, 2011

Page 54: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Current progressContact Lenses

@chris23

Babak Parviz, Univ of Washington

Wednesday, May 25, 2011

Page 55: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Current progressContact Lenses

@chris23

Babak Parviz, Univ of Washington

Wednesday, May 25, 2011

Page 56: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Challenges

@chris23

Wednesday, May 25, 2011

Page 57: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

ChallengesAesthetics

@chris23

Wednesday, May 25, 2011

Page 58: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

ChallengesAesthetics

@chris23

Ray Ban

Wednesday, May 25, 2011

Page 59: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

ChallengesAesthetics

Technical

@chris23

Wednesday, May 25, 2011

Page 60: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

ChallengesAesthetics

Technical - power, weight, capture, integration.

@chris23

Wednesday, May 25, 2011

Page 61: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

ChallengesAesthetics

Technical - power, weight, capture, integration.

Interface

@chris23

Wednesday, May 25, 2011

Page 62: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

ChallengesAesthetics

Technical - power, weight, capture, integration.

Interface - eye-tracking, gestural, selection,

execution, filtering.

@chris23

Wednesday, May 25, 2011

Page 63: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

ChallengesAesthetics

Technical - power, weight, capture, integration.

Interface - eye-tracking, gestural, selection,

execution, filtering.

Interaction

@chris23

Wednesday, May 25, 2011

Page 64: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

ChallengesAesthetics

Technical - power, weight, capture, integration.

Interface - eye-tracking, gestural, selection,

execution, filtering.

Interaction - context awareness, algorithms,

provisioning.

@chris23

Wednesday, May 25, 2011

Page 65: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

ChallengesAesthetics

Technical - power, weight, capture, integration.

Interface - eye-tracking, gestural, selection,

execution, filtering input & display.

Interaction - context awareness, algorithms,

provisioning.

Perception

@chris23

Wednesday, May 25, 2011

Page 66: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

ChallengesAesthetics

Technical - power, weight, capture, integration.

Interface - eye-tracking, gestural, selection,

execution, filtering input & display.

Interaction - context awareness, algorithms,

provisioning.

Perception - occlusion, distraction, depth cues,

eye strain.@chris23

Wednesday, May 25, 2011

Page 67: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

ChallengesLegal & ethical

@chris23

Wednesday, May 25, 2011

Page 68: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

ChallengesLegal & ethical

@chris23

Egypt, Jan 28 2011

Wednesday, May 25, 2011

Page 69: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

ChallengesLegal & ethical

Privacy

@chris23

Wednesday, May 25, 2011

Page 70: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

ChallengesLegal & ethical

Privacy

@chris23

Tim Boucher 2005

Wednesday, May 25, 2011

Page 71: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

ChallengesLegal & ethical

Privacy

Identity

@chris23

Wednesday, May 25, 2011

Page 72: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

ChallengesLegal & ethical

Privacy

Identity

@chris23

Viewdle

Wednesday, May 25, 2011

Page 73: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

ChallengesLegal & ethical

Privacy

Identity

Surveillance

@chris23

Wednesday, May 25, 2011

Page 74: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

ChallengesLegal & ethical

Privacy

Identity

Surveillance

@chris23

Wednesday, May 25, 2011

Page 75: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

ChallengesLegal & ethical

Privacy

Identity

Surveillance

Security

@chris23

Wednesday, May 25, 2011

Page 76: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

ChallengesLegal & ethical

Privacy

Identity

Surveillance

Security

@chris23

Baku-Tiblisi-Ceyhan pipeline

Wednesday, May 25, 2011

Page 77: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

ChallengesLegal & ethical

Privacy

Identity

Surveillance

Security

Safety

@chris23

Wednesday, May 25, 2011

Page 78: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

ChallengesLegal & ethical

Privacy

Identity

Surveillance

Security

Safety

@chris23

30 seconds to comply

Wednesday, May 25, 2011

Page 79: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

ChallengesLegal & ethical

Privacy

Identity

Surveillance

Security

Safety

Fragmented realities

@chris23

Wednesday, May 25, 2011

Page 80: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

ChallengesLegal & ethical

Privacy

Identity

Surveillance

Security

Safety

Fragmented realities

@chris23

Wednesday, May 25, 2011

Page 81: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Future Horizons

@chris23

Wednesday, May 25, 2011

Page 82: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Future Horizons

@chris23

Wednesday, May 25, 2011

Page 83: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Future HorizonsPersonal algorithms

@chris23

Wednesday, May 25, 2011

Page 84: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Future HorizonsPersonal algorithms

@chris23You have a problem with authority, Mr. Anderson.

Wednesday, May 25, 2011

Page 85: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Future HorizonsPersonal algorithms

Dynamic user interface

@chris23

Wednesday, May 25, 2011

Page 86: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Future HorizonsPersonal algorithms

Dynamic user interface

Provisioned experience

@chris23

Wednesday, May 25, 2011

Page 87: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Future HorizonsPersonal algorithms

Dynamic user interface

Provisioned experience

Cloud agents

@chris23

Wednesday, May 25, 2011

Page 88: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Future HorizonsPersonal algorithms

Dynamic user interface

Provisioned experience

Cloud agents

Brain-computer interface

@chris23

Wednesday, May 25, 2011

Page 89: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Future HorizonsPersonal algorithms

Dynamic user interface

Provisioned experience

Cloud agents

Brain-computer interface

Bio-nanotechnology

@chris23

Wednesday, May 25, 2011

Page 90: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Future HorizonsFully-native augmented reality?

@chris23

Woah! I know jujitsu!

Wednesday, May 25, 2011

Page 91: Signals, Challenges, & Horizons for Hand’s-Free Augmented Reality

Thank You!chris arkenberg

http://urbeingrecorded.com

@chris23

Gecko toes

Wednesday, May 25, 2011