stanford hci group / cs376

research topics in human-computer interaction http://cs376.stanford.edu

Tangible Interaction /Augmented Reality

Scott Klemmer12 October 2004

12 October 2004 2Tangible UIs / Augmented Reality

Baychi tonight: Don Norman

User Experience: Why Do So Many Organizations Believe They Own It?Kresge Auditorium, 7:45-9:45pm

12 October 2004 3Tangible UIs / Augmented Reality

Human Subjects

http://www.stanford.edu/dept/DoR/hsEmail me before class on Thursday that you have read and understand the guidelinesFor much of our research, we can ask for an exemption or for expedited review, but we do need to ask

12 October 2004 4Tangible UIs / Augmented Reality

“The future is already here. It is just not uniformly distributed”

—William Gibson

mentioned inBill Buxton, Forward Into the Past, Time Magazine, 10/11/2004 http://www.time.com/time/covers/1101041011/nextessay.html

12 October 2004 5Tangible UIs / Augmented Reality

Graphical User Interfaces

Potato, keyboard, small “desktop”Seated, single-userStructured tasks (word processing, spreadsheets, …)

12 October 2004 6Tangible UIs / Augmented Reality

Tangible User Interfaces

Augment the physical world, integrating digital information with everydayphysical objectsGenerally, physical input controlsgraphical or audio output

12 October 2004 7Tangible UIs / Augmented Reality

Three main types

Everyday (no actuation)Mechatronic (actuated)Ambient (actuated)

12 October 2004 8Tangible UIs / Augmented Reality

12 October 2004 9Tangible UIs / Augmented Reality

THE DESIGNERS’ OUTPOST

Web Design PracticeInterviews with 11 professional designers [Newman DIS 2000]

Post-It notes on large surfacesaffinity diagrams

Brainstormingcollaborativesolo

Advantagespersistentimmersive & hapticfluid, informal interface

Difficultieshard to edit…to share…to make digital Contextual Design, by Hugh Beyer and Karen HoltzblattWall of a design room at a Silicon Valley web design firm

12 October 2004 10Tangible UIs / Augmented Reality

THE DESIGNERS’ OUTPOST

12 October 2004 11Tangible UIs / Augmented Reality

The Designers’ Outpost

Combining...affordances of paper andadvantages of electronic media to support design practice[Klemmer et al, UIST 01]

Electronic wall surface(180 cm diagonal SMART Board)

Regular Post-it notesComputer vision, stylus, & physical tools UI

12 October 2004 12Tangible UIs / Augmented Reality

12 October 2004 13Tangible UIs / Augmented Reality

I N F R A S T R U C T U R ETHE DESIGNERS’ OUTPOST

Vision SystemRear Camera Vision (640x480, 7fps)

12 October 2004 14Tangible UIs / Augmented Reality

I N F R A S T R U C T U R E

Vision SystemTHE DESIGNERS’ OUTPOST

12 October 2004 15Tangible UIs / Augmented Reality

THE DESIGNERS’ OUTPOST

Geo-referenced I/O

12 October 2004 16Tangible UIs / Augmented Reality

12 October 2004 17Tangible UIs / Augmented RealityCollaborage Collaborage [Moran et al, UIST99][Moran et al, UIST99]

Rasa Rasa [McGee et al, CHI02][McGee et al, CHI02]

Illuminating LightIlluminating Light [CHI98][CHI98]

12 October 2004 18Tangible UIs / Augmented RealityPaper Flight StripsPaper Flight Strips [Mackay et al, CHI98][Mackay et al, CHI98]

MediaBlocksMediaBlocks [Ullmer][Ullmer]

Palette Palette [Nelson, CHI99][Nelson, CHI99]

12 October 2004 19Tangible UIs / Augmented RealityAudio Notebook Audio Notebook [Stifelman, CHI01][Stifelman, CHI01] Listen Reader Listen Reader [Back, CHI01][Back, CHI01]

Books with VoicesBooks with Voices [CHI03][CHI03]

12 October 2004 20Tangible UIs / Augmented Reality

12 October 2004 21Tangible UIs / Augmented Reality

12 October 2004 22Tangible UIs / Augmented Reality