Surface Computing

Turning everyday surfaces into interactive intelligent interfaces

Co-located input and output

Mixed reality: tangible objects, natural interactions with direct manipulation

TouchLight

an imaging touch screen with some unique capabilities

“Lunchbox” interactive vision system

PlayAnywhere

Short-throw projector, very wide angle lens on the camera

Lens distortion & projective transform correction for camera-projector alignment

Off-axis IR LED illuminant

Very few assumptions about the appearance of the surface

All calibration is done at the “factory”

Flow Move

Summarize optical flow field as simultaneous translation, rotation, scaling

Bluetooth Photo Sync

Mini PlayAnywhere

IR Laser Pointer Tracking

Track shaped laser pointer (hologram)

Theoretically 6 degree of freedom

Today, 4: position, depth, roll

AirStylus

With Mike Sinclair

Activate by thumb and forefinger together

Surface Computing Challenges

Display and Sensing

e.g. Projector + computer vision

Interactions

e.g. Two handed, multi-user

Applications

e.g. Mapping