Utah School of Computing

Utah School of Computing

Interfaces: Media and Devices

CS5540 HCI

Rich Riesenfeld

Fall 2007

CS5540 HCI

Rich Riesenfeld

Fall 2007

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of ComputingFall 2007Fall 2007 slide slide 22slide slide 22

Major CategoriesMajor Categories

• Input - Harder

• Output- More successful history

• Input - Harder

• Output- More successful history

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of ComputingFall 2007Fall 2007 slide slide 33slide slide 33

Inputs - 1Inputs - 1

• Clickless Interface Example- http://www.dontclick.it

• TTY• Voice• Gesture• Haptic

- Phantom devices, etc

• Handwriting

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of ComputingFall 2007Fall 2007 slide slide 44slide slide 44

Inputs - 2Inputs - 2

• Eye tracking• Body forces

- Live seat- Sides of back- Etc

• Structured light• Body sensors

- Animation

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of ComputingFall 2007Fall 2007 slide slide 55slide slide 55

Inputs - 3Inputs - 3

• Widgets- Buttons, sliders, menus, toggles, etc

• User Recognition- Get your coffee the way you always get it!

• Machine Learning- Watch and learn- Windows menus: What is on top of menu?

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of ComputingFall 2007Fall 2007 slide slide 66slide slide 66

Inputs - 4Inputs - 4

• Read CNS signals- Muscle signals- Lie detector

Skin conductivity

- Direct brain signal interface cyberkineticsinc.com ALS Spinal cord injury sufferers

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of ComputingFall 2007Fall 2007 slide slide 77slide slide 77

Outputs – 1 Outputs – 1

• Flat screen- Resolution, colors, refresh rate, …

• Stereopsis Techniques- Color filters: R/G, etc- Polarized glasses

• Sound- Synthetic effects- Speech

• Flat screen- Resolution, colors, refresh rate, …

• Stereopsis Techniques- Color filters: R/G, etc- Polarized glasses

• Sound- Synthetic effects- Speech

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of ComputingFall 2007Fall 2007 slide slide 88slide slide 88

Outputs – 2 Outputs – 2

• Sound- Synthetic, unnatural sounds

Laser, “wrong,” “dive”

- Realistic: prerecorded DB generated

- Speech Synthetic Real, prerecorded

• Sound- Synthetic, unnatural sounds

Laser, “wrong,” “dive”

- Realistic: prerecorded DB generated

- Speech Synthetic Real, prerecorded

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of ComputingFall 2007Fall 2007 slide slide 99slide slide 99

Outputs – 3 Outputs – 3

• VR Environments- 3D- Fantasy worlds- Overlays on realworld

Breast biopsy procedure Assembly or Maintenance Info HUDs in cockpit

Reduce cognitive overload

• VR Environments- 3D- Fantasy worlds- Overlays on realworld

Breast biopsy procedure Assembly or Maintenance Info HUDs in cockpit

Reduce cognitive overload

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of ComputingFall 2007Fall 2007 slide slide 1010slide slide 1010

Outputs – 3 Outputs – 3

• VR Environments• Smell• Vibrations• Newtonian Physics: ON

- Exploit the known, natural experience Highly predictable Concise

- Provide normal physics of environment Inertia Collisions (no penetrations) Gravity Friction Noise

• VR Environments• Smell• Vibrations• Newtonian Physics: ON

- Exploit the known, natural experience Highly predictable Concise

- Provide normal physics of environment Inertia Collisions (no penetrations) Gravity Friction Noise

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of ComputingFall 2007Fall 2007 slide slide 1111slide slide 1111

Outputs – 4Outputs – 4

• Background sound- Movie score

Important Not natural

• Background sound- Movie score

Important Not natural

Utah School of Computing

Utah School of Computing

End

Interfaces: Media and Devices Interfaces: Media and Devices