56
Understanding & Modeling Input Devices

Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Embed Size (px)

Citation preview

Page 1: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Understanding & Modeling

Input Devices

Page 2: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Questions

1. How do common input devices work?2. How can we think about the larger

space of all possible input devices?3. Can we predict human input

performance?4. What about uncommon input

devices (multitouch, tangible interfaces, …)?

5. Will this be on the exam? Yes.

Page 3: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Today’s lecture in graphic form

Page 4: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

I think my keyboard is broken. Whenever I have a few keys

pressed down, some keys suddenly don’t work anymore; at other times ‘phantom’ characters appear.

What’s going on?

Page 5: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Keyboard

Page 6: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input
Page 7: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input
Page 8: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input
Page 9: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Microprocessor and Controller

Page 10: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Row/Column Scanning

9 lines and 20 keys

http://v.youku.com/v_show/id_XMTI5NjE0OTQ4.html

Page 11: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Closeup

Page 12: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

One key down

Page 13: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input
Page 14: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

3 Keys Down

Page 15: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Encoding keyboard: Keys conflict

C1-R1-C2-R2 3 or 4 keys Q,W,A,S

http://www.upsdn.net/html/2006-10/760.html

Page 16: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

A Layered Framework

From: Hartmann, Follmer, Klemmer: Input Devices are like Onions

Page 17: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Mouse

Mouse. Engelbart and English ~1964

Page 18: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input
Page 19: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input
Page 20: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Encoder wheel for scrollingLeft button

Right button

Page 21: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

IR emitter IR detector

slotted wheel (between emitter & detector)

Page 22: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Sensing: Rotary Encoder

Page 23: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Sensing: Fwd rotation

Page 24: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Sensing: Backwd Rotation

Page 25: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Solutions: Use two Out-of-Phase Detectors

Page 26: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Sensing: Rotary Encoder

Page 27: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input
Page 28: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Transformation

cxt = max(0, min( sw, cxt-1+dx*cd )) cyt = … cxt: cursor x (horizontal) position in

screen coordinates at time t dx: mouse x movement delta in

mouse coordinates sw: screen width cd: control-display ratio

Page 29: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Device Abstraction

Click, DoubleClick, MouseUp, MouseDown, MouseMove …

Page 30: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

What about optical mice?

Source: http://spritesmods.com/?art=mouseeye

Page 31: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Source: http://spritesmods.com/?art=mouseeye

Page 32: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Trackball, Trackpad

Page 33: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Trackpoint

Indirect, force sensing, velocity control

Nonlinear transfer function

Page 34: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Joystick

Page 35: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

A design space of input devices…

Card, S. K., Mackinlay, J. D., and Robertson, G. G. 1991.A morphological analysis of the design space of input devices. ACM TOIS 9, 2 (Apr. 1991), 99-122.

Page 36: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input
Page 37: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input
Page 38: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Which is faster?

Page 39: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Which is faster?

Engelbart

Page 40: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Experiment: Mice are fastest!

Page 41: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Fitts’s law

Time Tpos to move the hand to target (size S) which is distance D away is given by:Tpos = a + b log2 (D/S + 1)

Index of Difficulty (ID) Only relative precision

matters

Exam Question Material!

Source: Landay, James. “Human Abilities”. CS160 UC Berkeley.

Page 42: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input
Page 43: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Tpos = a + b log2 (D/S + 1)

Device Characteristics(bandwidth of human muscle group & of

device)a: start/stop time (intercept) b: speed (slope)

Page 44: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Bandwidth of Human Muscle Groups

Page 45: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Why is mouse fastest? Why these results? Time to position mouse

proportional to Fitts’s Index of Difficulty ID.

[i.e. how well can the muscles direct the input device]

Therefore speed limit is in the eye-hand system, not the mouse.

Therefore, mouse is a near optimal device.

Page 46: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Fitts’s law example

Which will be faster on average? pie menu (bigger targets & less distance)

Page 47: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Fitts’s law in Windows &Mac OS

The Apple menu inMac OS X v10.4 Tiger.

Windows 95: Missed by a pixelWindows XP: Good to the last drop

Page 48: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

In office 2007

Larger, labeled controls can beclicked more quickly

Magic Corner: Office Button in theupper-left corner

Mini Toolbar: Close to the cursor

Source: Jensen Harris, An Office User Interface Blog : Giving You Fitts. Microsoft, 2007.

Page 49: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Uncommon Input Devices

Assumptions so far: Single user, working in front of a

desktop PC Main tasks are typing and pointing Efficiency rules

What if we change these assumptions? Design for enjoyment / engagement Design for multi-user scenarios

Page 50: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Position+Orientation: Nitendo Wii

Page 51: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Camera based input: IO Brush

Source: Kimiko Ryokai, http://web.media.mit.edu/~kimiko/iobrush/

Page 52: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Multi-touch

Jeff Han, Perceptive Pixel

http://www.tudou.com/programs/view/LfwscZ1iUXc/

Page 53: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Hybrids: Devices on Tables

Hartmann, Björn, Morris, M.R., Benko, H., and Wilson, A.Augmenting Interactive Tables with Mice & Keyboards. In Proceedings of UIST 2009.

Page 54: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

http://www.vid3o.net/view/v_AvkV286mI/uist09-augmenting-interactive-tables-with-mice-keyboards.html

Page 55: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Hybrids: Multi-touch on Mice

Mouse 2.0: Multi-touch Meets the MouseNicolas Villar, Shahram Izadi, Dan Rosenfeld, Hrvoje Benko, John Helmes, Jonathan Westhues, Steve Hodges,Eyal Ofek, Alex Butler, Xiang Cao and Billy Chen. Proceedings of UIST 2009.

http://www.disclose.tv/action/viewvideo/31170/Mouse_2_0_from_Microsoft/

Page 56: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input

Links

http://bjoern.org http://research.microsoft.com/apps/vi

deo/default.aspx?id=144849