SI3 – Master ISI : IHM02 2006/2007 1

Input / Output devices, Input / Output devices,

technologies and techniquestechnologies and techniques

Diane Lingrand

lingrand@polytech.unice.fr

http://www.polytech.unice.fr/~lingrand

SI3 – Master ISI : IHM02 2006/2007 2

Today's topic

� Input / output devices

� mouse, keyboard, etc.

� Taxonomies

� Evaluation

� Next time:

� displays

� About 3D space and more

SI3 – Master ISI : IHM02 2006/2007 3

Inputs / outputs

� Input

� text (keyboard, handwritten)

� position (mouse, GPS, ...)

� audio (speech recognition)

� visual (image, video: tracking, recognition)

� Output

� audio (precomputed, speech synthesis)

� visual (precomputed, synthetic image)

� tactil (force feedback, vibration, ...)SI3 – Master ISI : IHM02 2006/2007 4

Text entry

� Handwritten

� totally free

� constrained

� Keyboards

� hardware / software

� mobility (wearable computer, mobile phone, PDAs, ...)

� handicap

SI3 – Master ISI : IHM02 2006/2007 5

Graffiti, Calligrapher 8.3, xscribble

uni-stroke alphabetSI3 – Master ISI : IHM02 2006/2007 6

Keyboard's layout

� AZERTY, QWERTY, ..., Dvorak (1936).

SI3 – Master ISI : IHM02 2006/2007 7

Ergonomic keyboards

SI3 – Master ISI : IHM02 2006/2007 8

Logical keyboard

Mackenzie and Zhang, CHI'99

Hunter, Zhai and Smith, CHI 2000

SI3 – Master ISI : IHM02 2006/2007 9

Games

SI3 – Master ISI : IHM02 2006/2007 10

Wearable computer

SI3 – Master ISI : IHM02 2006/2007 11

2005

SI3 – Master ISI : IHM02 2006/2007 12

Mobility

� Twiddler

� WristPC

�

http://www.redwoodhouse.com/wearable/index.php?module=pagemaster&P

AGE_user_op=view_page&PAGE_id=7&MMN_position=16:7

SI3 – Master ISI : IHM02 2006/2007 13

Chord Keyboard: Microwriter (1980)

SI3 – Master ISI : IHM02 2006/2007 14

Another Chord Keyboards

� BAT keyboard (Infogrip)

� CyKey (Bellaire Electronics)

SI3 – Master ISI : IHM02 2006/2007 15

Keyboards for PDA

SI3 – Master ISI : IHM02 2006/2007 16

Mobile phone

� Example: Glyph (F. Poirier, Univ. Bretagne Sud)

SI3 – Master ISI : IHM02 2006/2007 17

Glyph alphabet

SI3 – Master ISI : IHM02 2006/2007 18

Motor handicap

� limiting displacements

� logical keyboard

� Ex: KeyGlasses (M. Raynal, Univ. Toulouse)

SI3 – Master ISI : IHM02 2006/2007 19

Pointing devices

� absolute / relative

� graphic tablet, touchscreen, optical pen

� mouse, joystick, trackball

� direct / indirect

� Control to Display Ratio

� touchscreen, optical pen

� graphic tablet, mouse, joystick, trackball

SI3 – Master ISI : IHM02 2006/2007 20

Mouse

� invented in 1967 by Douglas Engelbart and co.

� « any device that is capable of producing cursor motion » ?

SI3 – Master ISI : IHM02 2006/2007 21� touchscreen, camera mouse, eye mouse ...

� touchpad

� pointing stick

Alternative pointing devices

� foot mouse

� trackball

SI3 – Master ISI : IHM02 2006/2007 22

� where :� MT is the average time taken to complete the movement.

� a and b are empirical constants, and can be determined by fitting a straight line to measured data.

� A is the distance from the starting point to the center of the target or amplitude of movement.

� W is the width of the target measured along the axis of motion. W can also be thought of as the allowed error tolerance in the final position, since the final point of the motion must fall within ± W/2 of the target's centre.

Evaluation of pointing task:Fitt's law (1954)

W

A

SI3 – Master ISI : IHM02 2006/2007 23

Accot and Zhai Steering law (1997)

� Extension to 2D space

� Special case of path = straight tunnel of constant width W

SI3 – Master ISI : IHM02 2006/2007 24

Joystick

� Axes (absolute value)

� Buttons (up/down)

� Hats (discrete value: up, right, ...)

� Trackballs (relative 2D value)

SI3 – Master ISI : IHM02 2006/2007 25

Other ....

� Mouth joystick � « as a » joystick

Jouse2 (Infogrip)

SI3 – Master ISI : IHM02 2006/2007 26

Gaming

� Joypad, ....

SI3 – Master ISI : IHM02 2006/2007 27

Eye - tracking

� Method:

� Image Processing

� Cornea reflexion

� Magnetic system

� Mobile (on user head) / fixed (computer)

� 2D / 3D (?)

SI3 – Master ISI : IHM02 2006/2007 28

Positionning

� GPS

� Wifi

� RFID

� Camera tracking: eye, head, hand, body, ...

� ...

SI3 – Master ISI : IHM02 2006/2007 29

Laval Virtuel, 2006

Use your imagination !

Gestaction 3D

SI3 – Master ISI : IHM02 2006/2007 30

Taxonomies

� An exhaustive list is unusable

� GKS: logical device

� Locator, Stroke, Valuator, Choice, Pick, String

� 1974-84 :Foley

� Select, Position, Orient, Ink, Text, Value

� 1983: Buxton

� 1991: Card, Mackinlay and Robertson

SI3 – Master ISI : IHM02 2006/2007 31

1984: Foley

SI3 – Master ISI : IHM02 2006/2007 32

1983: Buxton's Taxonomy

SI3 – Master ISI : IHM02 2006/2007 33

Card, MacKinlay

and Robertson

(1997)

SI3 – Master ISI : IHM02 2006/2007 34

Mackinlay's radio

VolumeKnob = <Rz, [0o, 270o], �, I, [0o, 270o], {}>

= Rz : [0o, 270o] � [0o, 270o]

Volume = < InputDomain: [0, 25] decibels>

� Connection composition:

Connect (VolumeKnob, Volume, f( � deg) = Cv * � decibels)

VolumeKnob � Volume

� Layout composition:

VolumeKnobT1(x)�SelectionKnobT2(x)�StationKnobT3(x)

� Merge composition:

GenericTabletxy

= Generic1DTabletx X Generic1DTablet

y

SI3 – Master ISI : IHM02 2006/2007 35

Limitations

1D sensor 1D sensor 1D sensor 1D sensor

2D event (x;y)

X Y

2D event (x;y)

equivalent ???SI3 – Master ISI : IHM02 2006/2007 36

Ouputs

� Audio

� Visual

� screen / monitor

� glasses

� retinal

� Touch / Force

SI3 – Master ISI : IHM02 2006/2007 37

BCI: Brain Computer Interfaces

� Non-invasive / Invasive

� Paralysed people

� control of a robotic arm, ...

� Blind people

� camera + electrodes in the visual cortex

SI3 – Master ISI : IHM02 2006/2007 38

Tools and libraries

� Using different input devices:

� drivers

� libraries: � VRPN : Virtual Reality Peripheral Network

� SDL (www.libsdl.org): Simple DirectMedia Layer

� Speech recognition

� Speech synthesis (TTS=text-to-speech)� http://en.wikipedia.org/wiki/Speech_synthesis

� Handwritten recognition

� Gestures recognition

SI3 – Master ISI : IHM02 2006/2007 39

CHI at the Movie Theater

1968

20022001

2003

SI3 – Master ISI : IHM02 2006/2007 40

Bibliography

� Ken Hinckley « The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications » , chapter 7, 2003, J.A. Jacko and A. Sears editors.

� J. Accot and Sh. Zhai « More than dotting the i's � Foundations for crossing-based interfaces » CHI 2002

� Bill Buxton: http://www.billbuxton.com