View
9
Download
0
Category
Tags:
Preview:
DESCRIPTION
Citation preview
Amir Dotan - www.amirdotan.com
Input Devices
Amir Dotan - www.amirdotan.com
Input evolution
• As computers become smaller and ubiquitous(everywhere and in everything), they can not graball of our attention (sitting in front of a screen)and their size doesn’t allow us to use are fingersto communicate with them
• Alternative input methods (speech, movement,gazing) are considered as ways to makecomputing less attention demanding and moreintuitive (Accessibility benefits)
Amir Dotan - www.amirdotan.com
Input evolution
• Punch cards
• Keyboard
• Mouse
• Face recognition
• Facial expression
• Gaze / eye movement
• Touch / Multi-Touch
• Speech recognition
• Body movement (gestures)
Amir Dotan - www.amirdotan.com
Amir Dotan - www.amirdotan.com
Punch Cards
Amir Dotan - www.amirdotan.com
Text Entry Input - Keyboards
and Keypads
• The primary mode of textual data entry
• Keyboard size and packaging influences userssatisfaction and usability
• Large keyboards with many keys give animpression of professionalism and complexitybut may deter novice users
• Small keyboards seem lacking in power to someusers, but their compact size is an attraction formobile devices
Amir Dotan - www.amirdotan.com
The QWERTY layout
• The most commonly used keyboard layout is theQWERTY layout
• Also known as the Sholes keyboard, it wasinvented by Christopher Sholes who invented thetypewriter in 1868
• His layout slowed down users enough that keyjamming was infrequent
Amir Dotan - www.amirdotan.com
Dvorak Layout (Schneiderman, 2005)
• Developed in the 1920’s, supposedly reducesfinger travel, thereby increasing the typing rate ofexpert typists from about 150 words per minuteto more than 200 words per minute
• Acceptance of the Dvorak layout has been verylimited, despite the work of devotees
• People who have tried it report that it takes abouta week of regular typing to make the switch, butmost users have been unwilling to invest mucheffort
Amir Dotan - www.amirdotan.com
Keyboard Layouts
Amir Dotan - www.amirdotan.com
The Keyboard
Amir Dotan - www.amirdotan.com
Alternative Ergonomic and
Adjustable Keyboards
Amir Dotan - www.amirdotan.com
Alternative Adjustable
Keyboard
Optimus Maximus keyboard - http://www.artlebedev.com/everything/optimus/
Amir Dotan - www.amirdotan.com
Keyboards and Keypads for
Mobile Devices
http://amirdotan.multiply.com/video/item/98/The_Evolution_of_Mobile_Phones_1985_-_Today
Amir Dotan - www.amirdotan.com
Keyboards and Keypads for
Mobile Devices
• Mobile-phone functionalities are increasingconsiderably while their size is still shrinking
• Most devices combine normal static keys withdynamically labelled softkeys whose functionsare dependent on status and context
Amir Dotan - www.amirdotan.com
Alternative Mobile Phone
Keypads
http://www.digitwireless.com Nokia 7600
Amir Dotan - www.amirdotan.com
Pointing Devices
• A device such as a mouse, trackball, or graphicstablet that allows users to move a pointer abouton the workspace and point to graphical objects
• A direct-manipulation approach - No need tolearn commands or type, attention is focused onthe display
• Important for small devices and large walldisplays that make keyboards impractical asinput devices
Amir Dotan - www.amirdotan.com
Pointing Devices• Direct control devices
– Lightpen
– Touchscreen (Single input point)
– Multitouch (Multiple and simultaneous input points)
– Stylus
• Indirect control devices– Mouse
– Trackball
– Joystick
– Touchpad
– Trackpoint (for laptops)
– Graphics tablet
• Novel devices and strategies– Foot controls
– Eye tracking
– DataGloves
– Tangible user interfaces
– Digital paper
– Haptic feedback
Amir Dotan - www.amirdotan.com
Criteria for Success (Schneiderman, 2005)
• Speed and accuracy
• Learning time
• Cost and reliability
• Size and weight
Amir Dotan - www.amirdotan.com
Direct-Control Pointing Device
- The Lightpen (MIT’s Sketchpad 1963)
Amir Dotan - www.amirdotan.com
Direct-Control Pointing Device
- The Lightpen
• Had several disadvantages:
– Users’ arm got tired
– Users’ hand obscured part of the screen
– Users had to remove their hands from thekeyboard to pick up the lightpen
– The lightpen was too fragile for public-accessenvironments
Amir Dotan - www.amirdotan.com
Direct-Control Pointing Device
- Touch Screen
Amir Dotan - www.amirdotan.com
Direct-Control Pointing Device
- The Stylus
Amir Dotan - www.amirdotan.com
An Alternative to the Stylus -
Shift (Microsoft Research)
http://uk.youtube.com/watch?v=kkoFlDArYks
http://research.microsoft.com/users/baudisch/projects/shift/index.html
Amir Dotan - www.amirdotan.com
Indirect-Control Pointing
Devices (Schneiderman, 2005)
• Eliminate the hand-fatigue and hand-obscuring-the-screen problem
• They do however require the hand to locate thedevice and demand more cognitive processingand hand/eye coordination to bring the onscreencursor to the desired target
• Among the indirect pointing devices the mousehas been the most popular
Amir Dotan - www.amirdotan.com
Pointing Device - The Mouse
On December 9, 1968 in San Francisco, Douglas Engelbart
presented for the first time the computer mouse
http://uk.youtube.com/watch?v=1MPJZ6M52dI
Amir Dotan - www.amirdotan.com
Direct-Control Pointing Device
Multi-Touch Input
Amir Dotan - www.amirdotan.com
Direct-Control Pointing Device
- Multi-Touch Input
http://uk.youtube.com/watch?v=9zGDNFpOMcA
http://amirdotan.multiply.com/video/item/56/iBar_-_Interactive_Bar_largest_multitouch_touchscreen
Amir Dotan - www.amirdotan.com
Direct-Control Pointing Device
- Multi-Touch Input
http://amirdotan.multiply.com/video/item/47/Microsoft_Surface_Business_2.0_Demo
Amir Dotan - www.amirdotan.com
Touch Input Gestures
Amir Dotan - www.amirdotan.com
Touch Input - Considerations(Windows Vista User Experience "Touch" guidelines)
• Small controls are difficult to use
– The size of the controls greatly affects your ability
to interact effectively. Controls that are at least
23x23 pixels are usable with a finger, but larger
controls of at least 40x40 pixels are even more
comfortable to use
Amir Dotan - www.amirdotan.com
Touch Input - Considerations(Windows Vista User Experience "Touch" guidelines)
• Task locality helps
– While you can move the pointer across a 14-inchscreen with a 3-inch mouse movement, usingtouch requires you to move your hand the full 14inches
– Repeatedly moving between targets that are farapart can be tedious, so it's much better to keeptask interactions within the range of a resting handwhenever possible
– Context menus are convenient because theyrequire no hand movement
Amir Dotan - www.amirdotan.com
Touch Input - Considerations(Windows Vista User Experience "Touch" guidelines)
• Hover must not be required
– Most touchscreen technologies don't detect a
hovering finger, even if they can detect a hovering
pen. If a program has tasks that depend on hover,
you won't be able to perform them efficiently using
touch
Amir Dotan - www.amirdotan.com
Touch Input - Considerations(Windows Vista User Experience "Touch" guidelines)
• Text input and selection are difficult
– Lengthy text input is especially difficult using
touch, so auto-completion and acceptable default
text values can really simplify tasks. Text selection
can also be quite difficult
Amir Dotan - www.amirdotan.com
Touch Input - Considerations(Windows Vista User Experience "Touch" guidelines)
• Small targets near the edge of the display can
be very difficult to touch
– Some touchscreen technologies are less sensitive
at the edges, making controls near the edge
harder to use. For example, the Minimize,
Maximize/Restore, and Close buttons on the title
bar can be harder to use when a window is
maximized
Amir Dotan - www.amirdotan.com
Basic Touch Design Principles(Windows Vista User Experience "Touch" guidelines)
• Don't assume that if a UI works well for a mouse, it also workswell for touch
– While good mouse support is a start, a good touch experience has afew additional requirements
• You can assume that if a UI works well for a finger, it alsoworks well for a pen
– Making your program touchable goes a long way to providing good pensupport. The primary difference is that fingers have a blunter tip, sothey need larger targets. And again, hover must be optional
• Don't depend on touch pointer to fix touch UI problems
– Because the touch pointer isn't as easy to use as direct input, view thetouch pointer as a last resort for programs that haven't been designedfor touch
Amir Dotan - www.amirdotan.com
Comparison of Pointing
Devices
• Each input device has its strengths andweaknesses
• The keyboard is best for text input and givingcommands with minimal hand movement
• The mouse is best for efficient, precise pointing
• Touch is best for object manipulation and givingsimple commands
• A pen is best for freeform expression, as withhandwriting and drawing
Amir Dotan - www.amirdotan.com
Comparison of Pointing
Devices (Schneiderman, 2005)
• Early studies found that direct pointing devicessuch as a lightpen or touchscreen were often thefastest but the least accurate
• Studies have shown that the mouse is the moreaccurate and efficient than alternative devices
• Users’ tasks matter when comparing devices
• Joysticks and trackball are often preferred overmice by users with motor disabilities
Amir Dotan - www.amirdotan.com
Comparison of Pointing
Devices (Schneiderman, 2005)
• Pointing devices, especially indirect-controldevices such as the mouse, are particularlychallenging for users who have visionimpairments - Well designed cursors andadjustable size and shape can help
• Alternative keyboard or keypad navigationoptions should be provided whenever possible
Amir Dotan - www.amirdotan.com
Novel Devices (Schneiderman, 2005)
• The popularity of pointing devices and the questfor new ways to engage diverse users for diversetasks has led to provocative innovations
• Since users’ hands might be busy on thekeyboard, designers have explored othermethods for selection and pointing
• In some cases, the device is too small or too bigto be used with a keyboard or a conventionalpointing device
Amir Dotan - www.amirdotan.com
Gestural Interface
• Head gestures
• Hand gestures
• Body gestures
Amir Dotan - www.amirdotan.com
Gestural Interface
Amir Dotan - www.amirdotan.com
Gestural Interface - Example
G-Speak http://vimeo.com/2229299
Amir Dotan - www.amirdotan.com
Gestural Interface - Example
http://amirdotan.multiply.com/video/item/148/HITACHI_Gesture_operation_TV
Amir Dotan - www.amirdotan.com
Gestural Interface - Example
http://amirdotan.multiply.com/video/item/83/Second_Life_gestural_interface_-_Navigation_Demo
Amir Dotan - www.amirdotan.com
Gestural Interface - Example
http://amirdotan.multiply.com/video/item/80/ShadowReaching_New_Perspective_on_Wall_Display_Interaction
Amir Dotan - www.amirdotan.com
Imaging and Video Input
Device - Webcam Tracking
http://uk.youtube.com/watch?v=GDINqY9kekU
Amir Dotan - www.amirdotan.com
Gestural Interface - Example
http://uk.youtube.com/watch?v=7uixUmxH-Z0
Amir Dotan - www.amirdotan.com
Gestural Interfaces - Wii and
Wii Fit
http://uk.youtube.com/watch?v=5oNVIcMnZh4http://uk.youtube.com/watch?v=mCufArSg-SQ
Amir Dotan - www.amirdotan.com
Wii Fit
Amir Dotan - www.amirdotan.com
Input - Using physical objects
http://amirdotan.multiply.com/video/item/101/reactable_basic_demo_
Amir Dotan - www.amirdotan.com
Eye tracking systems
• Our eyes are an essential output device with isused to point to objects. We use it tocommunicate to the world our intents (Eyecontact)
• Combined with head gesture, this method ofpointing can be a powerful communicationchannel
Amir Dotan - www.amirdotan.com
Eye tracking - Example
• Squidoo EyeTracking
– http://www.youtube.com/watch?v=ilq9qeyVjT0
Amir Dotan - www.amirdotan.com
The future?
Gamers will soon be able to interact
with the virtual world using their
thoughts and emotions alone.
BBC NEWS 20.02.08
http://news.bbc.co.uk/1/hi/technolo
gy/7254078.stm
Amir Dotan - www.amirdotan.com
Thought Control
http://amirdotan.multiply.com/video/item/81/Brainloop_-_Thought_Control
Amir Dotan - www.amirdotan.com
Speech and Auditory Input(Schneiderman, 2005)
• Hardware designers have made dramaticprogress with speech recognition, generation,and processing but current success are far fromachieving the results we see in Sci-Fi movies
• They also recognize that voice commanding ismore demanding of user’s working memory thanis hand/eye coordination and thus may be moredisruptive to users while they are carrying outtasks
Amir Dotan - www.amirdotan.com
Speech and Auditory Input(Schneiderman, 2005)
• Planning and problem solving can proceed inparallel with hand/eye coordination, but they aremore difficult to accomplish while speaking
• Background noise and variations in users speechperformance make the challenge of speechrecognition still greater
• The benefits to people with certain disabilitiescan be immense, but general users are notrushing to implement speech input
Amir Dotan - www.amirdotan.com
Speech Systems -
Opportunities (Schneiderman, 2005)
• When users have vision impairments
• When the speaker’s hands are busy
• When mobility is required
• When the speaker’s eyes are occupied
• When harsh or cramped conditions preclude useof a keyboard
Amir Dotan - www.amirdotan.com
Speech Systems -
Technologies (Schneiderman, 2005)
• Discrete-word recognition -
– Recognize individual words spoken by a specificperson
– 90%-98% reliable
– 100-10000-word or larger vocabularies
• Continuous-speech recognition
Amir Dotan - www.amirdotan.com
Speech recognition -
Examples
Flight Simulator Voice Recognition
http://www.youtube.com/watch?v=wZf9Ni6Qocc
Speech recognition in Windows Vista
http://www.youtube.com/watch?v=v9o72XJcFQI
Amir Dotan - www.amirdotan.com
Speech recognition -
Examples
Google Mobile App for iPhone, now with Voice Search
http://uk.youtube.com/watch?v=y3z7Tw1K17A
Recommended