29
Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture Hugo Nicolau [email protected] Joaquim Jorge

Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

Embed Size (px)

DESCRIPTION

Presentation @ CHI'12

Citation preview

Page 1: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

Touch Typing using Thumbs: Understanding the Effect ofMobility and Hand Posture

Hugo [email protected]

Joaquim Jorge

Page 2: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture
Page 3: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

SIIDSituationally-Induced Impairments and Disabilities

Page 4: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

Hand oscillation hinder performance[Bergstrom-Lehtovirta et al., 2011]

Page 5: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

Especially with small virtual targets[Mizobuchi et al., 2005; Lin et al., 2007]

Page 6: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

Thumb interaction

Page 7: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

Text-entry whilst walking

Page 8: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

Effects of walking and hand posture on touch typing

Page 9: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

22 participants19 males, 3 females

23 to 40 years old

Right-handed

Page 10: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

Only 15used mobile touchscreens

regularly

Page 11: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

3 mobility conditions

Seated Walking 65% of human pace[Barnard et al., 2005]

WalkingAverage human pace2 steps / second

Page 12: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

Indoor test track and Pacesetter

Fixed pace [Kane et al., 2008]

Comparable level of walking demand

Vibrotactile feedback to pacesetter

Page 13: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

Hand Postures

One-handportrait

Two-handlandscape

Two-handportrait

Page 14: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

Copy task

2 practice sentences / condition

5 test sentences / condition

Portuguese language representative corpus

Error correction was not available

Page 15: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

Apparatus

HTC Desire

7x10 mm – portrait mode

10x10 mm – landscape mode

Neither word prediction nor correction was used

Page 16: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

Experiment Design

22 participants x 3 mobility settings x 3 hand postures

990 sentences overall

Two-way repeated measures analysis

Page 17: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

Results

Page 18: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

Two-hand input is faster

19.9

23.928.1

20.5

25.029.1

20.0

24.428.9

0

5

10

15

20

25

30

35

One-hand portrait Two-hand portrait Two-hand landscape

Words per Minute

Seated Walking (65%) Walking (100%)

Page 19: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

Two-hand posture does not provide additional stability

0%

2%

4%

6%

8%

10%

12%

14%

16%

0.0 g 0.5 g 1.0 g 1.5 g 2.0 g

MSD Error Rate by Hand Oscillation

One-Hand Portrait Two-Hand Portrait Two-Hand Landscape

seated walking (65%) walking (100%)

Page 20: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

Substitutions are the most common type of error

4.3% 3.8%1.7%

1.1%1.1%

0.7%

0.6% 1.1%

1.0%4.8% 5.2%

1.8%

0.9% 1.2%

0.8%

0.8%0.9%

0.8%7.0% 5.5%3.0%

1.0%1.4%

1.0%

0.6% 1.8%

1.2%

0%

2%

4%

6%

8%

Del Ins Subs

Page 21: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

Hand oscillation causes poor aiming nor finger slips

88% 84%87%92% 87% 93%93%

81%

96%

0%

20%

40%

60%

80%

100%

120%

One-hand portrait Two-hand portrait Two-hand landscape

Substitutions: incorrect land-on

Seated Walking (65%) Walking (100%)

Page 22: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

Substitution pattern

Same-row errors

Distance of one key

Typically at the right

Pattern was consistent across mobility demands

Page 23: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

Most users prefer larger keys

0

2

4

6

8

10

12

14

16

18

One-hand portrait Two-hand portrait Two-hand landscape

Participants Preference

Preferred hand posture Less preferred hand posture

Page 24: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

Design Implications(For all those sleeping/bored … WAKE UP!)

Page 25: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

!Do not over rely on two-hand interaction for physical stability

~

Page 26: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

!Take advantage of typing behaviors

T Ytranscribed > payyernintended > pattern

Page 27: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

!Design for poor aiming, especially whilst mobile

Touch

Accelerometer data

+ Intended key

Page 28: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

Conclusion

Negative effect of walking on touchtyping using thumbs

Consistent substitution pattern

Two-hand interaction does not improve text-entry accuracy; Increasing target size is an effective solution

Design implications

Page 29: Touch Typing using Thumbs: Understanding the Effect of Mobility and Hand Posture

The End.

Hugo [email protected]://web.ist.utl.pt/hugo.nicolau/