37
Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information [email protected]

Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information [email protected]

Embed Size (px)

Citation preview

Page 1: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

Trends in HCI

University of Michigan Human Factors Engineering Short Course

2011

Mark W. NewmanUniversity of Michigan School of Information

[email protected]

Page 2: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

Design

Technology

People

Task

Page 3: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

Design

Technology

People

Task

What do people do?How can we support them?

What do people do?How can we support them?

Page 4: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

Design

Technology

People

Task

How do people interact?What are the human constraints?

How do people interact?What are the human constraints?

Page 5: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

Design

Technology

People

Task

How do advances in technology expand the kinds of tasks that can be supported?

How do advances in technology expand the kinds of tasks that can be supported?

Page 6: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

Design

Technology

People

Task

How do we use our understanding of people, their tasks, and technical capabilities to design better systems?

How do we use our understanding of people, their tasks, and technical capabilities to design better systems?

Page 7: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

Design

Technology

People

Task

CSCW

Classic HCI

Social Computing

Page 8: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

Design

TechnologyTask

People

Page 9: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

• Bigger– Walls, Tables

• Smaller– Mobile, wearables

• Multiple Devices– Multi-display

environments, tangible computing

• Context-aware computing– Worn, carried, or

embedded sensing used as an interaction input

Design

Technology

Task

People

Page 10: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

[Fenn10]

Page 11: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

1965: Doug Engelbart creates first mouse

1973: Work begins on Xerox Alto

1978: Xerox Star goes to “market”

1984: Apple Macintosh launched

1995: Win95 launched

1969: Engelbart ‘s “mother of all demos”

From concept to mass market: 20-30 years

Adapted from [Buxton07]

Page 12: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

HCI Technology Drivers

• Computing: Cheaper, smaller, faster• Networking: Ubiquitous and faster• Displays: Cheaper and bigger• Displays: Cheaper and smaller• Sensing: Cheaper and smaller• Sensing: Ubiquitous

Page 13: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

• Large multitouch screen interaction• Bimanual direct manipulation• Multiple simultaneous users

[Han05]

Video: http://www.perceptivepixel.com/press-release-5

Page 14: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

[Pieper09]

30-100M Pixels; used for scientific visualization

Page 15: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

• Encourage multi-user interaction

• Integrate with new environments

• Raise new issues– Multi-user coordination– Rotation-independence– Private/public data

sharing

[ITS 2010]

http://www.youtube.com/watch?v=6VfpVYYQzHs

Page 16: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

Large Displays: Applications

Group Sharing

Tight Collaboration

Peripheral Information

PersonalWorkspaces

Page 17: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

Large Displays: Usability Issues

• Control from a distance• Losing track of the cursor • Window management• Task management• Configuration problems• Leverage the periphery• Multi-user coordination

Page 18: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

• Drag and Pop– Extending familiar

interactions to a new platform

– General problem with large displays: how do you work with things that are far apart?

[Baudisch03]

Page 19: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

Large Display Input: Cameraphones

• Most people already have an interactive device with them• Use built-in capabilities of “personal interactors” to control

public devices• Selection and control at a distance

[Ballagas05]

Page 20: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

Large Display Interaction: Sensing distance

• Use precise location sensing to determine user’s proximity

• Different functionality based on distance

[Vogel04]

Page 21: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

Tabletop Interaction: Rotation and Personal Space

• There is no longer a “privileged” vantage point

• Need to distinguish users’ content, especially when sharing

[Shen06]

Page 22: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

[Baudisch09]

Video: http://www.youtube.com/watch?v=4xfgZy2B5ro

Page 23: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

[Mann97]

Page 24: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

Wearable Computing: Skinput

Watch Video: http://www.youtube.com/watch?v=g3XPUdW9Ryg

[Harrison10]

Page 25: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

Small Device Usability Issues

• Information density• Selection target size• Text entry• Gesture set size• Gesture set learnability• Integration with larger devices• Multimodal interaction

Page 26: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

[Want92]

Page 27: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

• First (of many) location-aware tour guides

• Client detects position through GPS or IR

[Abowd97]

Page 28: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

• Now in stores!• Location-awareness has

entered the mainstream

Page 29: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

Location Aware Applications:Navigation for the Visually Impaired

• Video: http://www.youtube.com/watch?v=pU3uiOkjZ48 [Stewart08]

Page 30: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

[Consolvo08]

WalkingRunningCyclingPlaying SoccerDoing Yoga…

Page 31: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

• Monitor loved-one’s activity

• Broadcast awareness to support network

• Support for aging in place

[Consolvo04]

Page 32: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

[Fogarty07]

Page 33: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

Context-aware computing: HCI research issues

• Information sharing and privacy• Configuring and monitoring implicit interactions• Intelligibility of system inference• Integration of personal, public, and infrastructure

devices• Training and personalization

Page 34: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

• Bigger– Walls, Tables

• Smaller– Mobile, wearables

• Multiple Devices– Multi-display

environments, tangible computing

• Context-aware computing– Worn, carried, or

embedded sensing used as an interaction input

Design

Technology

People

Task

Page 35: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

• HCI evolves Wider focus on “people” Wider focus on “tasks” New technical capabilities

• New technology drives New interactions New tasks New questions about human

needs & capabilities

Design

Technology

People

Task

Page 36: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

References

[Abowd97] G.D. Abowd, C.G. Atkeson, J. Hong, S. Long, R. Kooper, and M. Pinkerton, “Cyberguide: a mobile context-aware tour guide,” Wireless Networks., vol. 3, 1997, pp. 421-433.

[Ballagas05] R. Ballagas, M. Rohs, and J.G. Sheridan, “Sweep and point and shoot: phonecam-based interactions for large public displays,” CHI '05 extended abstracts on Human factors in computing systems, Portland, OR, USA: ACM, 2005, pp. 1200-1203.

[Baudisch09] P. Baudisch and G. Chu, “Back-of-device interaction allows creating very small touch devices,” Proceedings of the 27th international conference on Human factors in computing systems, Boston, MA, USA: ACM, 2009, pp. 1923-1932.

[Baudisch03] P. Baudisch, E. Cutrell, D. Robbins, and M. Czerwinski, “Drag-and-pop and drag-and-pick: Techniques for accessing remote screen content on touch-and pen-operated systems,” Human-computer interaction: INTERACT'03; IFIP TC13 International Conference on Human-Computer Interaction, 1st-5th September 2003, Zurich, Switzerland , 2003, p. 57.

[Buxton07] W. Buxton, Sketching user experiences: Getting the design right and the right design, Morgan Kaufmann, 2007.[Consolvo04] S. Consolvo, P. Roessler, and B.E. Shelton, “The carenet display: Lessons learned from an in home evaluation of an

ambient display,” PROCEEDINGS OF THE 6TH INT'L CONFERENCE ON UBIQUITOUS COMPUTING: UBICOMP '04, 2004, pp. 1--17.[Consolvo08] S. Consolvo, D.W. McDonald, T. Toscos, M.Y. Chen, J. Froehlich, B. Harrison, P. Klasnja, A. LaMarca, L. LeGrand, R. Libby,

I. Smith, and J.A. Landay, “Activity sensing in the wild: a field trial of ubifit garden,” Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, Florence, Italy: ACM, 2008, pp. 1797-1806.

[Fenn10] J. Fenn. "2010 Emerging Technologies Hype Cycle is Here." Mastering the Hype Cycle blog. Sept. 7, 2010. http://blogs.gartner.com/hypecyclebook/2010/09/07/2010-emerging-technologies-hype-cycle-is-here/

[ITS10] ACM Interactive Tabletops and Surfaces Conference. Saarbrücken, Germany. November 7-10, 2010. http://www.its2010.org/[Fogarty07] J. Fogarty and S.E. Hudson, “Toolkit support for developing and deploying sensor-based statistical models of human

situations,” Proceedings of the SIGCHI conference on Human factors in computing systems, San Jose, California, USA: ACM, 2007, pp. 135-144.

[Han05] J. Y. Han. "Low-Cost Multi-Touch Sensing through Frustrated Total Internal Reflection." In Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology. Seatttle, WA, USA. 2005.

Page 37: Trends in HCI University of Michigan Human Factors Engineering Short Course 2011 Mark W. Newman University of Michigan School of Information mwnewman@umich.edu

References

[Harrison10] C. Harrison, D. Tan, and D. Morris, “Skinput: appropriating the body as an input surface,” Proceedings of the 28th international conference on Human factors in computing systems, Atlanta, Georgia, USA: ACM, 2010, pp. 453-462.

[Mann97] S. Mann, “Wearable Computing: A First Step Toward Personal Imaging,” IEEE Computer, vol. 30, 1997, pp. 25-32.[Pieper09] G. W. Pieper, et al. "Visualizing Science: The OptIPuter Project." SciDAC Review 12. Spring 2009.

http://www.scidacreview.org/0902/html/optiputer.html[Shen06] C. Shen, K. Ryall, C. Forlines, A. Esenther, K. Everitt, M. Hancock, M. R. Morris, F. Vernier, D. Wigdor, and M. Wu.

"Interfaces, Interaction Techniques and User Experience on Direct-Touch Horizontal Surfaces." IEEE Computer Graphics and Applications, Sept/Oct 2006, 36-46.

[Stewart08] J. Stewart, S. Bauman, M. Escobar, J.Hilden, K. Bihani, and M. W. Newman. "Accessible Contextual Information for Urban Orientation." In Proceedings of the 10th international conference on Ubiquitous computing (UbiComp 2008) [Note]. Seoul, Korea (2008)

[Vogel04] D. Vogel and R. Balakrishnan, “Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users.” In Proceedings of the 17th annual ACM symposium on User interface software and technology , Santa Fe, NM, USA: ACM, 2004, pp. 137-146.

[Want92] R. Want, A. Hopper, V. Falcão, and J. Gibbons, “The active badge location system,” ACM Trans. Inf. Syst., vol. 10, 1992, pp. 91-102.