Leonardo's Laptop: Leonardo's Laptop: Human Needs and the New ComputingHuman Needs and the New Computing
Ben ShneidermanBen ShneidermanFounding Director (1983-2000), Human-Computer Interaction Laboratory Founding Director (1983-2000), Human-Computer Interaction Laboratory
Professor, Department of Computer ScienceProfessor, Department of Computer ScienceMember, Institutes for Advanced Computer Studies &Member, Institutes for Advanced Computer Studies &
Systems ResearchSystems Research
University of MarylandUniversity of [email protected]@cs.umd.edu
Human-Computer Interaction Laboratory
Interdisciplinary research community - Computer Science & Psychology - Information Studies & Education (www.cs.umd.edu/hcil)
Scientific ApproachScientific Approach (beyond user friendly)(beyond user friendly)
Specify users and tasksSpecify users and tasks Predict and measurePredict and measure
time to learntime to learn speed of performancespeed of performance rate of human errorsrate of human errors human retention over timehuman retention over time
Assess subjective satisfactionAssess subjective satisfaction (Questionnaire for User Interface Satisfaction)(Questionnaire for User Interface Satisfaction)
Accommodate individual differencesAccommodate individual differences Consider social, organizational & cultural contextConsider social, organizational & cultural context
Design IssuesDesign Issues
Input devices & strategies Keyboards, pointing devices, voice Direct manipulation Menus, forms, commands
Output devices & formats Screens, windows, color, sound Text, tables, graphics Instructions, messages, help
Collaboration & communities Manuals, tutorials, training
www.awl.com/DTUI usableweb.com hcibib.org useit.com
Library of CongressLibrary of Congress
Scholars, Journalists, CitizensScholars, Journalists, Citizens
Teachers, StudentsTeachers, Students
Visible Human Explorer (NLM)Visible Human Explorer (NLM)
DoctorsDoctors
SurgeonsSurgeons
ResearchersResearchers
StudentsStudents
NASA Environmental DataNASA Environmental Data
ScientistsScientists
FarmersFarmers
Land plannersLand planners
StudentsStudents
Bureau of CensusBureau of Census
Economists, Policy Economists, Policy makers, Journalistsmakers, Journalists
Teachers, StudentsTeachers, Students
Leonardo da Vinci (1452-1519)Leonardo da Vinci (1452-1519)
Renaissance ManRenaissance Man PainterPainter InventorInventor VisionaryVisionary MathematicianMathematician PhilosopherPhilosopher EngineerEngineer
Mona LisaMona Lisa
Lady with Ermine & Leda with SwanLady with Ermine & Leda with Swan
Last Supper FrescoLast Supper Fresco
Remarkable Drawing SkillRemarkable Drawing Skill
Faces of Old MenFaces of Old Men
Anatomical DrawingsAnatomical Drawings
Machine Gun and Giant CrossbowMachine Gun and Giant Crossbow
Why Leonardo Inspires UsWhy Leonardo Inspires Us
He integrated - Scientific outlook - Practical technology - Artistic skill
Leonardo: An Inspirational MuseLeonardo: An Inspirational Muse
Three lessons:
1) Human needs drive innovation
2) Universal usability
3) Creativity support tools
Jefferson: Life, Liberty & the Pursuit of Happiness
Roosevelt: Freedom of speech & expression, religion, from want, from fear
Maslow: Hierarchy of human needs Physiological Safety Love Esteem Self-Actualization
Covey: Living, Loving, Learning & Leaving a legacy
1) Human needs drive innovation1) Human needs drive innovation
Spectrum of relationshipsSpectrum of relationships
Family & Friends (2-20 close intimates)
Colleagues & Neighbors (10-1000 regular encounters)
Members & Residents (1000-1,000,000 professionals or city residents )
Citizenry & Markets (larger communities)
Range of ActivitiesRange of Activities
Collect: Information
Relate: Communication
Create: Innovation
Donate: Dissemination
Periodic tablePeriodic table
Relationships:
Family & Friends
Colleagues & Neighbors
Members & Residents
Citizenry & Markets
Activities:
Collect Relate Create Donate
Periodic tablePeriodic table
Relationships:
Family & Friends
Colleagues & Neighbors
Members & Residents
Citizenry & Markets
Activities:
Collect Relate Create Donate
Skeptics corner - Aren’t relationships more complex
- Are these useful activities?
Examples: Collecting informationExamples: Collecting information
Relationships:
Family & Friends
Colleagues & Neighbors
Members & Residents
Citizenry & Markets
Activities:
Collect Relate Create Donate
LifeLines
InfoDoor
InfoWallInfoWall
WebBushWebBush
Examples: Relating to othersExamples: Relating to others
Relationships:
Family & Friends
Colleagues & Neighbors
Members & Residents
Citizenry & Markets
Activities:
Collect Relate Create Donate
Empathic support
Neighbor .com
Negotiatedexpectations
Million person community
Examples: Creating a futureExamples: Creating a future
Relationships:
Family & Friends
Colleagues & Neighbors
Members & Residents
Citizenry & Markets
Activities:
Collect Relate Create Donate
Vacation plan
Business strategy
Urban renewal
Policy manifesto
Examples: Disseminating & LeadingExamples: Disseminating & Leading
Relationships:
Family & Friends
Colleagues & Neighbors
Members & Residents
Citizenry & Markets
Activities:
Collect Relate Create Donate
Tell stories
Teach kids
Record events
Train novices
Report decisions
Mentorship
Preserve history
Leadership
Human needs drive innovationHuman needs drive innovation
Relationships:
Family & Friends
Colleagues & Neighbors
Members & Residents
Citizenry & Markets
Activities:
Collect Relate Create Donate
Photo Finder
ICQ Gather- round.com
XXX.LANL
Photo Quilt
GlassEye Ebay
Nasdaq
Napster
2) Universal Usability 2) Universal Usability
Problem: Confusion, frustration, and remorse dominate user experiences Survey of 6000 users finds 5.1 hours/week wasted Incompatible files, interfaces, networks, hardware Poorly designed websites lacking accessibility policy
Solutions: Raise user expectations Conduct research Provide practical tools & methods
2) Universal Usability 2) Universal Usability
Problem: Confusion, frustration, and remorse dominate user experiences Survey of 6000 users finds 5.1 hours/week wasted Incompatible files, interfaces, networks, hardware Poorly designed websites lacking accessibility policy
Solutions: Raise user expectations Conduct research Provide practical tools & methods
Skeptics corner - Dumbing down
- Lowest common denominator
2) Universal Usability Problem: Confusion, frustration, and remorse
dominate user experiences Survey of 6000 users finds 5.1 hours/week wasted Incompatible files, interfaces, networks, hardware Poorly designed websites lacking accessibility policy
Solutions: Raise user expectations Conduct research Provide practical tools & methods
ACM Code of Ethics
In a fair society, all individuals would have equal opportunity to participate in, or benefit from, the use of computer resources regardless of race,
sex, religion, age, disability, national origin or other such similar factors.
Internet Use by Education - 1998 Percent of U.S. Households Using the InternetPercent of U.S. Households Using the Internet
Total U.S., Rural, Urban, and Central City Areas Total U.S., Rural, Urban, and Central City Areas
Falling Through the Net: Defining the Digital Divide www.ntia.doc.gov
Internet Use by Income - 1998 Percent of U.S. Households Using the InternetPercent of U.S. Households Using the Internet
Total U.S., Rural, Urban, and Central City Areas Total U.S., Rural, Urban, and Central City Areas
Falling Through the Net: Defining the Digital Divide
www.ntia.doc.gov
Research Agenda Technology variety:
Support broad range of hardware, software, and network access
User diversity: Accommodate users with different skills, knowledge, age, gender, disabilities, disabling conditions (mobility, injury, noise, sunlight), literacy, culture, income, etc.
Gaps in user knowledge: Bridge the gap between what users know and what they need to know
Communications of the ACM, May 2000
Technology variety: Support broad range of hardware, software, and network access
1 to 100 range in processor speeds
286 486 Pentium
1 to 100 range in screen sizes
Palm devices Laptops Large Desktop or Wall Display 30,000 480,000 3,840,000 pixels
Software Versions Compatibility File conversion Multiple platforms
Device Independence Input: keyboard, speech,... Output: visual, auditory,... Conversion: Text-speech Speech-text,...
1 to 100 range in network bandwidth
9.6K 56K 10,000Kbps
Language & Culture Western, Eastern, developing...
Personality Introvert vs extravert Thinking vs feeling Risk aversion Locus of control Planful vs playful
User diversity: Accommodate different users
Skills Computer newbie to hacker Knowledge Domain novice to expert
Age Young to oldGender Male or FemaleIncome Impoverished to wealthy
Disabilities Visual, auditory, motoric, cognitive
Disabling conditions Mobility, injury, noise, sunlight
Online help Context sensitive, tables of contents, Indexes, Keyword search, FAQs, Newsgroups, Chat rooms Online communities
Gaps in User Knowledge - StrategiesBridge the gap between what users know and
what they need to know
Design Layered Level-structured Task-oriented Training
Fade-able scaffolding Training wheels Minimalist
Online Learning (evolutionary, phased) Introductory tutorials Getting started manuals, Cue cards Walkthroughs/Demos Minimalist/Active
Customer service Email Phone Help desks
3) Creativity Support Tools3) Creativity Support Tools
More people, more creative, more of the timeMore people, more creative, more of the time Revolutionary breakthroughs, paradigm shifts, H-Revolutionary breakthroughs, paradigm shifts, H-
creativitycreativity
Evolutionary, normal science, music & art, Evolutionary, normal science, music & art, creative knowledge workcreative knowledge work
Impromptu everyday creativityImpromptu everyday creativity
Eight Activities Eight Activities
1) Searching & browsing digital libraries 2) Consulting with peers & mentors 3) Visualizing data & processes 4) Thinking by free associations 5) Exploring solutions - What if tools 6) Composing artifacts & performances 7) Reviewing & replaying session histories 8) Disseminating results
Eight Activities Eight Activities
1) Searching & browsing digital libraries 2) Consulting with peers & mentors 3) Visualizing data & processes 4) Thinking by free associations 5) Exploring solutions - What if tools 6) Composing artifacts & performances 7) Reviewing & replaying session histories 8) Disseminating results
Skeptics corner - Tools can limit imagination - Not everyone wants to be creative - Creativity can be malicious
3) Visualizing data & processes3) Visualizing data & processes
The eye…
the window of the soul,
is the principal means
by which the central sense
can most completely and
abundantly appreciate
the infinite works of nature.
Leonardo da Vinci (1452 - 1519)
Information Visualization: Using Vision to Think Information Visualization: Using Vision to Think
Visual bandwidth is enormous Human perceptual skills are remarkable
Trend, cluster, gap, outlier... Color, size, shape, proximity...
Human image storage is fast and vast
Opportunities Spatial layouts & coordination Information visualization Scientific visualization & simulation Telepresence & augmented reality Virtual environments
Information Visualization: MantraInformation Visualization: Mantra
Overview, zoom & filter, details-on-demand Overview, zoom & filter, details-on-demand Overview, zoom & filter, details-on-demand Overview, zoom & filter, details-on-demand Overview, zoom & filter, details-on-demand Overview, zoom & filter, details-on-demand Overview, zoom & filter, details-on-demand Overview, zoom & filter, details-on-demand Overview, zoom & filter, details-on-demand Overview, zoom & filter, details-on-demand
Information Visualization: Data TypesInformation Visualization: Data Types
1-D Linear Document Lens, SeeSoft, Info Mural, Value Bars
2-D Map GIS, ArcView, PageMaker, Medical imagery
3-D World CAD, Medical, Molecules, Architecture
Multi-Dim Parallel Coordinates, Spotfire, XGobi, Visage, Influence Explorer, TableLens, DEVise
Temporal Perspective Wall, LifeLines, Lifestreams, Project Managers, DataSpiral
Tree Cone/Cam/Hyperbolic, TreeBrowser, Treemap
Network Netmap, netViz, SeeNet, Butterfly, Multi-trees(Online Library of Information Visualization Environments) otal.umd.edu/Olive
Customer HistoriesCustomer Histories
LifeLines
Treemap - view large trees Treemap - view large trees
Space fillingSpace filling Space limitedSpace limited Color codingColor coding Size codingSize coding Requires learningRequires learning
(Shneiderman, ACM Trans. on Graphics, 1992)
TreeViz (Mac, Johnson, 1992)NBA-Tree(Sun, Turo, 1993)Winsurfer (Teittinen, 1996)Diskmapper (Windows, Micrologic)Treemap97 (Windows, UMd)
Treemap - Stock market, clustered by industryTreemap - Stock market, clustered by industry
Leonardo da Vinci (1452-1519)Leonardo da Vinci (1452-1519)
Three lessons:
1) Human needs drive innovation
2) Universal usability
3) Creativity support tools
ACM Conference on Universal Usability
Washington, DC November 16-17, 2000
www.acm.org/sigchi/cuu
Human-Computer Interaction Laboratory
www.cs.umd.edu/hcil
For More InformationFor More Information
Visit the HCIL website for 200 papers & info on videosVisit the HCIL website for 200 papers & info on videos (www.cs.umd.edu/hcil)(www.cs.umd.edu/hcil)
See Chapter 15 on Info VisualizationSee Chapter 15 on Info Visualization Shneiderman, B., Shneiderman, B., Designing the User Interface:Designing the User Interface: Strategies for Effective Human-Computer Interaction: Strategies for Effective Human-Computer Interaction: Third Edition Third Edition (1998) (1998) (www.aw.com/DTUI)(www.aw.com/DTUI)
January 1999 book of readings:January 1999 book of readings: Card, S., Mackinlay, J., and Shneiderman, B. Card, S., Mackinlay, J., and Shneiderman, B. Information Visualization: Using Vision to ThinkInformation Visualization: Using Vision to Think