AdministriviaAdministrivia

Review Deliverable 2Review Deliverable 2– Overview (audience)Overview (audience)– Excellent additionsExcellent additions

User GoalsUser GoalsUsability GoalsUsability GoalsUser Group (who are you designing for?)User Group (who are you designing for?)Success CriteriaSuccess Criteria

AdministriviaAdministrivia

Review Deliverable 2 (continued)Review Deliverable 2 (continued)– RationaleRationale

Reasoning for problem is separate from reasoning for Reasoning for problem is separate from reasoning for solutionsolution

Principles differ from guidelinesPrinciples differ from guidelines Dumas & Redish (p. 53)Dumas & Redish (p. 53)

– Principle: broad statements (or goals) usually based on Principle: broad statements (or goals) usually based on research about how people learn and workresearch about how people learn and work

– Guideline: how to achieve specific goals for different users, Guideline: how to achieve specific goals for different users, environments and technologiesenvironments and technologies

Explain how you are applying the principle in your Explain how you are applying the principle in your solution and support the principle with guidelines or solution and support the principle with guidelines or findings or study resultsfindings or study results

Barnum: inspection methods are generally better at Barnum: inspection methods are generally better at finding problems than determining the appropriate finding problems than determining the appropriate improvementimprovement

AdministriviaAdministrivia

Review Deliverable 2 (continued)Review Deliverable 2 (continued)– Business CaseBusiness Case

Be specific about the return on investment, Be specific about the return on investment, business goals and revenue/cost. What business goals and revenue/cost. What measurable difference will it make to the measurable difference will it make to the company? For example, how do they measure company? For example, how do they measure success today and how much might that success today and how much might that measure be expected to improve?measure be expected to improve?

Too general: increase usage, increase users, Too general: increase usage, increase users, increase sales, improve satisfaction, contain increase sales, improve satisfaction, contain expenses, improving usabilityexpenses, improving usability

Project SharingProject Sharing

Team discussions Team discussions – Share results of heuristic evaluations Share results of heuristic evaluations – Discuss your choice of methods and resultsDiscuss your choice of methods and results

Class-level discussionClass-level discussion– Volunteers to share especially challenging Volunteers to share especially challenging

or surprising insights or surprising insights – Lessons learnedLessons learned

Where are we in the UCD process?Where are we in the UCD process?

Usability TestingUsability Testing Test early and often, not just at the endTest early and often, not just at the end

Evaluation TechniqueEvaluation Technique– Real usersReal users– Real tasksReal tasks– Observe and RecordObserve and Record

Two typesTwo types– Discover problems (to improve/form the product)Discover problems (to improve/form the product)

Think-a-loud (typical)Think-a-loud (typical)– Summarize the usability (measure against goals)Summarize the usability (measure against goals)

Usability goalsUsability goals

Compared to other testingCompared to other testing– Functional TestFunctional Test– QA TestQA Test– Beta TestBeta Test

Usability TestingUsability Testing PreparationPreparation

– Choose frequent and critical tasksChoose frequent and critical tasks– Tasks related to concerns you haveTasks related to concerns you have– Develop test scriptDevelop test script

Select ParticipantsSelect Participants– Screening criteria (create gaps to separate)Screening criteria (create gaps to separate)– Minimum of 3 participants per user groupMinimum of 3 participants per user group

3-5 (Nielsen)3-5 (Nielsen) 8 minimum for a summative test8 minimum for a summative test

ResultsResults– List of problemsList of problems– SeveritySeverity– Organize & PrioritizeOrganize & Prioritize

Usability TestingUsability Testing

Measurable usability goalsMeasurable usability goals– How manyHow many of what of what type of usertype of user will be will be able to do able to do

whatwhat within within what measurewhat measure??– 80% of Novice web site users will be able to 80% of Novice web site users will be able to

Contact Us in less than 25 seconds.Contact Us in less than 25 seconds.– What is a reasonable measure?What is a reasonable measure?

Consider how many test participants you haveConsider how many test participants you have How confident do you want to be in the results?How confident do you want to be in the results?

BiasBias– Inappropriate instructions or assistanceInappropriate instructions or assistance– Leading questionsLeading questions– Subtle feedback (positive or negative)Subtle feedback (positive or negative)– Confirming understanding of the taskConfirming understanding of the task

Usability TestingUsability Testing

IntroductionIntroduction– What to expect (how long?)What to expect (how long?)– Work as you would under normal circumstancesWork as you would under normal circumstances– Ethics Ethics

Voluntary (free to stop or leave at any time)Voluntary (free to stop or leave at any time) Permission to recordPermission to record An evaluation of the software not of their abilitiesAn evaluation of the software not of their abilities

Interaction with participantsInteraction with participants– Think-aloudThink-aloud– Handling questions (rhetorical)Handling questions (rhetorical)– AssistanceAssistance

IssuesIssues– How do you know when a task is done?How do you know when a task is done?– Time limitTime limit

Usability TestingUsability Testing

LimitationsLimitations– Only evaluates part of the interfaceOnly evaluates part of the interface– Scripted tasksScripted tasks– Not a true real-world situationNot a true real-world situation– May not reveal problems of proficient usersMay not reveal problems of proficient users– Even with think-a-loud, intent may not be Even with think-a-loud, intent may not be

clearclear

Usability TestingUsability Testing

PreparePrepare– Avoid biasAvoid bias– IntroductionIntroduction– Develop test scriptDevelop test script– Take notesTake notes– Take measuresTake measures– Prompt participant (if necessary)Prompt participant (if necessary)

Activity – Usability TestActivity – Usability Test

Form GroupsForm Groups– Individual work – choose tasksIndividual work – choose tasks– Individual work – define measurable Individual work – define measurable

goalsgoals– Individual work – identify measuresIndividual work – identify measures– Group work – share and discussGroup work – share and discuss

Activity – Usability TestActivity – Usability Test

Discussion TopicsDiscussion Topics What are important What are important decisionsdecisions?? What types of What types of variationsvariations could you could you

imagine?imagine? What are the What are the complexitiescomplexities– what makes it – what makes it

hard?hard? What factors are What factors are important for achieving important for achieving

successsuccess with this method? with this method?

Discussion of ReadingsDiscussion of Readings

Facilitate class discussion of topics / Facilitate class discussion of topics / ideas / themes garnered from the ideas / themes garnered from the online discussion, related to assigned online discussion, related to assigned readings.readings.– Discussion LeadersDiscussion Leaders

1.1. Sarah Sosiak Sarah Sosiak2.2. Ona Anicello Ona Anicello3.3. Astrid Lipke Astrid Lipke

4.4. Monica Risse Monica Risse

Project ExerciseProject Exercise

Usability Study Usability Study Design and execute a usability study of your Design and execute a usability study of your

prototype with 3 usersprototype with 3 users.. Prepare a Prepare a one pageone page description summarizing description summarizing

– Method for testingMethod for testing– Results of the studyResults of the study– Potential implications for redesignPotential implications for redesign

Bring copies of the exercise to class (one copy Bring copies of the exercise to class (one copy for each member of the team, one copy for for each member of the team, one copy for the instructor) and also post it to your design the instructor) and also post it to your design portfolio.portfolio.

Due next ThursdayDue next Thursday

Looking back / Looking aheadLooking back / Looking ahead

Where we’ve beenWhere we’ve been

Topics – Readings and Topics – Readings and discussiondiscussion

– What is UCD? What is UCD? – Collecting and summarizing info Collecting and summarizing info

about users, tasks and contextabout users, tasks and context– Problem definitionProblem definition– DesignDesign

Project Project – Insights about users, tasks, and Insights about users, tasks, and

contextual issuescontextual issues– Actual data from observing real users Actual data from observing real users – Problem definitionProblem definition– ProposalProposal– DesignDesign

Where we’re goingWhere we’re going

Redesign:Redesign: – Represent designRepresent design– Support and justifySupport and justify

Readings:Readings: – Cost-justifying usabilityCost-justifying usability– Justifying user visitsJustifying user visits– Benefits Benefits

Upcoming Exercises:Upcoming Exercises:– Final Design SolutionFinal Design Solution

Issue Statement: A reminderIssue Statement: A reminder

1.1. Jaana Linsenmayer Jaana Linsenmayer2.2. Kris Anderson Kris Anderson33.. Carol Taylor Carol Taylor