View
212
Download
0
Category
Preview:
Citation preview
AdministriviaAdministrivia
Review Deliverable 2Review Deliverable 2– Overview (audience)Overview (audience)– Excellent additionsExcellent additions
User GoalsUser GoalsUsability GoalsUsability GoalsUser Group (who are you designing for?)User Group (who are you designing for?)Success CriteriaSuccess Criteria
AdministriviaAdministrivia
Review Deliverable 2 (continued)Review Deliverable 2 (continued)– RationaleRationale
Reasoning for problem is separate from reasoning for Reasoning for problem is separate from reasoning for solutionsolution
Principles differ from guidelinesPrinciples differ from guidelines Dumas & Redish (p. 53)Dumas & Redish (p. 53)
– Principle: broad statements (or goals) usually based on Principle: broad statements (or goals) usually based on research about how people learn and workresearch about how people learn and work
– Guideline: how to achieve specific goals for different users, Guideline: how to achieve specific goals for different users, environments and technologiesenvironments and technologies
Explain how you are applying the principle in your Explain how you are applying the principle in your solution and support the principle with guidelines or solution and support the principle with guidelines or findings or study resultsfindings or study results
Barnum: inspection methods are generally better at Barnum: inspection methods are generally better at finding problems than determining the appropriate finding problems than determining the appropriate improvementimprovement
AdministriviaAdministrivia
Review Deliverable 2 (continued)Review Deliverable 2 (continued)– Business CaseBusiness Case
Be specific about the return on investment, Be specific about the return on investment, business goals and revenue/cost. What business goals and revenue/cost. What measurable difference will it make to the measurable difference will it make to the company? For example, how do they measure company? For example, how do they measure success today and how much might that success today and how much might that measure be expected to improve?measure be expected to improve?
Too general: increase usage, increase users, Too general: increase usage, increase users, increase sales, improve satisfaction, contain increase sales, improve satisfaction, contain expenses, improving usabilityexpenses, improving usability
Project SharingProject Sharing
Team discussions Team discussions – Share results of heuristic evaluations Share results of heuristic evaluations – Discuss your choice of methods and resultsDiscuss your choice of methods and results
Class-level discussionClass-level discussion– Volunteers to share especially challenging Volunteers to share especially challenging
or surprising insights or surprising insights – Lessons learnedLessons learned
Where are we in the UCD process?Where are we in the UCD process?
Usability TestingUsability Testing Test early and often, not just at the endTest early and often, not just at the end
Evaluation TechniqueEvaluation Technique– Real usersReal users– Real tasksReal tasks– Observe and RecordObserve and Record
Two typesTwo types– Discover problems (to improve/form the product)Discover problems (to improve/form the product)
Think-a-loud (typical)Think-a-loud (typical)– Summarize the usability (measure against goals)Summarize the usability (measure against goals)
Usability goalsUsability goals
Compared to other testingCompared to other testing– Functional TestFunctional Test– QA TestQA Test– Beta TestBeta Test
Usability TestingUsability Testing PreparationPreparation
– Choose frequent and critical tasksChoose frequent and critical tasks– Tasks related to concerns you haveTasks related to concerns you have– Develop test scriptDevelop test script
Select ParticipantsSelect Participants– Screening criteria (create gaps to separate)Screening criteria (create gaps to separate)– Minimum of 3 participants per user groupMinimum of 3 participants per user group
3-5 (Nielsen)3-5 (Nielsen) 8 minimum for a summative test8 minimum for a summative test
ResultsResults– List of problemsList of problems– SeveritySeverity– Organize & PrioritizeOrganize & Prioritize
Usability TestingUsability Testing
Measurable usability goalsMeasurable usability goals– How manyHow many of what of what type of usertype of user will be will be able to do able to do
whatwhat within within what measurewhat measure??– 80% of Novice web site users will be able to 80% of Novice web site users will be able to
Contact Us in less than 25 seconds.Contact Us in less than 25 seconds.– What is a reasonable measure?What is a reasonable measure?
Consider how many test participants you haveConsider how many test participants you have How confident do you want to be in the results?How confident do you want to be in the results?
BiasBias– Inappropriate instructions or assistanceInappropriate instructions or assistance– Leading questionsLeading questions– Subtle feedback (positive or negative)Subtle feedback (positive or negative)– Confirming understanding of the taskConfirming understanding of the task
Usability TestingUsability Testing
IntroductionIntroduction– What to expect (how long?)What to expect (how long?)– Work as you would under normal circumstancesWork as you would under normal circumstances– Ethics Ethics
Voluntary (free to stop or leave at any time)Voluntary (free to stop or leave at any time) Permission to recordPermission to record An evaluation of the software not of their abilitiesAn evaluation of the software not of their abilities
Interaction with participantsInteraction with participants– Think-aloudThink-aloud– Handling questions (rhetorical)Handling questions (rhetorical)– AssistanceAssistance
IssuesIssues– How do you know when a task is done?How do you know when a task is done?– Time limitTime limit
Usability TestingUsability Testing
LimitationsLimitations– Only evaluates part of the interfaceOnly evaluates part of the interface– Scripted tasksScripted tasks– Not a true real-world situationNot a true real-world situation– May not reveal problems of proficient usersMay not reveal problems of proficient users– Even with think-a-loud, intent may not be Even with think-a-loud, intent may not be
clearclear
Usability TestingUsability Testing
PreparePrepare– Avoid biasAvoid bias– IntroductionIntroduction– Develop test scriptDevelop test script– Take notesTake notes– Take measuresTake measures– Prompt participant (if necessary)Prompt participant (if necessary)
Activity – Usability TestActivity – Usability Test
Form GroupsForm Groups– Individual work – choose tasksIndividual work – choose tasks– Individual work – define measurable Individual work – define measurable
goalsgoals– Individual work – identify measuresIndividual work – identify measures– Group work – share and discussGroup work – share and discuss
Activity – Usability TestActivity – Usability Test
Discussion TopicsDiscussion Topics What are important What are important decisionsdecisions?? What types of What types of variationsvariations could you could you
imagine?imagine? What are the What are the complexitiescomplexities– what makes it – what makes it
hard?hard? What factors are What factors are important for achieving important for achieving
successsuccess with this method? with this method?
Discussion of ReadingsDiscussion of Readings
Facilitate class discussion of topics / Facilitate class discussion of topics / ideas / themes garnered from the ideas / themes garnered from the online discussion, related to assigned online discussion, related to assigned readings.readings.– Discussion LeadersDiscussion Leaders
1.1. Sarah Sosiak Sarah Sosiak2.2. Ona Anicello Ona Anicello3.3. Astrid Lipke Astrid Lipke
4.4. Monica Risse Monica Risse
Project ExerciseProject Exercise
Usability Study Usability Study Design and execute a usability study of your Design and execute a usability study of your
prototype with 3 usersprototype with 3 users.. Prepare a Prepare a one pageone page description summarizing description summarizing
– Method for testingMethod for testing– Results of the studyResults of the study– Potential implications for redesignPotential implications for redesign
Bring copies of the exercise to class (one copy Bring copies of the exercise to class (one copy for each member of the team, one copy for for each member of the team, one copy for the instructor) and also post it to your design the instructor) and also post it to your design portfolio.portfolio.
Due next ThursdayDue next Thursday
Looking back / Looking aheadLooking back / Looking ahead
Where we’ve beenWhere we’ve been
Topics – Readings and Topics – Readings and discussiondiscussion
– What is UCD? What is UCD? – Collecting and summarizing info Collecting and summarizing info
about users, tasks and contextabout users, tasks and context– Problem definitionProblem definition– DesignDesign
Project Project – Insights about users, tasks, and Insights about users, tasks, and
contextual issuescontextual issues– Actual data from observing real users Actual data from observing real users – Problem definitionProblem definition– ProposalProposal– DesignDesign
Where we’re goingWhere we’re going
Redesign:Redesign: – Represent designRepresent design– Support and justifySupport and justify
Readings:Readings: – Cost-justifying usabilityCost-justifying usability– Justifying user visitsJustifying user visits– Benefits Benefits
Upcoming Exercises:Upcoming Exercises:– Final Design SolutionFinal Design Solution
Issue Statement: A reminderIssue Statement: A reminder
1.1. Jaana Linsenmayer Jaana Linsenmayer2.2. Kris Anderson Kris Anderson33.. Carol Taylor Carol Taylor
Recommended