32
DIY USABILITY: TESTING 1, 2, 3 mandy butters, certified usability analyst

Podcamp11: DIY Usability Testing

  • Upload
    mandyhb

  • View
    411

  • Download
    1

Embed Size (px)

DESCRIPTION

While experts lend specific expertise and additional level of credibility, usability t

Citation preview

Page 1: Podcamp11: DIY Usability Testing

DIY USABILITY: TESTING 1, 2, 3mandy butters, certified usability analyst

Page 2: Podcamp11: DIY Usability Testing

#pcn11UT

Page 3: Podcamp11: DIY Usability Testing

usability testing is:

observing the user’s experience to improve the design

performance based, not preference based

an ongoing process

Page 4: Podcamp11: DIY Usability Testing

but you shouldn’t start there:

Think “prevention” not “validation”

Page 5: Podcamp11: DIY Usability Testing

why test?

performance problems achievement of business objectives critical or frequent tasks new stuff things you aren’t too sure about user complaints

Page 6: Podcamp11: DIY Usability Testing

benefits:

data not opinions avoids rework positive ROI

usage conversion drop-offs errors support training time

Page 7: Podcamp11: DIY Usability Testing

the not-so-secret formulas for ROI:

www.humanfactors.com/downloads/roi.asp

Page 8: Podcamp11: DIY Usability Testing

why don’t more people do it?

if this is so fabulous…

Page 9: Podcamp11: DIY Usability Testing

1. recruit2. test3. analyze

3 easy steps

Page 10: Podcamp11: DIY Usability Testing

but first, let’s talk about time:

user research rework user complaints customer service training / help

desk recovery

You could spend it here: Or here:

Page 11: Podcamp11: DIY Usability Testing

step 1: recruit

5 to 10 participants per user group ideal: match actual or potential user in a pinch: use friends, family or similar users do not: use coworkers, designers, developers

be serious about the schedule limit sessions to 1 hour leave time in between schedule back-ups (end-of-day); have “on-

calls” confirm and communicate

Page 12: Podcamp11: DIY Usability Testing

recruiting tips:

don’t be afraid to ask recruit 24/7

Page 13: Podcamp11: DIY Usability Testing

step 2: test

you need: a room a table a computer chairs (3) (and sometimes) internet connectivity a watch

optional: data capture software, audio/video

equipment

Page 14: Podcamp11: DIY Usability Testing

who’s in the room:

participant facilitator observer/note-taker

Page 15: Podcamp11: DIY Usability Testing

paper sketches wire framesdesign conceptsfunctioning prototypes

start early. test often.

Page 16: Podcamp11: DIY Usability Testing

what do I test, and how?

Page 17: Podcamp11: DIY Usability Testing

advanced prototypes live site

but it’s never too late.

Page 18: Podcamp11: DIY Usability Testing

what do I test, and how?

Page 19: Podcamp11: DIY Usability Testing

you will need:

written scenarios and/or tasks – OR – a script

test protocol a form or spreadsheet to track

performance

optional consent form if recording audio or video follow-up questionnaires

Page 20: Podcamp11: DIY Usability Testing

a word about scenarios:

create a realistic situation leave it open-ended, so user is free to

explore-OR- include tasks within the situation give answers to all choices don’t give away the answer

Page 21: Podcamp11: DIY Usability Testing

let’s talk about performance tests: observe the user:

how do they perform? can they succeed? is it efficient? do they “get it”? what problems did they have? can they recover from problems?

Page 22: Podcamp11: DIY Usability Testing

what to track on your form:

# tasks completed successfully # successful/unsuccessful steps # of wrong paths taken # of retries/restarts error rates time to complete time to achieve usability goal steps required tasks performed per time frame

Page 23: Podcamp11: DIY Usability Testing

the rating sheet:

Page 24: Podcamp11: DIY Usability Testing

the usability questionnaire:

Page 25: Podcamp11: DIY Usability Testing

about the test itself:

introduce set the stage / warm up distribute scenarios watch and rate performance ask final questions /clear up any

confusion pay set up for next user (clear cache, new

user i.d., etc.)

Page 26: Podcamp11: DIY Usability Testing

tips for facilitator:

you’re testing design not the person there is no “wrong” answer don’t point out mistakes, just move on do not give any help during the test.

redirect questions back to the participant Exception: need to finish task to get to next

scenario.

Page 27: Podcamp11: DIY Usability Testing

tips for facilitator:

ask: “Why?” “How would you do that?” “What do you think?” “What are you feeling?” “Tell me more about that.” “I’m not sure. What would you do?” “What are you looking for?”

Page 28: Podcamp11: DIY Usability Testing

other handy advice:

do a practice run use disclaimers reassure but be neutral don’t interrupt save explanation for the end

Page 29: Podcamp11: DIY Usability Testing

step 3: analyze

finish notes identify usability issues compile data (whatever you tracked) compare results to goals prioritize

Page 30: Podcamp11: DIY Usability Testing

prioritizing usability:

Page 31: Podcamp11: DIY Usability Testing

report formats:

quick fixes punch list pow-wow presentation report

Page 32: Podcamp11: DIY Usability Testing

NOW GET TO TESTIN’.

[email protected]