134
USABILITY TESTING HOW TO’s For small teams & little budgets Evgenia (Jenny) Grinblo & www.eventhandler.co.uk London, UK Oct 24, 2013 (This is Henrik)

Usability Testing How To's - EventHandler, London Oct 24th 2013

  • View
    1.653

  • Download
    0

Embed Size (px)

DESCRIPTION

Slides from my "Usability Testing How To's" workshop with Event Handler. http://www.eventhandler.co.uk/events/uxnightclass-usability Westminster Hub, London UK 24 October 2013 === Who is it for? This workshop is for those who want to create products that will be easy to use. Usability testing is an important part of the process of designing digital products, but it can often be overlooked due to time, money, and training constraints. In this workshop you'll learn how to test any product's usability without spending a large amount of time and money. And how to use what you've learned to improve the product. Who is it taught by? This workshop is being taught by Evgenia Grinblo @grinblo, User Experience Specialist at mobile agency, Future Workshops. Born in Siberia, Jenny freelanced and trained in ethnographic research in Israel and the USA, before bringing her talent to the UK. Her pet peeve is badly written error-messages and she has a growing collection of them. You'll find her speaking on empathy, UX, and other passions. What you'll learn An introduction to usability testing - what is it? Who should you test your product on? What do you test? How to facilitate a test and get reliable results How to manage data and act on your findings with your team Tools: Cheap, quick and effective testing tools for mobile and the web.

Citation preview

Page 1: Usability Testing How To's - EventHandler, London Oct 24th 2013

USABILITY TESTING HOW TO’sFor small teams & little budgets

Evgenia (Jenny) Grinblo& www.eventhandler.co.ukLondon, UK Oct 24, 2013 (This is Henrik)

Page 2: Usability Testing How To's - EventHandler, London Oct 24th 2013

2

http://bit.ly/1f9Pnzt

USABILITY TESTING: INTRODUCTION

Hello, I’m...

Evgenia (Jenny) GrinbloUser Experience SpecialistFuture Workshops, London

Page 3: Usability Testing How To's - EventHandler, London Oct 24th 2013

0 / Usability testing introduction1 / What do we test: preparing a test plan2 / Facilitating a usability test & recording results3 / Analysing and presenting key learnings

USABILITY TESTINGWorkshop schedule

Page 4: Usability Testing How To's - EventHandler, London Oct 24th 2013

USABILITY TESTING: INTRODUCTION

How to run a £3000 fool-proof test

✓ The easiest, quickest, cheapest methods

✓ Tips on facilitating, note-taking, & prioritising

✓ How to run a usability test tomorrow

✓ Resources & tools to keep learning

4

WHAT TO EXPECT TODAY

Page 5: Usability Testing How To's - EventHandler, London Oct 24th 2013

5

http://bit.ly/1f9Pnzt

What is usability testing & why do it?

USABILITY TESTING: INTRODUCTION

Page 6: Usability Testing How To's - EventHandler, London Oct 24th 2013

USER EXPERIENCE BUILDING BLOCKS

6

http://bit.ly/1f9Pnzt

http://www.flickr.com/photos/7855449@N02/2779597129 Diagram by David Armano

USABILITY TESTING: INTRODUCTION

Page 7: Usability Testing How To's - EventHandler, London Oct 24th 2013

USABILITY IS A MAJOR BUILDING BLOCK OF A GOOD EXPERIENCE

7

http://bit.ly/1f9Pnzt

http://www.flickr.com/photos/7855449@N02/2779597129 Diagram by David Armano

USABILITY TESTING: INTRODUCTION

Page 8: Usability Testing How To's - EventHandler, London Oct 24th 2013

1. INTUITIVE (n.)Using what one feels to be true without conscious reasoning

8

http://bit.ly/1f9Pnzt

www.youtube.com

USABILITY TESTING: INTRODUCTION

Page 9: Usability Testing How To's - EventHandler, London Oct 24th 2013

9

http://bit.ly/1f9Pnzt

NEEDING INSTRUCTIONS MEANS SOMETHING CAN BE MADE MORE SIMPLE

USABILITY TESTING: INTRODUCTION

Page 10: Usability Testing How To's - EventHandler, London Oct 24th 2013

2. EASY TO USEDoesn’t make people feel stupid or inferior to the tool they are using. Helps them feel in control.

10

http://bit.ly/1f9Pnzt

USABILITY TESTING: INTRODUCTION

www.errorwallofshame.tumblr.com

Page 11: Usability Testing How To's - EventHandler, London Oct 24th 2013

11

http://bit.ly/1f9Pnzt

USABILITY TESTING: INTRODUCTION

3. ACCESSIBLEPeople of different abilities can use it

Page 12: Usability Testing How To's - EventHandler, London Oct 24th 2013

12

http://bit.ly/1f9Pnzt

YOU CAN’T DIFFERENTIATE IF THE EXPERIENCE IS BROKEN

USABILITY TESTING: INTRODUCTION

Page 13: Usability Testing How To's - EventHandler, London Oct 24th 2013

67.45% (AVERAGE E-COMMERCE CART ABANDONMENT RATE)

13

http://bit.ly/1f9Pnzt

EVERYONE DEEPLY UNDERSTANDS THE USERS

http://baymard.com/lists/cart-abandonment-rate

July 28, 2013

Page 14: Usability Testing How To's - EventHandler, London Oct 24th 2013

14

http://bit.ly/1f9Pnzt

http://www.shopify.com/blog/8484093-why-online-retailers-are-losing-67-45-of-sales-and-what-to-do-about-it

USABILITY TESTING: INTRODUCTION

Page 15: Usability Testing How To's - EventHandler, London Oct 24th 2013

15

http://bit.ly/1f9Pnzt

http://www.shopify.com/blog/8484093-why-online-retailers-are-losing-67-45-of-sales-and-what-to-do-about-it

USABILITY TESTING: INTRODUCTION

Page 16: Usability Testing How To's - EventHandler, London Oct 24th 2013

WHERE TO FIND USABILITY PROBLEMS

16

http://bit.ly/1f9Pnzt

Analytics(Impersonal)

Survey(Tricky)

Usability test(Immediate, easy)

USABILITY TESTING: INTRODUCTION

Page 17: Usability Testing How To's - EventHandler, London Oct 24th 2013

USABILITY TESTING

17

http://bit.ly/1f9Pnzt

USABILITY TESTING: INTRODUCTION

• Behavioral vs. Self-reported• Opportunity to ask “why?”• Motivates teammates• Removes “designer bias”• Can be done on prototypes• Can be cheap & quick

Page 18: Usability Testing How To's - EventHandler, London Oct 24th 2013

WHAT HAPPENS IN A USABILITY TEST?

18

http://bit.ly/1f9Pnzt

USABILITY TESTING: INTRODUCTION

Video: http://www.youtube.com/watch?v=QckIzHC99Xc

Page 19: Usability Testing How To's - EventHandler, London Oct 24th 2013

19

http://bit.ly/1f9Pnzt

TEST YOUR IDEAS REGULARLY WITH REAL PEOPLE

USABILITY TESTING: INTRODUCTION

Page 20: Usability Testing How To's - EventHandler, London Oct 24th 2013

USABILITY TEST STEPS

20

http://bit.ly/1f9Pnzt

USABILITY TESTING: INTRODUCTION

Recruit Participants

Prepare a test plan Test Analyse +

iterate

Page 21: Usability Testing How To's - EventHandler, London Oct 24th 2013

WHO DO WE TEST WITH?

21

http://bit.ly/1f9Pnzt

USABILITY TESTING: INTRODUCTION

‣ Anyone who hasn’t seen the app

‣ Similar demographics to real users (whenever possible)

Page 22: Usability Testing How To's - EventHandler, London Oct 24th 2013

WHERE DO WE FIND PARTICIPANTS?

22

http://bit.ly/1f9Pnzt

USABILITY TESTING: INTRODUCTION

Page 23: Usability Testing How To's - EventHandler, London Oct 24th 2013

WHERE DO WE FIND PARTICIPANTS?

22

http://bit.ly/1f9Pnzt

USABILITY TESTING: INTRODUCTION

‣ Friends, family, colleagues

Page 24: Usability Testing How To's - EventHandler, London Oct 24th 2013

WHERE DO WE FIND PARTICIPANTS?

22

http://bit.ly/1f9Pnzt

USABILITY TESTING: INTRODUCTION

‣ Friends, family, colleagues

‣ Social media followers

Page 25: Usability Testing How To's - EventHandler, London Oct 24th 2013

WHERE DO WE FIND PARTICIPANTS?

22

http://bit.ly/1f9Pnzt

USABILITY TESTING: INTRODUCTION

‣ Friends, family, colleagues

‣ Social media followers

‣ Existing customers

Page 26: Usability Testing How To's - EventHandler, London Oct 24th 2013

WHERE DO WE FIND PARTICIPANTS?

22

http://bit.ly/1f9Pnzt

USABILITY TESTING: INTRODUCTION

‣ Friends, family, colleagues

‣ Social media followers

‣ Existing customers

‣ Streets and coffee shops

Page 27: Usability Testing How To's - EventHandler, London Oct 24th 2013

WHERE DO WE FIND PARTICIPANTS?

22

http://bit.ly/1f9Pnzt

USABILITY TESTING: INTRODUCTION

‣ Friends, family, colleagues

‣ Social media followers

‣ Existing customers

‣ Streets and coffee shops

‣ Recruitment agencies (<expensive!)

Page 28: Usability Testing How To's - EventHandler, London Oct 24th 2013

WHEN DO WE TEST?AS EARLY AS POSSIBLE

23

http://bit.ly/1f9Pnzt

USABILITY TESTING: INTRODUCTION

Idea stage Definition stageExploring FocusingMany ideasHigh-level“Dream world”

Best ideasRefinedRealistic

Page 29: Usability Testing How To's - EventHandler, London Oct 24th 2013

DO USABILITY TESTING REGULARLY,WITH YOUR WHOLE TEAM

24

http://bit.ly/1f9Pnzt

USABILITY TESTING: INTRODUCTION

Page 30: Usability Testing How To's - EventHandler, London Oct 24th 2013

# OF TEAM MEMBERS EXPOSED TO USERS IS MORE IMPORTANT THAN # OF USERS

25

http://bit.ly/1f9Pnzt

http://www.uie.com/articles/user_exposure_hours/

USABILITY TESTING: INTRODUCTION

Page 31: Usability Testing How To's - EventHandler, London Oct 24th 2013

26

http://bit.ly/1f9Pnzt

USABILITY TESTING: INTRODUCTION

SOMETIMES IT’S HARD TO ACCEPT YOUR PRODUCT NEEDS HELP

https://twitter.com/adrianhungate/status/391954628184915970

Page 32: Usability Testing How To's - EventHandler, London Oct 24th 2013

WHEN YOU SEE SOMEONE IN PAIN, YOU WANT TO HELP THEM

27

http://bit.ly/1f9Pnzt

http://www.flickr.com/photos/martin_mcdonald/371884786/

USABILITY TESTING: INTRODUCTION

Page 33: Usability Testing How To's - EventHandler, London Oct 24th 2013

— DANIELLead Developer, Future Workshops

28

http://bit.ly/1f9Pnzt

“ I was completely surprised at how cumbersome the users experience with the app was. Basic tasks were which was so obvious to me were suddenly a huge barrier.

http://www.uie.com/articles/user_exposure_hours/

USABILITY TESTING: INTRODUCTION

Page 34: Usability Testing How To's - EventHandler, London Oct 24th 2013

— DANIELLead Developer, Future Workshops

29

http://bit.ly/1f9Pnzt

“ ... What the usability testing did for me was really prove how much tech people can lose sight of who they are building for. It about going back to basics in some cases.

http://www.uie.com/articles/user_exposure_hours/

USABILITY TESTING: INTRODUCTION

Page 35: Usability Testing How To's - EventHandler, London Oct 24th 2013

IN SUMMARY:USABILITY TESTING BENEFITS

30

http://bit.ly/1f9Pnzt

USABILITY TESTING: INTRODUCTION

1. Highlights where our product isn’t intuitive / easy to use

2. Puts team in the shoes of users

3. Helps sell product improvements to stakeholders/ clients

4. Helps prioritise feature backlog

Page 36: Usability Testing How To's - EventHandler, London Oct 24th 2013

5 minute breakTime for a

Page 37: Usability Testing How To's - EventHandler, London Oct 24th 2013

0 / Usability testing introduction1 / What do we test: preparing a test plan2 / Facilitating a usability test & recording results3 / Analysing and presenting key learnings

USABILITY TESTINGWorkshop schedule

Page 38: Usability Testing How To's - EventHandler, London Oct 24th 2013

PREPARING A TEST PLAN

To run a test, you need

Page 39: Usability Testing How To's - EventHandler, London Oct 24th 2013

PREPARING A TEST PLAN

To run a test, you need

‣ Some representation of your product

Page 40: Usability Testing How To's - EventHandler, London Oct 24th 2013

PREPARING A TEST PLAN

To run a test, you need

‣ Some representation of your product

‣ Preferably interactive

Page 41: Usability Testing How To's - EventHandler, London Oct 24th 2013

PREPARING A TEST PLAN

To run a test, you need

‣ Some representation of your product

‣ Preferably interactive

‣ Doesn’t have to be finished

Page 42: Usability Testing How To's - EventHandler, London Oct 24th 2013

PREPARING A TEST PLAN

To run a test, you need

‣ Some representation of your product

‣ Preferably interactive

‣ Doesn’t have to be finished

‣ Or: competitor product!

Page 43: Usability Testing How To's - EventHandler, London Oct 24th 2013

PREPARING A TEST PLAN

To run a test, you need

‣ Some representation of your product

‣ Preferably interactive

‣ Doesn’t have to be finished

‣ Or: competitor product!

‣ Idea of what you want to test

Page 44: Usability Testing How To's - EventHandler, London Oct 24th 2013

PREPARING A TEST PLAN

What do we test?

Page 45: Usability Testing How To's - EventHandler, London Oct 24th 2013

PREPARING A TEST PLAN

What do we test?

‣ General impressions

Page 46: Usability Testing How To's - EventHandler, London Oct 24th 2013

PREPARING A TEST PLAN

What do we test?

‣ General impressions

‣ Ease of use of critical features

Page 47: Usability Testing How To's - EventHandler, London Oct 24th 2013

PREPARING A TEST PLAN

What do we test?

‣ General impressions

‣ Ease of use of critical features

‣ Features we’re not sure about (e.g., is the help clear?)

Page 48: Usability Testing How To's - EventHandler, London Oct 24th 2013

PREPARING A TEST PLAN

What do we test?

‣ General impressions

‣ Ease of use of critical features

‣ Features we’re not sure about (e.g., is the help clear?)

‣ Response to design, iconography

Page 49: Usability Testing How To's - EventHandler, London Oct 24th 2013

PREPARING A TEST PLAN

What do we test?

‣ General impressions

‣ Ease of use of critical features

‣ Features we’re not sure about (e.g., is the help clear?)

‣ Response to design, iconography

Tip: start from high-level when testing prototypes, test the details with later builds

Page 50: Usability Testing How To's - EventHandler, London Oct 24th 2013

35

http://bit.ly/1f9Pnzt

PREPARING A TEST PLAN

Wide (Generative)

SET THE SCOPE

Page 51: Usability Testing How To's - EventHandler, London Oct 24th 2013

35

http://bit.ly/1f9Pnzt

PREPARING A TEST PLAN

Wide (Generative)

WHY will people use this product?

SET THE SCOPE

Page 52: Usability Testing How To's - EventHandler, London Oct 24th 2013

35

http://bit.ly/1f9Pnzt

PREPARING A TEST PLAN

Wide (Generative)

Narrow (Validating)

WHY will people use this product?

SET THE SCOPE

Page 53: Usability Testing How To's - EventHandler, London Oct 24th 2013

35

http://bit.ly/1f9Pnzt

PREPARING A TEST PLAN

Wide (Generative)

Narrow (Validating)

WHY will people use this product?

SET THE SCOPE

HOW do these people use this product?

Page 54: Usability Testing How To's - EventHandler, London Oct 24th 2013

SET THE SCOPE

36

http://bit.ly/1f9Pnzt

PREPARING A TEST PLAN

Wide (Generative)

Narrow (Validating)

ExploreHow is the value proposition of this tool fit in with people’s lives

ValidateHow do people perform specific task with this tool?

Confirm/iterate Observing what people do with this tool, in their own environment

Page 55: Usability Testing How To's - EventHandler, London Oct 24th 2013

SET THE SCOPE

37

http://bit.ly/1f9Pnzt

PREPARING A TEST PLAN

Wide (Generative)

Narrow (Validating)

ExploreHow is the value proposition of this tool fit in with people’s lives

ValidateHow do people perform specific task with this tool?

Confirm/iterate Observing what people do with this tool, in their own environment

First...

Page 56: Usability Testing How To's - EventHandler, London Oct 24th 2013

FIRST IMPRESSIONS: THE 5 SECOND TEST

38

http://bit.ly/1f9Pnzt

PREPARING A TEST PLAN

Ready?

Page 57: Usability Testing How To's - EventHandler, London Oct 24th 2013

39

http://bit.ly/1f9Pnzt

Page 58: Usability Testing How To's - EventHandler, London Oct 24th 2013

5 SECOND TEST QUESTIONS

40

http://bit.ly/1f9Pnzt

PREPARING A TEST PLAN

• What is the purpose of the website/app?

• Name 3 things you can do with this website

• Who does this site or app belong to?

• How do you feel about this organisation?

Page 59: Usability Testing How To's - EventHandler, London Oct 24th 2013

SET THE SCOPE

41

http://bit.ly/1f9Pnzt

PREPARING A TEST PLAN

Wide (Generative)

Narrow (Validating)

ExploreHow is the value proposition of this tool fit in with people’s lives

ValidateHow do people perform specific task with this tool?

Confirm/iterate Observing what people do with this tool, in their own environment

Now...

Page 60: Usability Testing How To's - EventHandler, London Oct 24th 2013

PREPARING A DETAILED USABILITY TEST

42

http://bit.ly/1f9Pnzt

PREPARING A TEST PLAN

Recruit Participants

Prepare a test plan Test Analyse +

iterate

Page 61: Usability Testing How To's - EventHandler, London Oct 24th 2013

43

http://bit.ly/1f9Pnzt

THE MORE DETAILED YOUR ARTIFACT, THE MORE DETAILED THE FEEDBACK

USABILITY TESTING: INTRODUCTION

Page 62: Usability Testing How To's - EventHandler, London Oct 24th 2013

Choose a product to testTime: 10 minutes

EXERCISE 1

‣ We are going to validate an existing, finished product

‣ As a group, decide on a website or app to test

‣ It can be your app - I must be able to interact with it

Tip: avoid sites that require logging in (unless you have a login to share)

Page 63: Usability Testing How To's - EventHandler, London Oct 24th 2013

Show & Tell

EXERCISE 3

Page 64: Usability Testing How To's - EventHandler, London Oct 24th 2013

PREPARING A TEST PLAN

Scenario Structure

Page 65: Usability Testing How To's - EventHandler, London Oct 24th 2013

PREPARING A TEST PLAN

Scenario Structure

‣ Your character

Page 66: Usability Testing How To's - EventHandler, London Oct 24th 2013

PREPARING A TEST PLAN

Scenario Structure

‣ Your character

‣ Your motivation

Page 67: Usability Testing How To's - EventHandler, London Oct 24th 2013

PREPARING A TEST PLAN

Scenario Structure

‣ Your character

‣ Your motivation

‣ What you need to do

Page 68: Usability Testing How To's - EventHandler, London Oct 24th 2013

PREPARING A TEST PLAN

Scenario Structure

‣ Your character

‣ Your motivation

‣ What you need to do

‣ Any details like login information, etc

Page 69: Usability Testing How To's - EventHandler, London Oct 24th 2013

// SUCCESS PATH

// TEST PLAN FOR: // PART:// GROUP:

TASK

// SCENARIO

// GENERAL SCENARIO

// INFO (passwords, etc)

// SUCCESS PATH

TASK

// SCENARIO

// INFO (passwords, etc)

@ T

empl

ate

by @

grin

blo

Page 70: Usability Testing How To's - EventHandler, London Oct 24th 2013

// SUCCESS PATH

// TEST PLAN FOR: // PART:// GROUP:

TASK

// SCENARIO

// GENERAL SCENARIO

// INFO (passwords, etc)

// SUCCESS PATH

TASK

// SCENARIO

// INFO (passwords, etc)

Set up the motivation

@ T

empl

ate

by @

grin

blo

Page 71: Usability Testing How To's - EventHandler, London Oct 24th 2013

// SUCCESS PATH

// TEST PLAN FOR: // PART:// GROUP:

TASK

// SCENARIO

// GENERAL SCENARIO

// INFO (passwords, etc)

// SUCCESS PATH

TASK

// SCENARIO

// INFO (passwords, etc)

Set up the motivation

What we are testing

@ T

empl

ate

by @

grin

blo

Page 72: Usability Testing How To's - EventHandler, London Oct 24th 2013

// SUCCESS PATH

// TEST PLAN FOR: // PART:// GROUP:

TASK

// SCENARIO

// GENERAL SCENARIO

// INFO (passwords, etc)

// SUCCESS PATH

TASK

// SCENARIO

// INFO (passwords, etc)

Set up the motivation

What we are testing

What we want/expect the user to do

@ T

empl

ate

by @

grin

blo

Page 73: Usability Testing How To's - EventHandler, London Oct 24th 2013

// SUCCESS PATH

// TEST PLAN FOR: // PART:// GROUP:

TASK

// SCENARIO

// GENERAL SCENARIO

// INFO (passwords, etc)

// SUCCESS PATH

TASK

// SCENARIO

// INFO (passwords, etc)

Set up the motivation

What we are testing

What we want/expect the user to do

Motivation to do the task + instructions

@ T

empl

ate

by @

grin

blo

Page 74: Usability Testing How To's - EventHandler, London Oct 24th 2013

// SUCCESS PATH

// TEST PLAN FOR: // PART:// GROUP:

TASK

// SCENARIO

// GENERAL SCENARIO

// INFO (passwords, etc)

// SUCCESS PATH

TASK

// SCENARIO

// INFO (passwords, etc)

Set up the motivation

What we are testing

What we want/expect the user to do

Motivation to do the task + instructions

Information necessary for the task

@ T

empl

ate

by @

grin

blo

Page 75: Usability Testing How To's - EventHandler, London Oct 24th 2013

// SUCCESS PATH

// TEST PLAN FOR: // PART:// GROUP:

TASK

// SCENARIO

// GENERAL SCENARIO

// INFORMATION

// SUCCESS PATH

TASK

// SCENARIO

// INFORMATION

Page 76: Usability Testing How To's - EventHandler, London Oct 24th 2013

// SUCCESS PATH

// TEST PLAN FOR: // PART:// GROUP:

TASK

// SCENARIO

// GENERAL SCENARIO

// INFORMATION

// SUCCESS PATH

TASK

// SCENARIO

// INFORMATION

You need to cook a new recipe for the company potluck. You found a recipe online and now you need to buy the ingredients and cook it.

Page 77: Usability Testing How To's - EventHandler, London Oct 24th 2013

// SUCCESS PATH

// TEST PLAN FOR: // PART:// GROUP:

TASK

// SCENARIO

// GENERAL SCENARIO

// INFORMATION

// SUCCESS PATH

TASK

// SCENARIO

// INFORMATION

You need to cook a new recipe for the company potluck. You found a recipe online and now you need to buy the ingredients and cook it.

Text note

Page 78: Usability Testing How To's - EventHandler, London Oct 24th 2013

// SUCCESS PATH

// TEST PLAN FOR: // PART:// GROUP:

TASK

// SCENARIO

// GENERAL SCENARIO

// INFORMATION

// SUCCESS PATH

TASK

// SCENARIO

// INFORMATION

You need to cook a new recipe for the company potluck. You found a recipe online and now you need to buy the ingredients and cook it.

Create a text note and make a bulleted list of ingredients

Text note

Page 79: Usability Testing How To's - EventHandler, London Oct 24th 2013

// SUCCESS PATH

// TEST PLAN FOR: // PART:// GROUP:

TASK

// SCENARIO

// GENERAL SCENARIO

// INFORMATION

// SUCCESS PATH

TASK

// SCENARIO

// INFORMATION

You need to cook a new recipe for the company potluck. You found a recipe online and now you need to buy the ingredients and cook it.

Create a text note and make a bulleted list of ingredients

Text note

Page 80: Usability Testing How To's - EventHandler, London Oct 24th 2013

// SUCCESS PATH

// TEST PLAN FOR: // PART:// GROUP:

TASK

// SCENARIO

// GENERAL SCENARIO

// INFORMATION

// SUCCESS PATH

TASK

// SCENARIO

// INFORMATION

You need to cook a new recipe for the company potluck. You found a recipe online and now you need to buy the ingredients and cook it.

Create a text note and make a bulleted list of ingredients

Text noteDon’t show this to the participant!

Page 81: Usability Testing How To's - EventHandler, London Oct 24th 2013

// SUCCESS PATH

// TEST PLAN FOR: // PART:// GROUP:

TASK

// SCENARIO

// GENERAL SCENARIO

// INFORMATION

// SUCCESS PATH

TASK

// SCENARIO

// INFORMATION

You need to cook a new recipe for the company potluck. You found a recipe online and now you need to buy the ingredients and cook it.

You need to remember what to buy. Use the app to make a shopping list you can take to the supermarket.

Create a text note and make a bulleted list of ingredients

Text noteDon’t show this to the participant!

Page 82: Usability Testing How To's - EventHandler, London Oct 24th 2013

// SUCCESS PATH

// TEST PLAN FOR: // PART:// GROUP:

TASK

// SCENARIO

// GENERAL SCENARIO

// INFORMATION

// SUCCESS PATH

TASK

// SCENARIO

// INFORMATION

You need to cook a new recipe for the company potluck. You found a recipe online and now you need to buy the ingredients and cook it.

You need to remember what to buy. Use the app to make a shopping list you can take to the supermarket.

Print-out of a recipe from the internet

Create a text note and make a bulleted list of ingredients

Text noteDon’t show this to the participant!

Page 83: Usability Testing How To's - EventHandler, London Oct 24th 2013

// SUCCESS PATH

// TEST PLAN FOR: // PART:// GROUP:

TASK

// SCENARIO

// GENERAL SCENARIO

// INFORMATION

// SUCCESS PATH

TASK

// SCENARIO

// INFORMATION

You need to cook a new recipe for the company potluck. You found a recipe online and now you need to buy the ingredients and cook it.

You need to remember what to buy. Use the app to make a shopping list you can take to the supermarket.

Print-out of a recipe from the internet

Create a text note and make a bulleted list of ingredients

Text note Share a note via e-mailDon’t show this to the participant!

Page 84: Usability Testing How To's - EventHandler, London Oct 24th 2013

// SUCCESS PATH

// TEST PLAN FOR: // PART:// GROUP:

TASK

// SCENARIO

// GENERAL SCENARIO

// INFORMATION

// SUCCESS PATH

TASK

// SCENARIO

// INFORMATION

You need to cook a new recipe for the company potluck. You found a recipe online and now you need to buy the ingredients and cook it.

You need to remember what to buy. Use the app to make a shopping list you can take to the supermarket.

Print-out of a recipe from the internet

Create a text note and make a bulleted list of ingredients

E-mail a note to a friend using swipe to share

Text note Share a note via e-mailDon’t show this to the participant!

Page 85: Usability Testing How To's - EventHandler, London Oct 24th 2013

// SUCCESS PATH

// TEST PLAN FOR: // PART:// GROUP:

TASK

// SCENARIO

// GENERAL SCENARIO

// INFORMATION

// SUCCESS PATH

TASK

// SCENARIO

// INFORMATION

You need to cook a new recipe for the company potluck. You found a recipe online and now you need to buy the ingredients and cook it.

You need to remember what to buy. Use the app to make a shopping list you can take to the supermarket.

Print-out of a recipe from the internet

Create a text note and make a bulleted list of ingredients

E-mail a note to a friend using swipe to share

Text note Share a note via e-mail

You really liked the new recipe and you think your friend Jenny will like it too.

Send the recipe to Jenny from within the app.

Don’t show this to the participant!

Page 86: Usability Testing How To's - EventHandler, London Oct 24th 2013

// SUCCESS PATH

// TEST PLAN FOR: // PART:// GROUP:

TASK

// SCENARIO

// GENERAL SCENARIO

// INFORMATION

// SUCCESS PATH

TASK

// SCENARIO

// INFORMATION

You need to cook a new recipe for the company potluck. You found a recipe online and now you need to buy the ingredients and cook it.

You need to remember what to buy. Use the app to make a shopping list you can take to the supermarket.

Print-out of a recipe from the internet

Create a text note and make a bulleted list of ingredients

E-mail a note to a friend using swipe to share

Text note Share a note via e-mail

You really liked the new recipe and you think your friend Jenny will like it too.

Send the recipe to Jenny from within the app.

Jenny’s email: [email protected]

Don’t show this to the participant!

Page 87: Usability Testing How To's - EventHandler, London Oct 24th 2013

PREPARING A TEST PLAN

Scenario Tips

Page 88: Usability Testing How To's - EventHandler, London Oct 24th 2013

PREPARING A TEST PLAN

Scenario Tips

‣ Avoid using terminology from the interface (e.g., search, tag, filter)

Page 89: Usability Testing How To's - EventHandler, London Oct 24th 2013

PREPARING A TEST PLAN

Scenario Tips

‣ Avoid using terminology from the interface (e.g., search, tag, filter)

‣ Scenarios can have steps (e.g., find a recipe and add it to your collection)

Page 90: Usability Testing How To's - EventHandler, London Oct 24th 2013

PREPARING A TEST PLAN

Scenario Tips

‣ Avoid using terminology from the interface (e.g., search, tag, filter)

‣ Scenarios can have steps (e.g., find a recipe and add it to your collection)

‣ Escalate the difficulty as the test progresses

Page 91: Usability Testing How To's - EventHandler, London Oct 24th 2013

Test PlanTime: 20 mins

EXERCISE 2

‣ Define 3 key tasks that must be intuitive and easy to use in the application

‣ Identify the success paths for each task (what we expect users to do)

‣ Decide on a general scenario + write specific tasks

‣ Run through the test once

Page 92: Usability Testing How To's - EventHandler, London Oct 24th 2013

0 / Usability testing introduction1 / What do we test: preparing a test plan2 / Facilitating a usability test & recording results3 / Analysing and presenting key learnings

USABILITY TESTINGWorkshop schedule

Page 93: Usability Testing How To's - EventHandler, London Oct 24th 2013

USABILITY TEST STEPS

52

http://bit.ly/1f9Pnzt

FACILITATING A TEST & RECORDING RESULTS

Recruit Participants

Prepare a test plan Test Analyse +

iterate

Page 94: Usability Testing How To's - EventHandler, London Oct 24th 2013

Facilitating

‣ Practice staying quiet

‣ Remind the participant to speak out loud

‣ Don’t give anything away

‣ Be reassuring, say thank you

‣ If they get stuck, wait (a little)

FACILITATING A TEST & RECORDING RESULTS

Page 95: Usability Testing How To's - EventHandler, London Oct 24th 2013

Facilitator Cheat-Sheet

If they forget to think aloud

‣ "What are you thinking right now?"

‣ "What are you finding confusing on this screen?"

‣ "I know it's an unusual thing to do but could I please ask you to keep thinking out loud and talk as you go along? It really helps me understand your experience better."

FACILITATING A TEST & RECORDING RESULTS

Page 96: Usability Testing How To's - EventHandler, London Oct 24th 2013

Facilitator Cheat-Sheet

If they get stuck

‣ "This is very helpful for us, we are uncovering a lot of problems in the design that will help us make the app better."

‣ "I can already see how useful this is going to be in improving the app."

FACILITATING A TEST & RECORDING RESULTS

Page 97: Usability Testing How To's - EventHandler, London Oct 24th 2013

Facilitator Cheat-Sheet

If they have a question

‣ "Please continue in the way that makes sense to you. We will learn a lot from seeing how you proceed with this without any help."

‣ "I will be happy to answer your questions at the end. Please try to try this task for a bit longer."

FACILITATING A TEST & RECORDING RESULTS

Page 98: Usability Testing How To's - EventHandler, London Oct 24th 2013

Facilitator Cheat-Sheet

The golden go-to

‣ "We expected to uncover problems in the design. You are not doing anything wrong - we knew there would be issues and you are helping us find them."

FACILITATING A TEST & RECORDING RESULTS

Page 99: Usability Testing How To's - EventHandler, London Oct 24th 2013

58

http://bit.ly/1f9Pnzt

People will feel stupid.Make them feel at ease.

FACILITATING A TEST & RECORDING RESULTS

Page 100: Usability Testing How To's - EventHandler, London Oct 24th 2013

Ways to record our findingsFACILITATING A TEST & RECORDING RESULTS

Page 101: Usability Testing How To's - EventHandler, London Oct 24th 2013

Ways to record our findings

From easy to complicated

FACILITATING A TEST & RECORDING RESULTS

Page 102: Usability Testing How To's - EventHandler, London Oct 24th 2013

Ways to record our findings

From easy to complicated

‣ Pair up with a note-taker

FACILITATING A TEST & RECORDING RESULTS

Page 103: Usability Testing How To's - EventHandler, London Oct 24th 2013

Ways to record our findings

From easy to complicated

‣ Pair up with a note-taker

‣ DIY recording equipment

FACILITATING A TEST & RECORDING RESULTS

Page 104: Usability Testing How To's - EventHandler, London Oct 24th 2013

Ways to record our findings

From easy to complicated

‣ Pair up with a note-taker

‣ DIY recording equipment

‣ Professional recording equipment

FACILITATING A TEST & RECORDING RESULTS

Page 105: Usability Testing How To's - EventHandler, London Oct 24th 2013

Ways to record our findings

From easy to complicated

‣ Pair up with a note-taker

‣ DIY recording equipment

‣ Professional recording equipment

‣ Live-stream to a group of stakeholders

FACILITATING A TEST & RECORDING RESULTS

Page 106: Usability Testing How To's - EventHandler, London Oct 24th 2013

60

http://bit.ly/1f9Pnzt

Note-taking brings down 2 barriers to testing: time & equipment

(But I’ll give you some tips on recording later!)

FACILITATING A TEST & RECORDING RESULTS

Page 107: Usability Testing How To's - EventHandler, London Oct 24th 2013

Note-taking tips

Only record what’s important

‣ If someone is really happy

‣ If someone is really frustrated

‣ If someone fails a task

‣ Write down short quotes if you can

FACILITATING A TEST & RECORDING RESULTS

Page 108: Usability Testing How To's - EventHandler, London Oct 24th 2013

Notes Example

• Taps Map on merchant profile but this opens the system Maps

app — confused

• Goes to Search and types “coffee shops” but there are no results

— “why can’t I see what’s around me?”

• "If I had to think about something around me, I’d start the

merchant profile and expect to see other things around me"

• The icons aren’t telling me that Cafe Nero is a coffee shop

FACILITATING A TEST & RECORDING RESULTS

Page 109: Usability Testing How To's - EventHandler, London Oct 24th 2013

What to bring to the testPrinted scenarios & tasks for participant

Printed scenarios & tasks with success paths for facilitator

Facilitator script

Optional: List of pre-test and debrief questions

Consent form (if needed)

Pen + paper / recording tools

Test setup checklist

FACILITATING A TEST & RECORDING RESULTS

Page 110: Usability Testing How To's - EventHandler, London Oct 24th 2013

Setting up the testReset the mobile app / site to the default settings

Clear the test area of any open documents, written notes, etc.

Prepare participant forms: scenarios, intro script, consent form

Optional: Verify the recording equipment

Optional: Make sure the brightness on the screen is reduced

FACILITATING A TEST & RECORDING RESULTS

Page 111: Usability Testing How To's - EventHandler, London Oct 24th 2013

Usability TestTime: 40 minutes

EXERCISE 3

‣ Every 8 minutes, swap one member of your group in exchange for a member from another group

‣ The ‘foreign’ member is the participant

‣ Start running through the test you’ve planned

‣ Everyone else in the group should be a facilitator and a note-taker at least once

Page 112: Usability Testing How To's - EventHandler, London Oct 24th 2013

Show & Tell

EXERCISE 2

Page 113: Usability Testing How To's - EventHandler, London Oct 24th 2013

0 / Usability testing introduction1 / What do we test: preparing a test plan2 / Facilitating a usability test & recording results3 / Analysing and presenting key learnings

USABILITY TESTINGWorkshop schedule

Page 114: Usability Testing How To's - EventHandler, London Oct 24th 2013

USABILITY TEST STEPS

68

http://bit.ly/1f9Pnzt

ANALYSING & PRESENTING FINDINGS

Recruit Participants

Prepare a test plan Test Analyse +

iterate

Page 115: Usability Testing How To's - EventHandler, London Oct 24th 2013

What to do with all the data?

‣ Identify changes with the biggest impact & smallest effort as a team

‣ Find the “low-hanging fruit”

‣ What has impact on the bottom line?

‣ Put everything else in the ice-box

ANALYSING & PRESENTING FINDINGS

Page 116: Usability Testing How To's - EventHandler, London Oct 24th 2013

Identifying key findings

High-priority: people fail, or abandon the task

Medium: people succeed but are frustrated and unhappy

Low: people would enjoy the app more if...

ANALYSING & PRESENTING FINDINGS

Page 117: Usability Testing How To's - EventHandler, London Oct 24th 2013

Identifying key findings

High-priority: people fail, or abandon the task

Medium: people succeed but are frustrated and unhappy

Low: people would enjoy the app more if...

Tip: Work hard to prioritise the highest-impact items. You can’t fix everything.

ANALYSING & PRESENTING FINDINGS

Page 118: Usability Testing How To's - EventHandler, London Oct 24th 2013

Presenting findingsANALYSING & PRESENTING FINDINGS

Page 119: Usability Testing How To's - EventHandler, London Oct 24th 2013

Presenting findingsANALYSING & PRESENTING FINDINGS

Interface screenshot here

Page 120: Usability Testing How To's - EventHandler, London Oct 24th 2013

Presenting findingsANALYSING & PRESENTING FINDINGS

Interface screenshot here

Task

Page 121: Usability Testing How To's - EventHandler, London Oct 24th 2013

Presenting findingsANALYSING & PRESENTING FINDINGS

Interface screenshot here

Task

What we expected to happen

Page 122: Usability Testing How To's - EventHandler, London Oct 24th 2013

Presenting findingsANALYSING & PRESENTING FINDINGS

Interface screenshot here

Task

What we expected to happen

What really happened

Page 123: Usability Testing How To's - EventHandler, London Oct 24th 2013

Presenting findingsANALYSING & PRESENTING FINDINGS

Interface screenshot here

Task

What we expected to happen

What really happened

What we can fix right now

Page 124: Usability Testing How To's - EventHandler, London Oct 24th 2013

Identifying Key FindingsTime: 15 mins

EXERCISE 4

‣ As a group, debrief on each person’s notes

‣ Find 2 high, 2 medium, and 2 low-priority usability problems

‣ What will you fix first? Why?

‣ Jot down a quick summary of key findings to present to the larger group

Page 125: Usability Testing How To's - EventHandler, London Oct 24th 2013

Show & Tell

EXERCISE 3

Page 126: Usability Testing How To's - EventHandler, London Oct 24th 2013

SummarySUMMARY & CONCLUSION

Page 127: Usability Testing How To's - EventHandler, London Oct 24th 2013

Summary

‣ Match your test artifact to your scope

SUMMARY & CONCLUSION

Page 128: Usability Testing How To's - EventHandler, London Oct 24th 2013

Summary

‣ Match your test artifact to your scope

‣ Plan realistic scenarios that don’t give away the test purpose

SUMMARY & CONCLUSION

Page 129: Usability Testing How To's - EventHandler, London Oct 24th 2013

Summary

‣ Match your test artifact to your scope

‣ Plan realistic scenarios that don’t give away the test purpose

‣ Be encouraging and open to feedback

SUMMARY & CONCLUSION

Page 130: Usability Testing How To's - EventHandler, London Oct 24th 2013

Summary

‣ Match your test artifact to your scope

‣ Plan realistic scenarios that don’t give away the test purpose

‣ Be encouraging and open to feedback

‣ Record only what’s needed

SUMMARY & CONCLUSION

Page 131: Usability Testing How To's - EventHandler, London Oct 24th 2013

Summary

‣ Match your test artifact to your scope

‣ Plan realistic scenarios that don’t give away the test purpose

‣ Be encouraging and open to feedback

‣ Record only what’s needed

‣ Prioritise findings for maximum impact

SUMMARY & CONCLUSION

Page 132: Usability Testing How To's - EventHandler, London Oct 24th 2013

DIVE IN MORE DEEPLY

76

http://bit.ly/1f9Pnzt

Remote ResearchNate Bolt & Tony

Tulathimutte

DIY Usability Testing

Steve Krug

Lean UXJeff Gothelf

SUMMARY & CONCLUSION

Page 133: Usability Testing How To's - EventHandler, London Oct 24th 2013

http://www.humanfactors.com/ROIposter.asp

Any intelligent fool can make things bigger and more complex. It takes courage, and a touch of genius, to move in the opposite direction.

– Albert Einstein

77

A FINAL THOUGHT

SUMMARY & CONCLUSION