User Testing: Interactive System Design

7/27/2019 User Testing: Interactive System Design

1/22

Interactivity 1

User TestingWhats it Good For?

DECIDE FrameworkYour Next Move

User Test Plan

User Test Report


2/22

User Testing: Whats it Good For and Why?

Determine how well the design is performing- information design, navigation, readability, interactions

The logical audience for the testing is the intended users- really depends on the nature of your book

The term User Testing is rather misleading

- its your design thats being tested not the user


3/22

Plan, Test and Analyze Results

DECIDE Framework


4/22

DECIDE Framework

Determine overall goals of the evaluation-What do you want to find out about?

-Why is it important to your design?


5/22

DECIDE Framework

Explore specific questions to be answered-What are the big question to be explored?-They need to lead to actionable insights


6/22

DECIDE Framework

Choose the methodology to answer questions

-Provide a rationale for a selection of methods :

- usability study

- crowdsourcing- focus group

- cognitive walkthrough

- heuristic evaluation


7/22

DECIDE Framework

Identify practical issues that need to be addressed

-Testing environment

-Equipment

-Participants

-Time


8/22

DECIDE Framework

Decide on how to deal with any ethical issues

-Are there any you may encounter?

-How will you deal with these?


9/22

DECIDE Framework

Evaluate, interpret and present findings- Identify patterns or themes that emerge


10/22

Plan, Test and Analyze Results

DECIDE Framework


11/22

User Testing: Youre Next Move

You are now in the middle of the process developing the Future

Book Now project. At the beginning of this project, you

developed your content in a chapbook. We talked about all the

ways of transforming and remediating your print-based content

to an interactive user experience. You are in the midst ofmaking design choices to build a high fidelity prototype.

But how will you know if this is a good design?

How do you know if made the the right choices during thedesign process?

USER TESTING


12/22

User Testing: Designing the Test

You will design and conduct user testing on your prototype.

The User Test Plan which consists of four parts:

1. User Test Designchoose an appropriate research method for testing

your book

use DECIDE framework to develop methodology and

answer guiding questions

focus on areas where you have doubts and need direction


13/22

User Testing: Project Brief


The second part is a Project Brief

1. User Test Design

2. Project Brief

read to the participant to introduce the projectone brief for the whole team (group)

sets the tone of comfort, ease and trust

sets expectations, limits of testing


14/22

User Testing: Project Brief Example

We are students from York University who are developing a mobile app for

those that are interested in the educational technology. This app will allow

readers to view and interact with current research material, as well asencourage interaction between researchers with various interests across

campus to network and collaborate on projects.

The app takes you straight to the contents page which comprises of various

chapters. The app consists of three features: a browse section, a user

account section, and a collaboration board.

We will show you the app, and request you to perform some tasks in order

to evaluate the user experience of our interface. In no way are we testing

your abilities, but rather testing our interface and looking for ways to

improve its capabilities.


15/22

User Testing: Test Script


The third part is a Test Script

1. User Test Design

3. Test Scriptset the context and instruct them in their tasksform of a scenario, then direct them in task

can be exploratory testing (or both)

2. Project Brief


16/22

User Testing: Test Script Example

You are a first year design student of at York. As part of your

workstudy position you are working on the display cases on

campus and on the faculty website, but you would like to get a

better idea of what everyone else in the program is up to.

In particular, you have just submitted your Story Slam poster foryour Design and Image class and would like to see how your

peers from other sections have approached the same project.

Your task is to simply find two Story Slam projects by navigating

your way through the app. Find them any way you like. Go and

have a look!


17/22

4. Consent Formrequired for academic research involving human participants

protects not only participant but researcher

clearly stating parameters from the onset of the test

file and lock away completed forms in no way publish or refer to by name

User Testing: Consent Form


And the last part of this stage is the Consent Form

1. User Test Design

2. Project Brief

3. Test Script
http://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdfhttp://ysdn3005.files.wordpress.com/2013/02/consent_form.pdf


18/22

User Testing: User Test Plan

The User Test Plan will have four parts:

1. User Test Design

2. Project Brief

3. Test Script

4. Consent Form

Due Nov 5 in Class for Review


19/22

User Testing: Conducting the Test

Coordinate with any classmates to assist each otherand

make best use of time

Select participants from intended audience for your design -

3 minimum up to 5 max

Decide on roles for running the test

Be consistent in how the test is delivered

Do not prompt or comment on what the participant is doing

Follow up the the tests with additional feed back or

discussion from the participants - unstructured interview


20/22

User Testing: After Test Impressions

Consider any first impressions, common points of frustration

Prioritize

what stood out as biggest issue?

Clarify what are steps that took too long?

Conditions

did any technical, environmental issues effect the test?

Follow Up

feeling after the test, overall thoughts

write these down immediately


21/22

User Testing: Analysis

Each individual will report on:

Testing procedure how things went, what actually occurred

any surprises, challenges?

where expectations met?

Findings

what did you discover about your designs?

what are the answers to DECIDE big questions?

Reflection

how did you find this process, what you have learned?

would you change anything next time?


22/22

User Testing: Synthesis

The group will synthesize the user test designs, findings andanalysis to formulate an integrated group report with the

objectives of the new design requirements clearly stated.

User Testing Report will bedue in class Nov 8

Documents

User Testing: Interactive System Design