3/26/2013

1

Chapter 13: An Evaluation Framework Anna Loparev

Intro HCI

03/26/2013

Consider

2

An Evaluation Framework

3/26/2013

2

Nature of the product

3

Consider

4

Consider

http://starwars.wikia.com/wiki/Stormtrooper, http://kotaku.com/5650591/then-why-we-still-got-ewoks, http://simplicitymom.blogspot.com/2011/10/fishing-for-wookie.html

Target user population

3/26/2013

3

Context

5

Consider

Logistics

6

Consider

3/26/2013

4

DECIDE Framework

7

An Evaluation Framework

Determine the goals

8

DECIDE Framework

http://www.freewebs.com/theknightthatsayswii/morereviews.htm

3/26/2013

5

Explore the questions

9

DECIDE Framework

http://www.mariowiki.com/User:Red-CyanToad, https://chronicle.com/blogs/wiredcampus/scientists-from-8-universities-help-an-ibm-computer-compete-on-jeopardy/29713

Choose the evaluation methods

10 http://starwars.wikia.com/wiki/Stormtrooper, https://en.wikipedia.org/wiki/Mario

DECIDE Framework

3/26/2013

6

Identify the practical issues

11

DECIDE Framework

http://www.collegefashion.net/inspiration/movie-inspiration-fashion-inspired-by-top-gun/

Deal with ethical issues

12

DECIDE Framework

https://en.wikipedia.org/wiki/Mario

3/26/2013

7

Evaluate, analyze, interpret, and present the data

13

DECIDE Framework

Reliability

14

Evaluate … Data

3/26/2013

8

Validity

15

Evaluate … Data

Ecological validity

16

Evaluate … Data

3/26/2013

9

Biases

17

Evaluate … Data

http://www.emoclear.com/distortedthinking.htm

Scope

18

Evaluate … Data

3/26/2013

10

19

Your turn

https://en.wikipedia.org/wiki/Mario

Evaluate … Data

• Reliability

• Validity

• Ecological validity

• Biases

• Scope