123
ALZHEIMER’S ASSOCIATION WEBSITE Cody Freeman Negar Khalandi Yaser Khani

Alz.org Results

Embed Size (px)

Citation preview

ALZHEIMER’S ASSOCIATION WEBSITE

Cody FreemanNegar KhalandiYaser Khani

AGENDA

1. Primary question

2. Persona

3. UX Flowchart

4. Guerrilla Testing

5. Recommendations

6. Conclusion

Freeman Khalandi Khani

Alzheimer’s Association (2014, October 13). Retrieved from UX Design: http://alz.org/

PRIMARY QUESTION What are our main objectives?

PRIMARY QUESTION

Did the redesign of alz.org improve

the user’s ability to find the answers

to the 14 questions?

Freeman Khalandi Khani

Primary Question Persona UX Flowchart Guerilla Testing Recommendation Conclusion

Primary Method: Users navigating through the

prototype as they would naturally

PRIMARY QUESTION

Did the redesign of alz.org improve

the user’s ability to find the answers

to the 14 questions?

Freeman Khalandi Khani

Secondary Method: Users starting their navigation from the

home page to answer each question

Primary Question Persona UX Flowchart Guerilla Testing Recommendation Conclusion

• Three main deliverables

1. Persona

2. UX Flowchart – web and mobile

3. Guerilla testing – web and mobile

PRIMARY QUESTIONMAIN DELIVERABLES

Freeman Khalandi Khani

Primary Question Persona UX Flowchart Guerilla Testing Recommendation Conclusion

PRIMARY QUESTIONMAIN GOALS

• Goal achieved through our main objectives

1. Persona based design

o What is important to a caregiver?

2. Create a alz.org prototype

o Address issues found during previous usability tests

o Web and mobile interfaces

3. Guerilla testing

o Ensure users can find the answers to all the tasks

o Ensure users can get to the answers within 2 clicks

Freeman Khalandi Khani

Primary Question Persona UX Flowchart Guerilla Testing Recommendation Conclusion

PERSONA“Personas bring the absent user to the table” 1

1 Freeman, J. (2014, October 13). Synching the perception of the audience to conceptual design. Retrieved from UX Design: http://ux.justinrfreeman.com/

PERSONA How we did it

• Interviews

o Alzheimer’s patient caregiver

o Nursing home administrator

• Web search

• Consolidated findings to identify commonalities in user

attributes

Freeman Khalandi Khani

Primary QuestionPersona UX Flowchart Guerrilla Testing Recommendation Conclusion

PERSONA RESULT

Freeman Khalandi Khani

Primary QuestionPersona UX Flowchart Guerrilla Testing Recommendation Conclusion

PERSONA RESULT

Freeman Khalandi Khani

Primary QuestionPersona UX Flowchart Guerrilla Testing Recommendation Conclusion

PERSONA RESULT

Freeman Khalandi Khani

Primary QuestionPersona UX Flowchart Guerrilla Testing Recommendation Conclusion

PERSONA RESULT

Freeman Khalandi Khani

Primary QuestionPersona UX Flowchart Guerrilla Testing Recommendation Conclusion

PERSONA RESULT

Freeman Khalandi Khani

Primary QuestionPersona UX Flowchart Guerrilla Testing Recommendation Conclusion

PERSONA RESULT

Freeman Khalandi Khani

Primary QuestionPersona UX Flowchart Guerrilla Testing Recommendation Conclusion

UX FLOWCHART

UX FLOWCHARTHOW WE DID IT

1. Card sorting

2. Create the information architect of our site

3. Create a UX flowchart

Freeman Khalandi Khani

Primary Question PersonaUX

Flowchart Guerrilla Testing Recommendation Conclusion

UX FLOWCHARTHOW WE DID IT: CARD SORTING

Freeman Khalandi Khani

Primary Question PersonaUX

Flowchart Guerrilla Testing Secondary Question Recommendation Conclusion

UX FLOWCHARTHOW WE DID IT: INFORMATION ARCHITECT

Freeman Khalandi Khani

Primary Question PersonaUX

Flowchart Guerrilla Testing Recommendation Conclusion

UX FLOWCHARTHOW WE DID IT: INFORMATION ARCHITECT

Freeman Khalandi Khani

Home

Local chapters

Calendar

Support

Phone #

Address

Alzheimer’s

What is Alzheim

er’s10

warning signsLife

expectancy

(prognosis)Stages of

Alzheimer’sIssues to

expect with

Alzheimer’s

Dementia

Types of Dementi

aEducatio

n program

s

Care

Long-term careCommun

ication with

Alzheimer’s

patient

Primary Question PersonaUX

Flowchart Guerrilla Testing Recommendation Conclusion

UX FLOWCHARTRESULTS: PC LEGEND

Freeman Khalandi Khani

User Desired

action

Computer screen

User actio

n

Page chang

e

End of

task

Primary Question PersonaUX

Flowchart Guerrilla Testing Recommendation Conclusion

UX FLOWCHARTRESULTS: PC BROWSER “DEMENTIA”

Freeman Khalandi Khani

What other diseases, besides

Alzheimer’s, can cause dementia?

Turns on computer and

goes to alz.org

alz.org - Homepag

e Scans home page then clicks on “dementia” tab

alz.org – Dementia

Page Chan

ge

Dementia Tab: Types &

Education Programs

User Selects

“Types of Dementia

”Dementia: “Types

of Dementia”Closes Browse

r

Accordion

menu drops down

types of dementia

Reads various

User Desired action

Computer screen

User actio

n

Page change

End of task

Primary Question PersonaUX

Flowchart Guerrilla Testing Recommendation Conclusion

GUERRILLA TESTING Not gorilla testing!

1. Identified web design parameters to meet Ronda

needs

2. Create a PC and a mobile prototype

3. Conduct guerrilla testing on the prototypes

o Test the users in their natural environments

Coffee shops

Grocery stores

Work

GUERRILLA TESTINGHOW WE DID IT

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

GUERRILLA TESTINGHOW WE DID IT: DESIGN PARAMETERS

Identified web design parameters based

on

“Don’t Make Me Think! A Common Sense

Approach to Web Usability”

by Steve Krug

Freeman Khalandi Khani

GUERRILLA TESTINGHOW WE DID IT: DESIGN PARAMETERS

1. Name of things must be intuitive

2. Links and buttons are obviously clickable

3. Clear visual hierarchy on each page

4. Minimize noise

5. Persistent navigation one each page

6. You are here – give clear visual indicators of location of the site

7. Breadcrumbs – navigation path from home page to present page

8. Make it easy to recover from errors

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Used Axure to create mid-fidelity Browser prototype

Used Axure to create mid-fidelity Browser prototype

Used Axure to create mid-fidelity Mobile prototype

1. Find the name of the Alzheimer’s Association Chapter near you

2. Address of your local Alzheimer’s office

3. Local chapter phone number

4. Difference between Alzheimer’s and dementia

5. Diseases/conditions other than Alzheimer’s that cause dementia

6. 10 warning signs of Alzheimer’s

7. “Calendar of Events”

8. Educational programs specifically for individuals with dementia

9. Support groups

10. Information regarding finding a long term care home for someone with Alzheimer’s

11. Alzheimer’s prognosis

12. Three problems one should expect as Alzheimer’s disease progresses

13. Stages of Alzheimer’s and describe last stage

14. Effective ways to communicate with someone who has Alzheimer’s

Freeman Khalandi Khani

GUERRILLA TESTINGMETHODS: TASKS

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Team members conducted guerrilla tests individually

1. Approached random people and asked them to participate in our study

2. Explained the study to the participant

3. Explained and signed IRB

4. Demographic questionnaire was completed

5. Completed 14 tasks - found answers to questions using prototype

6. Satisfaction questionnaire was completed

7. Thanked individuals for their participation

Freeman Khalandi Khani

GUERRILLA TESTINGMETHODS

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

GUERRILLA TESTINGMETHODS

Total of 8

participants

Primary method Secondary method

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

GUERRILLA TESTINGMETHODS

Primary method

Secondary method

4 tested PC

Prototype

4 tested Mobile

Prototype

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

1. Efficiency – Time on task

2. Effectiveness – Number of clicks/taps

3. Errors

4. Completion rate

5. Satisfaction questionnaire (9 questions)o Combination of ease of use and frustration questions (4 questions)

Identify most difficult and easiest task

Identify most frustrating and least frustrating task

o Likert scale satisfaction questions (4 questions)

Freeman Khalandi Khani

GUERRILLA TESTINGMETHODS: MEASURES

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

PRIMARY QUESTION

Click icon to add picture

Primary Method

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: PRIMARY METHOD PARTICIPANT DEMOGRAPHICS

Average Age38.7

Age Range26 - 66

Caregivers0 / 6

Own smartphones6 / 6

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

EFFICIENCY

Click icon to add picture

Time on Task

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: EFFICIENCY

1 2 3 4 5 6 7 8 9 10 11 12 13 140

20

40

60

80

100

120

140

160

180

200

Average Time on Task

PCMobile

Tasks

Avera

ge T

ime o

n T

ask (

seconds)

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: EFFICIENCY

0

20

40

60

80

100

120

27.5

41.9

Average Time on Tasks

PCMobile

Avera

ge T

ime o

n T

ask (

seconds)

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: EFFICIENCY

PC Mobile

Tasks N1P C1P Average Std.Dev N1M N2M Y1M Y2M Average Std.Dev

1 23 10 16.5 9.2 16 60 102 137 78.8 52.4

2 9 3 6.0 4.2 2 10 49 10 17.8 21.2

3 5 13 9.0 5.7 12 6 30 2 12.5 12.4

4 62 76 69.0 9.9 23 165 120 62 92.5 62.6

5 30 2 16.0 19.8 20 1 250 42 78.3 115.7

6 11 61 36.0 35.4 10 14 30 44 24.5 15.6

7 25 34 29.5 6.4 118 11 5 68 50.5 53.2

8 45 1 23.0 31.1 10 12 10 159 47.8 74.2

9 6 1 3.5 3.5 0 42 40 160 60.5 69.1

10 10 1 5.5 6.4 13 10 20 15 14.5 4.2

11 19 16 17.5 2.1 6 26 35 27 23.5 12.3

12 3 90 46.5 61.5 1 5 89 20 28.8 41.0

13 6 70 38.0 45.3 8 10 22 19 14.8 6.8

14 45 94 69.5 34.6 47 11 30 82 42.5 30.2

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: EFFICIENCY

1 2 3 4 5 6 7 8 9 10 11 12 13 140

20

40

60

80

100

120

140

160

180

200

Average Time on Task

PCNMYM

Tasks

Avera

ge T

ime o

n T

ask (

seconds)

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: EFFICIENCY

0

10

20

30

40

50

60

70

Average Time on Tasks

PCNMYM

Avera

ge T

ime o

n T

asks (

seconds)

0

20

40

60

80

100

120

27.5

41.9

Average Time on Tasks

PCMobile

Avera

ge T

ime o

n T

ask (

seconds)

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

EFFECTIVENESS

Click icon to add picture

Number of Clicks/Taps

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: EFFECTIVENESS

1 2 3 4 5 6 7 8 9 10 11 12 13 140

2

4

6

8

10

12

14

Number of Clicks/Taps

PCMobile

Tasks

Num

be r

of

Clicks /

Taps

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: EFFECTIVENESS

1 2 3 4 5 6 7 8 9 10 11 12 13 140

1

2

3

4

5

6

7

8

Number of Clicks/Taps

PCNMYM

Tasks

Num

be r

of

Clicks /

Taps

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: EFFECTIVENESS

-1

0

1

2

3

4

5

6

Number of Clicks/Taps

PCMobile

Avera

ge N

um

ber

of

Clicks/T

aps

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: EFFECTIVENESS

0

0.5

1

1.5

2

2.5

3

Number of Clicks/Taps

PCNMYM

Avera

ge N

um

ber

of

Clicks/T

aps

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

ERROR

Click icon to add picture

Using Back ButtonClicking on an unproductive link

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: ERRORS

1 2 3 4 5 6 7 8 9 10 11 12 13 140

1

2

3

4

5

6

7

8

9

Error

PCMobile

Tasks

Num

ber

of

Err

or

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: ERRORS

1 2 3 4 5 6 7 8 9 10 11 12 13 140

1

2

3

4

5

6

7

8

9

Error

PCNMYM

Tasks

Num

ber

of

Err

or

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: ERRORS

0

5

10

15

20

25

30

Number Errors

PCMobile

Num

ber

of

Err

ors

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: ERRORS

0

5

10

15

20

25

30

Number of Errors

PCNMYM

Num

ber

of

Err

ors

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

COMPLETION RATE

Click icon to add picture

Successful and accurate completion of a task

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: COMPLETION RATE

1 2 3 4 5 6 7 8 9 10 11 12 13 140%

20%

40%

60%

80%

100%

Accurate Task Completion (%)

PCMobile

Tasks

% A

ccura

te C

om

ple

tion

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: COMPLETION RATE

1 2 3 4 5 6 7 8 9 10 11 12 13 140%

20%

40%

60%

80%

100%

Accurate Task Completion (%)

PCNMYM

Tasks

% A

ccura

te C

om

ple

tion

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: COMPLETION RATE

0123456789

10111213

11.5

12.75

Average # of Completed Tasks per Participant

PCMobile

Avera

ge #

of

Com

ple

ted T

asks p

er

Part

icip

ant

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: COMPLETION RATE

0123456789

10111213

11.512.5

13

Average # of Completed Tasks per Participant

PCNMYM

Avera

ge #

of

Com

ple

ted T

asks p

er

Part

icip

ant

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

SATISFACTION

Click icon to add picture

Ease of use, frustration and satisfaction

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: SATISFACTION – DIFFICULTY & FRUSTRATION

1 2 3 4 50

1

2

3

4

5

6

7

8

Tasks Identified as Most Difficult/Frustrating

Most FrustratingMost Difficult

Tasks

Num

ber

of

Identi

ficati

on T

imes

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: SATISFACTION – DIFFICULTY & FRUSTRATION

1 2 3 40

1

2

3

4

5

6

7

8

Tasks Identified as Easiest/Least Frustrating

Least FrustratingEasiest

Tasks

Num

ber

of

Identi

ficati

on T

imes

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: SATISFACTION – LIKERT SCALE

0

1

2

3

4

5

6

7

8

Satisfaction Likert Scale (1=Strongly Disagree, 7=Strongly Agree)

Overall SatisfactionTime SatisfactionSupport Information Satisfaction

Avera

ge R

ati

ng

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: SATISFACTION – FUNCTIONALITY

of participants thought the site

functioned as expected

100%

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: SATISFACTION – USER COMMENTS

C1P “nothing but couldn't find calendar of events”

N1P “Finding the differences between Alzheimer's and dementia required comparing two sections. one would have made it easier.”

N1M “None”

Y1M “revisit the questioning on task 5, as it was personally misleading.”

N2M “I don't know if a ‘FAQ’ tab was on the site, but that would have been helpful.”

Y2M “educational programs for Alzheimer's should be under Alzheimer's tab.”

Q: Based on your experience, what is the first thing you would change

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

HOW THESE RESULTS ANSWER OUR QUESTION

Freeman Khalandi Khani

Did the redesign of alz.org improve

the user’s ability to find the answers

to the 14 questions?

Primary Method: Users navigating through the

prototype as they would naturally

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

HOW THESE RESULTS ANSWER OUR QUESTION

• Goal of 2-click tasks

o Was met for the PC and NM groups (averagepc = 1.96; std.devpc =

1.91 and averageNM = 1.64; std.dev NM = 1.37)

o Was not met for the YM group (average YM = 2.68; std.dev YM =

2.82)

• Our results are being compared to a usability study

conducted on the current alz.org website

o The test compared the difference between association’s website

and brochure

Freeman Khalandi Khani

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

HOW THESE RESULTS ANSWER OUR QUESTION

• Redesign of the alz.org website improved user’s

o Improved the completion rate of Tasks 1, 2, 4, 5, 6, 9, 11, 13 and

14

o Completion rate of tasks 3 and 10 remained consistent

Freeman Khalandi Khani

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

1 2 3 4 5 6 7 8 9 10 11 12 13 140%

20%

40%

60%

80%

100%

Accurate Task Completion (%)

Current StudyPrevious Study

Tasks

% A

ccura

te C

om

ple

tion

HOW THESE RESULTS ANSWER OUR QUESTION

Freeman Khalandi Khani

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

HOW THESE RESULTS ANSWER OUR QUESTION

• Redesign of the alz.org website improved user’s

o Time on task

Freeman Khalandi Khani

Previous study

Current study

Rate of change

Average TOT (sec) 1136.4 27.5 -41.3

Std. Dev (sec) 563.4 28.9 -19.5

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

1 2 3 4 5 6 7 8 9 10 11 12 13 140%

20%

40%

60%

80%

100%

Accurate Task Completion (%)

Current StudyPrevious Study

Tasks

% A

ccura

te C

om

ple

tion

HOW THESE RESULTS ANSWER OUR QUESTION

• However, it diminished the user’s

o Completion rate on tasks 7, 8 and 12

Freeman Khalandi Khani

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

HOW THESE RESULTS ANSWER OUR QUESTION

Freeman Khalandi Khani

Did the redesign of alz.org improve

the user’s ability to find the answers

to the 14 questions?

Primary Method: Users navigating through the

prototype as they would naturallyYES

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

PRIMARY QUESTION

Click icon to add picture

Secondary Method

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: SECONDARY METHOD PARTICIPANT DEMOGRAPHICS

Average Age47.5

Age Range43 - 52

Caregivers0 / 2

Own smartphones2 / 2

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

EFFICIENCY

Click icon to add picture

Time on Task

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: SECONDARY METHOD EFFICIENCY

1 2 3 4 5 6 7 8 9 10 11 12 13 14

-20

-10

0

10

20

30

40

50

60

70

80

Average Time on Task (comparing primary and secondary PC methods)

Secondary MethodPrimary Method

Tasks

Tim

e o

n T

ask (

seconds)

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: SECONDARY METHOD EFFICIENCY

-10

0

10

20

30

22.3

27.5

Average Time on Task per Method

SPCPPC

Avera

ge T

ime o

n T

ask (

seconds)

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

EFFECTIVENESS

Click icon to add picture

Number of Clicks/Taps

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: SECONDARY METHOD EFFECTIVENESS

1 2 3 4 5 6 7 8 9 10 11 12 13 140

1

2

3

4

5

6

Average Clicks per Task (comparing primary and secondary PC methods)

Secondary MethodPrimary Method

Tasks

Avera

ge C

licks

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: SECONDARY METHOD EFFECTIVENESS

2

2

2

2.2

2.0

Average Number of Clicks per Method

SPCPPC

Avera

ge N

um

ber

of

Clicks)

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

ERROR

Click icon to add picture

Using Back ButtonClicking on an unproductive link

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: SECONDARY METHOD ERROR

1 2 3 4 5 6 7 8 9 10 11 12 13 140

1

2

3

4

5

6

Error per Task

Secondary MethodPrimary Method

Tasks

Num

ber

of

Err

ors

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: SECONDARY METHOD ERROR

0

1

2

3

4

5

6

7

8

9

6

8

Error per Method

SPCPPC

Num

ber

of

Err

ors

)

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

COMPLETION RATE

Click icon to add picture

Successful and accurate completion of a task

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: SECONDARY METHOD COMPLETION RATE

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

1 2 3 4 5 6 7 8 9 10 11 12 13 140%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Accurate Completion per Task (%)

Secondary MethodPrimary Method

Tasks

% A

cucura

te c

om

ple

tion

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: SECONDARY METHOD COMPLETION RATE

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

0.0

2.0

4.0

6.0

8.0

10.0

12.0

14.0

13.0

11.5

Average # of Completed Tasks

SPCPPC

Avera

ge #

of

Com

ple

ted T

asks

SATISFACTION

Click icon to add picture

Ease of use, frustration and satisfaction

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: SATISFACTION – DIFFICULTY & FRUSTRATION

1 20

0.2

0.4

0.6

0.8

1

1.2

Tasks Identified as Most Difficult/Frustating

Most FrustratingMost Difficult

Tasks

Num

ber

of

Identi

ficati

on T

imes

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: SATISFACTION – DIFFICULTY & FRUSTRATION

1 20

0.5

1

1.5

2

2.5

Tasks Identified as Most Difficult/Frustating

Least FrustratingEasiest

Tasks

Num

ber

of

Identi

ficati

on T

imes

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: SATISFACTION – LIKERT SCALE

0

1

2

3

4

5

6

7

8

Satisfaction Likert Scale (1=Strongly Disagree, 7=Strongly Agree)

Overall SatisfactionTime SatisfactionSupport Information Satisfaction

Avera

ge R

ati

ng

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: SATISFACTION – FUNCTIONALITY

of participants thought the site

functioned as expected

100%

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

GUERRILLA TESTINGRESULTS: SATISFACTION – USER COMMENTS

Q: Based on your experience, what is the first thing you would change

C2P “nothing made make the calendar of events larger”

C3P “not having to go to home screen after each task”

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

HOW THESE RESULTS ANSWER OUR QUESTION

Freeman Khalandi Khani

Did the redesign of alz.org improve

the user’s ability to find the answers

to the 14 questions?

Secondary Method: Users starting their navigation from the

home page to answer each question

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

HOW THESE RESULTS ANSWER OUR QUESTION

• Goal of 2-click tasks

o Was not met (Average = 2.2; Std.Dev = 1.2)

• Our results are being compared to a usability study

conducted on the current alz.org website

o The test compared the difference between association’s website

and brochure

Freeman Khalandi Khani

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

HOW THESE RESULTS ANSWER OUR QUESTION

• Redesign of the alz.org website improved user’s

o Improved the completion rate of Tasks 1, 2, 4, 5, 6, 8, 9, 11, 13

and 14

o Completion rate of tasks 3 and 10 remained consistent

Freeman Khalandi Khani

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

1 2 3 4 5 6 7 8 9 10 11 12 13 140%

20%

40%

60%

80%

100%

Accurate Task Completion (%)

Current StudyPrevious Study

Tasks

% A

ccura

te C

om

ple

tion

HOW THESE RESULTS ANSWER OUR QUESTION

Freeman Khalandi Khani

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

HOW THESE RESULTS ANSWER OUR QUESTION

• Redesign of the alz.org website improved user’s

o Time on task

Freeman Khalandi Khani

Previous study

Current study

Rate of change

Average TOT (sec) 1136.4 22.3 -50.9

Std. Dev (sec) 563.4 27.2 -20.7

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

1 2 3 4 5 6 7 8 9 10 11 12 13 140%

20%

40%

60%

80%

100%

Accurate Task Completion (%)

Current StudyPrevious Study

Tasks

% A

ccura

te C

om

ple

tion

HOW THESE RESULTS ANSWER OUR QUESTION

• However, it diminished the user’s

o Completion rate on tasks 7 and 12

Freeman Khalandi Khani

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

HOW THESE RESULTS ANSWER OUR QUESTION

Freeman Khalandi Khani

Did the redesign of alz.org improve

the user’s ability to find the answers

to the 14 questions?

Secondary Method: Users starting their navigation from the

home page to answer each questionYES

Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion

RECOMMENDATIONS

RECOMMENDATIONS

Simplifying the website design and content will improve

website’s usability

• Make the “Calendar of events” more noticeable

• Difference between dementia and Alzheimer’s need to

be more readily available

• The website content needs to be restructured

• Enhance the mobile platform design

Freeman Khalandi Khani

Primary Question Persona UX Flowchart Guerrilla TestingRecommendat

ion Conclusion

CONCLUSION & Lessons learned

CONCLUSION

• Our prototype did not improve the usability of all the

14 tasks

• Improvements with prototype

o PC: Improvement in 9 of the 14 tasks

o Mobile: Improvements in 10 of the 14 tasks

• http://7xedgj.axshare.com

o Password protected

Freeman Khalandi Khani

Primary Question Persona UX Flowchart Guerrilla Testing Recommendation Conclusion

CONCLUSIONLESSONS LEARNED

• How to properly create a persona

• Difference between IA and UX Flowchart

• How to properly create an IA and a UX Flowchart

• How do you spell Guerrilla (Guerilla?)

• Team communication skills

• Time management

• Users don’t always do what you ask them to

Freeman Khalandi Khani

Primary Question Persona UX Flowchart Guerrilla Testing Recommendation Conclusion

BACKUP SLIDES

Click icon to add picture

Removing all “WHAT’s”, “WHY’s” and some “HOW’s”

PERSONAWHAT IS A PERSONA?

“A persona represents a cluster of users who exhibit

similar behavioral patterns in their purchasing decisions,

use of technology or products, customer service

preferences, lifestyle choices, and the like.” 2

Freeman Khalandi Khani

Primary QuestionPersona UX Flowchart Guerrilla Testing Secondary Question Recommendation Conclusion

2 O’Connor, K. (2014, October 13). Personas: The foundation of a great user experience. Retrieved from UX Magazine: http://uxmag.com/articles/personas-the-foundation-of-a-great-user-experience

PERSONA WHY WE DID IT

• Users have certain goals & expectations when interacting with a

product

• Understanding the user goals, behaviors, and patterns

o Help define the important attributes users possess

• Personas aim to capture those attributes

• We wanted to create a prototype that better met the user’s needs

Freeman Khalandi Khani

Primary QuestionPersona UX Flowchart Guerrilla Testing Secondary Question Recommendation Conclusion

“Personas bring the absent user to the table” 1

1 Freeman, J. (2014, October 13). Synching the perception of the audience to conceptual design. Retrieved from UX Design: http://ux.justinrfreeman.com/

UX FLOWCHARTWHY WE DID IT

• Define how all the objects and actions of our prototype

should interrelate

• Keep our prototype inline with our persona’s needs and

wants

• Provided our team with a common vision for our

prototype

• Help achieve our 2-click per task goal

Freeman Khalandi Khani

Primary Question PersonaUX

Flowchart Guerrilla Testing Secondary Question Recommendation Conclusion

UX FLOWCHARTWHAT IS A FLOWCHART?

Freeman Khalandi Khani

Primary Question PersonaUX

Flowchart Guerrilla Testing Secondary Question Recommendation Conclusion

A UX flowchart binds an application together in a way that

supports the conceptual models of its target users. 3

3 Nieters, J. (2014, October 13). Defining an Interaction Model: The cornerstone of application design. Retrieved from UX Matters: http://www.uxmatters.com/mt/archives/2012/01/defining-an-interaction-model-the-cornerstone-of-application-design.php

UX FLOWCHARTHOW WE DID IT: CARD SORTING

1. Card sorting

o A method used to help design (or evaluate)

the information architect of a site 4

o Categorized our tasks into four main groups

In your area

Alzheimer’s

Dementia

Care

2. Create an information architect of

our site

3. Create a UX flowchart

Freeman Khalandi Khani

Primary Question PersonaUX

Flowchart Guerrilla Testing Secondary Question Recommendation Conclusion

4 C

ard

Sortin

g (2

014

, Octo

ber 1

3). R

etrie

ved fro

m U

sab

ility.gov:

http

://ww

w.u

sab

ility.gov/h

ow

-to-a

nd

-tools/m

eth

ods/ca

rd-so

rting

.htm

l

UX FLOWCHARTHOW WE DID IT: INFORMATION ARCHITECT

1. Card sorting

2. Create an information architect of our site

o “IA focuses on organizing, structuring and labeling content in an

effective and sustainable way” 5

o Using categories created from card sorting exercise

o Create subcategories

o Ensure users can complete tasks

3. Create a UX flowchart

Freeman Khalandi Khani

Primary Question PersonaUX

Flowchart Guerrilla Testing Secondary Question Recommendation Conclusion

5 In

form

atio

n A

rchite

cture

Basics (2

014

, Octo

ber 1

3). R

etrie

ved fro

m U

sab

ility.gov: h

ttp://w

ww

.usa

bility.g

ov/w

hat-a

nd-w

hy/in

form

atio

n-

arch

itectu

re.h

tml

UX FLOWCHARTHOW WE DID IT: UX FLOWCHART

Freeman Khalandi Khani

Primary Question PersonaUX

Flowchart Guerrilla Testing Secondary Question Recommendation Conclusion

UX FLOWCHARTRESULTS: MOBILE LEGEND

Freeman Khalandi Khani

User Desired

action

Computer screen

User actio

n

Page chang

e

End of

task

Primary Question PersonaUX

Flowchart Guerrilla Testing Recommendation Conclusion

UX FLOWCHARTRESULTS: PC BROWSER “IN YOUR AREA”

Freeman Khalandi Khani

Does the Alzheimer’s

association have a local chapter

near me?

Turns on computer and

goes to alz.org

alz.org - Homepag

e Searches for local chapter

by state: Missouri

alz.org – In your area

Page Chan

ge

Locations in MO – 3 options

Documents Prairie

Village, KS chapter

Locations: Columbia, MO; St. Louis, MO;

Prairie Village, KS

Closes Browse

rUser Desired

actionComputer

screen

User actio

n

Page change

End of task

Primary Question PersonaUX

Flowchart Guerrilla Testing Recommendation Conclusion

UX FLOWCHARTRESULTS: PC BROWSER “ALZHEIMER’S”

Freeman Khalandi Khani

Are there any warning signs

for Alzheimer’s disease?

Turns on computer and

goes to alz.org

alz.org - Homepag

e Scans page. Clicks on “10 Warning signs” under Alzheimer’s section

alz.org – Alzheimer’s

Page Chan

ge

Alzheimer’s: “10 Warning Signs”

Scrolls through the 10 warning signs

of Alzheimer’s

Alzheimer’s: “10 Warning Signs”

Closes Browse

rUser Desired

actionComputer

screen

User actio

n

Page change

End of task

Primary Question PersonaUX

Flowchart Guerrilla Testing Recommendation Conclusion

UX FLOWCHARTRESULTS: PC BROWSER “CARE”

Freeman Khalandi Khani

Are there recommended communication methods to use

with Alzheimer’s patients?

Turns on computer and

goes to alz.org

alz.org - Homepag

e Scans home page. clicks on “Long-term Care” under Care tab

alz.org – Care

Page Chan

ge

Care Tab: Long-term Care

Reads about available long-term

care options

Care: “Long-term Care”

Closes Browse

rUser Desired

actionComputer

screen

User actio

n

Page change

End of task

Primary Question PersonaUX

Flowchart Guerrilla Testing Recommendation Conclusion

UX FLOWCHARTRESULTS: MOBILE “ALZHEIMER’S”

Freeman Khalandi Khani

Are there any warning signs for

Alzheimer’s disease?

Unlock phone and

goes to alz.org

alz.org - Homepag

eSkims home

page and taps on

Alzheimer’s Tab

alz.org – Alzheimer’s Tab

In Your area page opens

Alzheimer’s Tab

taps on “10

Warning Signs”

10 Warning

Signs

Locks

Phone

Accordion

Menu opens

User Desired action

Computer screen

User actio

n

Page change

End of task

Primary Question PersonaUX

Flowchart Guerrilla Testing Recommendation Conclusion

UX FLOWCHARTRESULTS: MOBILE “IN YOUR AREA”

Freeman Khalandi Khani

What is the address of the

Alzheimer’s association

chapter near me?

Unlock phone and

goes to alz.org

alz.org - Homepag

eSkims home

page and taps on map under In your

Area

alz.org – Map

In Your area page opens

In Your Area Tab

Scrolls down

and taps on

Missouri on

the Map

Address: Columbia, MO; St. Louis, MO;

Prairie Village, KS

Locks

Phone

Local Chapte

rs page opens

Village

address

Documents Prairie

User Desired action

Computer screen

User actio

n

Page change

End of task

Primary Question PersonaUX

Flowchart Guerrilla Testing Recommendation Conclusion

UX FLOWCHARTRESULTS: MOBILE “DEMENTIA”

Freeman Khalandi Khani

What other diseases, besides Alzheimer’s, can cause dementia?

Unlock phone and

goes to alz.org

alz.org - Homepag

eScrolls down the home page. taps

“Types of Dementia” under Dementia Tab

alz.org – Dementia Tab

“Typ

es o

f Dem

entia

” pa

ge

open

s

Dementia Tab –

“Types of Dementia”

Scrolls down the page and find types of

dementia

10 Warning

Signs

Locks

Phone

User Desired action

Computer screen

User actio

n

Page change

End of task

Primary Question PersonaUX

Flowchart Guerrilla Testing Recommendation Conclusion

UX FLOWCHARTRESULTS: MOBILE “CARE”

Freeman Khalandi Khani

Are there any long-term care

options for Alzheimer’s

patients?

Unlock phone and

goes to alz.org

alz.org - Homepag

e

Dementia Tab –

“Long-Term Care”

Scroll down to see Long=term

Care information

“Long-Term Care”

Locks

Phone

Scrolls down the home page. taps “long-term care”

under the care tab

alz.org – Care Tab

“long-

term Care

” page open

s

User Desired action

Computer screen

User actio

n

Page change

End of task

Primary Question PersonaUX

Flowchart Guerrilla Testing Recommendation Conclusion

Freeman Khalandi Khani

Primary Question Persona UX FlowchartGuerrilla Testing Secondary Question Recommendation Conclusion

GUERRILLA TESTINGWHAT IS GUERRILLA TESTING?

“Guerrilla research methods are faster, lower-cost

methods that provide sufficient enough insights to make

informed strategic decisions.” 5

5 Unger, R. & Wafgel, T. (2014, October 13). Getting Guerrilla With It. Retrieved from UX Magazine: http://uxmag.com/articles/getting-guerrilla-with-it

• It is a fast way to test a prototype

• Test the users in their natural environments

o Coffee shops

o Grocery stores

o Work

• Understand if the prototype meets the user’s goals

and needs

Freeman Khalandi Khani

Primary Question Persona UX FlowchartGuerrilla Testing Secondary Question Recommendation Conclusion

GUERRILLA TESTINGWHY WE DID IT

Freeman Khalandi Khani

Primary Question Persona UX FlowchartGuerrilla Testing Secondary Question Recommendation Conclusion

GUERRILLA TESTINGRESULTS: OVERALL PARTICIPANT DEMOGRAPHICS

Average Age40.9

Age Range26 - 66

Caregivers0 / 8

Own smartphones8 / 8