Usability Test Report for Home Depot Project Color

8/18/2019 Usability Test Report for Home Depot Project Color

1/71

1

Final Project Test Report:

Home Depot Project Color

Conducted by Group 3: Cassidy Craig, Sabrina D’ali-endo!a,

"essica #layman, "onat$an %eal, &rancis Salatino

'ac( to )able o* Contents


2/71

+

Usability Test Plan for

The Home Depot Project Color

___________________________________________________

Prepared for: Dr. Jane oody! Professor "#C $%&'

Completed by: Group 3

Cassidy Crai(

Jonathan #eal)abrina D*+li,endo-a

Francis )alatino

Jessica layman

Date: December '/! %'01

TABLE OF CONTENTS



3/71

3

Coer.1

)itle.+

)able o* Contents....3

/0ecutie Summary.

2ntroduction.

)est Plan and Procedures.

4sers.5

Scenarios.6

)op &indings and Seerity Codes.7

8nalysis *rom 9uestionnaires.1

;ecommendations.11

4rge to 8ction.1+

Appendices

Section 1 - Heuristic /aluation.13

Section + - oderator Script.+5

Section 3 - Screening 9uestionnaires.+6

Section - Post-)as( 9uestionnaires.3

Section - Post-)est 9uestionnaires.35

Section 5 - Personas.

Section 6 - Session


4/71

>ur group analy!ed a smartp$one app called Project Color. >erall, t$e studyparticipants did not enjoy using t$e app, because t$ey encountered numerous design*la?s and usability issues t$at $indered t$eir progress in signi*icant ?ays. )$e majorityopined t$at ?$ile t$e app is capable o* doing ?$at it s$ould, its structure and layout aretoo con*using *or it to really be use*ul. )$e symbols and prompts are also problematic,

o*ten leading to dead ends ?$en t$e user can’t *igure out ?$at to do or ?$ere to gone0t. )$ese arious problems are @uite damaging, because Project Color is only li(elyto be used *or a s$ort time, and users ?ill probably not ?ant to spend a lot o* timelearning $o? it ?or(s. Ae o**er our recommendations *or c$ange belo?.

Speci*ically, t$e study participants encountered $ig$ priority usability issues ?it$t$e *ollo?ing areas:

B %aigating bac(?ards and *or?ards,B


5/71

)$e *ollo?ing report is coers our met$ods o* testing as ?ell as t$e results andconclusions ?e’e dra?n based on *eedbac( *rom our olunteers.

TEST PLAN AND PROCEDURES

>ur group’s test plan and procedures encompassed a series o* tests and@uestions t$at o**ered insig$t*ul data about our product. )oget$er, ?e created ascreening @uestionnaire, pre-test @uestionnaire, post-tas( @uestionnaire, and a post-test@uestionnaire to gat$er t$e in*ormation ?e needed during our time spent testing. /ac$o* t$ese tests indiidually ?ere crucial to t$e success o* our project. >ur goal *or t$etests ?as to learn about $o? a consumer ?ould respond to t$is app and any c$allengest$ey mig$t encounter along t$e ?ay. 2n t$is sense, ?e could learn about t$e usability o*t$is application.

)$e screening @uestionnaire ?as used to discoer t$e bac(ground o* t$e person?e ?ere testing. )$roug$ t$is set o* @uestions ?e learned not only basic t$ings about

t$e person suc$ as t$eir gender and age, but t$eir com*ort leel using tec$nology.4nderstanding ?$ere t$is person ?as in t$eir leel o* com*ort to?ards tec$nology ?asimportant to note so t$at ?e could read t$eir end results ?it$ t$e applicationappropriately *or e0ample, i* t$ey are clueless about tec$nology and $ad issues ?it$t$e test t$en ?e cannot conclude t$e app does not ?or( ?ell, but t$at per$aps t$eirissues ?it$ tec$nology ?as a *actor.

)$e pre-test @uestionnaire is speci*ically pointed @uestions to t$e test subjectregarding t$e Home Depot Project Color app. )$e purpose o* t$is test ?as to *ind ?$ate0pectations t$e test subject $ad about t$e app going into t$e test. )$is gae insig$tinto ?$at a regular consumer ?ould e0pect *rom t$e app ?$en t$ey do?nload it.

'ot$ t$e post-tas( @uestionnaire and t$e post-test @uestionnaire ?or( toget$er tounderstand ?$at t$e test-subject t$oug$t about eac$ aspect o* t$e app. )$is ?asaccomplis$ed by creating arious types o* @uestions t$ere ?ere @uestions t$at re@uireda 1- rating to represent $o? ?ell t$ey agree ?it$ t$e prompt, ?rite-in ans?er @uestionssuc$ as )$e aspect 2 li(ed most about Home Depot Project Color app ?as, areas?$ere t$e participant could list any c$anges t$ey *elt needed to improe in t$e app as?ell as space to ?rite any comments t$ey ?ould li(e. )$e ariety o* @uestions ?ere putinto place to ensure ?e got t$e most in*ormation *rom t$e testing as possible.

>ur procedure ?as *or group members to *ind one person ?illing to participatein t$is test and conduct t$e preiously agreed upon tests. 8*ter $aing *ound our oneperson, eac$ group member used a smartp$one or some ot$er recording deice tocapture t$e test subject’s erbal reactions to naigating t$e app.



6/71

5

USERS

Ae $ad *our users *or our testing purposes.

)$e *irst user ?as a &emale ?$o is 3 years old. )$is user $as aerage

pro*iciency ?$en it comes to tec$nology. S$e mostly uses $er apps *or social mediaand $as do?nloaded a total o* 5 in t$e past mont$. A$en as(ed about aerage amounto* time spend on apps in an aerage ?ee( s$e responded ?it$ 6-7 $ours. S$e *it ourparameters and ?as *ound to be a good test user.

)$e second user ?as a ale ?$o is 56 years old. )$is user rated $imsel* as a in pro*iciency ?$en it comes to tec$nology on a scale o* 1-1. He mostly uses ades(top computer and $as not do?nloaded any apps in t$e past mont$. )$is usermostly uses email and messaging *unctions on $is smartp$one. A$en as(ed aboutaerage amount o* time spend on apps in an aerage ?ee( s$e responded ?it$ 1 $our.He *it our parameters and ?as *ound to be a good test user.

)$e t$ird user ?as a &emale ?$o is +6 years old. )$is user rated t$eirpro*iciency as a 5 on a scale o* 1-1 ?$en it comes to tec$nology. S$e mostly uses $er apps *or games and $as do?nloaded none in t$e past mont$. A$en as(ed aboutaerage amount o* time spend on apps in an aerage ?ee( s$e responded ?it$ lesst$an 1 $our. S$e *it our parameters and ?as *ound to be a good test user.

)$e *inal user ?as a male ?$o is +3 years old. )$is user rated t$eir pro*iciencyas a 6 on a scale o* 1-1 ?$en it comes to tec$nology. He mostly uses apps *or socialmedia, te0t messaging, bleac$er report and emails. He $as do?nloaded a total o* 3apps in t$e past mont$. A$en as(ed about aerage amount o* time spend on apps inan aerage ?ee( $e responded ?it$ 5-6 $ours. He *it our parameters and ?as *ound tobe a good test user.

8s you can see ?e $ad a ariety o* users to test and eac$ $as a di**erent leel o*tec$nology pro*iciency as ?ell as e0perience leels ?it$ applications. )$is allo?ed usto diersi*y our results and aoid any bias results.



7/71

6

SCENARIOS

/ac$ moderator made t$e e**ort to (eep t$e testing scenario bot$ pro*essionaland organi!ed *or eery olunteer. /ac$ olunteer ?ould be greeted and gien ageneral understanding o* ?$at t$e test pertains too in terms o* content. >nce t$e

olunteer agrees to parta(e in t$e study t$ey are gien t$e consent *orm. )$is *ormgies a brie* oerie? o* bot$ t$eir rig$ts and t$e rig$t o* t$e moderator. >nce t$isdocument is signed t$e moderator begins t$e pre-screening @uestionnaire. &or *urt$erre*erence and detail on t$e pre-screening script consult Section 1 o* t$e 8ppendices.>nce t$e olunteer $as located t$e app and do?nloaded t$e program success*ully t$eolunteer t$en begins t$e usability testing process. )$is begins ?it$ t$e olunteer *illingout t$e pre-tas( @uestionnaire. &or *urt$er detail on t$ese topics and t$e olunteersconsult Sections 3- o* t$e 8ppendices. )$e olunteers ?ould be bot$ guided t$roug$t$e app ?it$out instruction and ?it$ instruction *rom t$e moderator. )$is dual tacticallo?s *or a more t$oroug$ understanding o* t$e user ability. >nce t$e usability test ?ascomplete t$e moderator ?ould t$en administer t$e post tas( @uestionnaire. )$is is t$e

conclusion o* t$e usability test ?$ere t$e olunteer is gien t$e opportunity to e0presst$eir opinion on t$e user ability o* Project Color.



8/71

7

TOP FINDINGS AND SEVERITY CODES

SEVERITY CODES

>ur ran(ing system $as t$ree leels: $ig$ priority, medium priority, and lo?

priority. Hig$ priority issues $ae a signi*icant impact on usability, in ?$ic$ t$e user is

unable to continue using t$e product or one o* its important *eatures. edium priority

issues are lesser problems, t$oug$ ones t$at s$ould be *i0ed i* possible. inor

problems are cosmetic, but ?ort$ mentioning because ?e ?ant t$e product to be

polis$ed.

TOP FINDINGS - HIGH PRIORITY

B )$ere is no uniersal bac( button to $elp naigate t$roug$ menus. )$e ?ay users

naigate is not streamlined, as t$ere are seeral di**erent bac( buttons ?it$

contrasting appearances, and a *e? o* t$e menus lac( a bac( button entirely. )$e

majority o* our olunteers needed to repeat an action but *ound t$emseles unable to

locate t$e preious menus.

B )$e c$ec(out menu is di**icult to locate. )$is is a signi*icant problem, because enabling

users to buy paint is a *undamental part o* Home Depot’s agena. )$e majority o* our

olunteers ?ere unable to *ind it ?it$out $elp.

B 4sers $ae trouble ?it$ t$e atc$ 2t menu, ?$ic$ is used to select colors *romp$otograp$s *or use in ot$er p$otograp$s. )$ere are no instructions on t$e screen a*tert$ee user ta(es $is$er *irst picture - it merely becomes still, causing it to appear ast$oug$ t$e app $as cras$ed or *ro!en.

TOP FINDINGS - MEDIUM PRIORITY

B )$ere is no isible indicator t$at t$ere are t?o dra?ing modes Edra? and *illF. )$e

majority o* our olunteers did not utili!e bot$.B )$e paint button s$ares a space ?it$ t$e erase button, o*ten causing con*usion about

?$ic$ mode is currently actie. )$e button does not display t$e tool t$at is being used,but rat$er t$e tool t$at ?ould be used i* it ?ere pressed again. 8 di**erent ?ay to

distinguis$ bet?een t$ese t?o modes ?ould be $elp*ul.

B Painting around ?indo?s can be di**icult. )$is is mainly due to t$e preious t?o issues.



9/71

=

B )$e See 2t and atc$ 2t mode titles are too ague. )$e majority o* our olunteers

e0pressed some concern t$at t$ey ?ere guessing ?$ere to go *irst.

TOP FINDINGS - LOW PRIORITY

B )$e menu *or /diting )ools is redundant as it only contains one editing tool. )$is is not

a signi*icant usability problem, since t$e majority o* our users ?ere able to *ind t$e tool

inside ?it$out any trouble. Ho?eer, it remains a design *la?.

B )$ere is no internal $elp menu. )$is is not a signi*icant usability issue, because t$e

majority o* our olunteers decided t$at t$ey ?ould not put muc$ time into learning t$e

app’s *unctions. Ae suggest improing t$e app’s 42 be*ore adding more te0t.

ANALYSIS FROM UESTIONNAIRES



10/71

1

4pon care*ully reading eac$ o* t$e @uestionnaires t$ere ?ere seeral issues t$atseemed to be a problem *or eac$ user ?$o tested Home Depot’s Project color. )$ere?ere a lot o* similarities in t$e *eatures t$at t$e users li(ed as ?ell. 8ny o* t$e issuest$at ?ere mentioned by more t$an one user can sa*ely be considered problematic.>erall t$e user responses on t$eir e0perience using Home Depot’s Project Color ?ere

negatie.

)$e most common problem, ?$ic$ ?as mentioned in one *orm or anot$er in all*our o* t$e sureys ?e conducted ?as t$at it ?as not user *riendly or intuitie. A$ile t$eyounger users in our group seemed to $ae less trouble completing t$e tas(s t$an t$eolder users, none o* t$e users t$oug$t t$at t$e user inter*ace ?as consistent or sel*-e0planatory. ost users noted t$at t$ere ?as no 'ac( button on t$e menu. 8not$eruser noted t$at t$e instructions on t$e opening screen See it and atc$ it are notclear instructions on $o? to use t$e application or ?$at to do *irst.

Seeral users $ad di**iculty using t$e color matc$ tool. 8s one o* t$e applications

main *eatures, t$e color matc$ tool s$ould be easy to use. )$is is a di**icult *la? tooerloo(, and since it s$o?ed up as an issue on seeral o* our sureys itIs probably anissue t$at t$e deelopers o* Project Color s$ould consider addressing.

Hal* o* t$e users ?e sureyed said t$at t$at t$e tas(s t$ey ?ere as(ed to per*ormtoo( bet?een and 1 minutes, ?it$ t?o outliers. >ne user ?as able to complete t$etas(s in under minutes and anot$er user too( bet?een 1 and + minutes. )$e user?$o ?as able to complete t$e tas(s in t$e s$ortest period o* time gae a less negatiereie? o* Project Color, and ?$ile oerall, most o* t$e *eedbac( ?as negatie, t$e user?$o too( t$e longest to complete t$e tas(s *eedbac( seemed more negatie t$an t$eot$ers.

)$e most popular, or t$e only *eature t$at eac$ user said t$ey li(ed about t$eproduct ?as t$e color matc$ *eature, but t$at ?as also a *eature t$at users $ad t$e mostdi**iculty using success*ully. )$e idea o* t$e color matc$ tool ?as popular, but t$ee0ecution o* it is problematic.

A$ile seeral users noted t$at t$e concept ?as a good idea, most *ollo?ed t$atby saying t$at t$e bugs, and problem areas needed to be *i0ed in order *or t$eapplication to be use*ul to t$em. )$e general consensus ?as t$at t$e program ?ouldbe use*ul i* it could easily do t$e t$ings it is supposed to do, but t$at it ?as needlesslycomplicated. Clarity o* $o? or ?$at it could do ?ere also an issue. 2t ?as unclear to

our users ?$et$er or not you could purc$ase t$e paint color you c$oose using t$eapplication, and i* you could $o? it ?as done.

RECOMMENDATIONS



11/71

11

8s *ar as improements *or t$e Home Depot app go, our team $as somesuggestions to o**er based on t$e data ?e ac@uired. Ae $ae *ound t$at t$ere are bot$s$ort-term and long-term improements t$at can be made. )$e s$ort-termimproements are t$e smaller issues-t$e ones t$at are simple *i0es. )$is means t$ent$at t$e long-term improements are t$e more di**icult ones to deal ?it$ and t$e ones

t$at $ae greater e**ects on t$e usability o* t$e app.

>ne o* our s$ort-term recommendations *or improement ?ould be to ma(e t$e*act t$at t$ere are t?o di**erent dra?ing modes more clear. )$roug$ our testing ?ediscoered t$at most o* t$e participants ?ere una?are t$at t$is ?as een an option.

8not$er recommendation ?e $ae is to add a ?ay to ie? t?o separate pictures at t$esame time. )$e addition o* t$is ?ould be ideal *or people ?$o ?is$ to compare colors?it$out t$e trouble o* $aing to go bac( and *ort$ t$roug$ t$e app. )$ere a *e? smallissues t$at, i* resoled, ?ould ma(e t$e app muc$ simpler to use. 8 speci*ic problem ?eencountered t$roug$ testing ?as t$at tools *or editing ?ere scattered t$roug$out t$eapp. Ae recommend collecting all t$e editing tools and putting t$em under t$e /diting

)ools menu. Currently, t$is menu $as only editing tool. )$ese s$ort-term *i0es ?illma(e a $uge di**erence in t$e oerall use*ulness o* t$e app.

8s *ar as long-term improements go, ?e *ound a *e? t$at a**ect t$e app moret$an t$e ot$ers and cause t$e use*ulness o* t$e app to be minimal *or some consumers.>ne o* t$ese long-term improements t$at need to be made is a dedicated bac(button. )$roug$ t$e testing, many participants dealt ?it$ *rustration ?$en t$ey could notgo bac( to t$e main menu or to ?$ateer t$ey ?ere preiously on. Ae recommend t$ata bac( button remain constant no matter ?$ere in t$e app you are so t$at t$e user $ast$e *reedom to moe t$roug$ t$e app ?it$out getting stuc( and not being able to gobac(. 8not$er major issue is t$e system loc(ing up or cras$ing. A$en s?itc$ing *rom

lie ie? to still p$oto t$e system ?ould o*ten loc( up or *orce t$e user out o* t$eapplication completely. A$eneer an app $as any sort o* cras$ing $appening it giest$e impression to t$e user t$at it is bro(en and t$ey o*ten ?ill not deal ?it$ it any longer.>erall, t$e greatest issue ?e *ound ?it$ t$e app is t$e lac( o* clear directions andguidance o**ered. >ur recommendation is to add in tips instead o* leading t$e user to apage ?it$out any directions. A$ile e0perienced users mig$t be able to guidet$emseles t$roug$ t$e process, a $uge portion o* your consumers are being ignoredby not o**ering more guidance. 8not$er recommendation to $elp *i0 t$is issue is to add a$elp page. )$is ?ay, i* someone needs assistance t$ey $ae a place to go and i* t$eydon’t t$en t$ey are not bot$ered.

Ae beliee t$at t$ese are important problems to tac(le, bot$ s$ort-term and long-term. 2* dealt ?it$, t$e usability o* t$is app ?ill be muc$ better.

URGE TO ACTION



12/71

1+

Since only *our test subjects ?ere used it ?ould be best to ta(e t$e *ormatcreated and e0pand t$e pool o* users tested. &or t$e purpose o* t$e initial testing t$eresults ?ere consistent ?it$ t$e users e0periences and (no?ledge o* applications. )oget more accurate results a testing pool o* roug$ly 1 plus users ?ould gie a betterpicture. Ae suggest (eeping t$e mi0ture o* age and se0 to (eep t$e results dierse and

@uanti*iable ?it$ t$ese current results.

APPENDICES

Sec!i"n # - He$%is!ic E&'($'!i"n



13/71

13

Heuristic /aluation:

Project C>;

In!%"d$c!i"n)$e Home Depot’s Project Color app promises to ease a buyerIs concerns ?$en

it comes to committing to a ne? paint color. )$is is supposedly accomplis$ed t$roug$

an application t$at allo?s t$e user to ie? paint colors against t$eir $ouse or ?all

?it$out any conse@uences. >ur group c$ose to test t$is app and see $o? user-*riendly

it ?as. 'e*ore conducting a test ourseles, ?e t$oug$t it best to discuss t$e user type

?e ?ould consider as ?ell as t$e scenario. >ur user type ?ould li(ely be an indiidual

?$o is ine0perienced ?it$ t$is speci*ic app- a majority o* people do not paint t$eir $ouse

ery o*ten so een i* t$ey $ae used t$e app be*ore t$ey mig$t $ae lost *amiliarity. >urscenario ?as speci*ied ?it$ more guidelines ?e ?ould loo( at $o? t$e app ?or(s ?$en

c$oosing a color to paint t$e outside ?alls o* our $ouse. >ur indiidual tests o* t$e

application ?ill be critical to our *uture testing. )$is report allo?ed us to become

com*ortable in t$e inner ?or(ings o* t$e app it also uneiled any issues to loo( out *or

to see i* ot$er users encounter t$e same issues. 2n t$ese ?ays t$e report $elps us *ind

patterns and understand usability.

P$%p"se

)$e purpose o* our test is to proide a description o* t$e critical elements ?it$in

t$e Project Color application. )$is test plan ?ill identi*y any problems t$at may e0ist so

t$at e0ecuties, deelopers, and managers can react to increase t$e e0perience o* t$e

users. >ur group plans to use t$is report in preparation *or testing by deeloping t$e

proper testing scenario’s *or t$e users. )$e report ?ill also assist our group ?it$ setting

up realistic test goals. Ait$out t$ese test goals ?e ?ill be blindly testing users ?it$out

any speci*ic desired results. Ae *eel t$at t$e results belo? ?ill be a good benc$mar( *or

us to begin our testing.

Me!)"d"("*+



14/71

1

)o ealuate Project Color, our team $as conducted a *ormal ealuation and

reie?. Ae *irst agreed upon t$e target user, t$en tested t$e application ?it$ t$at

mindset, e0ploring t$e entire e0perience. )$is includes: starting t$e application, ta(ing

p$otos Eindoors and outdoorsF, manipulating t$e p$otos ?it$ di**erent paint colors,

te0tures, and *inally e0ploring t$e c$ec(-out *eature. >ur set o* $euristics is diided into

9uesenbery’s *ie /s: /ngaging, /**icient, /**ectie, /rror )olerant, and /asy to erie?: 2n order to create a success*ul app t$at engages its users, it is

necessary to setup a simple layout t$at is easy *or a majority o* people to naigate.

>t$er t$ings to (eep in mind ?$en loo(ing to engage users are: isual elements,

descriptions and *un actiities to allo? t$e user to enjoy t$e product.

Suggestion: >erall, t$e app could ?or( on being more engaging to its users t$roug$di**erent met$ods.



15/71

1

Speci*ic 2ssue- %o dedicated bac( button.

Description-)$ere are 3 simple c$oices ?$en t$e user *irst opens t$e app. A$ile

t$is aspect is ery engaging due to its simplicity, t$ere is no clear ?ay out o* t$e

option and bac( to t$e $ome screen once a c$oice $as been made. Since t$e

options are not detailed t$e user must discoer t$roug$ trial-and-error. A$ile

t$ere is a sidebar menu option, it does not $ae t$e ability to get t$e user bac( to

t$e main menu.

Suggestion- )$e addition o* a undo or bac( to menu *eature to t$e app ?ould

be an enormous improement to t$e engaging @ualities o* t$e app. 2t is essential

to $ae t$is t$roug$out eery step o* t$e ?ay so t$at t$e user $as control to

enture t$roug$ t$e app ?it$out repercussions. %ielsen stresses t$e importance

o* t$is by saying, 4sers o*ten c$oose system *unctions by mista(e and ?ill need

a clearly mar(ed Jemergency e0it’ to leae t$e un?anted state ?it$out $aing to

go t$roug$ an e0tended dialogue E'arnum 5+F.

Speci*ic 2ssue- &aorite colors are di**icult to locate.

Description- A$en t$e user selects t$e c$oose a color menu, *aorite colors

aren’t a selectable option. 2nstead, to *ind your *aorite colors you must go to t$e

system menu ?$ere t$e di**erent app *unctions are, ?$ic$ is not logical or

simple.

Suggestion- 8dd a *aorite colors tab at t$e top o* t$e c$oose a color menu.)$is tab is already *unctional on ot$er menus, so it ?ould not be di**icult or

e0pensie to implement $ere.

$esen/e%+ 0E1 $sed2 E%%"% !"(e%'n!3



16/71

15

Criterion >erie?: Due to t$e lac( o* in*ormation and prompts it is not di**icult to come

across an error message or *ind a glitc$. )$ings suc$ as: lig$ting, angles, odd s$aped

?alls and many ot$ers create obstacles ?$en designing your space.

Suggestion: >erall, 2 beliee t$is app could use more prompts and $o?-to’s. )$e

current application does not o**er @uic( tips or suggestions ?$en ta(ing or uploading

pictures.

Speci*ic 2ssue- 2nsu**icient in*ormation about security settings.

Description- 4sers ?$o are not *amiliar ?it$ smartp$ones may struggle ?it$ t$e

re@uired add-ons and security settings re@uired by t$e application. 2* you do not

$ae your camera set to allo? access to your p$otos t$e application ?ill loc( up

and re@uire you to leae t$e application and return once you update your p$one’s

priacy settings.

Suggestion- >nce t$e application is installed it ?ould be $elp*ul *or t$ere to be a

@uic( tips be*ore you begin or pop up in*orming you o* t$is re@uirement to

ensure proper use o* t$e application.

Speci*ic 2ssue-


17/71

16

options to paint t$e space you just too( a still p$oto o*. 8n error ?ill t$en occur

and you are not able to paint t$e space. )$e paint brus$ ?ill s$o? you dra?ing

t$e lines but t$ey disappear as soon as you let go.

Suggestion- )$e *unction to paint t$e space t$at you just too( a still p$oto o* is

aailable it just needs to $ae t$e bugs ?or(ed out. )$e steps and buttons are in

place but need to be *unctional.

$esen/e%+ 0E1 $sed2 E44ec!i&e3

Criterion >erie?: A$en loo(ing at $o? e**ectie t$e app is it must be considered t$at

t$e app itsel* is designed to sae Home Depot s$oppers time and money on paint

related projects. A$et$er it be deciding on a color, c$oosing a room to paint, matc$ing a

piece o* *urniture to a complimentary paint color, or any ot$er possible combination t$is

app is in *act e**ectie. 'ecause t$e app allo?s a sample color to be applied to any

space proided in a p$otograp$ t$e time and money o* going to Home Depot and

ac@uiring a p$ysical sample is saed.

Suggestion: >erall t$e accuracy o* t$e app is ?$at ineitably aries. 'ecause eac$

$uman eye is di**erent t$e app relies $eaily on t$e consumer perception o* ?$at t$e

color ?ill loo( li(e on t$e ?all, dry. )$e e**iciency o* t$e app is going to constantly be in

@uestion as a result o* t$is premise.

Speci*ic 2ssue- 2nsu**icient *eedbac(.

Description- >ne o* t$e main issues ?it$ t$e e**iciency o* t$e app is t$e lac( o*

direction. 8lt$oug$ as a ne? user 2 ?as able to moe com*ortably t$roug$out t$e

settings, more *eedbac( ?ould be a signi*icant improement to *uture users.



18/71

17

Suggestion- A$en ta(ing p$otos $elp*ul reminder bubbles s$ould appear reading

turn o** *las$ to aoid glares and discoloration and use HD; *unctions to

improe color accuracy. )$ese bubbles s$ould appear initially t$en disappear in atimely manner.

Speci*ic 2ssue- 2nconsistent menu design.

Description- )$e initial screen o* t$e app is ideal in t$at it is clean and

straig$t*or?ard. Ho?eer, t$is soon becomes lost in drop do?n menus, side

screens, clear all buttons, and a mess o* ot$er consistency issues.)$e side menu

?it$ t$e same options as t$e $ome screen appears cluttered and con*using to

users.

Suggestion- /liminate t$e side screen and t$e irelleant escape cues in place o*

one single $ome button t$at ?ill bring t$e user bac( to t$e original screen. )$is ?ill

gie users a certain leel o* e0pertise in t$at t$ey (no? $o? to go bac( i* t$ey get

lost. )$is ?ill greatly improe t$e e**iciency and time spent using t$e app itsel*.

$esen/e%+ 0E1 $sed2 E's+ !" (e'%n3

Criterion >erie?: Some users are not e0perienced ?it$ smartp$ones or tec$nology in

general. &or t$is reason it’s important to ma(e applications approac$able and easy to

learn - ot$er?ise, t$e application could *ail to *ul*il its purpose. Some @ualities to loo( out

*or are isibility, *le0ibility, and $elp*ul documentation.

Suggestion: )$e *undamental idea is to ma(e



19/71

1=

Speci*ic 2ssue- %o indicator o* dra?ing modes.

Description- )$ere is no isible indicator t$at t$ere are t?o dra?ing modes. %e?

users may not reali!e t$at tapping t$e screen *ills a *ield ?it$ color, ?$ile dra?ing

a continuous line generates blotc$es. 'ecause o* t$is, it’s possible t$at users

?on’t use bot$ *eatures.

Suggestion- 8ccording to %ielson’s 1 $euristics, 2nstructions *or use o* t$e

system s$ould be isible or easily retrieable ?$eneer appropriate E'arnum 5+F.

)$ere*ore, t$ere s$ould be e0plicit instructions on t$e painting screen letting users(no? ?$at t$ey are able to do. 8lternatiely, t$ere could be a button t$at reeals

t$e instructions.

Speci*ic 2ssue- )e0t can be too small in e0ternal $elp screen.

Description- 2n t$e $elp screen Ea ?ebpage meant to supplement t$e applicationF,

t$e te0t si!e is too small, and t$e user cannot !oom in. 2t is too di**icult to read t$is

?ay.

Suggestion- Since t$e p$one’s 2nternet bro?ser is not a part o* Project Color, t$e

best ?ay to sole t$is issue ?ould be to put t$e instructions in t$e application

itsel*. )$en it ?ould be possible to incorporate a reliable !oom *unction.

$esen/e%+ 0E1 $sed2 E44icien!3



20/71


21/71


22/71

++

?ebsite, ?$ic$ is not *ormatted *or easy ie?ing on smartp$ones. )$is seems li(e a

glaring oersig$t, since t$e majority o* t$e programs users ?ill li(ely be using t$e

application on t$eir smartp$ones.

A$ile t$e (ey *unctions do ?or(, t$e lac( o* isual cues and signi*iers *ail to direct

t$e user in an e**icient and easy-to-use manner. >ne *eature ?e t$oug$t ?ould sae t$e

user time ?ould be t$e ability to purc$ase paint online and pic( it up in t$e store at a

later time. Since t$e primary goal o* t$is application is *or Home Depot to sell paint, it

seemed li(e including a *eature li(e t$is ?ould be bene*icial to bot$ t$e user and Home

Depot.

)$ere is a )a(e an 8pp )our *eature, ?$ic$ is di**icult to read, and only *ound

under t$e See 2t inter*ace Enormally somet$ing li(e t$is ?ould be located on t$e maininter*ace- t$e menu t$e user sees ?$en t$ey *irst load t$e applicationF. )$e )our

consists o* a *our slides t$at do little to e0plain t$e *eatures and *unctions Esuc$ as

loading and ta(ing pictures to t$e programF.

)$oug$ ?e t$in( t$at t$e concept *or t$e application is cleer idea t$at $as t$e

potential to ma(e pic(ing out and purc$asing paint a less daunting and time-consuming

tas(, t$e *la?s and lac( o* direction render it *rustrating and time consuming *or *irst time

users. ost basic Paint programs can per*orm t$e same *unctions aailable in ProjectColor. >erall ?e agreed t$at t$e painting *eatures come o** more li(e an a*tert$oug$t in

a program ot$er?ise designed to lead people to t$eir nearest Home Depot or t$eir

?ebsite.

Hi*) P%i"%i!+ Iss$es

B )$ere is no dedicated bac( button to $elp naigate t$roug$ menus. 4sers may $ae torestart t$e application i* t$ey ma(e a mista(e.

B )$ere is no $elp screen built into t$e application. )$e e0ternal $elp ?ebsite does not

necessarily $ae a !oom *unction, so users may not be able to read it depending on

t$eir p$one.



23/71

+3

B )$e application does not noti*y you o* re@uirements and security settings t$at may need

to be altered up *ront. 4sers can be loc(ed out o* some *eatures i* t$ey ma(e a mista(e.

B A$en c$anging *rom lie ie? to still p$oto t$e system loc(s up.

B 2n general, t$ere is a lac( o* directions or prompts to guide you t$roug$ t$e application.

Medi$. P%i"%i!+ Iss$es

B )$ere is no isible indicator t$at t$ere are t?o dra?ing modes.

B Painting around ?indo?s can be di**icult.

B )$ere is no ?ay to display t?o separate pictures at t$e same time and matc$ colors

*rom one to t$e ot$er.

B )$e icons do not remain consistent *rom screen to screen. )$e initial screen is clear

and easy to naigate, but t$is is not t$e same *or all screens.

L"6 P%i"%i!+ Iss$es

B &aorite colors aren’t a selectable option in t$e c$oose a color menu.

B )$e menu *or /diting )ools is redundant as it only contains one editing tool.



24/71

+

C"nc($si"n

)$roug$ test per*ormance o* t$e app by noice users ?e ?ill be able to

determine t$e core user ability *la?s ?it$in t$e program. 2n order to better determine

?$at t$e issues are ?e ?ill re@uire eac$ user to per*orm seeral styles o* testing

depending on ?$ic$ program *la? ?e are targeting. &or instance, users ?ill be as(ed to

*ocus on naigation or t$e oerall e0perience, ?$ile ot$ers ?ill be as(ed to *ocus on

design. )$e *ocus o* our testing ?ill be to determine t$e program *la?s and t$e most

e**icient means o* correction. Ae ?ill record *eedbac( *rom eac$ user on t$eir

e0pectations be*ore t$e test and a*ter t$e test *or a ?ell e0ecuted conclusion. 'y t$e

end o* t$is study ?ill be able to identi*y t$e usability *la?s and t$e steps necessary to

correct t$em.

Sec!i"n 7 - M"de%'!"% Sc%ip!

M'in Scen'%i" 8# - P'in!in* Ind""%s C"("% Se'%c) Me!)"d

1. )a(e a p$oto o* a ?all indoors.+. &ind and select an attractie color.



25/71

+

3. Paint t$e desired area.. Kie? t$e image in alternate lig$ting conditions.. Continue to c$ec(out.

M'in Scen'%i" 87 - P'in!in* O$!d""%s C"("% M'!c) Me!)"d

1. )a(e a p$oto o* a nearby $ouse to c$oose a color *rom.+. C$oose a color and add it to &aorites.3. )a(e a p$oto o* a ?all outdoors.. Paint t$e ?all in t$e second image ?it$ t$e *aorite color.. Kie? t$e image in alternatie lig$ting conditions.5. Continue to c$ec(out.

Sec!i"n 9 - Sc%eenin* $es!i"nn'i%es

T)e Sc%eenin* $es!i"nn'i%e

8re you male or *emaleM Male.



26/71

+5

A$at is your ageM 67.

>n a scale *rom 1 to 1 ?it$ 1 being t$e most pro*icient, ?$ere do de*ine yoursel* in

tec$nological pro*iciencyM 5.

8re you currently renting or do you o?n propertyM Own.

Do you o?n a smartp$one or tablet deiceM Yes.

2* yes, $o? many apps $ae you do?nloaded in t$e past mont$M None.

A$ic$ deice do you use most o*ten to access t$e 2nternetM Desktop computer.

A$at type o* apps do you use most o*tenM Email and messaging.

A$at ?ould you li(e to see in *uture appsM Better use of older hardware.

A$at ?ould you li(e to c$ange about current appsM More securit. Easier to !lock unwanted

access.


8re you male or *emaleM Male.

A$at is your ageM "#.



8re you currently renting or do you o?n propertyM $enting.

Do you o?n a smartp$one or tablet deiceM Yes.

2* yes, $o? many apps $ae you do?nloaded in t$e past mont$M #.

A$ic$ deice do you use most o*ten to access t$e 2nternetM %martphone.

A$at type o* apps do you use most o*tenM &nstagram' te(t messaging' Bleacher $eport' Email.

A$at ?ould you li(e to see in *uture appsM )uicker response time.

A$at ?ould you li(e to c$ange about current appsM *nwanted crashing.



27/71

+6


8re you male or *emaleM +emale.

A$at is your ageM "7.




Do you o?n a smartp$one or tablet deiceM %martphone.

2* yes, $o? many apps $ae you do?nloaded in t$e past mont$M None.

A$ic$ deice do you use most o*ten to access t$e 2nternetM ,omputer.

A$at type o* apps do you use most o*tenM -ames.

A$at ?ould you li(e to see in *uture appsM ess internet unrelia!ilit.

A$at ?ould you li(e to c$ange about current appsM /he need for internet connection.


8re you male or *emaleM +emale.

A$at is your ageM #0.


tec$nological pro*iciencyM 12erage proficienc.


Do you o?n a smartp$one or tablet deiceM Both.

2* yes, $o? many apps $ae you do?nloaded in t$e past mont$M 6.

A$ic$ deice do you use most o*ten to access t$e 2nternetM %martphone.

A$at type o* apps do you use most o*tenM %ocial media.

A$at ?ould you li(e to see in *uture appsM Easier to use.

A$at ?ould you li(e to c$ange about current appsM More compati!ilit across different de2ices.



28/71

+7

Sec!i"n : - P"s!-!'s, $es!i"nn'i%es

P"s! T's, $es!i"nn'i%e

1. Home Depot’s Project Color lied up to my e0pectations.

Strongly Disagree Slig$tly Disagree %ot Sure Slig$tly 8gree Strongly 8gree

0

+. 'ased on t$e tas(s you per*ormed using Home Depot’s Project Color, please rate $o? use*ulyou t$in( it ?ould be *or someone pic(ing out paint *or t$eir $ome:

/0tremely 4se*ul ig$t sae time. %ot Sure %ot use*ul 8 ?aste o* time

0

3. 2 needed $elp completing my tas(s:

%eer ;arely Sometimes >ccasionally 8l?ays

0

. >erall, *inding speci*ic colors using Project Color ?as:

/0tremely Di**icult Slig$tly Di**icult 8erage &airly /asy /0tremely /asy



29/71

+=

0

. Completing all o* t$e tas(s 2 ?as as(ed too( me:

4nder inutes 'et?een and1 minutes.

'et?een 1 and+ inutes

>er +inutes.

Aas unable tocomplete tas(.

0

5. )$e aspect 2 li(ed most about Home Depot’s Project Color ?as...linked photo to paint color.

Best part is a!ilit to match a color to the photo and ha2e it link to an actual paint color.

6. )$e aspect 2 disli(ed most about Home Depot’s Project Color ?as3as not clear how it

worked. %m!ols were not helpful. Na2igation not intuiti2e. ,annot go !ack.

7. Please list any c$anges t$at you t$in( ?ould improe Home Depot’s Project Color:

1. /he colors need more organi4ation. Need more categories. Need colors to

correspond to color !ooks or swatches. You cant ust ha2e 888 green s9uares with no

organi4ation and e(pect people to pick one.

+. *se standard na2igation' similar to a !rowser. :ro2ide an eas wa to start o2er.

3. +i( opening screen. Not clear how to start. ;%ee it< is not a good option.

.

.

=. Please use t$e space proided *or any additional comments:

Not nearl good enough.



StronglyDisagree

Slig$tly Disagree %ot Sure Slig$tly 8gree Strongly 8gree

0



30/71

3

+. 'ased on t$e tas(s you per*ormed using Home Depot’s Project Color, please rate $o?use*ul you t$in( it ?ould be *or someone pic(ing out paint *or t$eir $ome:


0



0


/0tremely

Di**icult

Slig$tly Di**icult 8erage &airly /asy /0tremely /asy

0




>er +inutes.


0

5. )$e aspect 2 li(ed most about Home Depot’s Project Color ?as..& liked the Match &t feature

so & can see what color something else is painted that & like.

6. )$e aspect 2 disli(ed most about Home Depot’s Project Color ?as=ow difficult it was to

na2igate> ou cannot go !ack to the main menu and where to purchase a color was unclear.


1. 1 simple wa to start o2er or undo e2erthing?not ust the paint.

+. More instructions to start out with> ;%ee it< and ;Match it< are not specific enough.

3. Directions on how to paint?ou needed to dou!le tap the photo to paint and that was

not clear.

.



31/71

31

.


&t is a good concept' !ut it has some kinks to work out.



Strongly Disagree Slig$tly Disagree %ot Sure Slig$tly 8gree Strongly 8gree

0

+. 'ased on t$e tas(s you per*ormed using Home Depot’s Project Color, please rate $o? use*ulyou t$in( it ?ould be *or someone pic(ing out paint *or t$eir $ome:


0



0


/0tremely Di**icult Slig$tly Di**icult 8erage &airly /asy /0tremely /asy

0


4nder inutes

'et?een and 1minutes.


>er +inutes.


0

5. )$e aspect 2 li(ed most about Home Depot’s Project Color ?as... /he color option and photo

smash.

6. )$e aspect 2 disli(ed most about Home Depot’s Project Color ?as /he laout.




32/71

3+

1. More detail.

+.

3.

.

.


N@1



StronglyDisagree


0

+. 'ased on t$e tas(s you per*ormed using Home Depot’s Project Color, please rate $o?use*ul you t$in( it ?ould be *or someone pic(ing out paint *or t$eir $ome:


0



0


/0tremelyDi**icult


0




33/71

33



>er +inutes.


0

5. )$e aspect 2 li(ed most about Home Depot’s Project Color ?as...&t was kind of fun to pla

around with.

6. )$e aspect 2 disli(ed most about Home Depot’s Project Color ?as/he application did not

work.


1. Make it easier to use and easier to know what to do.

+. Make the !rush easier to control.

3.8dd a $elp menu or tutorial.

.

.


N@1

Sec!i"n ; - P"s!-!es! $es!i"nn'i%es

P"s! Tes! $es!i"nn'i%e



34/71

3

1. 2 t$in( 2 ?ould use Home Depot’s Project Color *re@uently ?$en painting my $ouse.

Strongly Disagree1

+

3

Strongly 8gree

0

+. 2 *ound Home Depot’s Project Color to be needlessly complicated.

Strongly Disagree1

+

3

Strongly 8gree

0

3. 2 t$oug$t Home Depot’s Project Color ?as user-*riendly and easy to use.

Strongly Disagree1 + 3 Strongly 8gree

0

. 2 t$in( 2 ?ould need t$e $elp o* a )ec$nical Support person or e0pert in order to use HomeDepot’s Project color e**ectiely.

Strongly Disagree1

+

3

Strongly 8gree

0

. 2 t$oug$t t$at t$e arious *unctions in Home Depot’s Project Color ?ere ?ell-integrated Et$att$e *unctions and capabilities are coordinated ?ell-enoug$ to ma(e *unctional ?$oleF.

Strongly Disagree1

+

3

Strongly 8gree

0

5. 2 t$oug$t Home Depot’s Project Color ?as inconsistent.

Strongly Disagree

1

+

3

Strongly 8gree

0

6. 2 t$in( aerage ne? users ?ould $ae no trouble learning to use Home Depot’s Project Color@uic(ly and easily.

Strongly Disagree Strongly 8gree



35/71

3

1 + 3

0

7. 2 *ound Home Depot’s Project Color to be ery clumsy and a?(?ard to use.

Strongly Disagree1

+

3

Strongly 8gree

0

=. )$e user-inter*ace ?as ery intuitie and 2 *elt ery sure o* mysel* ?$ile using Home Depot’sProject Color.

Strongly Disagree1

+

3

Strongly 8gree

0

1. 2 needed to loo( *or $elp and learn @uite a bit be*ore 2 ?as able to get started using HomeDepot’s Project Color.

Strongly Disagree1

+

3

Strongly 8gree

0



Strongly Disagree1

+ 3

Strongly 8gree

0


Strongly Disagree1

+

3

Strongly 8gree

0



36/71

35


Strongly Disagree1

+

3

Strongly 8gree

0


Strongly Disagree1

+

3

Strongly 8gree

0


Strongly Disagree1 + 3 Strongly 8gree

0


Strongly Disagree1

+

3

Strongly 8gree

0

6. 2 t$in( aerage ne? users ?ould $ae no trouble learning to use Home Depot’s Project Color @uic(ly and easily.

Strongly Disagree1

+

3

Strongly 8gree

0


Strongly Disagree1

+

3

Strongly 8gree

0




37/71

36

Strongly Disagree1

+

3

Strongly 8gree

0

1. 2 needed to loo( *or $elp and learn @uite a bit be*ore 2 ?as able to get started using Home

Depot’s Project Color.

Strongly Disagree1

+

3

Strongly 8gree

0



Strongly Disagree1

+

3

Strongly 8gree

0


Strongly Disagree

1

+

3

Strongly 8gree

0


Strongly Disagree

1

+

3

Strongly 8gree

0

. 2 t$in( 2 ?ould need t$e $elp o* a )ec$nical Support person or e0pert in order to use Home

Depot’s Project color e**ectiely.



38/71

37

Strongly Disagree

1

+

3

Strongly 8gree

0

. 2 t$oug$t t$at t$e arious *unctions in Home Depot’s Project Color ?ere ?ell-integrated Et$at

t$e *unctions and capabilities are coordinated ?ell-enoug$ to ma(e *unctional ?$oleF.

Strongly Disagree

1

+

3

Strongly 8gree

0


Strongly Disagree1

+

3

Strongly 8gree

0

6. 2 t$in( aerage ne? users ?ould $ae no trouble learning to use Home Depot’s Project Color@uic(ly and easily.

Strongly Disagree1

+

3

Strongly 8gree

0


Strongly Disagree1

+

3

Strongly 8gree

0


Strongly Disagree1

+

3

Strongly 8gree

0



39/71

3=

1. 2 needed to loo( *or $elp and learn @uite a bit be*ore 2 ?as able to get started using HomeDepot’s Project Color.

Strongly Disagree1

+

3

Strongly 8gree

0



Strongly Disagree1

+

3

Strongly 8gree

0


Strongly Disagree1

+

3

Strongly 8gree

0


Strongly Disagree1

+

3

Strongly 8gree

0


Strongly Disagree1

+

3

Strongly 8gree

0


Strongly Disagree1

+

3

Strongly 8gree

0



40/71


Strongly Disagree1

+

3

Strongly 8gree

0

6. 2 t$in( aerage ne? users ?ould $ae no trouble learning to use Home Depot’s Project Color @uic(ly and easily.

Strongly Disagree1

+

3

Strongly 8gree

0


Strongly Disagree1

+

3

Strongly 8gree

0

=. )$e user-inter*ace ?as ery intuitie and 2 *elt ery sure o* mysel* ?$ile using Home Depot’s

Project Color.

Strongly Disagree

1

+

3

Strongly 8gree

0



Strongly Disagree

1

+

3

Strongly 8gree

0

Sec!i"n < - Pe%s"n's



41/71

1

S"$%ces2

Ae decided t$at t$e best ?ay to deelop a demograp$ic *or Project Color ?ould be to read

customer reie?s on i)unes E8pple’s app storeF and Google Play Et$e primary app store *or

most android p$onesF. Ae also use a ?ebsite called ar(et ;ealist E???.mar(etrealist.comF todeelop a pro*ile *or Home Depot customers in general, ersus t$ose ?$o ?ould go to a

competing store li(e


42/71

+

His *iancNe tas(ed $im ?it$ *inding colors *or bot$ t$e bedroom andliing room. 2t is important to $er t$at $e coordinate t$e colors ?it$ t$e*urniture t$ey $ae already purc$ased as ?ell as ma(ing sure t$ecolors ?ill *lo? ?it$ t$e layout o* t$e rooms.

He and $is ?i*e ?ill paint t$e rooms toget$er.

Mindse! E=pec!'!i"ns "4P%"d$c!

He learned about Home Depot’s Project Color app *rom a )Kcommercial, and t$ere*ore e0pects it to ?or( as s$o?n t$ere.

Since $e is busy, t$ere’s not muc$ time in $is sc$edule to spend ons$opping *or paint. He $as neer boug$t paint be*ore, but $e e0pects itto be relatiely simple. )$e commercial coninced $im t$at it ?ould beeasy i* $e used t$e app.

He re@uires e0plicit instructions to $elp $im get started, but ?antst$em to be clear and concise. He e0pects to receie assistance *romt$e app ?it$ bot$ pic(ing out a paint color and t$e paint-buyingprocess.

He e0pects *or t$ere to be a *e? steps Eas s$o?n on t$e commercialF,but s$ould be e**icient and simple to learn.

His opinion o* Home Depot is neit$er positie nor negatie. 2* $eencounters too many problems, $e may c$oose to buy paint *rom adi**erent $ome improement store instead.

En&i%"n.en! He is in a domestic enironment, painting t$e interior o* $is ne?$ome.

)$e lig$ting conditions in $is ne? $ome are ideal. )$ere is one large?indo? in t$e liing room, and t$ere are t?o small ?indo?s in t$ebedroom.

He is com*ortable ?it$ using t$e latest tec$nologies, includingcomputers and touc$ screen smartp$ones. Ho?eer, $e can’t use $iscomputer no?. )$e computers in $is ?or(place are resered *orbusiness use only, so $e cannot use t$em.

His ne? $ome does not $ae an 2nternet connection yet, but $e canuse $is smartp$one’s 2nternet *unctions near access points. )$ismeans $e cannot use t$e 2nternet ?$ile painting.



43/71

3

Pe%s"n' 7 >lder 4ser %e? to )ec$nology

P)"!"

Source: &reedigitalp$otos.net

Fic!i"n'( N'.e Sara$ 'ro?n

De."*%'p)ics years oldarried3 c$ildren+ grandc$ildrenaster’s degree

G"'(s T's,s )as(s: Sara$ is loo(ing to per*orm t$e *ollo?ing tas(s and $as moret$an enoug$ time to do so because s$e is retired.

Selecting a color based on t$e $omes on $er street&inding painters

Goals: Sara$ ?ould li(e to $ae t$e *ollo?ing completed at t$e end o*t$e process.

&inding a complimentary color to $er neig$bors $omesHaing t$e $ome painted in t$e color selected, *inding it

Mindse! E=pec!'!i"ns "4P%"d$c!

Sara$ is intimidated by t$e idea o* c$oosing a paint color online ass$e struggles ?it$ tec$nology. 'ecause t$e color is important, s$e is?illing to e0periment ?it$ ne? met$ods o* *inding t$e per*ect color.Her mindset is c$allenged by t$e idea o* tec$nology and t$at it may beuntrust?ort$y. Sara$ is determined to *ind a color at all costs and s$eis motiated to do so and is ?illing to spend time and money. S$e is alongtime Home Depot customer, and is ?illing to listen to employee’s

adice.

En&i%"n.en! Sara$ is retired and is loo(ing to paint t$e e0terior o* $er $ome tocompliment t$e neig$bor$ood $omes s$e lies near. Sara$ ?ill $iresomeone else to paint once s$e decides on a color. S$e lies in amodest $ome ?it$ all t$e modern coneniences including cable and2nternet. 'ecause s$e is painting t$e e0terior o* $er $ome, lig$ting ?ill



44/71

not be an issue *or t$e p$otos. %aigating t$e ?ebsite ?ill bemoderately di**icult as s$e is a noice smartp$one user. Her leel o*success using t$e app ?ill depend on $er patience ?$ile using t$eapp.

Sec!i"n > - Sessi"n L"*s

>ur group used seeral di**erent means o* communication t$roug$out t$e semester.

8ppro0imately meetings too( place ia ?ebcourses con*erences, ia a te0t message

client on our cellp$ones, and 1 ia telecon*erence. 8s o* t$is ?riting, t$e te0t message

client contains +=6 messages. /ac$ meeting too( appro0imately 3-= minutes.

2n sum, our sessions totalled - 6 $ours.



45/71

Sec!i"n ? - Tes! P('n

G%"$p 9 Us'/i(i!+ Tes! P('n

G"'(s And Tes! O/@ec!i&es

>ur goal *or t$ese test *indings is simply to discoer i* our *indings in t$e $euristics report ?ere

accurate and all-inclusie. 2n ot$er ?ords, ?e ?ant to (no? ?$et$er t$e issues ?e encountered

in our personal tests ?ere a problem only because o* somet$ing in our understanding or

bac(ground, or i* t$ere is a usability issue in t$e app t$at t$e majority o* users ?ill *ace ?$ile

naigating t$e *eatures o* t$e app. Speci*ically, our team is interested in *inding out $o? users

respond to t$e lac( o* a $elp *eature and $o? t$ey cope ?it$ t$is *act among ot$er t$ings too.

'eyond con*irming our preious *indings, ?e $ope t$at t$roug$ t$is test plan ?e can learn more

about t$e problems di**erent users ?ill $ae ?$ile using t$e Home Depot color application in

t$e end, ?e ?ill $ae a *irm understanding in t$e oerall usability o* t$e program.



46/71

5

Sc"pe "4 P%"@ec! N$./e% "4 Use%s Len*!) "4 Sessi"ns

)$e scope o* our project is on a smaller scale but ?e beliee it ?ill be $ig$ly e**ectie. )$roug$

t$e test ?e set up, ?e ?ill discoer i* t$e user encounters t$e same problems t$at ?e did during

our personal testings. )$ere ?ill be users total t$is is to ensure t$at ?e receie enoug$ data

to come to a complete and accurate conclusion. )$e lengt$ o* t$e sessions could ary slig$tly

*rom user to user simply because some mig$t $ae more di**iculty naigating t$e app more t$an

ot$ers. Ae estimate t$at it ?ill ta(e a user about minutes to complete t$e @uestionnaire. >ur

team decided to ma(e sure t$at ans?ering t$e @uestions ?ould not ta(e ery long so t$at ?e

?ould not $ae an issue conincing people to participate in our surey. Ae are con*ident t$at ?e

$ae set up tests t$at ?ill yield success*ul results.

P%"@ec! C"("% Use% P%"4i(e

)$e persona o* "o$n Doe ?as used to deelop t$e test plan and t$e user pro*ile. "o$n is

described as:

B + years oldB /ngagedB c$ildrenB &ull time employeeB 'ac$elor’s degreeB )ime is o* t$e essenceB 'usy balancing ?or( and planning a ?eddingB His *iancNe tas(ed $im ?it$ *inding colors *or bot$ t$e bedroom and liing roomB He is a *irst time $omeo?ner

'ased on t$e persona o* "o$n, ?e ?ill be conducting our testing on participants ?$o $old t$e

*ollo?ing c$aracteristics:

B


47/71

6

B /0perience: ust not $ae any prior e0perience ?it$ t$e Project Color applicationB 4sage: ust be *amiliar ?it$ a smart p$one and use one at least $ours per ?ee(


8re you male or *emaleM

A$at is your ageM


tec$nological pro*iciencyM

8re you currently renting or do you o?n propertyM

Do you o?n a smartp$one or tablet deiceM

2* yes, $o? many apps $ae you do?nloaded in t$e past mont$M

A$ic$ deice do you use most o*ten to access t$e 2nternetM

A$at type o* apps do you use most o*tenM

A$at ?ould you li(e to see in *uture appsM

A$at ?ould you li(e to c$ange about current appsM



48/71

7

T's,s Scen'%i"s

Ae ?ant to test our concerns listed in t$e $euristic ealuation. )$e most inclusie and

condensed series o* tas(s and scenarios ?ould be as *ollo?s:

M'in Scen'%i" 8# - P'in!in* Ind""%s C"("% Se'%c) Me!)"d - APPROXIMATE #-7 MINUTES

)as( Conte0t O Prere@uisites 42 &lo? 2ssues tested )as( Scenario

1 )a(e a

p$oto o* a

?all indoors.

4ser is proided a brie*

oerie? o* t$e app, its

purpose, and its*unctions.

1. Start app on

p$one’s menu

+. Select yes to

allo? access to

p$one’s camera

data

3. Select See 2t

. Select )a(e

P$oto

. 8im camera

and clic( t$e ?$itecircle to ta(e a

p$oto.

%o internali!ed

$elp screen


49/71

=

3 Paint t$e

desired area

8*ter selecting a color,

t$e user is broug$t to a

screen ?it$ no e0plicit

instructions on ?$at to

do. Ae e0pect $im$er to

ocali!e @uestions.

1. Clic( on t$e

bo0 containing t$e

desired color

+. )ouc$ t$e

screen to apply

color. Dra? to

paint, and tap to

*ill.

Painting around

?indo?s is

di**icult

%o indicator t$at

t$ere are t?o

dra?ing modes

"o$n tries to paint t$e

image t$e same ?ay

actors did in t$e

adertisement.

Kie? t$e

image in

alternatie

lig$ting

conditions

8*ter painting t$e image,

t$e user mig$t ?ant to

see t$e color in alternate

lig$ting conditions. )$is

is an optional step.

1. Clic( on t$e

/diting )ools

button.

+. Clic( on t$e

ne0t button to

access lig$ting

options

3. anipulate t$e

slider to see t$ree

lig$ting options

;edundancy in

menu options

"o$n considers $o? $is

rooms ?ould loo( ?it$

di**erent lig$ting

conditions. )$e ?alls

mig$t loo( di**erent at

nig$t or ?it$ di**erent

types o* lig$tbulbs. He

tests t$e *ilters aailable

to $im.

;epeat

steps +- as

desired.

)$is step tests t$e user’s

ability to retrace $is$er

steps and naigate t$e

application’s 42. 2* t$e

application’s 42 *lo? $as

problems, t$ey are li(ely

to be detected at t$is

stage.

See aboe

%ote: )$e bac(

button is eit$er 1F

a clic( on t$e

same icon t$at

opened t$e menu,

or +F a clic(

outside o* t$eactie menu, or 3F

a clic( at t$e top

le*t corner o* t$e

screen.

%ote: )$e user

may remoe paint

?it$ t$e /rase

tool or clear t$e

image ?it$ t$e

Clear 8ll tool. 2t

is also possible to

paint directly oer

ot$er colors.

%o uniersal

bac( button

2nconsistent icons

Clarity issues

"o$n doesn’t li(e t$e *irst

color $e c$ose, and

decides to loo( at a *e?

more to *ind t$e best

paint color.

5 Continue to

c$ec(out.

8*ter *inding a suitable

color, t$e user must

*igure out t$e name o*

1. Clic( on t$e

Done button

located in t$e

2nconsistent icons

Clarity issues

"o$n *inds a really good

paint color and ?ants to

buy it. 'e*ore driing to



50/71

t$e paint some$o?, or

buy it directly. )$ere is

no e0plicit 'uy button

in t$e main menu, so ?e

e0pect t$e user to

ocali!e @uestions.

topmost toolbar

+. Clic( on t$e

bo0 containing t$e

desired color to

actiate t$e lin(

*or purc$asing

3. Clic( on t$e lin(

*or purc$asing

Home Depot, $e

searc$es t$roug$ t$e

application to see i* $e

can buy *rom t$ere. 2t

?ould be best i* $e didn’t

$ae to spend a lot o*

time doing t$is.

M'in Scen'%i" 87 - P'in!in* O$!d""%s C"("% M'!c) Me!)"d

)as( Conte0t O Prere@uisites 42 &lo? 2ssues tested )as( Scenario

1 )a(e a

p$oto o* a

nearby

$ouse to

c$oose a

color *rom.

4ser is proided a brie*

oerie? o* t$e app, its

purpose, and its

*unctions.

1. Start app on

p$one’s menu

+. Select yes to

allo? access to

p$one’s camera

data

3. Clic( atc$ 2t

. Clic( )a(e

P$oto

. 8im camera

and clic( t$e ?$ite

circle to ta(e a

p$oto

%o internali!ed

$elp screen


51/71

1

p$oto o* a

?all

outdoors.

p$oto and saing a color,

t$e user needs to retrace

$is$er steps to access

t$e See 2t screen.

)a(ing t$e second p$oto

s$ould be easy once

inside t$e correct mode.

?$ile in t$e same

menu *rom be*ore

or *rom ot$er

menus

+. 8im camera

and clic( t$e ?$ite

circle to ta(e a

p$oto

bac( button

2nconsistent icons

Clarity issues

?ants to try. %e0t $e

needs to ta(e a picture o*

$is o?n ?all so $e can

apply t$e color to it.

Aal(ing bac(, $is p$one

goes into sleep mode, so

depending on $is p$one$e may $ae to restart

t$e application *rom t$e

main menu to ta(e t$e

second p$oto.

Paint t$e

?all in t$e

second

image ?it$

t$e *aorite

color

8*ter ta(ing a second

p$oto, t$e user is can

access $is$er color in

more t$an one ?ay. 2*

t$e user restarts t$e

application *rom t$e

main menu, $es$e ?ill

need to *ind t$e *aoritecolor in a separate menu

*rom t$e preloaded

s?atc$es.

)$e screen *or painting,

again, $as no e0plicit

instructions. )$e user

may not use bot$

dra?ing modes.

1. 2* t$e *aorite

color is aailable

at t$e bottom,

clic( on it. 2* t$e

*aorite color not

not aailable

t$ere, clic( t$e

enu icon, t$en&aorites. Clic(

on t$e color $ere

to ma(e it s$o?

up in t$e toolbar.

+. )ouc$ t$e

screen to apply

color. Dra? to

paint, and tap to

*ill.

&aorite colors

can be $ard to

locate

Painting around

?indo?s is

di**icult

%o indicator t$at

t$ere are t?o

dra?ing modes

8*ter ta(ing t$e p$oto o*

$is ?all, "o$n tries to

locate t$e color $e added

to &aorites earlier.

Kie? t$e

image in

alternatie

lig$ting

conditions

8*ter painting t$e image,

t$e user mig$t ?ant to

see t$e color in alternate

lig$ting conditions. )$is

is an optional step.

1. Clic( on t$e

/diting )ools

button.

+. Clic( on t$e

ne0t button to

access lig$ting

options

3. anipulate t$e

slider to see t$ree

lig$ting options

;edundancy in

menu options

"o$n considers $o? $is

?all ?ould loo( in

di**erent lig$ting

conditions. He tests t$e

*ilters aailable to $im.

5 ;epeatsteps 1- as

desired.

)$is step tests t$e user’sability to retrace $is$er

steps and naigate t$e

application’s 42. 2* t$e

application’s 42 *lo? $as

problems, t$ey are li(ely

to be detected at t$is

stage.

See aboe

%ote: )$e bac(

button is eit$er 1F

a clic( on t$e

same icon t$at

opened t$e menu,

or +F a clic(

outside o* t$e

%o uniersalbac( button

2nconsistent icons

Clarity issues

"o$n doesn’t li(e t$e *irstcolor $e c$ose, and

decides to capture some

more colors *rom ot$er

$ouses. He tries t$em

one by one, so oer time

$e $as a lot to remember.



52/71

+

actie menu, or 3F

a clic( at t$e top

le*t corner o* t$e

screen.

%ote: )$e user

may remoe paint

?it$ t$e /rase

tool or clear t$e

image ?it$ t$e

Clear 8ll tool. 2t

is also possible to

paint directly oer

ot$er colors.

6 Continue to

c$ec(out.

8*ter *inding a suitable

color, t$e user must

*igure out t$e name o*

t$e paint some$o?, or

buy it directly. )$ere is

no e0plicit 'uy button

in t$e main menu, so ?e

e0pect t$e user to

ocali!e @uestions.

1. Clic( on t$e

Done button

located in t$e

topmost toolbar

+. Clic( on t$e

bo0 containing t$e

desired color to

actiate t$e lin(

*or purc$asing

3. Clic( on t$e lin(

*or purc$asing

2nconsistent icons

Clarity issues

"o$n *inds a really good

paint color and ?ants to

buy it. 'e*ore driing to

Home Depot, $e

searc$es t$roug$ t$e

application to see i* $e

can buy *rom t$ere. 2t

?ould be best i* $e didn’t

$ae to spend a lot o*

time doing t$is.

P%e-!es! $es!i"nn'i%e

Ho? li(ely are you to consult an app *or $elp ?it$ at $ome projectsM

A$at are your e0pectations o* t$e app based on t$e name o* t$e app aloneM

Ho? o*ten do you see yoursel* using t$e app in eeryday li*eM

A$at $as been t$e most *rustrating part about apps in your past e0perienceM



53/71

3

A$at are your goals going into t$e purc$ase o* t$is app as a consumerM

A$at is t$e aerage amount o* time you spend using apps in an aerage ?ee(M

Do you typically naigate apps and ot$er online mediums ?it$out troubleM

Ho? li(ely are you to recommend an app to a *riendM

A$at ma(es an app success*ul based on your preious personal e0perienceM



Strongly

Disagree


+. 'ased on t$e tas(s you per*ormed using Home Depot’s Project Color, please rate $o?

use*ul you t$in( it ?ould be *or someone pic(ing out paint *or t$eir $ome:





54/71



/0tremely

Di**icult



4nder inutes 'et?een and

1 minutes.

'et?een 1 and

+ inutes

>er +

inutes.

Aas unable to

complete tas(.

5. )$e aspect 2 li(ed most about Home Depot’s Project Color ?as...

6. )$e aspect 2 disli(ed most about Home Depot’s Project Color ?as

)$e application did not ?or(.


1.

+.

3.

.



55/71

.




Strongly

Disagree

1

+

3

Strongly

8gree


Strongly

Disagree

1

+

3

Strongly

8gree




56/71

5

Strongly

Disagree

1

+

3

Strongly

8gree

. 2 t$in( 2 ?ould need t$e $elp o* a )ec$nical Support person or e0pert in order to use Home

Depot’s Project color e**ectiely.

Strongly

Disagree1

+

3

Strongly

8gree

. 2 t$oug$t t$at t$e arious *unctions in Home Depot’s Project Color ?ere ?ell-integrated Et$at

t$e *unctions and capabilities are coordinated ?ell-enoug$ to ma(e *unctional ?$oleF.

Strongly

Disagree

1

+

3

Strongly

8gree


Strongly

Disagree

1

+

3

Strongly

8gree



57/71

6

6. 2 t$in( aerage ne? users ?ould $ae no trouble learning to use Home Depot’s Project Color

@uic(ly and easily.

Strongly

Disagree

1

+

3

Strongly

8gree


Strongly

Disagree

1

+

3

Strongly

8gree

=. )$e user-inter*ace ?as ery intuitie and 2 *elt ery sure o* mysel* ?$ile using Home Depot’s

Project Color.

Strongly

Disagree

1

+

3

Strongly

8gree



Strongly

Disagree

Strongly

8gree



58/71

7

1 + 3

C"nsen! 'nd Re(e'se F"%.

Ait$out e0pectation o* compensation or ot$er reparation, no? or in t$e *uture, 2 $ereby gie my

consent to /%C +3 Group 3, to conduct image and li(eness andor any interie? statements

*rom me in its publications, adertising or ot$er media actiities Eincluding t$e 2nternetF. )$is

consent includes, but is not limited to:

EaF Permission to interie?, *ilm, p$otograp$, tape, or ot$er?ise ma(e a ideo

reproduction o* me andor record my oice

EbF Permission to use my name

EcF Permission to use @uotes *rom t$e interie?EsF Eor e0cerpts o* suc$ @uotesF, t$e *ilm,

p$otograp$EsF, tapeEsF or reproductionEsF o* me, andor recording o* my oice, in part or in

?$ole, in its publications, in ne?spapers, maga!ines and ot$er print media, on teleision, radio

and electronic media Eincluding t$e 2nternetF, in t$eatrical media andor in mailings *or

educational and a?areness.

'y signing t$is *orm 2 am giing up any rig$ts to t$e ideo recording andor publications and

understand t$at t$ey may be used *or purposes listed on t$is release *orm. y signature is also

ac(no?ledging t$at 2 $ae completely read and *ully understand t$e aboe release and agree to

be bound.



59/71

=

&ull Printed %ame:

Street 8ddress:

CityStateQip Code:

P$one %umber:

/mail 8ddress:

Signature: Date:

P%"@ec! Ti.e(ine

)as( Date Completed



60/71

5

Complete &inal Project )est Plan 1171

F"%.'( C"n4e%ence

&ind olunteers ?$o pass pre-test

screening. a(e plans to test ?it$ t$em.

1+51

F"%.'( C"n4e%ence

8dminister Proctor )ests and produce t$e

*ollo?ing delierables:

Consent and ;elease &ormScreening @uestionnairePre-test @uestionnairePost-tas( @uestionnairePost-test @uestionnaire

8udio o* olunteer’s t$in(-aloud process

11151

F"%.'( C"n4e%ence

F"%.'( C"n4e%ence

Complete all sections o* *irst dra*t o* &inal

Project ;eport

11+31

F"%.'( C"n4e%ence

Compile *irst dra*t o* &inal Project ;eport

1131

Complete *irst dra*t o* Presentation o*

4sability )est ;esults

1131

F"%.'( C"n4e%ence 11+61

Complete *inal dra*t o* &inal Project )est

;eport

1+1

F"%.'( C"n4e%ence 1+1

Complete *inal dra*t o* Presentation o*4sability )est ;esults

1+1

Submit &inal Project )est ;eport

Submit Presentation o* 4sability )est ;esults

1+51



61/71

51

Resp"nsi/i(i!ies "4 Te'. Me./e%s C)ec,(is!

%ame ;esponsibility Due Date C$ec(list

Cassidy Craig Proctor t$e test *or one olunteer.

Delierables are as *ollo?s:

Consent and ;elease &ormScreening @uestionnairePre-test @uestionnairePost-tas( @uestionnairePost-test @uestionnaire


11151

Contribute report elements to t$e &inal

Project )est ;eport. )$is member’s report

elements are as *ollo?s:

Coer Description o* test plan and procedures;ecommendations *or s$ort-term and long-

term improementsPrepare all Screening 9uestionnaires *or

8ppendices

11+31

Submit &inal Project )est ;eport 1+51

Sabrina D’ali-

endo!a

Prepare *irst dra*t o* Presentation o*

4sability )est ;esults.


62/71

5+

"essica #layman Proctor t$e test *or one olunteer.


Consent and ;elease &ormScreening @uestionnaire

Pre-test @uestionnairePost-tas( @uestionnairePost-test @uestionnaire


11151




)able o* ContentsDescription o* scenariosPrepare Heuristic /aluation *or

8ppendicesPrepare oderator Script *or 8ppendi0es

11+31

Sere as Copy /ditor *or Po?erPoint

Presentation

11+31 -

1+1

"onat$an %eal Proctor t$e test *or one olunteer.





11151




/0ecutie summary)op *indings ?it$ e0amples and seerity

codesPrepare Personas *or 8ppendicesPrepare


63/71

53

&rancis Salatino Proctor t$e test *or one olunteer.





11151




2ntroduction 8nalysis *rom t$e post-tas( and post-test

@uestionnairesPrepare )est Plan *or 8ppendicesPrepare miscellaneous test session

material *or 8ppendices

11+31

Sere as Copy /ditor *or &inal Project )est

;eport

11+1 -

1+11

P('n 4"% Rec"%din* 'nd Up("'din* !)e Tes!

Ait$ t$e a**ordability o* Smartp$ones t$ey are no? ubi@uitous. /en t$e most basic

Smartp$ones are no? being manu*actured ?it$ cameras capable o* recording ideo and audio.

2n lieu o* going out and purc$asing e0pensie standalone recording e@uipment, ?e reasoned

t$at t$e most a**ordable option *or recording t$e testing process.

Since t$e test ?ill encourage t$e users to t$in( out loud t$e erbal reactions are just as

important as p$ysical ones. )$ere are a number o* audio editing programs, ?it$ one o* t$e more



64/71

5

popular ones being 8udacity. 8udacity is a *ree-source audio editing program t$at ?e can use

to adjust t$e olume o* t$e audio and reduce noise to optimise t$e clarity o* t$e user’s erbal

reactions ?$ile using Project Color.

Sec!i"n - Misce(('ne"$s


Ho? li(ely are you to consult an app *or $elp ?it$ at $ome projectsM :hone ne2er' computer

often.

A$at are your e0pectations o* t$e app based on t$e name o* t$e app aloneM =elps me pick a

paint color from =ome Depot .

Ho? o*ten do you see yoursel* using t$e app in eeryday li*eM 1 few times a ear.



65/71

5

A$at $as been t$e most *rustrating part about apps in your past e0perienceM &nput is difficult on

a phone. No standard. %mall screen.

A$at are your goals going into t$e purc$ase o* t$is app as a consumerM /he app has to !e

free. &ts a wa for =ome Depot to sell me something.

A$at is t$e aerage amount o* time you spend using apps in an aerage ?ee(M 1ppro(. hour

per week. 3ould use it more if it functioned !etter.

Do you typically naigate apps and ot$er online mediums ?it$out troubleM /akes a while to

learn at first' then no pro!lem.

Ho? li(ely are you to recommend an app to a *riendM Aer likel if its good' not likel if !ad .

A$at ma(es an app success*ul based on your preious personal e0perienceM &t works. Doesnt

crash.






EaF Permission to interie?, *ilm, p$otograp$, tape, or ot$er?ise ma(e a ideo

reproduction o* me andor record my oice

EbF Permission to use my name

EcF Permission to use @uotes *rom t$e interie?EsF Eor e0cerpts o* suc$ @uotesF, t$e *ilm,

p$otograp$EsF, tapeEsF or reproductionEsF o* me, andor recording o* my oice, in part or in

?$ole, in its publications, in ne?spapers, maga!ines and ot$er print media, on teleision, radio



66/71

55

and electronic media Eincluding t$e 2nternetF, in t$eatrical media andor in mailings *or

educational and a?areness.

'y signing t$is *orm 2 am giing up any rig$ts to t$e ideo recording andor publications and

understand t$at t$ey may be used *or purposes listed on t$is release *orm. y signature is also

ac(no?ledging t$at 2 $ae completely read and *ully understand t$e aboe release and agree to

be bound.

Street 8ddress: 111 Aestern Aay CityStateQip Code: >rlando, &< 3+7

P$one %umber: 6-+6-163+ /mail 8ddress: andy?or(Rgmail.com

/lectronic Signature: 8ndy %eal Date: 11111


Ho? li(ely are you to consult an app *or $elp ?it$ at $ome projectsM ikel on phone.

A$at are your e0pectations o* t$e app based on t$e name o* t$e app aloneM &t will help me

choose a color.

Ho? o*ten do you see yoursel* using t$e app in eeryday li*eM Once or twice a ear.

A$at $as been t$e most *rustrating part about apps in your past e0perienceM Difficult to

na2igate.

A$at are your goals going into t$e purc$ase o* t$is app as a consumerM )uick and eas color

selection.

A$at is t$e aerage amount o* time you spend using apps in an aerage ?ee(M 6?7 hours per

week.

Do you typically naigate apps and ot$er online mediums ?it$out troubleM Yes.

Ho? li(ely are you to recommend an app to a *riendM ikel' if it works well.

A$at ma(es an app success*ul based on your preious personal e0perienceM Eas to use'

simple design that works well.



67/71

56






EaF Permission to interie?, *ilm, p$oto

Documents

Usability Test Report for Home Depot Project Color