How to

test your mobile sitewithout spending a fortune

Barry Briggs Umbraco UK Festival30th October 2015

#umbUKfest

This presentation contains

D.I.Y.

Warning:

#umbUKfest

@quiffboy

#umbUKfest

@quiffboy #umbUKfest

@quiffboy #umbUKfest

@quiffboy #umbUKfest

@quiffboy #umbUKfest

technology

design

research & strategy

ux are here

@quiffboy #umbUKfest

Northern User Experience Manchester ~ Leeds ~ Newcastle ~ Liverpool

nuxuk.org ~ @nuxuk

So, usability testing…

@quiffboy #umbUKfest

@quiffboy #umbUKfest

@quiffboy #umbUKfest

Many organisations are scared of testing

Bold unsubstantiated statement:

@quiffboy #umbUKfest

Why?1. Money2. Time (which also = money)

Econsultancy User Experience Survey 2013

@quiffboy #umbUKfest

Perceived pain points1. Hardware2. Software3. Recruitment4. Reporting

@quiffboy #umbUKfest

Addressing those pain points…

@quiffboy #umbUKfest

@quiffboy #umbUKfest

Silverback• De facto app for desktop

usability testing on a Mac• Simple and powerful UI • Affordable (v2 is now free!)• v3 due soon (again)

@quiffboy #umbUKfest

@quiffboy #umbUKfest

typical desktop usability testing output@quiffboy #umbUKfest

What about PCs?

That’s Macs sorted.

@quiffboy #umbUKfest

@quiffboy #umbUKfest

90percentofeverything.com/2009/01/26/cheap-and-free-alternatives-to-morae-usability-testing-software/

No relation

camtasia.com ~ @camtasia@quiffboy #umbUKfest

ovosolo.com ~ @ovostudios@quiffboy #umbUKfest

ovosolo.com ~ @ovostudios@quiffboy #umbUKfest

Last updated April 2013

@quiffboy #umbUKfest

They live!!

We’ve got affordable desktop testing nailed

Over-simplified but still truthful statement:

@quiffboy #umbUKfest

ˊ ` ` ` ` ` ` ` ` ` ` ` ` ` ` `'F'¯'''''L ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` `'[``…'¾`` ``` ``` ``` ``` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` `'[```…ʹ[` ` ` ` ``` ``` ``` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` `#````ˆ[```` ``` ``` ``` ``` ` ` ` ` ` ` ` ` ` ` ` ` ` `'#``…``'[`… ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` ` #…`````'F`` ` ` ` `` ``` ``` ` ` ` ` ` ` ` ` ` ` ` ` ` ƒ¯```````'[__` ` ` ` ` ` ` ``` ``` ` ` ` ` ` ` ` ` ` ` ` ƒ¯````````ʹ¯¯¯¯''''''''''''¯¯¯¯¯¯™[ ` gµµµµµµµµµµµµµµ_µ™`````````````````````````'# ` '₫₫₫₫₫₫₫₫₫₫₫₫₫F¯…`````````````````````` ` ²q[¯ ` `ʹ₫₫₫₫₫₫₫₫₫₫₫₫¾````````````````````````````ʹ} … `›₫₫₫₫₫₫₫₫₫₫₫₫#`````````````````````````__µr… ` `³₫₫₫₫₫₫₫₫₫₫₫₫₫…`````````````````````````¯[ … ` ``₫₫₫₫₫₫₫₫₫₫₫₫$``````````````````````````_F … ` ``]₫₫₫₫₫₫₫₫₫₫₫#````````````````````````ʹ''''[… … ` ``'₫₫₫₫₫₫₫F''''']₫#___`````````````````````` '# … ` ` …₫₫₫₫₫₫₫bµ₫₫₫₫$¯''''¹uuuuuɷuɷuɷuɷuɷuɷµ#¯ ` ` ` ` `…'''''''™''''™'''™''''™™ … … ` ` ` ` ` ` ` ` ` ` ` ` … … ` ` ` ` … ` ` ` ` ` ` ` ` … ` … ` ` ` ` ` ` ` ` ` ` ` … ` ` ` ` `.

@quiffboy #umbUKfest

People think testing on mobile is harder

than desktop

Another bold unsubstantiated statement:

@quiffboy #umbUKfest

@quiffboy #umbUKfest

petbucket.com/blog/61984/scaredy-cat-how-to-handle-a-frightened-feline.html

Scaredy-Cat Excuse #1

Requires expensive & specialist hardware

@quiffboy #umbUKfest

This is the

D.I.Y.bit

Warning:

@quiffboy #umbUKfest

Hi Ali!

@quiffboy #umbUKfest

tinyurl.com/oxqbxsd@quiffboy #umbUKfest

This bit

Not this bit

@quiffboy #umbUKfest

tinyurl.com/lpv2cvc@quiffboy #umbUKfest

This bit

Not these bitsNot these bits

@quiffboy #umbUKfest

tinyurl.com/ks6xsyj@quiffboy #umbUKfest

tinyurl.com/o6vqgzt@quiffboy #umbUKfest

tinyurl.com/qbsxpjp@quiffboy #umbUKfest

@quiffboy #umbUKfest

@quiffboy #umbUKfest

@quiffboy #umbUKfest

Sticky padExtreme D.I.Y.

@quiffboy #umbUKfest

Flush = stable

#umbUKfest@quiffboy

About £55 *

* device not included@quiffboy #umbUKfest

The D.I.Y. bit is over now

And relax…

@quiffboy #umbUKfest

Scaredy-Cat Excuse #2

Specialist software is expensive

@quiffboy #umbUKfest

airsquirrels.com ~ @reflectorapp@quiffboy #umbUKfest

mobizen.com ~ @mobizenglobal@quiffboy #umbUKfest

obsproject.com ~ @obsproject@quiffboy #umbUKfest

@quiffboy #umbUKfest

@quiffboy #umbUKfest

@quiffboy #umbUKfest

About £10 *

* unless you want a vimeo pro account@quiffboy #umbUKfest

vimeo.com/pro ~ £159 per year@quiffboy #umbUKfest

>ruby  -­‐e  "$(curl  -­‐fsSL  https://raw.githubusercontent.com/Homebrew/install/master/install)"  

>brew  install  ffmpeg  

>ffmpeg  -­‐i  source.flv  new.mp4

thanks to @coldclimate & @whitingx@quiffboy #umbUKfest

Scaredy-Cat Excuse #3

Recruiting participants is complicated & expensive

@quiffboy #umbUKfest

tinyurl.com/a9ldz7d

5 users ≈ 85% problems

@quiffboy #umbUKfest

tinyurl.com/mhr8emm

Caveats, caveats, caveatsSummary: The answer is 5, except when it's not. Most arguments for using more test participants are wrong, but some tests should be bigger and some smaller.

@quiffboy #umbUKfest

“Testing with one person is 100% better than testing with none”

steve krug ~ “rocket surgery made easy” ~ tinyurl.com/oufm9ao

@quiffboy #umbUKfest

@quiffboy #umbUKfest

gds.blog.gov.uk/2012/10/05/testing-gov-uk-with-real-users/

@quiffboy #umbUKfest

This is not how people use your products

@quiffboy #umbUKfest

Contentious but accurate statement:

.com

@quiffboy #umbUKfest

Hello Bev!

@quiffboy #umbUKfest

£15 for15 minutes!!

HOW IT WORKS:We ask you to carry out a couple of simple tasks using a new website, and we learn if we've designed it correctly. It will take no more than 15 minutes of your time and as a thank you we'll give you £15 cash.

WHEN:Monday 17th November // Time slots available 12-1.30pm and 2.30-4pm

WHERE:Amaze, 1st Floor, Royal Liver Building

We're looking for a few people to help us test a new website.

INTERESTED?Participants must be female and use a smartphone to browse the internet.Email b.briggs@amaze.com with your current make of smartphone, and preferred testing slot.

@quiffboy #umbUKfest

@quiffboy #umbUKfest

businessupperhand.com/how-to-open-a-coffee-shop/

5 x £15 *

* or 5 cups of coffee, if you’re on a really tight budget@quiffboy #umbUKfest

Scaredy-Cat Excuse #4

Writing the test report takes ages

@quiffboy #umbUKfest

1) Make it a one-pager

@quiffboy #umbUKfest

2) Bullet-point list, not reams of copy

@quiffboy #umbUKfest

3) Structure the report by task/user journey

@quiffboy #umbUKfest

4) Make your findings actionable

@quiffboy #umbUKfest

5) Do highlight when a test passes…

@quiffboy #umbUKfest

6) …but focus on the things you can fix

@quiffboy #umbUKfest

@quiffboy #umbUKfest

1 day to write *

* or less if you make notes between test sessions@quiffboy #umbUKfest

Up-front costHardware ≈ £55 (one-off cost)

Software ≈ £10 (one-off cost)

Recurring costRecruitment ≈ £75 (per round of testing)

≈ £140 for one round of testing

@quiffboy #umbUKfest

What’s your hourly rate?

And how long have you spent debating the cost of running tests?

@quiffboy #umbUKfest

“But you should probably read more”

Anyone Can Usability Test, Part 1: On a Shoestring Chris Atherton

How Many Test Users in a Usability Study? Jakob Nielson

The Art of Guerrilla Usability Testing UX Booth

New to Usability Testing? You’re not alone!Jennifer Aldrich

User Experience Survey 2013 Econsultancy & WhatUsersDo

UX Challenge: how to choose the right approach to user research WhatUsersDo & Ian Franklin

“Don’t make me think” & “Rocket Surgery Made Easy” and more…Steve Krug

@quiffboy #umbUKfest

Thanks! ☺

@quiffboy#umbUKfest