TechnicalMobileTes.ngRisk,IssuesandExperiences

AlanRichardson-@eviltesterEvilTester.com

Whatwelearnedwhenwetestedmobile

•  Decisionswemade•  Painwewentthrough•  Whatwedidaboutit

WhatIlikeabouttes@ngmobile

@eviltester

Whatishardaboutmobiletes@ng

•  Ergonomics•  Observing•  Repor.ng•  Manipula.on

PhoneExperience

@eviltester

Findworkarounds

@eviltester

PayaEen@ontopaintoimproveprocess

•  Gainsomeexperience•  PayaBen.ontopain•  Resolvepaintoimproveprocess•  StatusQuo!=Dishwasher

Workaroundsaddrisk

•  Adoptworkaround,andmi.gatetherisk•  Communicatetherisk•  Acceptrisksthroughknowledgenotfear(wherepossible)

@eviltester

Somerisksmustbeaccepted

EveryoneshouldhavetheopportunitytoaspiretoRockGodhood

@eviltester

MobileTechnicalandRiskBasedTes@ng

•  OurtestapproachesareoNenbuiltaroundfearmi.ga.on–  Lotsandlotsofdevices–  Becausewedon’tbuildfordevicecompa.bility– Wecaveatforasubsetofdevices

Na@veandWeb

•  Whichisworseforcompa.bility?

TestLikeNormalUsers?

•  DefaultBrowser?Dolphin,Chrome•  LastPassPasswordManager•  Auto-Comple.onOff•  Alterna.veKeyboards–hacker’sKeyboard

Automa@ng?

•  Automa.ngmobileishard•  Strategicchoice

Automa@ngTac@cally

•  Screenshotsfordifferentscreensizes•  Serverbasedresponsesfrommobiledeviceheaders•  Notautomatedondevice•  TargetTechnicalRiskTac.cally

Thechallengeofobservability

•  Ihatetes.ngblind•  WebTes.ngmoreobservable?•  ProxiesandSniffers

ProxyToolsfoundPreloadcachingissue

•  JavaScriptlibraryforpre-loadcaching•  Observingtrafficthroughproxysawmul.pleloading

WifiHoopsandRoundabouts

•  EnvironmentalSecurity•  Tes.ngonwi-fi•  LaptopHotspots•  Wiresharkforna.veviawi-fihotspot

ProxyBenefits

•  Isolatedevicefromserver•  FeedinnewJSandCSSpriortorelease•  Triggererrorsitua.onsondevicewithoutmessingwithserver

•  Mul.plescenariosconfiguredbydatafedtodevicebyproxy

Ergonomics

paulbishopbooks.com/2013_01_27_archive.html

Myhandshavenotevolvedtouseamobilephone

CheapErgonomicSolu@ons

•  Tabletstands•  Stylus•  Keyboards•  Risk?–  Fearmi.ga.on,usephonetoo–  EventhoughthisisbuiltinOSfunc.onality

Phonesmakethemselveshardtotest

•  Simcardneededtoconnecttowi-fi

•  Enterthe‘porta£1simcardcollec.on’™

Repor@ng

•  Informa.onistrappedonthemobiledevice•  Getinfooffmobileandontodesktop

Oldendaysinefficiency

Usephonetotakephotoofscreenshotofotherphoneforuploadingtodesktopforbugrepor.ng

Screenshotsfromphonetodesktop

•  AirPlay•  VNC•  Evernote•  Dropbox•  Email•  Eachtooladdsrisk?

EmulatorsandSimulators

•  WhentouseEmulators?•  RiskofBrowserDevToolsformobileweb?

Non-TechnicalRisks

•  Phonesgowalking•  Startwithsecurelibrarysystem•  Endupwithcardboardboxfilledwithdevices

LessonsLearned

•  Don’tbringinyourownkit•  Neverlendyourkit•  Buy2ndhand/refurbishedkit

Therightkitisimportant

•  Douserschargetheirphoneswhenusingthem?•  Randomcharsonoldandroid

Listofhowtotestoneachdevice

•  Eachdeviceisdifferent•  Listthe‘shortcuts’andlessonslearned–  Howtotakeascreenshot– Whattoolstouse

FutureisgeTngbeEer

•  AirPlay•  Chromecast•  Miracast•  Remotedebug•  Biggerphones

RiskManagement

•  Iden.fy•  Mi.gate•  Accept•  Communicate

FinalNotes

•  Tes.ngondeviceisarisk•  Iden.fyTechnicalRisk–  Targettoreduceplakormtes.ngscope

•  Ifwewerereallyserious…

AlanRichardson@EvilTester

www.JavaForTesters.comwww.SeleniumSimplified.comwww.EvilTester.comwww.CompendiumDev.co.uk