The Mobile Tester - Your place in the team with Stephen Janaway [Webinar]

© Stephen Janaway 2015

THE MOBILE TESTERYOUR PLACE ON THE TEAM


WHO AM I?STEPHEN JANAWAY

www.stephenjanaway.co.uk @stephenjanaway

www.testinginthepub.com @testinginthepub

http://www.stephenjanaway.co.uk

http://www.testinginthepub.com


TODAY

• Is This Even Important Anyway?

• Isn’t Mobile Testing Just Like Any Other Sort Of Testing?

• What I Think Is Different.

• What Makes a Great (Mobile) Tester.


WHY IS THIS IMPORTANT?


MAYBE YOU AREN’T THERE AT ALL…MOBILE PROJECTS OFTEN DON’T HAVE TESTERS


BUT SOON MOST OF YOU COULD BE MOBILE TESTERS




SUBSCRIPTIONS VS. PEOPL


A LOT IS THE SAMEUSE YOUR EXISTING SKILLS


SIMILARITIES• Functional testing. • Non-functional

testing. • Asking questions. • Discovering

information. • Communication. • Understanding and

exploring the software.


SO WHAT’S DIFFERENT?


DIFFERENCES• Projects are quick. • You can be closer to

design. • Usability matters. • You’re not sat at a

desk all day. • Hardware influences

software more.

Testers as customer advocates.


PROJECTS ARE QUICK• CONSIDER EXPLORATORY APPROACHES • CONSIDER CONTEXT • DON’T EXPECT REQUIREMENTS TO HAVE

ALL THE ANSWERS


GET CLOSER TO DESIGN• REVIEW WIREFRAMES • PAIR WITH UI DESIGNERS • UNDERSTAND THE UI LANGUAGE • USABILITY MATTERS


USABILITY MATTERSUsability is more important. • Smaller screen. • More difficult to interact

with and typically used one handed.

Focus on. • How easy is it to use

the application? Do user ‘just get it’?

• How is the look and feel?

• Does the application or device feel fast?


USABILITY MATTERS


GET OUT OF THE OFFICE• GO WHERE YOUR USERS ARE • BUSY AREAS • TRAINS • DEADSPOTS


USE THE LATEST DEVICES• UNDERSTAND THE MARKET • READ THE TECH BLOGS • IT’S CONSUMER ELECTRONICS!


MOBILE DEVICES ARE COMPLICATED

While your application runs, the phone is…..

• Talking to the network. • Working out where you

are. • Maybe receiving calls,

texts, Facebook and Twitter updates.

Complicated Test Scenarios


CUSTOMER ADVOCATES• UNDERSTAND YOUR USERS - THERE ARE

LOTS OF THEM • THEY ARE DIFFERENT • THEY LIVE IN DIFFERENT PLACES


HOW DO YOU BECOME A CUSTOMER ADVOCATE?

• User Persona’s. • User Profiling. • Industry Statistics. • Apps Store

Reviews. • Analytics. • Use Your Users.


WHAT MAKES A GREAT MOBILE TESTER?


TRAITS OF THE GREAT• Flexible. • Great understanding

of technology. • Employ exploratory

approaches. • Coach the team on

how to deliver good quality.

• Perhaps do less actual testing?

• Give great information in bug reports.


YOU UNDERSTAND YOUR TECH

• OS updates. • New devices. • Using SDKs,

Android, Xcode. • Build and deploy the

software. • Battery life. • OS specific

functionality.


YOU USE REAL HARDWARE• Can be dropped. • Can get wet. • Heats up!! • Shaking. • Tactile. • Things are

removable.



DIFFERENT OS’S


Source: https://developer.android.com/about/dashboards/index.html

ANDROID VERSIONS

https://developer.android.com/about/dashboards/index.html

https://developer.android.com/about/dashboards/index.html


IOS VERSIONS

Source: https://mixpanel.com

https://mixpanel.com/

https://mixpanel.com/


SCREEN SIZES


YOU CHOOSE CLEVERLYOpen Device Labs • Borrow devices,

normally for free.

• http://opendevicelab.com

• Open Device Labs = shared community pools of internet connected devices for testing purposes.

http://opendevicelab.com/

http://opendevicelab.com/


YOU USE AUTOMATIONOR YOU KNOW SOMEONE WHO DOES


YOU CAN TEST WEB SERVICESDON’T JUST TEST THE CLIENT


YOU UNDERSTAND WHY APPS GET REJECTED

More info needed

BugsUI Too Complicated

FraudulentName too similar

Place holder text

Inappropriate ratingsBeta/ demo


YOUR BUG REPORTS CONTAIN ALL THE RIGHT INFORMATION

Can I repeat the issue?

What steps are needed to reproduce the issue?

Is the issue repeatable on a fresh install of the application?

What data is available?

Which device and OS version was I using?

How was the device connected to a network (which mobile operator and/ or Wifi network)?

Where was I when I saw the issue

What other applications were running?

Do I have screen shots or a video of the issue?

Have I spoken with the developer?


YOU WORK MORE CLOSELY WITH YOUR USERSHARNESS THE CROWD



HARNESS THE CROWD• Usability testing. • Internal user

groups. • Beta test groups.


PERHAPS YOU ENGAGE USERS THROUGH APPS STORES


YOU MONITOR YOUR APPS IN LIVE• USAGE PATTERNS • CRASHES • LOAD • APP STORE RATINGS



SO…


SUMMARY - BUILD ON WHAT YOU KNOW

• Customer advocate: • Which platforms and devices will they use? • How will they use the app or website?

• Mobile tech obsessive: • Devices, OS versions, what’s being updated, what’s

new. • Test using simulators, real devices, web

services and users. • Understand the cost of automation. • Use an exploratory approach to manual testing:

• Mobile device projects are typically short.


EVERYONE IS RESPONSIBLE FOR QUALITYIF WE DON’T FORGET THAT THEN IT’LL BE OK


QUESTIONS

“Be proud, your work will soon be in the hands of millions”

A NOKIA PRODUCT MANAGER

Stephen Janaway

www.stephenjanaway.co.uk @stephenjanaway www.testinginthepub.com

http://www.testinginthepub.com

Software

The Mobile Tester - Your place in the team with Stephen Janaway [Webinar]