18
John Carpenter PEng, CTO www.mob4hire.com Sept 30, 2010 The Power Of The Crowd Mobile Testing for Scale and Global Coverage

The Power of the Crowd: Mobile Testing for Scale and Global Coverage

Embed Size (px)

DESCRIPTION

John Carpenter, CTO, Mob4Hire, illuminates the audience at Starwest with his look at how the crowd can perform scaling and global coverage miracles when it comes to the difficult but absolutely necessary of performing mobile user feedback studies BEFORE you launch your mobile app or website. www.mob4hire.com

Citation preview

Page 1: The Power of the Crowd: Mobile Testing for Scale and Global Coverage

John Carpenter PEng, CTO www.mob4hire.com

Sept 30, 2010

The Power Of The Crowd

Mobile Testing for Scale and Global Coverage

Page 2: The Power of the Crowd: Mobile Testing for Scale and Global Coverage

“5 out of 6 app developers will not break even”2

“[Only] one in 8 - will break even its programming costs in six

months of downloads” 2

“Trism has made $250,000 for its developer, Steve Demeter, in

just two month” 1

1. Wired Magazine.  http://www.wired.com/gadgetlab/2008/09/app-store-is-a/#ixzz0upLJqgzq

3. Telegraph UK. http://www.telegraph.co.uk/technology/apple/5163678/Apples-iPhone-is-a-developers-goldmine.html

2. Tomi Ahonen http://communities-dominate.blogs.com/brands/2010/03/paid-smartphone-apps-half-get-under-1000-downloads-what-does-this-mean.html

“Joel Comm, whose virtual flatulence app, iFart, was at one point earning him £5,000 every day” 3

Page 3: The Power of the Crowd: Mobile Testing for Scale and Global Coverage

Would you buy it?

Page 4: The Power of the Crowd: Mobile Testing for Scale and Global Coverage

Don’t Crash –

Do Your Unit Testing. White Box Testing.

Don’t Suck–

How do Users Respond to Your App?

Get Sticky–

User Feedback / Customer Loyalty Starts Here?

What Features Will Go In The Next Version

Page 5: The Power of the Crowd: Mobile Testing for Scale and Global Coverage

7 years ago developing a mobile application,

...to deploy on 3 carriers for around 3% of phones

took a team of 15, 6 months and cost ~$500,000

1. Engadget . http://www.engadget.com/2004/10/02/gps-cellphone-swordfish-game/

 [Blister] says that they are the first location based fishing game, which we're sure is true, since we're not even sure there is a market for one of these

things.1

Page 6: The Power of the Crowd: Mobile Testing for Scale and Global Coverage

Today,

...expectations are higher. Budgets are lower.

$30,000 and take less than 6 weeks..

1. Android Lib Stats. http://www.androlib.com/appstats.aspx

Page 7: The Power of the Crowd: Mobile Testing for Scale and Global Coverage

Today,User Feedback is Even More Important

..69% of users discovery apps through rankings, reviews and recommendation

Page 8: The Power of the Crowd: Mobile Testing for Scale and Global Coverage

The Crowd are Your Customers

The Crowd Are Amateurs

Page 9: The Power of the Crowd: Mobile Testing for Scale and Global Coverage

Focus

Language

Incentives

Rules

Tools

FLIRT model for planning open collaboration

Sami Viitamakiwww.samiviitamaki.com

Page 10: The Power of the Crowd: Mobile Testing for Scale and Global Coverage

Focus

Language

Incentives

Rules

Tools

Sami Viitamakiwww.samiviitamaki.com

What do you need done?

What results are you looking for? In what

format?

What is the objective of engaging the community?

Who is managing it?

Page 11: The Power of the Crowd: Mobile Testing for Scale and Global Coverage

Sami Viitamakiwww.samiviitamaki.com

Does the Tester Understand the Tasks?

Is There a Mutual Understanding and

Respect?

Focus

Language

Incentives

Rules

Tools

Page 12: The Power of the Crowd: Mobile Testing for Scale and Global Coverage

Sami Viitamakiwww.samiviitamaki.com

Is There a Reasonable Incentive to Complete The

Task?

Are There Reasonable Safe Guards Against Unknowns?

What Non-Monetary Value Can You Offer?

Focus

Language

Incentives

Rules

Tools

Page 13: The Power of the Crowd: Mobile Testing for Scale and Global Coverage

Sami Viitamakiwww.samiviitamaki.com

Are You Protecting Your IP? Copyright Issues?

What Is The Criteria For Completion?

What Constraints on Testing Are Needed?

Focus

Language

Incentives

Rules

Tools

Page 14: The Power of the Crowd: Mobile Testing for Scale and Global Coverage

Sami Viitamakiwww.samiviitamaki.com

Do You Have The Ability To Monitor The Work?

How Do You Correct Deficiencies?

How Do You Handle App Distribution?

Focus

Language

Incentives

Rules

Tools

Page 15: The Power of the Crowd: Mobile Testing for Scale and Global Coverage

Rule 1 Don’t Crowd Source Your Development

Page 16: The Power of the Crowd: Mobile Testing for Scale and Global Coverage

Rule 2 Don’t Internal Source Your Usability Testing

“Thankfully, the theory behind such poor scoring isn’t an inherent bug or an outright failure to work, but users’ annoyance at not being able to access

the app without stumping up the necessary £9.99-per-month premium

subscription.”. T3 UK

Page 17: The Power of the Crowd: Mobile Testing for Scale and Global Coverage

LIVEPROJECTS

http://www.mob4hire.com/the-mob/projects

1,700 developers registered in the Mob4Hire community