How to Continuously Ensure Mobile App Quality

Joint Webinar February 11, 2014

Agenda & Hosts

Agenda •  Introduction: testCloud & Crittercism •  The hidden cost of software testing •  Build better apps faster •  Case study: How a high-performing

app uses our joint solution •  Live demonstration

2

Hosts •  Thomas Grüderich

Co-Founder and Chief Sales Officer testCloud

•  Lars Kamp VP of Business Development Crittercism

Introduction: testCloud & Crittercism

3

Mobile application performance management

On-demand software

testing services

Why testCloud?

Incentivized Testers Guarantee superior test

quality

Real Conditions Real people test on their

devices

Free Developers From testing

Target Audience Test your app with the

right audience

On-demand Fast and always available

testing services

Happy Customers Through better, bug-free

products

Advantages of the Crowd

App Websites Software

Tester Tester

Tester

How testCloud works

Tester

Tester Tester

Tester

Functional Testing

Usability Testing Test

Cases

Security Testing

4

Why Crittercism?

Advantages of Mobile APM

Improved Efficiency Faster troubleshooting for

IT teams

Full Stack Cloud, network, device,

OS, app, user

Business Critical Developers, IT, product

managers, line of business

Mobile-First Built from the ground up

for mobile

Optimize Performance Faster, better, smarter

mobile apps

Happy Customers Higher retention, ratings,

revenue

How Crittercism works

SDK

SDK

SDK

SDK SDK

5

You are in good company with us…

6

Software testing is a massive hidden cost – if neglected

Source: NIST (National Institute of Standards and Technology‘s, part of the U.S. Department of Commerce)

in the US could be saved from improved testing $25 billion

~ 302,450 full time employees engaged in testing and debugging activities.

~ $85,430 application software engineer median wage

~ $92,430 systems software engineer median wage

of engineers’ time is spent on debugging 35%

That results in…

$25,838,303,500 spent on debugging

7

Leverage our joint expertise and build better apps faster

Build apps

Launch better, faster apps

and never worry…

about testing again…

“Mobile application performance management”

“On-demand software testing services”

+

8

Joint Value Proposition & Case Study

How to use our platforms together

10

Reproduce bugs found in Crittercism by creating new

tests in testCloud

Deploy releases to testCloud testers & ensure bugs are fixed

in Crittercism

Crittercism to testCloud testCloud to Crittercism

Constantly monitor your apps performance in real-time

Monitor and Report Diagnostics Drilldown

•  Real-time app performance stats

•  Take a global network perspective

•  Analyze app performance by user profile, behavior,

location or device…

•  Review device diagnostics

11

Easily discover or reproduce bugs through on-demand testing

Set up Test Execute Test

•  Testing environment

•  Test Type

•  Tester selection

•  Any device, browser or OS

Analyze Reported Bugs

•  Distribute your app to well-

qualified testers

•  Ranging from hobby testers to

QA professionals

•  Detailed real-time bug reports

•  Descriptions include

screenshots/videos

•  Seamless bug tracker integration

12

Introduction to KeepSafe

13

Challenge

Ensure that new features run smoothly throughout their entire user base, especially across various devices and OS-versions.

How does KeepSafe ensure mobile app quality?

14

User base

100%

10%

1%

+

Performance monitoring of sequential feature releases

Functional tests & test cases for new releases

Tester

Tester

Tester Tester

Tester

Q&A

Appendix: Product Demonstration

Monitor and report in Crittercism

17

Real-Time Monitoring Crash Reporting

Diagnostics drilldown

18

View Usage Breakdown Drilldown by Device, OS, App…

Setup test in testCloud

19

Set up New Test Define Devices

Review test results

20

View All Test Results Drill down into results

Detailed bug reports – structure by test type

21

Test Cases Functional Bug Review