SOASTA Webinar: Process Compression For Mobile App Dev 120612

1Webinar

Presents

Continuous Integration and Automation for Mobile Development & Test

2

Where to automate for rapid mobile dev and test

TODAY’S PRESENTERS

• Dave Meyer: Product Marketing Manager, Atlassian - @d_meyer• Sanjay Zalavadia: Director of Professional Services, Zephyr - @ZalinCal• Brad Johnson: VP Product & Channel Marketing, SOASTA - @bradjohnsonsv

Leading Innovators in Software Development!

- Helping teams build amazing software

- Delivering real-time test management

- The leader in mobile and cloud testing

Aligned with a Common Goal

High Speed Software Delivery

3

o Introductiono Poll Questiono Continuous Integration and Bamboo for Mobileo Test Management and the CI processo Automation for continuous mobile testing

Questions: - Please submit via Chat during event

4

o Shear Number of Devices (953M Smartphones)

o Different Operating Systems

o Scale of Global Customers (6B)

o Dynamic Content (Video, Animation)

o Rapid development driven by demand

Manual Processes Can Not Keep Up

5

Fingers and Eyeballs VS.Pace and Scale of Mobile

Development

6

SDLC tasks are a constant. Pace Isn’t

7

The Mobile Need is Elementary> More Progress in Less Time <

8

99

We help plan, build, and launch great software

Team Collaboration

Track projects, events, & people Group Chat

Track, Plan, Analyze

Agile project tracking Exploratory Testing

...and more!

• 23,000 customers in over 130 countries

• Offices in Sydney, San Francisco & Amsterdam

• A “leader” in ALM according to Gartner

10

Dave Meyer

@d_meyer@d_meyer

Why does Continuous Integration matter?

Find bugs faster

Make merging suck less

Faster feedback loops

Less lag time

x 2 for Mobile

If you’re going to fail, fail fast!

#atlassian

Principles of CI

oOne (1) repo

o Automate your builds!

o Builds all the time!

o Automate your tests!

oDeploy, deliver, distribute, deploy, deliver ....

14

What does a CI tool do?

Clone repo Build Unit Tests Deploy to QAUI TestsIntegration TestsAPI TestsPerformance/Load Tests

Deploy to Production

Smoke tests

15

Plan

16

Plan

Stage StageStage

17

Plan

Stage StageStage

Job

Job

Job

JobJob

18

Task

Task

Task

Task

Task

Task

Task

Task

Task

Plan

Stage StageStage

Job

Job

Job

JobJob

19

• Checkout from Source Control

• SVN, Git, Hg, Perforce, CVS

• Build Engine

• Ant, Maven, MSBuilder, Rake, Grails, Ivy

• Analysis & Reports

• code coverage, static analysis, performance

• Deployment

• Tomcat, Heroku, Deploy It, LiveRebel, Artifactory, SCP, Script

Tasks run sequentially inside their container: a Job

20

Task

Task

Task

Task

Task

Task

Task

Task

Task

Plan

Stage StageStage

Job

Job

Job

JobJob

21

JobsJobs

Jobs run in parallel inside their container: a Stage

• Group dependent Tasks together inside a Job to ensure order of execution• “Build & Package” Job = SCM Checkout Task + Checkstyle Task + Ant

Task

• Place independent Tasks in their own Jobs to tighten the feedback loop• “Integration Tests” Job = Maven Task

• “UI Tests” Job = Maven Task

• These two Jobs can run in any order, or simultaneousl

22

Task

Task

Task

Task

Task

Task

Task

Task

Task

Plan

Stage StageStage

Job

Job

Job

JobJob

23

PlansPlans

• Represents the complete set of actions taken with each build• Variety of triggers:

• Change in SCM

• Cron

• Manual (push-button)

• Parent Plans

• Global elements you can fine-tune at the Plan level:• Variables

• Repositories

• Notifications

• Permissions

• Build Expiry

24

Up your Mobile Dev speed

1. Start failing faster

25



2. Don’t build alone

26




3. Atlassian <3 mobile devs

27





Blog: http://atlss.in/mobileCI

28






29






30

Company overview

profileo Founded in 2007o 900+ global customerso Atlassian Integration Partnero Headquartered in Silicon Valley, CA

CONTACT o Email: [email protected] o Office: (510) 400-8656o Home: getzephyr.com

31

Sanjay Zalavadia

@ZalinCal@ZalinCal

Challenges with Mobile App testing

Transitional testing team•Seasonal testers•Globally distributed teams

Huge testing footprint•Wide variety of platforms, devices, OS, languages, browser versions, MODS, carriers•Dealing with multiple marketplaces / ecosystems / product catalogs•Can’t write and manually execute separate tests

Keeping track of what’s going on …•Hard to know where you are in your testing•Constant updates needed for the Business, Executives, PMs, etc.

Consequences if left unaddressed

Lack of organized, re-useable systems:•Missed Deadlines•App certification process - rejection•Re-inventing the wheel

Lack of Coverage•Quality issues•Low ratings, Poor reviews

Lack of visibility•Lose track of where you are in your testing•QA = black hole

Get organized

•3

Centralize your test assets•Single test repository•Accessible and useable globally•Manual, automation and performance

Achieve test completion with Quality

Automate•Build time verification•Utilize the cloud

Performance testing•Not optional

Maintain Consistency

Provide complete Visibility

Accessibility to entire Project Team

Metrics Availability 24 x 7

Real-time updates


•5



Real-time updates




Real-time updates




Real-time updates

40

o First End-to-End Mobile App Test Platform

• First Cloud-Based Load Testing Solution

• First Global Test Cloud (17 Countries, 100 Cities)

• First Mobile Test Automation “Platform”

• First real time RUM for web and mobile

o Over 350 Global Corporate Customers

• 10,000 Mobile Developers and Testers use CloudTest

• Over 1,000 Mobile and Web Apps are Tested with CloudTest

o Award Winning & Patented Technology

• Named by Wall Street Journal Top 50 Hottest Companies three years running

• Gartner Visionary Leader

o Over 100+ Employees US, EMEA

41

Brad Johnson

@bradjohnsonsv@bradjohnsonsv

42

Functional Test Automation

Real User Monitoring

Performance & Load Testing

Development & Build

Application

Application Development Lifecycle

43

Application Development Lifecycle

Application

TouchTest

CloudTestmPulse

mobilev

Development & CI

44

45

Source Code Repository

Devs

Build Server

Check out

Test Results

Check in

Run Tests

Unit Tests

☐Pass

☐ Fail

✓

To QA or Users

46


Real Devices

Bamboo Build Server

Check out

Test Results

Check in

Push to devices

In parallel

Run Tests

Execute on devices

☐Pass

☐ Fail

✓

Bamboo Mac Agent

DevsToor

Beta Users

47


Devs

Real Devices

Bamboo Build Server

Check out

Test Results

Check in

Push to devices

In parallel

Run Tests

Execute on devices

☐Pass

☐ Fail

✓

Bamboo Mac Agent

Toor

Beta Users

48


Devs

Real Devices

Bamboo Build Server

Check out

Test Results

Check in

Push to devices

In parallel

Run Tests

Execute on devices

☐Pass

☐ Fail

✓

Bamboo Mac Agent

Toor

Beta Users

49


Devs

Real Devices

Bamboo Build Server

Check out

Test Results

Check in

Push to devices

In parallel

Run Tests

Execute on devices

☐Pass

☐ Fail

✓

Bamboo Mac Agent

Toor

Beta Users

50


Devs

Real Devices

Bamboo Build Server

Check out

Test Results

Check in

Push to devices

In parallel

Run Tests

Execute on devices

☐Pass

☐ Fail

✓

Bamboo Mac Agent

Toor

Beta Users

51


Devs

Real Devices

Bamboo Build Server

Check out

Test Results

Check in

Push to devices

In parallel

Run Tests

Execute on devices

☐Pass

☐ Fail

✓

Bamboo Mac Agent

Toor

Beta Users

52


Devs

Real Devices

Bamboo Build Server

Check out

Test Results

Check in

Push to devices

In parallel

Run Tests

Execute on devices

☐Pass

☐ Fail

✓

Bamboo Mac Agent

Toor

Beta Users

53


Devs

Real Devices

Bamboo Build Server

Check out

Test Results

Check in

Push to devices

In parallel

Run Tests

Execute on devices

☐Pass

☐ Fail

✓

Bamboo Mac Agent

Toor

Beta Users

54


Devs

Real Devices

Bamboo Build Server

Check out

Test Results

Check in

Push to devicesIn parallel

Run Tests

Execute on devices

☐Pass

☐ Fail

✓

Bamboo Mac Agent

Toor

Beta Users

55


Devs

Real Devices

Bamboo Build Server

Check out

Test Results

Check in

Push to devicesIn parallel

Run Tests

Execute on devices

☐Pass

☐ Fail

✓

Bamboo Mac Agent

Toor

Beta Users

56


Devs

Real Devices

Bamboo Build Server

Check out

Test Results

Check in

Push to devices

In parallel

Run Tests

Execute on devices

☐Pass

☐ Fail

✓

Bamboo Mac Agent

Toor

Beta Users

57

• No jailbreak required• No tethering required• iOS 5.0, 5.1, 6.0• iPhone 3GS, 4, 4S, and 5• iPad 1, 2, 3, 4• iPad mini• Simulators

• No “rooting” required• No tethering required• Android 2.3.3

(Gingerbread) and later• Phones, tablets, and

emulators

58

• Download CloudTest Lite (http://www.soasta.com)• Includes TouchTest technology

• Free for a single device• No expiration• Free support via CloudLink forums

59

It Doesn’t Matter Where You Start.JUST START!

60

Q&A

Contact SOASTA:

[email protected]

866.344.8766

Follow us:

twitter.com/cloudtesttwitter.com/cloudtest

facebook.com/cloudtestfacebook.com/cloudtest

Knowledge Center•White Papers•Webinar Recordings•Case Studies

CloudLink Community•Support•Tutorials•Video

RESOURCES

www.SOASTA.com www.Atlassian.comwww.GetZephyr.com

Products•Zephyr Enterprise•Zephyr Community•Zephyr for JIRA

Support Center•Knowledge Base•ZephyrTV•Community Forums