15
Pivotal Labs Toronto PIVOTAL LABS QUALITY ASSURANCE

Mobile Quality Assurance

Embed Size (px)

DESCRIPTION

An overview of how Pivotal Labs performs quality assurance on mobile. We have over 1300 mobile devices on all platforms - iOS, Android, Windows, BlackBerry and more. We perform automated and manual testing using various tools and methodologies to ensure a bug-free app for our clients.

Citation preview

Page 1: Mobile Quality Assurance

Pivotal Labs Toronto

PIVOTAL LABS QUALITY ASSURANCE

Page 2: Mobile Quality Assurance

PLATFORM COVERAGE

Page 3: Mobile Quality Assurance

OUR TEAM AND APPROACH

DEVELOPMENT START

PROJECT MANAGEMENT FOR QA PLANNING

QA INTEGRATED CYCLES

FEW WEEKS BEFORE PROJECT ENDS

BUILD

FIX QA

RC

DEVELOPMENT END

BUILD

FIX QA

Page 4: Mobile Quality Assurance

PIVOTAL LABS THE QA PROCESS

Page 5: Mobile Quality Assurance

THE TESTING PROCESS

Initial Setup Testing Review Final Checklist

Page 6: Mobile Quality Assurance

THE TESTING PROCESS

Page 7: Mobile Quality Assurance

THE TEST DOCUMENT

Page 8: Mobile Quality Assurance

PIVOTAL LABS TEST COVERAGE

Page 9: Mobile Quality Assurance

ESSENTIAL

FUNCTIONAL• Verifying specific actions or

functions of the code, usually based on the BRDs

GUI• Verifying the user interface to

ensure that it meets specification (functional and non-functional)

ACCEPTANCE• Part of handoff process towards

the end of the project

STRESS• Deliberately intense or thorough

testing used to determine the stability of the application

USABILITY TESTING• Evaluating the user experience of

a product by testing it on users

CAPABILITIES

Page 10: Mobile Quality Assurance

ADVANCED

BETA TESTING• Testing with beta users using

techniques such as Configuration, In-the-wild, Dog food, and Discovery

APP SUBMISSION CHECKLIST• Validating the app meets generic

app store requirements

REGRESSION• Seeks to uncover changes to

previous functionality due to new updates

STABILITY• Testing for stability of the system

with large workloads

SMOKE• Preliminary testing to reveal

simple bugs severe enough to reject a release

INTEGRATION TESTING• Testing the integration of the

mobile application along with other existing components of the larger application suite

CAPABILITIES

Page 11: Mobile Quality Assurance

PIVOTAL LABS CI AND DEVICE AUTOMATION

Page 12: Mobile Quality Assurance

• Currently utilizing an advanced Jenkins environment - Builds over 40 active projects - Implemented for Android, BB10, Windows and iOS - Performs build verification, TDD, automation

• Defines many custom build environments

• Able to perform device automation for Android and iOS

• Upon code change and successful build, Jenkins will install the application to a connected device and run an automated test if available

JENKINS CI

Page 13: Mobile Quality Assurance

PULSE MONITOR

Page 14: Mobile Quality Assurance

TRAVIS CI•For TDD projects we utilize Travis CI for private repositories

•Travis is a cloud-based CI solution that is optimal for TDD by performing build verification and running tests

•Builds are performed on VMs that are installed with the latest packages and SDK’s: no maintenance required.

•Currently using Travis for nearly 15 active projects

Page 15: Mobile Quality Assurance

THANK YOU!

Pivotal Labs Toronto