Building a High Performance QA Team

Mr. Karim FanadkaDevTest Manager@kim0z85

About me: Karim Fanadka

Job: DevTest Manager at HPE Software, 7+

Product: StormRunner Load

Favorite activates: Traveling, Ski, Blogging

Ski – France 2013

Road Trip – Iceland 2015

@srijan #SrijanWW

We are going to talk about:

AgileModern QA

SaaS

Automation

Environments

Hotfixes Continuous Deployment

@srijan #SrijanWW

SaaS – Software as a Service

@srijan #SrijanWW

Before SaaS – On Premise

Software

Users

@srijan #SrijanWW

SaaS – Software as a Service

Data Base

Servers

File System

Firewall

Users SaaS

@srijan #SrijanWW

StormRunner Load - SaaS product

Which product my team is testing :

Performance testing solution that makes it easy to plan, run, and scale web and mobile testing over the cloud.

@srijan #SrijanWW

@srijan #SrijanWW

9

1 Create and run a load test using your favorite scripting tool

2 Load Generators spin up in AWS EC2 or MS Azure

3 Results and app insights are available in real time

The product my team is testing: StormRunner Load

New

Soon

Performance testing solution that makes it easy to plan, run, and scale web and mobile testing over the cloud.

@srijan #SrijanWW

@srijan #SrijanWW

StormRunner Load as a Service

Some text

Data Base

Servers

File System

Firewall

Users SaaS Cloud

@srijan #SrijanWW

Agile – Do It Fast

Some text

@srijan #SrijanWW

Before Agile - Delivery Timeline

Some text

1 or 2 Major releases to production in 1 year

@srijan #SrijanWW

Agile StormRunner Load Delivery Timeline

March April AugustJune Nov Dec

Whats the CodeName of the next release?If you know the answer, I will invite you to a

AlleyCat BubbleBobble Elevator Action Frogger Golden Axe Hang-On

FebruaryDec

CommanderKeen Digger

6 Major releases to production in 1 yearYear: 2015

@srijan #SrijanWW

Agile – The Challenges

Some text

• Test new features

• Test Regression

• Automation

• Environments

• Continues Integration / Continues Delivery

• Hotfixes

Do it in 1.5 months

• Data Migration (When update SaaS with the newer version)

• Performance Testing

• Security Testing

• Globalization

• Documentation

• And more …

@srijan #SrijanWW

Modern QA Team (DevTest)

@srijan #SrijanWW

What is DevTest? Using top end QA/DEV practices combined with DevOps techniques

QA & DEV Working very close, on the same IDE, code base, and in united process

Automation is a MUST

Manual is for new features / exception flows that are difficult to automate

NO MORE “Deliveries for QA” YES for “Push to Production”

@srijan #SrijanWW

Training

“we are testing, and breaking code constantly but we help rebuild it better…….”

@srijan #SrijanWW

Continues Testing

Some text

Push new code

Master

Release branch (1.5 months)

Test new codeShort Regression

Push to production

Automation

X Many times a day

Builds Hang-On: 1400• Full: 236• Commit: 1164• Avg 30 build a day

Developer Engineer

Test Engineer DevTest Team

Builds in 1 Release (1.5 month): 1,400• Full: 236• Commit: 1,164

@srijan #SrijanWW

Modern QA

Some text

DevTest

DevOpsSaaS

Dev

Product

Customer

@srijan #SrijanWW

Automation

@srijan #SrijanWW

Automation85% Coverage

100% Coverage

65% Coverage X 2 Browsers

Builds Number (JumpMan 1.95): 1,617• Number of Full : 427• Number of Commits: 1,190

@srijan #SrijanWW

@srijan #SrijanWW

@srijan #SrijanWW

Frameworks:

Frameworks

Tests

Client Testing Framework

API Testing FrameworkCloud Framework

Results

@srijan #SrijanWW

Testing based analytics from production

@srijan #SrijanWW

Client automation framework

@srijan #SrijanWW

Backend automation framework

@srijan #SrijanWW

API discovery tool

@srijan #SrijanWW

Cost cloud tool

@srijan #SrijanWW

Cloud Testing

@srijan #SrijanWW

Example for Automation challenge

Some text

17 Regions in the Cloud 6 different images for each region

15 different metrics

102 Tests

(~1500 metrics)

@srijan #SrijanWW

Automation – Cloud Framework - Report

@srijan #SrijanWW

Test Environments

@srijan #SrijanWW

Test Environments Farm

QA Security Performance IntegrationLocal (Linux)

Staging

@srijan #SrijanWW

Hotfixes in 1 day

@srijan #SrijanWW

Hotfixes Lifecycle

Some text

07:00Production bug

08:00Research by QA and Dev

10:00Fixing bug

16:00Testing (Staging)

14:00Testing (Local)

18:00 Push to production

@srijan #SrijanWW

Articles • 10 best practices for QA teams to deliver quality software, fast

• Blurring the lines: How the development tester role changes on agile teams

• 3 steps to building test databases for the real world

@srijan #SrijanWW

Tip

“Changing our mindset takes precedence over technology. When we work together, we will succeed.”

Thank you

@srijan #SrijanWW

@kim0z85

Question?

https://il.linkedin.com/in/kareemfakareem9k@gmail.comKarim.Fanadka@HPE.com

Karim FanadkaDevTest ManagerHPE Software

@srijan #SrijanWW

Neat Picture!