Solution Testing in the Cloud - ANZTB - Australia & New ... · @testRUNnz Synchronicity...

@testRUNnz Synchronicity

Solution Testing in the Cloud with Agile

TeamsANZTB Test 2016: Advancing Testing Expertise Conference

Chris SAUNDERS May 2016 Melbourne AUSTRALIA

Interactive

Optional

doodle

Non-verbal Visual

How many words are there?

VerbalActivities

Solution Testing

in the Cloud

withAgile

TeamsThink

A Regular Heartbeat

A Regular HeartbeatIs similar to a testing heartbeat

By Dr. Jana (http://docjana.com/images/gifs/heart_beating.gif) [CC BY-SA 4.0 (http://creativecommons.org/licenses/by-sa/4.0)], via Wikimedia Commons

Regular interval

Expected event

Varyingintervals

Patterns

Information

A Regular HeartbeatIs similar to a testing heartbeat

Continuous DeliveryRequires a regular heartbeat

ScopeBig Release

Bug: Missing Side

Bar Translations

Feature:

Enhanced Search

July Sept Nov JanMay

Continuous Delivery

ModelImprovement:

UX Colour Change

Heart RateTesting your fitness level

Medical Disclaimer

Content is not intended to be professional

medical advice.

For any medical questions, always seek

advice of a qualified health professional.

RELAXResting heart rate

Feet flat

on floor

straight

Breath in

Breath outHands

on your

Heart RatePulse

Inside of

your elbow

Side of

your neck

Top of

the foot

Heart RateCount X 4 = beats per minute (bpm)

16 x 4 = 64 bpm15s

00:0100:0200:0300:00

15 Second Count Down

Heart RateObservations

Age18-25 26-35 36-45 46-55 56-65

Athlete 49-55 49-54 50-56 50-57 51-56

Excellent 56-61 55-61 57-62 58-63 57-61

Good 62-65 62-65 63-66 64-67 62-67

Average66-69 66-70 67-70 68-71 68-71

Average 70-73 71-74 71-75 72-76 72-75

Average74-81 75-81 76-82 77-83 76-81

Poor 82+ 82+ 83+ 84+ 82+

Age 18-25 26-35 36-45 46-55 56-65

Athlete 54-60 54-59 54-59 54-60 54-59

Excellent 61-65 60-64 60-64 61-65 60-64

Good 66-69 65-68 65-69 66-69 65-68

Average70-73 69-72 70-73 70-73 69-73

Average 74-78 73-76 74-78 74-77 74-77

Average79-84 77-82 79-84 78-83 78-83

Poor 85+ 83+ 85+ 84+ 84+

Male Female

TESTING = LEARNING

Solution Testing

Product Testing

Product TestingA product is similar to a person

UNIQUE

UNIQUE ABILITIES

UNIQUE EXPERIENCES

Product TestingA product is similar to a person

Solution Testing

SOLUTION

Solution TestingA solution is similar to a

community of people

Solution TestingA solution is similar to a

community of people

Scripted

Environments

---------

--------------

The Cloud

1985Old Network Schematics

1994Network ≡ Cloud

2016 SurveySource: Cloud Computing Trends: 2016 State of the Cloud Survey

(1,060 IT professionals)

of respondents are

using the cloud

Heavy cloud users

Solution Testing

in the Cloud

Solution Testing

Solution Development Solution Cloud Deployment

Feature. Bug.

Improvement. No

MergeBranch

Release

Develop

Packaged

Solution

ProductionDevelopment

Observations

Script:

Environments

---------

Product

Configuration

---------

Multiple Teams

Environment Configuration and

Management

Vagrant

Create and configure lightweight, reproducible, and portable development

environments.

vagrantup.com

Puppet

With Puppet, you define the state of your IT

infrastructure, and Puppet automatically enforces the

desired state.

puppetlabs.com

Puppet

user { chrissaunders':

ensure => 'present',

home => '/home/chrissaunders ',

comment => ‘Chris Saunders',

groups => 'web',

password => ‘I$LOVE$TESTING',

password_max_age => '99999',

password_min_age => '0',

shell => '/bin/bash',

uid => '501‘,

RELAXResting heart rate

Feet flat

on floor

straight

Breath in

Breath outHands

on your

16 x 4 = 64 bpm15s

00:0100:0200:0300:00

Age65-56 55-46 45-36 35-26 25-18

Athlete 54-59 54-60 54-59 54-59 54-60

Excellent 60-64 61-65 60-64 60-64 61-65

Good 65-68 66-69 65-69 65-68 66-69

Average69-73 70-73 70-73 69-72 70-73

Average 74-77 74-77 74-78 73-76 74-78

Average78-83 78-83 79-84 77-82 79-84

Poor 84+ 84+ 85+ 83+ 85+

Age 65-56 55-46 45-36 35-26 25-18

Athlete 51-56 50-57 50-56 49-54 49-55

Excellent 57-61 58-63 57-62 55-61 56-61

Good 62-67 64-67 63-66 62-65 62-65

Average68-71 68-71 67-70 66-70 66-69

Average 72-75 72-76 71-75 71-74 70-73

Average76-81 77-83 76-82 75-81 74-81

Poor 82+ 84+ 83+ 82+ 82+

MaleFemale

AgileTeams

Development People Making Solutions

Agile Team

Scrum or Kanban

Department

Development Group

Connections between Individuals, Teams and Tribes

Solution DeliveryThree Agile Teams

JulMay

Green Tribe

Red Tribe

Blue Tribe

Solution Testing

in the Cloud

withAgile

BALLOONS & TWINE

The Balloon Tribe

FEATURE

PRODUCT

SOLUTION

The Balloon TribeCreating our Balloon Tribe

Agile TeamsFour people in a Team

Team colour.

Other teams.

Features

X 8 X 8

Solution1. Group balloons

into solution is system integration testing.

2. User acceptance testing.

Product

1. Inhaling is component test.2. Exhaling is coding.

3. Knots & twine is component integration test.

4. Group balloons into each colour is system testing

A different person must tie the knots, to the one who Blows it up.

Cross-Functional

The Balloon Tribe

Features

BALLOONS & TWINE

into solution

2. User acceptance testing.1. Inhaling

2. Exhaling

3. Knots & twine

4. Group balloons

Cross-Functional

The Balloon Tribe

Features

1 Minute Iteration

The Balloon Tribe

Product Focused Completed own

coloured balloons

Solution Focused Completed other coloured balloons

into solution

2. Exhaling

3. Knots & twine

4. Group balloons

Cross-Functional

The Balloon Tribe

Features

1 Minute Iteration

Solution DeliveryHave you delivered a solution yet?

2 min0 min

Green Tribe

Red Tribe

Blue Tribe

into solution

2. Exhaling

3. Knots & twine

4. Group balloons

Cross-Functional

The Balloon Tribe

Features

1 Minute Iteration

The Balloon Tribe

Solution

The Balloon Tribe

Solution Solution

USER ACCEPTANCE TESTING

22 x 4 = 88 bpm15s

00:0100:0200:0300:00

Age18-25 26-35 36-45 46-55 56-65

Athlete 49-55 49-54 50-56 50-57 51-56

Excellent 56-61 55-61 57-62 58-63 57-61

Good 62-65 62-65 63-66 64-67 62-67

Average66-69 66-70 67-70 68-71 68-71

Average 70-73 71-74 71-75 72-76 72-75

Average74-81 75-81 76-82 77-83 76-81

Poor 82+ 82+ 83+ 84+ 82+

Age 18-25 26-35 36-45 46-55 56-65

Athlete 54-60 54-59 54-59 54-60 54-59

Excellent 61-65 60-64 60-64 61-65 60-64

Good 66-69 65-68 65-69 66-69 65-68

Average70-73 69-72 70-73 70-73 69-73

Average 74-78 73-76 74-78 74-77 74-77

Average79-84 77-82 79-84 78-83 78-83

Poor 85+ 83+ 85+ 84+ 84+

Male Female

TESTING HEARTBEAT OBSERVATIONS

Solution Testingin the cloud with Agile Teams

By Dr. Jana (http://docjana.com/images/gifs/heart_beating.gif) [CC BY-SA 4.0 (http://creativecommons.org/licenses/by-sa/4.0)], via Wikimedia Commons

Solution Testing

in the Cloud

withAgile

DISCUSSION TIME

Synchronicity

Simultaneous cultural and

technical transformation

The following slides are not for the ANZTB presentation

into solution

2. Exhaling

3. Knots & twine

4. Group balloons

Cross-Functional

The Balloon Tribe

Features

1 Minute Iteration

Testing Heartbeat and Test Levels

Standard Glossary of Terms

http://anztb.org/downloads.php

Test LevelsDifferent sizes and feel different

A group of test activities that are organised and managed together.

Examples of test levels:• component test• integration test • system test• acceptance test

Component TestIt feels like playful small drumming

A humming bird’s heart rate is 1200bpm

The testing of individual software components. E.g. A web service, a web resource, or a module that encapsulates a set of related functions (or data).

Component Integration Test

It feels like fast playful clicking fingers

A rat’s heart rate is 400bpm

Testing performed to expose defects in the interfaces and interaction between integrated

components.

System Test It feels like a regular finger clap

A cat’s heart rate is 120bpm

Testing an integrated system to verify that it meets specified requirements.

System Integration Test

It feels like a regular clock clap

A giraffe’s heart rate is 60bpm

Testing performed to expose defects in the interfaces and in the interactions between integrated

components or systems.

Acceptance TestIt feels like a very slow clap

An elephant’s heart rate is 30bpm

Formal testing with respect to user needs, requirements, and business processes conducted to determine whether or not a system satisfies the acceptance criteria.

Beta TestIt feels like a very, very slow stomp

A blue whale’s heart rate is 10bpm

Testing by users at an external site, to determine whether or not a component or system satisfies the

user needs and fits within the business processes.

Size matters

Test Levels

Testing Pyramid

Beta Test

Acceptance Test

System Integration Test

System Test

Component Integration Test

Component Test

Solution Testing in the Cloud - ANZTB - Australia & New ... · @testRUNnz Synchronicity...

Documents

Performance Testing - ANZTB · Performance Testing ... “Testing was completed ... JMeter vs. LoadRunner Tuesday, 19 February 13. Cloud Impact? Force Multiplier Tuesday, 19 February

Multi-Cloud testing

Web Services/ API Testing - ANZTB · Web Service/API testing 1. Understand the WSDL file contract of the service 2. Determine the operations that particular web service provides 3

User Acceptance Testing - ANZTB · Usability Testing User Acceptance Testing Satisfaction Memorability Learn ability Compatibility Roadmap Validation Test Support Process Errors Efficiency

Advance your testing: Go on Bug Hunt! - ANZTB Bug-Hunting with Klaus Olsen... · Advance your testing: ... ”Exploratory Testing is an interactive process of ... Create charters

Mobile Application Testing - ANZTB · Mobile Application Testing ! Challenges ! Services in the market ! Flexible Approach ! Automation Framework Demo

The Agile Mindset - ANZTB...© Planit Software Testing End of Agile Byte Link to article: © Planit Software Testing

5 Andrew Muller - ANZTB of security testing.pdf · ANZTB Test 2013: Advancing Expertise in Software Testing 6 June 2013 Canberra, Australia 1 Andrew Muller, Canberra Managing Director,

Performance Testing for Managers - ANZTB Testing for Managers 15... · Performance Testing ... database connections), web server settings, ... Functional Testing Performance Testing

The Agile Mindset - ANZTB · © Planit Software Testing The Rise of Agile Planit Index 2014 - 1

SIGIST31st May 2011 - FINAL - ANZTB - Australia & New Zealand Testing … SIGiST Presentations... · 2013-11-04 · • The Australia and New Zealand Testing Board offers sought after

Cloud based testing

Special Interest Group in Software Testing - ANZTB · 2014-02-26 · Australia and New Zealand Testing Board ANZTB’s Mission Statement • The ANZTB offers sought after certification,

Performance Testing Mobile Devices - ANZTB · Simulating user behaviour of application Testing against Non Functional Requirements (NFRs ) Analysing all results (test and monitoring

Mobile Application Testing - ANZTB · Mobile Application Lifecycle Testing (MALT) ! Integrates with Continuous Integration and can be adapted to work with most standard test management

Functional Testing With the Cloud Testing Service

Testing as a Service TaaS - ANZTB...• Performance testing – can include number of virtual users, leaving clients to pay only for what they use, not having to purchase the tools

Automated Security Testing - ANZTB · with complete manual testing to get the best penetration testing results. • OWASP Mantra Security Framework Mantra is a web application security

ANZTB ISTQB Expert Certificate 20111116

Fonterra – Our Testing Journey - ANZTB Ludlam - Fonterra Our Testing... · Agenda • Introduction to Fonterra, Information Services and our system landscape • Preparing for the