A Peek at the Future of Software TestingRuud Teunissen – Passionate software tester since 1989

“The best way to predict the future is to invent it” – Alan Kay

© 2014 2

St

ruct

ure

Pioneering

Structuring

Optimizing

Unstructured

Undisciplined

Flexible

Structured

Disciplined

Inflexible

Evolution

Time

© 2014 3

© 2014 4

© 2014 5

© 2014 6

St

ruct

ure

Pioneering

Structuring

Optimizing

Unstructured

Undisciplined

Flexible

Structured

Disciplined

Inflexible

Evolution of (software) testing

Time

© 2014 7

Pioneering

• Fully integrated in the development process

• Unknown, no buy-in, no budget, no process, no tools

• Struggling to get involved

• Only welcome in emergency situations

© 2014 8

Structuring

© 2014 9

• Defining the process

• Publishing

• Test automation

• Test Process Improvement models

Structuring

© 2014 10

Great!

• Dedicated, trained staff

• (Early) involvement

• Independent testing

• Risk based

• Testing Competence Center

• Recognized Role

Structuring

St

ruct

ure

© 2014 11

But…

• Template Zombies

• Process (Improvement) freaks

Structuring

St

ruct

ure

ProcessTheorySchedule

StrictIndependentDisciplineStructureStandards

© 2014 12

But…

• Template Zombies

• Process (Improvement) freaks

• Spreadsheet management

• Measure and metrics mania

• Complaining and blaming

Structuring

St

ruct

ure

© 2014 13

Optimizing

© 2014 14

Technology push Efficiency push

A Peek at the Future of IT

© 2014 15

A Peek at the Future of IT

• Architecture

– SOA, Virtualization, Web technology, Devices

© 2014 16

A Peek at the Future of IT

• Architecture

• Cloud

– *aaS

searching, recording, accounting, paying, writing,

reviewing, tracking, calculating, developing,

listening, analyzing, transmitting, learning,

controlling, purchasing, testing, alarming,

changing, updating, deleting, accessing, rejecting,

correcting, studying, booking, receiving, tracing,

protecting, deciding, managing, teaching,

facilitating, identifying, copying, removing,

demonstrating, checking, showing, selecting,

subscribing, unsubscribing, sharing, mailing,

communicating, reading, playing, working,

meeting, gambling, shopping, storing, cross

checking, retrieving, configuring, sketching,

saving, accelerating, enhancing, creating, growing,

checking in, checking out, finding out, reaching,

denying, talking, designing, making, verifying,

measuring

© 2014 17

• Architecture

• Cloud

• SoLoMo

A Peek at the Future of IT

© 2014 18

• Architecture

• Cloud

• SoLoMo

A Peek at the Future of IT

© 2014 19

• Architecture

• Cloud

• SoLoMo

A Peek at the Future of IT

© 2014 20

• Architecture

• Cloud

• SoLoMo

• Packages

• Integration

A Peek at the Future of IT

© 2014 21

• Architecture

• Cloud

• SoLoMo

• Packages

• Integration

• Outsourcing

A Peek at the Future of IT

© 2014 22

• Architecture

• Cloud

• SoLoMo

• Packages

• Integration

• Outsourcing

• Agile, Scrum

A Peek at the Future of IT

© 2014 23

• Architecture

• Cloud

• SoLoMo

• Packages

• Integration

• Outsourcing

• Agile, Scrum

• Collaboration

A Peek at the Future of IT

© 2014 24

• Architecture

• Cloud

• SoLoMo

• Packages

• Integration

• Outsourcing

• Agile, Scrum

• Collaboration

• DevOps

A Peek at the Future of IT

© 2014 25

• Architecture

• Cloud

• SoLoMo

• Packages

• Integration

• Outsourcing

• Agile, Scrum

• Collaboration

• DevOps

• Continuous Delivery

A Peek at the Future of IT

© 2014 26

• Architecture

• Cloud

• SoLoMo

• Packages

• Integration

• Outsourcing

• Agile, Scrum

• Collaboration

• DevOps

• Continuous Delivery

• … … … …

A Peek at the Future of IT

© 2014 27

• Architecture

• Cloud

• SoLoMo

• Packages

• Integration

• Outsourcing

• Agile, Scrum

• Collaboration

• DevOps

• Continuous Delivery

• … … … …

A Peek at the Future of Software Testing

Optimizing

Today Tomorrow/Next

© 2014 28

A Peek at the Future of Software Testing

• Agile, Scrum

– Joint effort and success

– Early involvement and feedback

– Social skills required

– Test management role

© 2014 29

A Peek at the Future of Software Testing

• Agile, Scrum

• Context Driven

– Problem solving, (good) practice, heuristics, questioning

–People, skills, cooperation

– Exploratory

– Rapid Software Testing

The Seven Basic Principles of the Context-Driven School1.The value of any practice depends on its context.2.There are good practices in context, but there are no best practices.3.People, working together, are the most important part of any project’s context.4.Projects unfold over time in ways that are often not predictable.5.The product is a solution. If the problem isn’t solved, the product doesn’t work.6.Good software testing is a challenging intellectual process.7.Only through judgment and skill, exercised cooperatively throughout the entire project, are we able to do the right things at the right times to effectively test our products.

© 2014 30

A Peek at the Future of Software Testing

• Agile, Scrum

• Context Driven

• SDTM (Service Driven Test Management)

– From complaining and blaming towards enabling

– Tactful leadership

© 2014 31

A Peek at the Future of Software Testing

• Agile, Scrum

• Context Driven

• SDTM (Service Driven Test Management)

• TestOps

– Test in production

– Cloud testing (Iaas, Taas)

– Integration

© 2014 32

A Peek at the Future of Software Testing

• Agile, Scrum

• Context Driven

• SDTM (Service Driven Test Management)

• TestOps

• Automation 2.0

– Automation of testing

– Architecture TestwareTest scriptsTest casesTest data

Registration Reporting

Test Automation

Software – Platform – Infrastructure

Test Automation Process & Organization

ProjectsChanges

PatchesFixes

System Under Test

Software – Service – Platform - Infrastructure

© 2014 33

A Peek at the Future of Software Testing

• Agile, Scrum

• Context Driven

• SDTM (Service Driven Test Management)

• TestOps

• Automation 2.0

• Cloud Computing

– Testing in the Cloud (TaaS)

– Testing Cloud Services (SaaS)

© 2014 34

A Peek at the Future of Software Testing

• Agile, Scrum

• Context Driven

• SDTM (Service Driven Test Management)

• TestOps

• Automation 2.0

• Cloud Computing

• SoLoMo

– Technical skills

– Multi dimensional

– Continuous integration

© 2014 35

A Peek at the Future of Software Testing

• Agile, Scrum

• Context Driven

• SDTM (Service Driven Test Management)

• TestOps

• Automation 2.0

• Cloud Computing

• SoLoMo

• Outsourcing

– Scoping

– Agreements

– Management controls, metrics, health checks

test deliverables

test progress test process

product quality

© 2014 36

A Peek at the Future of Software Testing

• Agile, Scrum

• Context Driven

• SDTM (Service Driven Test Management)

• TestOps

• Automation 2.0

• Cloud Computing

• SoLoMo

• Outsourcing

•

© 2014 37

• Architecture

• Cloud

• SoLoMo

• Packages

• Integration

• Outsourcing

• Agile, Scrum

• Collaboration

• DevOps

• Continuous Delivery

• … … … …

A Peek at the Future of Software Testing

Optimizing

Today Tomorrow/Next

© 2014 38

TMapDevOpsCreativeTolerant

CMMI

Outsourcing

SaaS

BYODWaterfall

Telecom

Logistics

Reporting

CI

CD

SBTM

Vir

tu

al

iza

tio

n

IT-general

Networks

Infrastructure

PRINCE2

IREB

A Peek at the Future of Software Testing

© 2014 39

DistributedBusiness/RQMS

DevelopmentOperations

TechnicalAutomation

CloudSoLoMo

e.g. Security

CodingAutomation

TestingDevelopment

SocialTeam player

Communication

CraftsmanshipTesting

Test management

A Peek at the Future of Software Testing

© 2014 40

ProcessTheorySchedule

StrictIndependentDisciplineStructureStandards

PeopleSkills

ChangeLoose

Collaboration SolutionFlexibilityCreative

We’re Optimizing!

Optimizing

Today Tomorrow/Next

and

© 2014 41

Process

Theory

Schedule

Strict

Independent

Discipline

Structure

Standards

Creative

Flexibility

Solution

Collaboration

Loose

Change

Skills

People