ISTBQ®

Yesterday, Today, Tomorrow

HUSTEF 2015,

Budapest, November 2015G. Bazzana – ISTQB® President

ISTQB® 2015 2

ISTQB®

Yesterday

ISTQB® 2015 3

• ISTQB®: International Software Testing Qualifications Board

(www.istqb.org):

– Non-profit association

– Founded in 2002

– Headquartered in Belgium

– Has its own constitution, rules and regulations

– Composed of volunteer international Testing Experts

– Responsible for the “ISTQB® Certified Tester” scheme worldwide

• ISTQB® is the world’s leading organization for Software Testing Certification

WHAT IS THE ISTQB®?

Advancing

the software testing profession

ISTQB® 2015 4

“To continually improve and advance

the software testing profession by:

Defining and maintaining a Body of Knowledge

which allows testers to be certified based on best practices,

connecting the international software testing community,

and encouraging research.”

ISTQB® VISION

ISTQB® 2015 5

ISTQB® VALUE CHAIN

Working Groups: http://www.istqb.org/about-istqb/working-groups.html

Member Boards: http://www.istqb.org/istqb-where-you-are/your-local-member-board.html

Training Providers: http://www.istqb.org/istqb-where-you-are/find-a-training-provider.html

Exam Providers: http://www.istqb.org/istqb-where-you-are/find-an-exam-provider.html

ISTQB® Partners: http://www.istqb.org/partner/istqb-partners.html

ISTQB® 2015 6

ISTQB® ECO-SYSTEM

ISTQB® 2015 7

ISTQB® WORKING GROUPS (WGs)

ISTQB® 2015 8

ISTQB® VIDEOS

• ISTQB® Videos give you insights into the ISTQB® Certified Tester scheme

http://www.istqb.org/introduction-to-istqb.html

ISTQB® 2015 9

ISTQB® LEVELS AND SYLLABI

ISTQB® 2015 10

Market trends – current situation

In accordance to Technavio Report «Global Software Testing Service Market»

Outsourced Software Testing Services segment has a value of over 16B$

It is growing at a CAGR of 10% in 2014 and 2015

11,512,58

13,78

15,15

16,7

9,11%9,35%

9,60%

9,90%

10,25%

8,00%

8,50%

9,00%

9,50%

10,00%

10,50%

11,00%

11,50%

0

2

4

6

8

10

12

14

16

18

2011 2012 2013 2014 2015

Market Value (US$) Growth Rate

ISTQB® 2015 11

World Quality Report Findings

ISTQB® 2015 12

ISTQB®

Today

ISTQB® 2015 13

Drivers

COSTQUALITY

RISKAGILITY

• Quicker time

to market

• Consumption

based pricing

• Increasing

dependency of

business from SW

• Multiple platforms

• SW Intensive

systems

• Knowledge

retention

• Competition

• Tightening

margins

ISTQB® 2015 14

APPLICABLE MARKETS

IT

Engineering

Telco

ISTQB® 2015 15

More than

560.000exams world wide!

Figures as of 2015Q2

Executive Summary

In 2015Q2, 18993 exams

and 14036 certificates

Trend YOY is OK

Wrt FL+AL+EL + 8,5%

Adding-up Agile +

14,5%

Close to

410.000certificates world wide!

ISTQB® 2015 16

Agile uptake

VERY Good:

- Almost 2000 exams

- 1600 certificates

- By 33 Boards

- Forecast for 2015:

over 4000 exams

Figures as of 2015Q2

Executive Summary (2)

Certificates issued in 108 countries

ISTQB® 2015 17

• International recognition of acquired competencies

and skills

• Authorized to use the “Certified Tester” logo

(specifying the level of certification)

• Whole of career path support, from Foundation to

Expert level

• Higher appeal in the labor market

BENEFITS FOR PROFESSIONALS

ISTQB® 2014 18

BENEFITS FOR COMPANIES

• ISTQB® certification can provide a competitive

advantage for companies, promising a higher level of

reliability of the applications being developed due to

efficient and cost effective testing practices derived

from the ISTQB® competencies

• Consulting companies with certified staff can offer

higher-level services to customers, increasing

revenues and brand value

• ISTQB® has defined a “Partner Program” for

companies that engage a large number of certified

testers

ISTQB® 2014 19

BENEFITS FOR ATPs

(Accredited Training Providers)

• Educational institutions and consulting companies

may become an ISTQB® Accredited Trainer Provider

(ATP) according to processes and rules defined at the

international level

• Accredited Training Providers ensure a high standing

of training is delivered through having:

• certified trainers

• the content, quality and syllabus coverage of

training materials checked by ISTQB® Boards

• advance notice of changes to the ISTQB®

Glossary and syllabi

• Accredited Training Providers are entitled to use

relevant logos and are listed in the ISTQB® Website

ISTQB® 2015 20

EXAM RELIABILITY - SURVEY

• To what extent do you feel the ISTQB® Foundation Level certification exam

reflects the knowledge of the candidates?

More than 70% of respondents regard the ISTQB® Foundation Level

certification exam as fully or exceedingly reliable and these results are

consistent throughout the world; only 6% found the exam not very reliable

0%

10%

20%

30%

40%

50%

60%

70%

Exceedingly well Well Partially well Not very well

Test Engineers

Test Managers

ISTQB® 2015 21

BENEFITS FOR PROFESSIONALS –

ISTQB® SURVEY

• Would you recommend the ISTQB® Foundation Level (CTFL) certification

to your colleagues?

ISTQB® 2015 22

Report:

“Practices &

Attitudes in

Software

Testing (PAST)

Study” –

EUROSTAR

Sw Testing

Report 2014

Based on 630

respondents

(85% CTFL and

26% also

CTAL)

EUROSTAR 2014 SURVEY

“SW TESTING CERTIFICATION VALUE”

ISTQB® 2015 23

• Data collected and analysed by Capers Jones from 1984 through 2015

From About 725 companies (150 clients in Fortune 500) and 40

government/military groups for 25,000 total projects in 27 countries

INCREASING PRODUCTIVITY OF SW PROJECTS

CERTIFICATION OF TESTERS CAN HELP !

Factor Impact on productivity

Experienced test teams 12% Improvement

Testing by certified test personnel 7% Improvement

Testing by developers only 6% Worsening

Informal test case design 8% Worsening

Inexperienced test teams 15% Worsening

Truncating testing to "meet schedule" 45% Worsening

(Capers Jones, Scoring and evaluating software methods,

practices, and results, version 15.0, September 6, 2014)

ISTQB® 2015 24

ISTQB® survey on “Worldwide Software Testing Practices”

2015 – to be published soon

This report has been produced by

the ISTQB® MWG – Marketing

Working Group as a result of a

survey , characterized by the

following quantitative data:

- Period: 26 Feb - 22 May 2015

- Data collection method: Web-

based at www.istqb.org

- Target: Open to anybody

- Number of respondents: 3294

- Number of countries represented:

89

- End user companies: 52% wrt

48% of IT companies

North America

22%

South America

9%

Africa1%

Asia31%

Europe36%

Oceania1%

ISTQB® 2015 25

What percentage of a typical IT/ R&D project

budget is allocated to software testing?

The large majority of respondents indicate budgets between 11% and 40%.

This is in line with the World Quality Report 2014-15 that indicates an average

expenditure of 26%

0,0%

5,0%

10,0%

15,0%

20,0%

25,0%

30,0%

35,0%

40,0%

45,0%

0% - 10% 11% - 25% 26% - 40% More than 40%

ISTQB® 2015 26

What is your expectation for your organization's

software testing budget in the next 12 months?

About 60% of the

respondents expect an

increase of the budgets

allocated to testing; this

confirms the growing trend

exhibited in the World

Quality Report 2014-15, that

is forecasting that by 2017

the IT budget allocated to

QA & testing will rise to

29%.

Average expected growth is

14% that is much pretty in

line with the forecasted

CAGR of the Global Testing

Market in 2015-2019 in the

Technavio Report

(www.technavio.com)

0,0%

5,0%

10,0%

15,0%

20,0%

25,0%

30,0%

35,0%

Decrease Stable Growth

9,8% 31% 59,2%

Average = 14%

ISTQB® 2015 27

Who is responsible for software testing

in your company?

0,0%

10,0%

20,0%

30,0%

40,0%

50,0%

60,0%

70,0%

80,0%

90,0%

Near-shoretest team

Off-shore testteam

Distributedtest team

In-sourcedtest team

End Users Developers In-house testteam

In close to 80% of the cases, the responsibility of SW testing is assigned to an in-

house test teams; this confirms the increasing adoption of “segregation of duties”,

that is one of the key factors for the effectiveness of testing activities

ISTQB® 2015 28

To whom do the test team report ?

To Business 18%

To Development 16%

To Operation 51%

Other15%

Wide adoption of

“segregation of

duties” is

confirmed by the

fact that in most

cases (84%) the

test team does

not report to

Development

ISTQB® 2015 29

Which Software Development Lifecycle (SDLC) model are you using?

0,0% 50,0% 100,0%

Other

Iterative (RUP, Spiral)

Sequential (Waterfall, V-model)

Agile (Scrum, Extreme programming,…

Agile based SDLCs are being adopted ahead of traditional ones (Waterfall or V-

Model)

Agile methodologies are significantly increasing in popularity; this underlines the

need to have appropriate testing processes and techniques also for Agile,

combined with certification of testing competences

ISTQB® has recently launched a specific certification module for “Agile Tester”

with a remarkable positive reply by the market, and in the near future will further

extend the certifications on Agile testing at Advanced level

ISTQB® 2015 30

How many test cases do you automate ?

• Test automation has

become very

widespread in the

market, with 72%

adoption

• in 40% of the cases

the percentage of

automated test cases

is well beyond 20%

No automation28%

Less then 20%32%

From 21% - to 40%15%

From 41% to 50%8%

More than 50%17%

ISTQB® 2015 31

ISTQB®

Tomorrow

ISTQB® 2015 32

Market trends – the future

The trend is predicted to accelerate

over the period 2015-2018

- Global Software Testing Service Market

CAGR 11.15%

- Global Software Testing

System Integrator Market

CAGR 21.53%

ISTQB® 2015 33

• Budgets dedicated to QA&Testing are growing at warp speed, with a growth

pace much higher than anticipated, reaching in average 35% of the IT

budgets

• Test automation is increasing, jumping in one year from 28% to 45% of test

cases

• Digital transformation is putting more and more emphasis on customer value

and end-user experience as targets for testing

• Security is the most pressing concern

• Agile and DevOps adoption has become widespread and call for extreme

level of speed and integration in testing practices; a lack of professionals

with Agile Testing expertise is among the top-three challenges

• Mobile testing is maturing, being adopted by 92% of the organizations and

consuming 35% of the QA&Testing Budgets for new projects

• Testing Centers of Excellence are widely adopted and are turning into more

agile and hybridized forms

• Test environments are being enhanced with virtualization and cloud solutions

HIGHLIGHTS FROM THE

2015 WORLD SW QUALITY REPORT

ISTQB® 2015 34

ISTQB® Planned evolution

ISTQB® has defined an evolution of its product portfolio

architecture and contents in order to: Maintain the mission and vision of ISTQB® and keep the high quality

of deliverables that has marked the success of the scheme world-

wide

Make the scheme more modular

Make it easier for professionals to obtain the certification they are

interested in

Provide an overall framework in which all future potential modules

may fit in a way which is coherent and understandable to our

stakeholders

Maintain the validity of certifications already obtained

ISTQB® 2015 35

The customer perspective

Some people like to follow a breadth-first generalist approach (going

from Foundation to the “classic” Advanced)

Whereas others prefer to follow a depth-first approach (going from

Foundation to Specialist)

We have so many different professionals interested in our programme

that we cannot think we can propose a “one size fits all” approach …

Indeed, it is exactly the goal of a modular approach to allow people to

design their own training/ certification path and allow them to broaden

their knowledge base

ISTQB® 2015 36

Evolution Axes

The review of the product architecture and product

portfolio embraces three aspects

1. The overall framework in which the various certification

modules have to fit

2. The modules that populate the framework: fitting the current

modules (the existing ones and those under development) and

identifying/ positioning the potential new ones

3. The preconditions/ pre-requisites/ entry criteria

ISTQB® 2015 37

Overall Framework/ architecture

Levels and categories

The new ISTQB® Portfolio is a Matrix characterized by:

Levels (FL, AL, EL): they identify progressively increasing LOs

Categories: they identify differing target groups of certification

modules:

Core:

they cover a topic in a broad, horizontal way,

valid for any technology/ methodology/ application domain

Allowing for a common understanding

Specialist: they cover a specific topic/ domain in a vertical way, using

a drill down / deep-dive approach

Agile It deserves an its own Stream

ISTQB® 2015 38

Identifying future modules that could fit

into the Framework – Potential Specialist

Specialist modules may include

Software Quality Characteristics Usability

Security

Performance

Specific activities Test Automation

Advanced Agile

Mobile Testing

User Acceptance Testing

…..

Domain Specific modules Automotive tester

Pharma/ TechMed Tester

…..

ISTQB® 2015 39

ISTQB® Product Portfolio

CORE AGILE SPECIALIST

C

T

E

L

C

T

A

L

C

T

F

L

FOUNDATION

Test Manager

Test Analyst

Technical

Test Analyst

Test

Management

Improving the

Test Process

Test

Automation

Engineer

Automotive

Tester

Usability

Tester

Security

Tester

Model-Based

Tester

Technical

Organizational

AGILE Tester

Foundation

In

DEV

In

DEV

In

DEV

In

DEV

In

DEV

In

DEV

NEW

2015

Q4

ISTQB® CONTACTS AND CHANNELS

YouTube : http://www.youtube.com/user/ISTQBORG

Slide Share : http://www.slideshare.net/ISTQBORG

LinkedIn : http://www.linkedin.com/groups/ISTQB-International-Software-Testing-Qualifications-99444

Twitter : http://twitter.com/ISTQBORG

XING : https://www.xing.com/net/istqb

Facebook : http://www.facebook.com/istqborg

ISTQB® Smart Show