Www.objentis.com OBJENTIS Outsourcing testiranja softvera 2015 Hans Hartmann

www.objentis.com

OBJENTISOutsourcing testiranja softvera

2015

Hans Hartmann

© 2015 OBJENTIS Outsourcing Software Testing, 2015, Hans Hartmann 2

Agenda

• The Speaker• Software Testing

• Somewhere in the world• In Serbia

• Outsourcing Software Testing• Why • Costs• Savings• ROI for Testing Computer Software

• In Serbia• ???


The Speaker

• OBJENTIS Software Integration GmbH since 1999• OBJENTIS Software Integration doo since 2011• Hans Hartmann ([email protected])

• IN TESTING COMPUTER SOFTWARE• His whole life• Professionally since 1997• In OBJENTIS Austria since 2007• In OBJENTIS Serbia since 2011• Accredited for ISTQB® and IREB® Training

since 2008• Lecturing since 1997 in TU Vienna and TU

Leipzig („Software Engineering of large Business Software Systems“)

In contact with the big guys since 1999 (Hetzel, Boris Beizer, Cem Kaner, Kent Beck, James Coplien, a.o.)

mailto:[email protected]


Software Testing – Outsourcing?

• Somewhere in the world• Costs of Testing are high• Outsourcing seems to reduce costs• Outsourcing done to various countries (not

to Serbia)

• In Serbia• Testing is done in some companies (betting

and gaming) and in some companies where software development is controlled in foreign countries (e.g. Germany, Switzerland, Austria, etc.)

• Testing it outsourced to high salary level countries because Serbians don‘t know how to test professionally (or do they?)

No processes known


Test Planning

ControlTest Analysis and Design

Test Implementation and Execution

Evaluating Exit Criteria&Reporting

Test Closure Activities

Start

End

Software Testing – Outsourcing?

In Serbia• Testing is done in some companies (betting and gaming) and in some

companies where software development is controlled in foreign countries (e.g. Germany, Switzerland, Austria, etc.)

Somewhere in the world• Software Testing currently accepted

as one of the special fields of software engineering

• Test Processes• ISTQB® Fundamental Test

Process• TMAP® TPI® (Martin Pol,

Ruud Teunissen und Erik Van Veenendaal)

• Others (TMM etc.)


Why do we test

• Test is risk management (We want to avoid risk) like loosing 20 Mill. British Pounds, 20 Mill. Euros, 500 Billions US$

• We want to avoid risks of lives (standards for airplanes, railways, cars)


How much does Testing cost

• Costs• Testing is expensive (30% of total project costs)

• 18% in 2012, (Sources: Cap Gemini)• 23% in 2013, (Sources: Cap Gemini)• 28% in 2015 (OBJENTIS Estimate)

2011.5 2012 2012.5 2013 2013.5 2014 2014.5 2015 2015.50%

10%

20%

30%

40%

50%

60%

70%

80%

90%

Percentage DevelopmentPercentage Test


ROI in Software Testing

Software Testing• Savings

• Example of an insurance company• Costs of one failure in production averages to 3750 €• Costs of finding the fault before in the testing phase 550 €• Saving per year if one tester is added• (tester finds one severe error and several not-severe per day)• Saving 200 days * 3.200€ = 640 kE (very conventional

estimate)

• ROI for Testing Computer Software• Possible source: „What IT Managers Should Know about Testing

ROI“, RBCS – Rex Black• Examples show APPROXIMATE Testing ROI between 700% and

850% for large developments


Costs of Testing

Costs of Testing

• Internally• How much does a tester cost who is employed in the

company• Compute total costs

• Externally• Costs can be easily determined by costs/hour• You need an estimate about the needed testing time• External specialists could automate testing for

software that is often to be updated


Criteria Vendors I

Outsourcing evaluation criteria Vendor Criterion ExamplesCost and value Productivity savings and improvement Efficiency Automation and industrialization Commercial optionsPortfolio of test services Range of test services End-to-end testingTest expertise Quality control and improvement Consistent/repeatable testing Commit & comply with SLA/metricsProcess expertise Transition approach/handover risk mitigation Testing lifecycle process Requirements management Test strategy and planning Test case design and execution Defect management Metrics/KPIs

© Source: OVUM Services Guide Outsourced Testing 2011


Test environment and data management Test environment management Test data managementStandards and credibility Accreditation References Case stories Sustainability credentials Maturity and rigor of methodologiesPricing and engagement models Flexibility Service offering and options Outcome-based pricing Risk-reward/risk sharing Day rates Testing-as-a-service (TaaS) pricing/pay-as-you-use-modelOnshore Onshore Nearshore OffshoreGeographic locations Vendor locations Customer locationsDomain expertise Industry vertical expertise Specialist expertise

Criteria Vendors II

© Source: OVUM Services Guide Outsourced Testing 2011


Why would you outsource

Assessment of the table

• Making your own assessments• What are your main criteria• Costs calculation• Does testing knowledge exist in

company• Who are possible vendors• Who are possible vendors in Serbia

• What tests are you mainly interested in

• What risks do you want to minimize• Do you have a timing problem• …

Why not start outsourcing testing services right now?


And Serbia ?

In Serbia• What do you currently know about software testing?• About professional software testing?• About budgeting software testing?• Who should do software testing?

• If you have questions write to us and we will come and answer your questions. [email protected]

Documents

Www.objentis.com OBJENTIS Outsourcing testiranja softvera 2015 Hans Hartmann