TMMI FRAME WORK FOR INDEPENDENT TESTINGGS Raju

Mahindra Satyam

AGENDA

Drivers for Independent Testing TMMi Foundation Test Maturity Model Benefits

DRIVERS FOR INDEPENDENT TESTING

ROAD-MAP FOR INDEPENDENT TESTING

SHARED SERVICES – VALUE PROPOSITION

20% savings in tools license costs

Reusable assets and frameworks will reduce cost

Entry level testers with higher productivity will result in 10 ~ 25 % savings in test execution phase only

Infrastructure (20%)

Tools & Framework

s

Resources(30%)

Infrastructure

Tools & Framework

s (50%)

Resources

Based on testing services the overall project cost reduction will be in a range of 12.5% ~ 25 %

A regular testing Shop costs 20% for Infrastructure,

30% for Resources and 50% for Tools

and Frameworks

REGULAR TESTING SHOP

SHARED SERVICES

Non-profit organization dedicated to improving testing for everyone Founded by a number of leading test and quality practitioners from across

Europe Promote a standard model and international industry standard for assessing

and rating organizations' testing process capabilities Persisting feeling that SW-CMM and CMMI models do not investigate the test

process areas in sufficient depth TMMi aligns with, and can fully support being used in isolation or alongside

CMMI

TEST MATURITY MODEL INTEGRATION

Richard Sykes (Chair)

Andrew Goslin Mac Miller Fran O'Hara

Klaus Olsen Geoff ThompsonErik van Veenendaal

Brian Wells

The TMMi Foundation Board members are: TMMi Foundation

Board

OBJECTIVES & DELIVERABLES

The TMMi Foundation is a non-profit organization (based in Dublin) dedicated to improving testing for everyone with specific objectives:

The following organizations founded the TMMi Foundation  

• Identifying and securing ownership of the TMMi Model • Definition of an international core TMMi Model • Creation and management of an independent, unbiased central

data repository• Provision of an independent accreditation process for TMMi®

Assessment • Independent assessor training, accreditation, guidelines and

examinations • Provision of a public forum of interested parties to facilitate free

interchange of information, education, ideas and usage of the public standard The Foundation will provide

•A standard TMMi Model . •An independently managed data repository to support TMMi assessment•Assessment Method Accreditation/Audit Framework for TMMi assessment•Certification and training/examination process.

TEST MATURITY MODEL

Supports testing activities and test process improvement in systems engineering and software engineering

Does not provide an approach for test process improvement

Provides generic framework as a reference model

Addresses all test levels

TMMI & CMMI

Level Focus Key Process Areas (CMMi Testing) TMMI Level

5 Continuous Process Improvement

Improved Test Process Defect Prevention

Optimizing Defect Management Test Process Optimization     Quality Control

4Quantitatively Managed

Establish & measure testing process performance

Test Measurement

Quantitative Managed Peer Reviews Product Quality Evaluation

    Advanced Peer Reviews

3Process Standardization

Standard template for test requirments collection

Test Organization

Defined  Integration test plans & schedule Test Training Program

  Testing ProcessTest Life Cycle and Integration Non-Functional Testing

  Peer Reviews Peer Reviews

2Basic Project Management

Gathers Testing Requirements Test Policy and Strategy

Managed Testing Schedule Test Planning   Testing Execution Test Monitoring and Control   Testing Monitoring & Reporting Test Design and Execution      

1 Process is informal and Adhoc

No Process for TestingTesting is a chaotic,

Initial Undefined process

TMMI ASSESSMENT & CERTIFICATIONThe following organizations have been formally assessed by an accredited assessment provider

Organization LevelAssessment

ProviderCertificate

Expiry Date

LG CNS3 - Defined Improve QS B.V.

HNDR-738724-091005-5575200019 31-Oct-12

Level 2 - Managed Fully AchievedLevel 3 - Defined Fully Achieved

Metodos y Tecnologia (MTP)

3 - Defined Experimentus Ltd

WLLB-556857-101217-3252000087 31-Dec-13

Level 2 - Managed Fully AchievedLevel 3 - Defined Fully Achieved

Home Office IT2 - Managed Experimentus Ltd

WLLB-556857-110601-0024700119 30-Jun-14

Level 2 - Managed Fully Achieved

TMMI & CMMI TMMi complements CMMi

Comparison of TMMi and CMMi Levels 2 and 3 show:

TMMi covers test-related quality in much greater detail

Nearly half of TMMi is not covered by CMMI

Non-test Process Areas and Practices elaborated in CMMi are mostly not repeated in TMMi, only referenced

To benefit most at higher levels of TMMi needs strong CMMi-like processes across development

Value added by TMMi

Assesses test more deeply than CMMi

Almost 50% of TMMi covers test elements not in CMMi

BENEFITS OF TMMI & INDEPENDENT TESTING TMMi processes aligns with organizational and quality objectives early in

the improvement model

The structure and the generic components of CMMi have been re-used within TMMi

Better testing quality and objectivity

Independence of a development team so that they are unable to influence testing results

Objective, comprehensive, timely data on the developed software enabling you to estimate the real project progress, reveal problems (e.g., divergence from the schedule, budget, planned go-to-market time) and timely mitigate them

Proper commitment of vendor's management and development team to your project

More business flexibility and efficiency

More costs for investment in business expansion or revenue-producing activities

Better customer satisfaction