Testing Visibly

8/14/2019 Testing Visibly

1/13

8/14/2019 Testing Visibly

2/13

Topics/OutlineTheInterrogatives

WhatisTestingVisibly?

Whyisitimportant?

WhenshouldthetechniquesforTestingVisiblybeemployed?

WhoisresponsibleforensuringthatweTestVisibly?

Where(organizationally)shouldthistechniquebeappliedand

wherearetherelationshipswithotherSoftware/Systems

EngineeringTeams? Howdoesitwork?Howdoyoudoit?

Wheredowegofromhere?

8/14/2019 Testing Visibly

3/13

What is Testing Visibly?

Determinethesuccesscriteria,metrics,andresult

datatobeprovidedbytestingatthestartofthe

process,delivertheseresultsconstantlyandreview

frequently

8/14/2019 Testing Visibly

4/13

What is Testing Visibly?MakeanearlyappearanceintheSoftwareDevelopmentLifeCycle(SDLC)

TestEarlyandOften

Reduceoverallcostofdefects

ShareTestingOperationsProcessandPolicywiththeOrganization

Empowersotherstounderstandhowweworkandtosetexpectations

Providesabaselineforchangeearlyon;ifneeded

Keepinganopendoorpolicy Donotremaincloakedinsecrecy

Inviteotherteamstostatusandreportingmeetingswhileintest

8/14/2019 Testing Visibly

5/13

Why is it important to test visibly?Testingisthemicroscopeinto

viewinganorganizationsabilityto

buildqualitysoftware.

Ittellsusmorethanwhetherornot

softwaresatisfiesaspecified

requirement,itisthecatalystfor

illustratinghoweffectivethe

organizationworks.

ValueAddedContribution

TestEarlyandOften

Reduceoverallcostofdefects

CommoditizationofITandtherelevanceto

BusinessGoals

Remainingrelevantandavaluedcontributorre

enforcesrequirementfortest

VisibilitymakesthecomponentsoftheTriangleof

Qualityunambiguousandeasytounderstandthe

impactofeachcomponent

8/14/2019 Testing Visibly

6/13

When should the techniques of Testing Visibly be employed?

EarlyandoftenSoundfamiliar?

Plantodeliverresults

Asearlyaspossibleandfrequently;keep

youraudienceengagedandinformed

Knowwhentoreportandtowhom

Seekouttheirparticipation

Oftentimesotherteamshavemoved

ontothenextrelease

8/14/2019 Testing Visibly

7/13

Who is responsible for Testing Visibly?

Everyone

Alllayersofthetestingorganizationhavesomecontributiontotesting

visibly.

TestLeadership

Defineanddrivethevision

Takeownershipofthestateoftherelationships

TestEngineers

Collectdataforreportingpurposes

Communicateandcollaboratewithcounterparts

Allowingaprojectteaminsightintotestingoperationsdoesnotdiscountthe

credibilityofthetest,nordoesitdisintegratethenatureofbeingunbiased.

8/14/2019 Testing Visibly

8/13

Relationships and Touch Points

Environment

Arch

DEV TM 1

TM 2PM

TM 4

TM 3

!"#$%&'()*"+,-".,/+'Quality

ManagerOffshore

Core Teams

Functional Unit 1

Test Lead

Test Analysts

Testers

Functional Unit 2

Test Lead

Test Analysts

Testers

Functional Unit N

Test Lead

Test Analysts

Testers

Engineering

UAT Team

Sponsors

Test Managers

!!0&.),12'!!(3%,*".,/+'./'!456'!!7&8&1.'7"."'!!921"%".,/+'

8/14/2019 Testing Visibly

9/13

How does it work?

WeneedtosharewiththeOrganizationhowweworkandhowweexpecttowork

withothers.

ThisismosteffectivelyconveyedviaaUserManual

TheUsersManualisaguideforteamstouseinitsinteractionwiththetestingteam.Itdescribesthefollowing:

Theenvironmentandsystemsportfoliothatthetestingteamwillsupport

Theorganizationofthetestingteam

Howtorequestandreceiveservicesfromthetestingteam

Supportingdefiningdocumentsthatprescribehowthetestingteamwillwork

8/14/2019 Testing Visibly

10/13

The User Manual

RequestProcess

RequestPrioritization

Howtocheckrequeststatus

Howtoescalaterequests

Theunderlyingprinciplessupportingtestingservicesinclude:

Aconsistent,repeatable,flexible,andenterpriseorientedframework

Insertingtestingintoallphasesofthesoftwaredevelopmentlifecycle

Establishingqualityaspartofthetaskfromitsinception

Identificationofrisksearly,andappliestaskandqualityresourcesasneededtomitigate

thoserisks

Aggressiveuseofmetrics,trendanalysis,andlessonslearnedtoevaluateperformance

QualityAssurance

RiskManagement

IssueManagement

StaffRotation/Replacement

ChangeControl

AcceptanceManagement

StatusMeasuringandReporting

PerformanceMeasurementandReporting

8/14/2019 Testing Visibly

11/13

Orchestrating

the Defining

Documents

TheUserManualisestablishedasahubormapintotheotherdefiningdocumentsthatdrive

howthetestingteamsoperate.

!"#"$%&

'()(*"+")%&

,-()&

./"0&

'()1(-&

'"%02$/&

'()(*"+")%&

,-()&

3"/%&4%0(%"*5&

6"-"(/"&

'()(*"+")%&

,-()&

78()*"&

'()(*"+")%&

62/9&

'()(*"+")%&

,-()&

:);20

8/14/2019 Testing Visibly

12/13

Where we go from hereWemustmaintainrelevanceintheSDLCdespite

organizationalandbudgetcutbacks

AlignwiththeBusiness

EnterpriseWideTestingStrategy

ASISmodeling FutureStateDefinition Roadmap

.

RoadmapisacodifiedartifactthatillustrateshowTestingwillcontinuetogrowandremain

relevanttotheBusinessgoals.

Aroadmapisbuiltonprinciples;TestingVisiblyisoneofthem

8/14/2019 Testing Visibly

13/13

Thank You

DavidKapfhammer

GlobalDirector

david.kapfhammer@keane.com