TechTalk: What Happened in the Backend? The Power of DB Compare

World®’16

TechTalk:WhatHappenedintheBackend?ThePowerofDBCompareHuw PriceVPofApplicationDelivery&ProductManagerCAARD– CATechnologies

DO5T07T

DEVOPS

2 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

©2016CA.Allrightsreserved.Alltrademarksreferencedhereinbelongtotheirrespectivecompanies.

Thecontentprovidedinthis CAWorld2016presentationisintendedforinformationalpurposesonlyanddoesnotformanytypeofwarranty. The informationprovidedbyaCApartnerand/orCAcustomerhasnotbeenreviewedforaccuracybyCA.

ForInformationalPurposesOnlyTermsofthisPresentation


Abstract

Alotoftesting,whetherit’sautomatedormanual,focusesoninputtingdataintothefront-end,recordingtheresult,andcomparingittoanexpectedresult.However,anactioninthefront-endwilltypicallyhaveanimpactacrossnumerouscomponentsofasystem,includingmultipletablesinaback-enddatabase.Testersrequireanunderstandingofhowtablesshouldbeupdated,inordertovalidatethattheygottherightresultfortherightreason.§ Inthesessionyouwillsee:§ DBCompare,anew,high-performancedatabasecomparisonutilityforperformingsnapshot

comparisonsbetweendata.§ Hownumerousvisualizationscanbeusedtoquicklyidentifytheexactchangesthathave

occurredacrossinterdependenttables.§ HowDBComparecanbeusedbytesterstoidentifytheexactimpactoftheirtestsonthe

back-endsystem.WhenshowntheimpactoftheirtestsinDBCompare,testershavefrequentlyacknowledgedtoustheunforeseenconsequencesoftheirtests.DBComparecanthereforeprovideausefulaidfortestteamstoidentifytheactualresultoftheirtests,comparingittotheexpectresults.

HuwPrice

CATechnologiesVP,ApplicationDelivery,andProductManager,CAAgileRequirementsDesigner


Agenda

UNFORESEENCONSEQUENCES:AREAL-WORLD

MOSTTESTERSSTILL…

Q&A

TECHNICALDEBT

DBCOMPARE

DEMO

1

2

3

4

5

6


ARealWorldExampleofUnforeseenConsequences

https://www.linux.com/news/how-devops-failed-60k-users


FrontEnd Results

ManyTestersStillHammerDataIntotheFrontEndandRecordResults

TestCase

§ Isourexpectedresultdefinedproperly?Dotheymatch?

§ Didtherightthinghappenfortherightreason?

§ Doweactually knowtheactualresult?

Whathappenedinthebackend?


Doyouknowwhatimpactyourtestshadinthefront-endand back-end?Didyougettherightresultfortherightreason– whataboutobservability?

WecanhavealookwithDBCompare

Systemsundertestaretoocomplexforanyonesubjectmatterexpert,butthedocumentationdoeshelp.Testersneedtoknowthattheygottherightresultforthe

rightreason,butmustreckonwith:1. Systemdependencies?IfIdothis,whathaveIchanged?Ifthistestfailed,what

needsfixing?2. Observability:Wecannotverifythatwegottherightoutcomefortherightreason

– forexample,aretwoormoredefectsproducingafalsepositive?


DBCompare

§ Comparedatabasesnapshots(allorpartial)

§ Analyze messagetraffic

§ Useittounderstandhowapplicationsactuallyworkandpayofftechnicaldebt

§ Useittocaptureactualresultsandcompareittoyourexpectedresultswithallyouractualresultsinoneplace

HighPerformanceDataBaseComparison


CompareDatabaseSnapshots

StartTest

ExploreManualTest

AutomatedTest

EndTest

ActualResults

SnapshotStartTest

ApplicationUnderTest

DBCompare

DBCompareAnalyser

AutomationFrameworkAssertions


CompareDatabaseSnapshot– FocusedComparison

StartTestTime1

ExploreManualTest

AutomatedTest

ActualResults

SnapshotTime1

ApplicationUnderTest DBCompare

DBCompareAnalyser

AutomationFrameworkAssertions

EndTestTime2

SnapshotTime2


CADBCompare

§ Aversatilecomparisontoolthathelpsyouunderstandhowapplicationswork

§ Providesastructuredapproachtomanagingthecomparisonofexpectedagainstactualresults

§ ApowerfultooltoimprovetestingandsupportDevOps

HighPerformanceDatabaseComparison


SourceData-1

TransformTF1TransformTF2TransformTF3

OutputData-1

PublishTF1PublishTF2PublishTF3

DMTransformations

TF1-ExpectedTF2TF2-ExpectedTF2TF3-ExpectedTF3

DMTransformedData

PASSEDPASSEDFAILED

DBCompareActualvsExpected

ActualResults

ETLTesting


SourceData-1

OldApplicationVersion10

OutputData-1

ExpectedSD1-ND1-OD1-OD2SD1-ND1-OD1-OD2

TDMTransformedData

PASSEDPASSEDFAILED

DBCompareActualvsExpected

NewSourceData-2

NewApplicationVersion1

OutputData-2

TransformData–TF1

TransformData–TF2

TransformData–TF3

MigrationTesting– CompareDataBetweenOldandNew


RegressionData-1

OldApplicationVersion10

OutputData-1

PACK1-E0-E1-E2PACK2-E0-E1-E2PACK3-E0-E1-E2

TDMRegressionBuilder

PASSEDPASSEDFAILED

CoveredSetsofConditions

RegressionData-2


OutputData-2

RegressionData-3


OutputData-3

MigrationTesting– RegressionDrivenComparison


RecommendedSessions

SESSION# TITLE DATE/TIME

DO5T08TTechTalk:WhatisDDSIandHowtoMakeSenseofData-DrivenServiceImage. 11/17/2016at3:45pm

DO5X42STechVision:TestDataonDemand:DeliveringtheRightData,totheRightPlace,attheRightTime 11/17/2016at4:30pm

DO5T19SCaseStudy:GMFinancialBuildsaSustainable,Holistic,ContinuousDeliveryPractice 11/17/2016at4:30pm


Stayconnectedatcommunities.ca.com

Thankyou.


DevOps– ContinuousDelivery

FormoreinformationonDevOps– ContinuousDelivery,pleasevisit:http://cainc.to/PiTFpu

Technology

TechTalk: What Happened in the Backend? The Power of DB Compare