20
There Has To Be a Better Way To Fast Test Coverage Mark Braemer - Sr. Principal Consultant - CA Technologies DO5X28E DEVOPS

Pre-Con Ed: There has to be a Better Way to Fast Test Coverage!

Embed Size (px)

Citation preview

Page 1: Pre-Con Ed: There has to be a Better Way to Fast Test Coverage!

There Has To Be a Better WayTo Fast Test CoverageMark Braemer - Sr. Principal Consultant - CA Technologies

DO5X28E

DEVOPS

Page 2: Pre-Con Ed: There has to be a Better Way to Fast Test Coverage!

3 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

© 2016 CA. All rights reserved. All trademarks referenced herein belong to their respective companies.

The content provided in this CA World 2016 presentation is intended for informational purposes only and does not form any type of warranty. The information provided by a CA partner and/or CA customer has not been reviewed for accuracy by CA.

For Informational Purposes Only Terms of this Presentation

Page 3: Pre-Con Ed: There has to be a Better Way to Fast Test Coverage!

4 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Abstract

Are you tired of lousy test coverage?

This presentation will show you how to obtain high test coverage without all the hassle most organizations encounter.

See in a demo how CA Test Data Manager and CA Agile Requirements Designer work together to help you build better test cases with better coverage using better data!

Mark BraemerCA TechnologiesSr. Principal Consultant

Page 4: Pre-Con Ed: There has to be a Better Way to Fast Test Coverage!

5 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Agenda

OVERVIEW OF CA TEST DATA MANAGER

OVERVIEW OF CA AGILE REQUIREMENTS DESIGNER

INTEGRATION OF TDM & ARD IN A BROADER DEVOPS USE CASE

DEMO OF USE CASES

Q&A

1

2

3

4

5

Page 5: Pre-Con Ed: There has to be a Better Way to Fast Test Coverage!

6 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Overview of CA Test Data Manager

Page 6: Pre-Con Ed: There has to be a Better Way to Fast Test Coverage!

7 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

CA Test Data Manager

Data Discovery, modeling,

visualization and Profiling

Data Subsetting,

Masking and Synthetic

Data Generation

Test Data on Demand™

Review data quality and data errors

Measure coverage and identify gaps

Discover relationships Identify sensitive data

across all systems Identify future trends

Share data across parallel teams

Enable Self-Service on demand access

Provide multiple outsources with secure data

Eliminate manual data creation and masking

Reduce costs and improve quality with short but rigorous test cycles

Improve test coverage

Page 7: Pre-Con Ed: There has to be a Better Way to Fast Test Coverage!

8 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Synthetic Test Data Generation“Empty”

CA TDM +

Required Data Characteristics

Provision fit for purpose test data anytime and every time!Provision data without access to production systems!

Reduce cost of creation and maintenance of Test Data.

Ready for Testing!

8

Find/n Demand

Page 8: Pre-Con Ed: There has to be a Better Way to Fast Test Coverage!

9 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Synthetic Generation of Flat Files

Create high quality test data to test applications that rely on non-relational database sources.

Generate synthetic data in various formats including XSD/XML, WSDL, RR pair, JSON etc.

Publish RR Pairs to a virtual service via integration with CA Service Virtualization

Page 9: Pre-Con Ed: There has to be a Better Way to Fast Test Coverage!

10 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Overview of CA Agile Requirements Designer

Page 10: Pre-Con Ed: There has to be a Better Way to Fast Test Coverage!

11 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

What is CA Agile Requirements Designer?

Graphs sophisticated business processes and path modeling.

Defines and optimizes requirements and test case designs

Designs clear requirements, test cases, and even data, in one flow charting tool

Significantly improves the quality of requirements and test cases.

Reduces costs of testing by detecting the smallest number of test cases that have the maximum coverage, removes duplicate or redundant test cases

Page 11: Pre-Con Ed: There has to be a Better Way to Fast Test Coverage!

12 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

CA Agile Requirements Design – Create perfect test cases

Generate the smallest number of test cases with maximum coverage

Test more functionality in fewer tests

Measure test coverage and know that every requirement has been tested

The cost and complexity tool in CA Test Case Optimizer

With ARD Without ARD

No of Test Cases 450 318

Code Coverage 63 55

Functional Coverage 67% ~70% (Est)

Man Days to Create 3 40

Page 12: Pre-Con Ed: There has to be a Better Way to Fast Test Coverage!

13 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Integration of TDM & ARD in a Broader DEVOPS Use Case

Page 13: Pre-Con Ed: There has to be a Better Way to Fast Test Coverage!

14 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Big Picture End to End Testing

24 User Stories were identified in CA Agile Central that describe the functional behavior of flat file generation capability

We modeled these stories using Agile Requirements Designer, resulting in 1 Top Flow and 6 Sub Flows

‘Full Coverage – All Paths’ option yielded 17,000 Test Cases. However, an optimal code coverage of 70% was achieved using ‘Full Coverage – All In/Out Edges ’ option resulting in more manageable set of 450 Test Cases

The Test Data was provided in context of each model to drive the automation

The Test Cases were automated by associating a code snippet to each node on the flow so that export of any path resulted in an end-end automation

Page 14: Pre-Con Ed: There has to be a Better Way to Fast Test Coverage!

15 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Demo of Use Cases

Page 15: Pre-Con Ed: There has to be a Better Way to Fast Test Coverage!

16 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Today’s Demo

Synthetically generate multiple XMLs using Test Data Manager

Model the paths of the data generation use case using Agile Requirements Designer

Automate the data generation testing using the model from Agile Requirements Designer

Page 16: Pre-Con Ed: There has to be a Better Way to Fast Test Coverage!

17 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Questions?

Page 17: Pre-Con Ed: There has to be a Better Way to Fast Test Coverage!

18 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Recommended Sessions

SESSION # TITLE DATE/TIME

DO5X06L Pre-Con Lab: Test Data Manager - Masking, subsetting and generating synthetic data 11/15/2016 at 9:00 am

DO5T06T TechTalk: Sometimes Less is More –Visualization Can Reduce your Test Data while Enhancing Quality! 11/16/2016 at 3:00 pm

DO5X38S Case Study: GM Financial's Test Data Management and Automated Testing Journey 11/17/2016 at 3:45 pm

Page 18: Pre-Con Ed: There has to be a Better Way to Fast Test Coverage!

19 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Must See Demos

Use Model Based Testing

Continuous Delivery

Continuous DeliveryTheater 5

Achieve Max Test Coverage

CA ARDTheatre 5

Deliver Test Data Faster

CA TDMTheater 5

CA ARDTheatre 5

Page 19: Pre-Con Ed: There has to be a Better Way to Fast Test Coverage!

20 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Thank you.

Stay connected at communities.ca.com

Page 20: Pre-Con Ed: There has to be a Better Way to Fast Test Coverage!

@CAWORLD #CAWORLD © 2016 CA. All RIGHTS RESERVED.21 @CAWORLD #CAWORLD

DevOps – Continuous Delivery

For more information on DevOps – Continuous Delivery, please visit: http://cainc.to/PiTFpu