Creating Visibility with Test Automation & Test Case Management

Creating Visibility and Speed with Automation

and Test Case Management

MARCH 24 2016

Joe Colantonio –TestTalks.com@jcolantonio

Kevin Dunne – QASymphony@kevindunneqa

Join the conversation – use the hashtag #testvisibility on Twitter

Kevin Dunne, VP of Strategy and Business Development, QASymphony

Kevin Dunne is the VP of Strategy and Business Development at QASymphony. In this role, Kevin focuses on innovation, thought leadership and new global business opportunities. As one of the first employees at QASymphony, Kevin has seen many facets of the business working in sales, customer support, marketing, and product management.

Kevin comes to QASymphony from Deloitte, where he managed testing on large government and Fortune 500 engagements delivering ERP implementations and custom software development. Kevin holds a Bachelor of Science degree from Vanderbilt University.

OUR PRESENTERS

Joe Colantonio, Author, Speaker, Test Automation Thought-Leader

Joe Colantonio is a test automation architect for a large Fortune 100 company with more than 15 + years of test automation and performance testing experience.

Joe is also the founder of the popular test automation blog, joecolantonio.com and the host of TestTalks, a podcast dedicated to all things test automation related. He is also the author of the highly rated book The UFT API Testing Manifesto – A step-by-step hands-on testing guide for the masses.

Join the conversation – use the hashtag #testvisibility on Twitter

MAKE AUTOMATION VISIBLE TO YOUR ORGANIZATION

Planning

Writing

Executing &Reporting

Join the conversation – use the hashtag #testvisibility on Twitter

MANAGE EXPECTATIONS

Join the conversation – use the hashtag #testvisibility on Twitter

STAFFING

Join the conversation – use the hashtag #testvisibility on Twitter

TEST FIRST METHODOLOGIES

• Test-Driven Development (TDD)

• Behavior Driven Development (BDD)

• Definition of Ready (DOR)

• Definition of Done (DOD)

MANAGING TESTS AND SCRIPT MAINTENANCE

Join the conversation – use the hashtag #testvisibility on Twitter

TEST MIX

UI

API

Unit

Join the conversation – use the hashtag #testvisibility on Twitter

TEST MIX - TEST SHOULD BE SMALL AND FAST

Join the conversation – use the hashtag #testvisibility on Twitter

RISK BASED TEST MIX

Join the conversation – use the hashtag #testvisibility on Twitter

MANAGING TEST WITH CODE REVIEWS

Join the conversation – use the hashtag #testvisibility on Twitter

CRITICAL REPORTS - MAKE VISIBLE IN CI

Join the conversation – use the hashtag #testvisibility on Twitter

MANAGE FAILING TEST

• Automatically re-run failing tests

• Quarantine Test

• Delete test after 48 hours

Join the conversation – use the hashtag #testvisibility on Twitter

MANAGE TEST WITH TAGS

• Specify New

• Specify Flaky

• Specify Manual

@

Join the conversation – use the hashtag #testvisibility on Twitter

MANAGE TEST WITH TAGS

Join the conversation – use the hashtag #testvisibility on Twitter

MANGE TEST WITH METRICS

• Mean time to diagnosis

• Run time• Automated to Manual

ratio• Flaky Rate• Bugs found by

automationJoin the conversation – use the hashtag #testvisibility on Twitter

MANAGING TEST - MAKE IT VISIBLE WITH DASHBOARDS

• Increased traceability• Single source of truth• More powerful reporting • Increased visibility

Join the conversation – use the hashtag #testvisibility on Twitter

INTEGRATE AUTOMATION WITH MANAGEMENT TOOLS

• Rally• Jira• ALM• Serenity• QTest

Join the conversation – use the hashtag #testvisibility on Twitter

Planning

Writing

Executing &Reporting

Join the conversation – use the hashtag #testvisibility on Twitter

QUESTIONS?

Join the conversation – use the hashtag #testvisibility on Twitter

Joe Colantoniojoe@testtalks.com

Twitter: @jcolantonioPodcast:

www.testtalks.comBlog:

www.joecolantonio.com

Thank you

Join the conversation – use the hashtag #testvisibility on Twitter