Arun Krishnan - Automation ManagerMaria Afzal- Automation Test Analyst

Agile based delivery model is commonly used to be able to keep up with the

pace at which businesses must change in response to emerging trends in

market. To complement BDD development process, a need for robust testing

solution required to help Developers, QA and Business Analysts to share a

common language with focus on business requirements.

Abstract

This presentation outlines how we can achieve faster time to market and quality by implementing BDD based testing solution build on open source automation toolset.

2012 2014 2017 Process Challenges

10% defect leakage in Prod

3 Months Release cycle

Partial Agile

BDD Implementation

1% defect leakage in Prod

6 Weeks Release cycle

Fully Agile Adoption

BDD Process Implementation

0% defect leakage in Prod

4 Weeks Release cycle

Challenges

1 Frequent application deployment changes under stringent timelines

2 High defect leakage to UAT/Production

3 Minimal automation coverage

4 Time to market

5 Isolated teams (BA, DEV, QA)

Slow VM connectivity due to heavy configuration requirement

BDD Automation In Sprint Data independent scripts Service layer

Test Design Automation Execution of BDD

Suite on Code Check in Headless mode

Continuous Integration Integrate Build

deployment process

Regression Automation E2E Automation Smoke Automation

Automated Test Result generation by Jenkins.

Dashboard for Jenkins test execution report.

Emailing Test Reports to the stake holders

Our Solution

Solutions

Specialized

Advanced

Traditional

Process

How BDD happens?

Product SME

SystemUnder Test

Function Skeleton Created

Script generation

Test Result

Write Scenarios

Code /Refactor

Step Definition generation and

Feature Execution (Dry

Run)

Script Execution-Jenkins

QA/BA

QA/BA

Automatically created by BDD Tool

DEV

QA/BA/DEV

Automation Team//DEV

Product SME/BA

User Story

Failed Test CasePassed Test Case

Feature Files

Initiation Phase Scripting & Implementation

B D D

BA –VersionOne User stories

BDD Acceptance

criteriaTester – BDD

stories

BDD stories are written in parallel to developmentof VersionOne stories

BDD Technical Implementation

Features – a text file with a .feature extension, house the tests.Features are made up of Scenarios –scenarios are synonymous with a user story or test case(s) i.e. BehaviorThe Scenarios are made up of Individual Steps – Steps are the component interactions (or Test Steps) for a given Test Case(s), written in Gherkin language

The Step Definitions essentially convert the simple English “Steps” into code that can be executed to perform the step.Support Code will be executed to perform the specific Step in the Feature file.WATiR & Selenium are all examples of pre built Support Libraries that can be used in conjunction with Cucumber to conduct Automated tests.

Benefits Delivered

VALUE DELIVERED BENEFITS DELIVERED

Accelerated Time to market by reduced testing window

Jenkins eliminates manual dependency

Effort savings enables manual team to focus more on end-end tests

Increased scope of in – sprints tests Monthly releases with reduced team

size Easy and comprehensive testing of

hot fixes

350 + Business Scenarios automated 80% Reduction of in-sprint testing

time 0% defect leakage with end to end

automation coverage 300% Increase in test case execution

count post BDD implementation > 30% reduction in overall team size

over a year

https://en.wikipedia.org/wiki/Behavior-driven_development

http://behaviourdriven.org/

https://github.com/cucumber/cucumber/wiki/Gherkin

Reference Topic Link

References

Arun Krishnan is an automation manager with more than 11 years of extensive experience working with automation tools, such as HP UFT, Selenium, Cucumber, Watir, SeeTest, Perfecto Mobile, and Mobile Labs. His core expertise is in functional and mobile automation with traditional and nontraditional tools and techniques. Engaged with customer teams to design, implement, and deliver solutions that address specific pain points.

Author Biography

Maria Afzal is an automation expert with more than 3 years of experience in automation testing. Maria has extensive experience on key automation tools and platforms and has worked on Hybrid framework for Selenium,Ruby. Maria has expertise in developing automation framework for multiple technologies like Web, and Mobile and has worked on NextGen methodologies like BDD, CI and Agile Maria is currently working with a leading US banking client

Author Biography

Thank you!