BizDevOps – Delivering Business Value Quickly at Scale

BizDevOps: Delivering Business Value Quickly at Scale

Our Last Webinar

Watch Now at QASymphony.com/resources

Our Last Webinar Upcoming Webinar Series

Kickstarting BDD: Scaling for the Enterprise

Sign up Today QASymphony.com/resources

About QASymphony

Test Management | Exploratory Testing | Test Analytics | BDD and more...

The Complete Testing Platform

STATE OF THE INDUSTRY

Organizations

practicing agile

development

Organizations have or

are planning a DevOps

initiative in their

company in the next

12 months

The difference in the

number of code

deployments between

high performing and

low performing IT

organizations

94% 71% 46x

The Pace of Software Development is Moving Faster Than Ever

Source: V1 2016 State of Agile, Puppet 2016 State of DevOps

The Move to DevOps is Clear

1) Quicker time to customer value

2) Better alignment between businesses and customers

3) Better ability to respond to customer input

DevTestOps

Business

+

Development

+

Operations

“Bringing the business stakeholders

into DevOps in order to confidently

validate that business processes

work end-to-end across single or

multiple applications.”

What is BizDevOps?

Testing in DevOps

Practices like behavior-driven development (BDD) and test-

driven development (TDD) are becoming more popular.

Source: V1 2016 and 2009 State of Agile

78%Increase in Teams

doing BDD

Getting the Biz in DevOps

Dev

Product Owner

Tester

Living

Documentation

Scenario: Buy Last Coffee Given There are 1 Coffees left in the MachineAnd I have deposited $5And I previously have $100 in the bankWhen I press the coffee buttonThen I should be served a coffee

Feature: Serve CoffeeCoffee should not be served until paid forCoffee should not be served until the button has been pressed If there is no coffee left, then the money should be refunded

Three Amigos in BDD

01

02

0304

05

5 Major Problems in DevOps Adoption

BizDevOps

Our Presenters

Kevin DunneVP of Strategy

Brandon CipesVP DevOps,

Bobby SmithDirector QAS Labs

01

02

0304

05 01LACK OF TEST

AUTOMATION COVERAGE


“Functional testing is one of the most crucial, time-consuming, and expensive steps in continuous testing —so it’s necessary to automate this testing, and to automate it at higher levels than most Agile teams achieve today.”

– Forrester

Oh, no…

Freaking OutAcceptance

Tests

Integration

Tests

Unit TestsWe for sure have this covered.

Super Confident

I think we got this covered

Semi-Confident

QA Risk When Scaling Automation

RISK LEVEL

BDD to the Rescue

Collaborate

Owner, Dev, Test, design acceptance criteria

Record

Document common syntax for all

Automate

Execute test scenarios that validate behavior

Full Traceability

Behavior Driven Development

01

02

0304

05 02LACK OF VISIBILITY

MAKES TEST AUTOMATION HARDER


We wrote a bunch of

automated tests, but what

exactly do those tests cover?

INSERT PHOTO ON TOP

Festering Problems

Code

Code

Code

Automation Scripts

Code

Code

Cod

e

Cod

e

What Are

We Testing?

Automation Confusion

Automation frameworks without feature visibility create

business confusion around application coverage.

• Automation becomes pure code, without clear understanding

of test coverage

• QA doesn't know if test coverage is sufficient

Communication Breakdowns

Features and requirements change during Agile and DevOps

sprints. If automation is disconnected from these features, we

might be testing a changed feature set without know it.

• Changes are discovered after automation is completed

• Automation is never updated to reflect adequate coverage

01

02

0304

05 03MAINTAINING TEST

VERSIONS WITH CODE


Are My Tests Connected with Code?

TESTING

VERSION

CONTROLBUILD & UNIT TEST

AUTOMATED AND

MANUAL TESTDEPLOY

Check In

TESTS FAIL

Typical CI Workflow

PLAN

DEV

Trigger

Trigger

FEED BACK

Check InTrigger

Trigger

TEST PASS

PUSH TO PROD

FEEDBACK

01

02

0304

05 04MAINTAINING SINGLE

SOURCE OF TRUTH IS A NIGHTMARE


Siloed TeamsTraditional Software Development

Three Amigos BDD Process

BDD in JIRA

01

02

0304

05

WHAT IS THE BUSINESS VALUE IN THE PIPELINE?

05


DEVOPS MATURITY MODEL

PROCESS FOCUS

Define Plan Code Build Integrate Test Release Deploy Operate

AUTOMATION FOCUS

AGILE vs DEVOPS

DevOps, TDD/BDD, Continuous Testing, CI,

CD, Data Driven, Automated Deployment

Scrum, Kanban, Integration Planning, Retrospective, Small Integrations, Daily Standups, Backlog

Planning

*Cloud Bees, Jenkins World 2016

AGILE UPSTREAM AGILE DOWNSTREAM

1) BDD – BDD can help with alignment and building automation

more efficiently

2) Technical Testing is Here – testing is increasingly

technical and should be treated as code

3) Atlassian Stack – provides the system of record for

“BizDevOps” pipeline and should be accessible to everyone and built to provide visibility to C-Suite.

Key Takeaways

Questions?