Shift-Right' - Rapid Evolution with DesignOps

‘Shift-Right’ - Rapid Evolution with DesignOpsJonathon Wright

DO5X47S

DEVOPS

2 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

For Informational Purposes Only

Terms of this Presentation

© 2016 CA. All rights reserved. All trademarks referenced herein belong to their respective companies. The presentation provided at CA

World 2016 is intended for information purposes only and does not form any type of warranty. Some of the specific slides with customer

references relate to customer's specific use and experience of CA products and solutions so actual results may vary.

Certain information in this presentation may outline CA’s general product direction. This presentation shall not serve to (i) affect the rights

and/or obligations of CA or its licensees under any existing or future license agreement or services agreement relating to any CA software

product; or (ii) amend any product documentation or specifications for any CA software product. This presentation is based on current

information and resource allocations as of November 1, 2016, and is subject to change or withdrawal by CA at any time without notice. The

development, release and timing of any features or functionality described in this presentation remain at CA’s sole discretion.

Notwithstanding anything in this presentation to the contrary, upon the general availability of any future CA product release referenced in

this presentation, CA may make such release available to new licensees in the form of a regularly scheduled major product release. Such

release may be made available to licensees of the product who are active subscribers to CA maintenance and support, on a when and if-

available basis. The information in this presentation is not deemed to be incorporated into any contract.


Abstract

This session will directly address the new delivery paradigm; from ideation to design, development, testing through to operations known as DesignOps that providing a value-driven delivery approach that scales when defining, building and deploying solutions.

Evolution, over revolution shifting to a more cognitive, dynamic, adaptive, continuous model calls for new practices that require accelerated communication, collaboration, integration, measurement and automation. Join Jonathon who will explore some of the new features of CA continuous testing platforms that can accelerate your adoption of modern scaled agile and lean approaches.

Jonathon Wright

CA

Director of Digital Assurance


Agenda

INTRODUCTION

DESIGNOPS

CONNECTED INTELLIGENCE

DIGITAL EVOLUTION

DIGITAL ASSURANCE

DIGITAL ECOLOGY

1

2

3

4

5

6


VA

LUE-

DR

IVEN

TIME

1960s 1990s TODAY

Cognitive Adoption - ‘Evolution, over Revolution’

1 – “The Battle for Competitive Advantage in the App Economy”, Oxford Economics, 2015

of enterprises believe that they need value-driven algorithmic business models to respond to disruption in the next 3 years.78%

Legacy is your Legacy (API)

Digitalization of your Core (SOA)

Digital (Cognitive Adoption)


Businesses no longer have the luxury of time.

Rising customer expectations, competitive threats,

and increased consumer choice have turned rapid

delivery and iteration of software applications into a

competitive differentiator.

Optimizing the delivery value chain has become the

new means to better business outcomes.

TechRadar™: Continuous Software Delivery, Q2 2015, Forrester Research, May 1, 2015

“

”

2014 Vanson Bourne study commissioned by CA

UNPRECEDENTED

94%of executives face increased pressure to release appsmore quickly

“

Journey to Digital Transformation

© 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD


78% of Executives in most B2C industries say their business will be disrupted by digital

technologies in the next 12 months. 20% say their business will be massively disrupted.

- Forrester State of Digital Business - Big Bang Disruptions - Larry Downes - RallyON Keynote


Companies Look to DevOps for the Answer

Vanson Bourne – DevOps survey 2014

Benefits of DevOpsPercent improvements in business areas

Co

llab

ora

tio

n

Ap

p q

ual

ity

Cu

sto

mer

s

New

ser

vice

s

Tim

e-to

-mar

ket

Rev

enu

e

Co

st s

avin

gs

Dep

loy

freq

uen

cy

Plan to adopt DevOpsNext 3 to 5years

15%88PERCENT

18% 18%19% 19% 19%

21% 21%


Our Focus…

Dramatically Improve Testing in Digital

Better. Value. Smarter.

*National Institute of Standards & Technology

Per Year of IT Budget for QA and Testing*

Per Year on Testing Tools$60B $2.5B

How about focusing on Minimum Viable Quality?



Limited test resources and

lack of Automation

of all testing is still manual

70%

Source: Bloor Research, 2014

Test Datafor setup & staging

of time spent looking for50%

Source: Bloor Research, 2014

Build of various dev & testing

Environments

of critical dependencies are unavailable when dev and test teams need them

56%

Source: voke Market Snapshot TM Report: Service Virtualization – January 2015

Is Testing still the Bottleneck?

Digital TestingAgile Requirements Designer, TDM and RA



DESIGNOPS

Continuous Delivery - Sub-Value Streams

1Continuous

Delivery

2Continuous

Testing

3Continuous

Staging

4Continuous

Release


Continuous Adoption

CognitiveAdaptive Adoption

Continuous Testing

Continuous Improvement

Continuous Delivery

Continuous Intelligence

Continuous Learning

Continuous Innovation

idea

DEVELOPMENT OPERATIONS

‘Shift-Right’ Digital Ecology

‘Shift-Up’ Digital Assurance feat. Connected Intelligence

‘Shift-Left’ Digital Evolution feat. DesignOps

CUSTOMER EXPERIENCE TESTING

DesignDevTestOpsAgility across all 4 increases speed, reliability and efficiency

CognitiveAdaptive Testing

CognitiveAdaptive

Improvement

Cognitive Adaptive Delivery

CognitiveAdaptive

Intelligence

CognitiveAdaptive Learning

CognitiveAdaptive

Innovation

DESIGN

‘Shift-Down’ Digital Archaeology


WATERFALL / V-MODELDAD, LeSS & SAFE (v4)LEAN STARTUP / UX

Incubate Scale

FASTFEEDBACK

BUSINESS INTELLIGENCEREAL TIMEPREDICTIVEPERSCRIPTIVE

Enhance

SLOW FEEDBACKWHAT IS HAPPENING NOW?

WHAT SHOULD WE DO?EXPERIMENT ASSURE


‘Shift Left’ Becoming an Digitally Disruptive Business

Digital Evolution feat. DesignOps

PORTFOLIOMANAGEMENT

Easily and securely manage from single location &decrease creation time

by 96%

LIFECYCLEVIRTUALIZATION

Simultaneously access and virtual services

accelerating app development by 97%

SCALED AGILEMANAGEMENT

30–50% improvements in both cost and deliveryduration compared to

traditional projects

SHIFTLEFT

Innovation …. Faster


* Dave Landis, LitheSpeed.com, LeanUX principles and Design Thinking

Solution & Design Thinking, Lean Digital, Customer & User Experience (DX, CX & UX)

Rapid Evolution



Build

Deliver

MonitorMeasure

Learn

Design

Make

Check

Think

Proactive over Reactive

Governance over

Ownership

Maturity over Mastery

Predictive over Continuous

Evolution over Revolution

Engineering over Agility

Intelligence over Things


INNOVATION (INNOVATION, GROWTH & MATURITY)FAST

INNOVATIONSLOW

INNOVATION

DECOMPOSITIONLIBERATIONIMMUNIZATION

Incubate Scale

WHAT HAPPENED ?WHAT’S HAPPENING NOW? WHAT WILL HAPPEN ? WHAT COULD HAPPEN ?

Enhance

WHAT IS HAPPENING NOW?

Ecologist

DevScrumMaster

Therapist Researcher

Designer

DevOpsEngineer

DisciplinedAgilist

Maker

Creative

Infrastructure Engineer

SDET

BA

Tester

Product Owner PM

Ops

Support

FASTFEEDBACK

SLOW FEEDBACK


WireframeUser Story Mapping

(DEMO)

Digital Evolution Use Case - Agile Architect Designer




IdeasBeliefs, Values, Culture

Heuristics

Behaviors

Value

AgileLean

Solution ThinkingExploring Solutions Thinking (Business, Technology & Usage)

Copyright © 2016 nuCognitive LLC. All Rights Reserved.

Methods and Skills


Solution Thinking

Ray Arell

www.solution-thinking.com



‘Shift-Up’ Becoming an Value-Driven Business

Digital Assurance

LIFECYCLEVIRTUALIZATION

Simulate missing systems, to save up to 640 Hrs.

DIGITAL ENGINEERING & AUTOMATION

Test less, cover more, automate 100% of tests.

DATA VISUALIZATION & VIRTUALIZATION

Reduce time spent waiting on data by 95%.

SHIFTUP

VALUE-DRIVEN

Multi-Modal Delivery (Incubate to Lead, Scale for Growth and Enhance the Core)


CO

GN

ITIV

E A

DA

PTI

VE

AD

OP

TIO

N

Manual

Continuous

Autonomics

Lean Engineering

Connected Intelligence

BUSINESS VALUE

LEVEL 1 LEVEL 2 LEVEL 3 LEVEL 4 LEVEL 5

?

Optimized Organization

for DesignOps

Continuous Insight & Learning

Value StreamMapping

Consistency & Collaboration

Heroes & Heavy Lifting

DIG

ITA

L M

ATU

RIT

Y

• Insight-Driven (Predictive / Prescriptive)• NoOps organized (IoT-Ops/CX-Ops/Sec-Ops)• Self-healing end-to-end autonomic orchestration• Microcontainerization & Microservices enabled• Open Innovation & Connected Intelligence• Quantum Teleportation (Shift X)

Where are you?

Minimum Viable Quality

• Silos, manual handovers, waterfall process• One release/year• Monolithic apps• Long term project/resource planning• Error prone dev/test/release processes

Minimum Viable Product

Minimum Viable Delivery

Organization Change

User Story Mapping InsightBeliefs, Values,

CultureValue Behaviors Heuristics


Cognitive Adaptive Insight (CAI)


Release Management

Environment Management

ApplicationManagement

Network Management

Infrastructure Management

RepositoryManagement

Data Management

Test Data LearnProbe


CA App Experience Analytics

25 © 2016 CA. ALL RIGHTS RESERVED.

REAL TIME, BIG DATA ANALYTICS EMBEDDED THROUGHOUT OUR PORTFOLIO

AGILE MANAGEMENT AGILE OPERATIONS DEVELOPER PRODUCTS

CONTINUOUS DELIVERY MAINFRAME SECURITY

25 © 2016 CA. ALL RIGHTS RESERVED.

API analyticsRelease management dashboard Access incident responseReal-time app performance

Cognitive Adaptive Insight (CAI)



Design QA/TESTDEV PRODUCTIONPRE-PROD

Specification

CI/Build Functional testing UAT Integration

testing Performance engineering

Deploy to pre-prod

Code commit SCM

Design Spec

Requirements

Business Users

TESTData

TESTStub

TESTData

User BA

Product Manager

CustomerUsers

CustomerExperience

CustomerExperience

CustomerExperience

CustomerExperience

Design

Business Value

Business Value

Business Value

Improvement

Innovation

Intelligence

Assessment

Insight

Learning

Maintenance

Operations

Delivery

Testing

Support

Cu

sto

me

r

Digital Assurance

Value Insight

Learn Learn

Monitor Monitor TESTStub

REALUsers

TESTData

REALData

TESTStub

USERCase

Bu

sin

ess

Value-Driven Delivery

idea


Digital AssurancePocketbook

Paul Gerrard

NEW exclusive CA sponsored Pocketbook authored by Paul Gerrard, eminent Test-Transformation consultant, thought leader, teacher and international conference speaker.

Pre-order your FREE copy today from http://bit.ly/digital-assurance


‘Shift Right’ Becoming an Insight-Driven Business

The Digital Ecology

CONTINUOUS LEARNING & INSIGHT

Improve release quality, processes, and teams —

reduce production

errors by 98%

SEAMLESS, END-TO-ENDORCHESTRATION

Easily leverage existing tool investments to orchestrate

thousands of composite releases across diverse environments

RELEASE CYCLEAGILITY

Fully automate the release of agile applications through dev, test & production — improving

deployment time by 20x

SHIFT RIGHT

DIGITIAL ECOLOGY (ECOSYSTEMS OF ECOSYSTEMS)


* CA’s Analytics Reference Architecture

Data CollectorsD

ata

Agg

rega

torAgents

…

Probes

Machine/Log File Data

Insight-Driven

Existing Platforms

Custom Platforms

New Platforms

Partner Platforms

Analytics Engine

Dat

a In

ject

ion

AP

I

Dat

a A

cces

s A

PI

Service

Layer

Dat

a Ex

trac

tio

nData Processing (Speed)

Data Processing (Batch)

Data Bus

‘Shift Right’ Becoming an Insight-Driven Business

The Digital Ecology SHIFT RIGHT


T H E D I G I TA L EC O LO G Y

RUNDEPLOYTESTBUILDPLAN

INTAKE RequirementsUser StoriesRelease Plan

MODEL Import User Stories to Automatically Create, Visualize and Optimize Tests

Initiate Functional, Non-Functional and Security as Code

FUNCTIONAL Subset/Mask Test Data Create/Reserve Test Data Test Automation Library Ensure Mobile Experience

INSIGHT-DRIVEN

CONFIG/DEPLOY Provision Entire Stack Confirm Configurations Approve Changes Successfully Deploy Internal or External Cloud

INTEGRATIONRemove Constraints with Virtual Services Mobile, Web, App Server,

Middleware, Backend, MF 3rd Party Systems / API’s

CODEDevelop and Commit Code, Scan Code, Version Control, Continuous Integration. Complete Build and Initiate Release

AUTOMATION AUTOMATION AUTOMATION

Speed/Time-to-Market Quality/Availability

AUTOMATION

Cost/Financial Mix Risk/Compliance

Requirements Environments

Data Automation

CustomerExperience

NON-FUNCTIONAL Performance Engineering Simulate Backend Load Test Outlier Conditions Ensure Mobile Experience Security / Penetration

Common Goals “Big Picture” Issues

DESIGN SHIFT-LEFT SHIFT-RIGHT OPS

Node.Probe

Node.TestTDDBDD

ATDD

BPMNNimbus

Visio

Node.Data

Node.Learn

MEASURE/FEEDBACK Customer Experience Business Service View Application View Infrastructure View Dynamic Capacity Feedback loop

31 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD © 2016 CA. ALL RIGHTS RESERVED.

The Digital EcologyUse Case - Agile Architect Designer


BRINGS TRUE ARTIFICIAL INTELLIGENCE (AI) TO LIFECYCLE VIRTUALIZATION Virtualize services without requiring any knowledge or

decoding of the service protocols

Applies a genome sequence alignment algorithm, discovers byte-level patterns in message protocols

Now virtualize a much wider range of protocols without requiring a new DPH

HIGH ACCURACY: 99.6 – 100%

Increased speed and accuracy with Entropy Weighting + Message Clustering

The more data a service observes the data, more intelligent it becomes

Perfect for performance testing where we deal with tons of data


NODE PROBESYSTEMATIZED

(EPISTEMIC & SYSTEMICENTROPY)

CHAOS HARMONISATION LIBERATION

SENSE-ANALYZE-RESPONDPROBE-SENSE-RESPONDACT-SENSE-RESPOND

Lear

nin

g C

ult

ure

s Teachin

g Cu

ltures

High Abstraction

Low Abstraction

Complex

Chaotic

Lear

nin

g C

ult

ure

s Teachin

g Cu

ltures

High Abstraction

Low Abstraction

Complex Complicated

Lear

nin

g C

ult

ure

s Teachin

g Cu

ltures

High Abstraction

Low Abstraction

Obvious

Complicated

SENSE-CATEGORIZE-RESPOND

FASTFEEDBACK

SLOW FEEDBACKTHE DIGITAL ECOLOGY

DOMAIN OF DISCOURSE


The Digital Ecology

Blog - Legacy is your Legacy!


Erik Simmons


Copyright © 2016 nuCognitive LLC. All Rights Reserved.

NEW world exclusive CA

sponsored Webinar with nuCognitive.

Register now value-stream.net


DESIGNOPS

VALUE-DRIVEN DELIVERY

Cognitive Adaptive Adoption (CA-A)

1Cognitive Adaptive Learning

2Cognitive Adaptive Testing

3Cognitive Adaptive

Technology

4Cognitive AdaptiveDelivery


% of Regression Tests Passed for Provisioning:Virtual Services Test Data

% of Successful:Virtual Services

Provisioned Test Data Deployed

% of Regression Tests Passed for: Environment

Provisioning Build

Deployment

% of Successful: Environments

Provisioned Builds Deployed

# of Automated Tests Executed

% of Tests Passed # of Defects

Found in Test # of Defects

leaked from Dev % Test CoverageQA Feedback Time

(Time to Fully Test a Build – Target: < 4 hours)

% of Virtual Services Defined

% of Test Data Elements Defined

# of Manual Test Cases

% of Automated Test Cases

Deployment Frequency to Stage

Change Lead Time Change Failure RateMTTR*

% of Sprint User Stories Modeled

# of QA builds received per Day

TEST

% of Regression Tests Passed for Application Monitoring Process Configuration

% of Successful App Monitor Initiation

% of Passed Configuration Regression Tests

Cognitive Adaptive Testing (CA-T)

Validate Build Promotion Criteria

Golden Build & Data Stream

Received

Auto Generate Virtual Services

Definition and Test Data Definition

Auto Generate Tests (manual &

automation) Validate Build Configuration

Provision Environmentand Deploy

Build

ProvisionVirtual Servicesand Test Data

Application Monitoring(Measure)

Enhance ModeledRequirements(Feature Level)

Golden Deployment

AutomatedExecution



Cognitive Adaptive Adoption (CA-A)The future is Value-Driven Delivery

40

CA Project & Portfolio Management

Unify long term strategy, investment and portfolio planning.

CA Agile Central

Collaboratively plan, prioritize and track work across the enterprise.

Develop & Test

Synchronize efforts to dramatically speed app development & increase quality

Manage & Monitor

Make a great customer experience a competitive advantage

Release & Deploy

Control the release process, to continuously advance application quality, improve the customer experience and reduce costs.

MinimumViableDelivery

Minimum Viable Experience

Minimum Viable Quality


(Minimum Viable-Value-Validated)

Executives

BUSINESS INITIATIVE

Complexity-Informed Organizational Change

The Digital Ecology

MinimumViableProduct

CUSTOMER

THINK

MAKE



Q & A


© 2016 CA. All rights reserved.

Thank you!


What next?


Recommended Sessions

SESSION # TITLE DATE/TIME

DO5X22EManaging Test Data Across Distributed and Mainframe

Systems 11/15/2016 at 1:00 pm

MFX59EHigh Performance Masking and Test Data Generation for

IMS and DB211/15/2016 at 1:00 pm

@CAWORLD #CAWORLD © 2016 CA. All RIGHTS RESERVED.46 @CAWORLD #CAWORLD

DevOps – Continuous Delivery

For more information on DevOps – Continuous Delivery, please visit: http://cainc.to/PiTFpu

http://cainc.to/PiTFpu

Director of Digital Assurance

[email protected]

Jonathon Wright

@Jonathon_Wright

SlideShare.net/Jonathon_Wright

LinkedIn.com/in/Automation

https://www.ca.com/us/trials/ca-agile-requirements-designer.register.html