Techwell / IT World Canada - Digital Assurance

CA/ITWC WEBINARTesting in the Digital World: Digital Assurance

JUNE 27, 2017

2 © 2017 CA. ALL RIGHTS RESERVED.

Digital AssuranceDigital - ‘Evolution, over Revolution’

Jonathon WrightChief Technology Evangelist – Automation, DevOps & Digital [email protected] | linkedin.com/in/automation

© 2017 CA. ALL RIGHTS RESERVED.


Disclaimer

Certain information in this presentation may outline CA’s general product direction. This presentation shall not serve to (i) affect the rights and/or obligations of CA or its licensees under any existing or future license agreement or services agreement relating to any CA software product; or (ii) amend any product documentation or specifications for any CA software product. This presentation is based on current information and resource allocations as of June 27th and is subject to change or withdrawal by CA at any time without notice. The development, release and timing of any features or functionality described in this presentation remain at CA’s sole discretion.

Notwithstanding anything in this presentation to the contrary, upon the general availability of any future CA product release referenced in this presentation, CA may make such release available to new licensees in the form of a regularly scheduled major product release. Such release may be made available to licensees of the product who are active subscribers to CA maintenance and support, on a when and if-available basis. The information in this presentation is not deemed to be incorporated into any contract.

Copyright © 2017 CA. All rights reserved. All trademarks, trade names, service marks and logos referenced herein belong to their respective companies

THIS PRESENTATION IS FOR YOUR INFORMATIONAL PURPOSES ONLY. CA assumes no responsibility for the accuracy or completeness of the information. TO THE EXTENT PERMITTED BY APPLICABLE LAW, CA PROVIDES THIS DOCUMENT “AS IS” WITHOUT WARRANTY OF ANY KIND, INCLUDING, WITHOUT LIMITATION, ANY IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, OR NONINFRINGEMENT. In no event will CA be liable for any loss or damage, direct or indirect, in connection with this presentation, including, without limitation, lost profits, lost investment, business interruption, goodwill, or lost data, even if CA is expressly advised in advance of the possibility of such damages.


Agenda

INTRODUCTION

DIGITAL ASSURANCE

Q & A

SHIFT LEFT & RIGHT

VALUE-DRIVEN DELIVERY

WHAT NEXT?

1

2

3

4

5

6


MA

TUR

ITY

TIME

1960s 1990s TODAY

Digital - ‘Evolution, over Revolution’

1 – “The Battle for Competitive Advantage in the App Economy”, Oxford Economics, 2015

of enterprises believe that they need value-driven algorithmic business models to respond to disruption in the next 3 years.78%

Legacy is your Legacy (API)

Digitalization of your Core (SOA)

Digital (Cognitive Adoption)


Businesses no longer have the luxury of time.

Rising customer expectations, competitive threats,

and increased consumer choice have turned rapid

delivery and iteration of software applications into a

competitive differentiator.

Adoption of Value-Driven Delivery has become the

new means to better business outcomes.

TechRadar™: Continuous Software Delivery, Q2 2015, Forrester Research, May 1, 2015

“

”

2014 Vanson Bourne study commissioned by CA

UNPRECEDENTED

94%of executives face increased pressure to release appsmore quickly

“

© 2017 CA. ALL RIGHTS RESERVED.

Digital EnterpriseJourney to Enterprise Digital Adoption


© 2017 CA. Confidential. All rights reserved.

BORN DIGITAL TRANSFORMING DIGITIAL

Amazon’s lost sales per 1 second delay

75% Delete apps that load slowly

75%$ 1.6B

1. Akamai, “Performance Matters: Key Consumer Insights”2. Dynatrace Holiday Shopping Report

Digital ExperienceIn the Digital Economy, Every Business is a Software Business

Digital ExperienceIn the Digital Economy, Every Business is a Software Business

OVERWHELMING

feel the impact of change now or will, in the next year.

59%

34% expect to see impact in the next

2 to 5 years. Leadership for Digital

Transformation comes from the C-

level (43%) or from Senior IT

leadership (36%) Canadian CIO Census 2017

“

”

Poll Question #1

What is the main goal for Digital within your organization?

• Business cultural change

• Organizational transformation

• Improved delivery speed / time to market improvement

• Respond to market disruption

• Embrace shift left / shift right

• Increasing customer expectations


QUALITY

2/3of business leaders say the future of their business depends on the quality of their software2

VELOCITY

94%of executives face increased pressure to release apps more quickly1

1. 2014 Vanson Bourne study commissioned by CA2. “Surviving Disruption, Leading Change: Winning in the Application Economy,” 2015 3. voke Market Snapshot TM Report: Service Virtualization – January 2015

© 2017 CA. ALL RIGHTS RESERVED.12

EXPERIENCE

79%of users will abandon a site if they don’t quickly find what they need3

While Ensuring a Superior Digital Experience!

Digital QualityDelivering Quality at Speed



1. “Accelerating Velocity And Customer Value With Agile And Devops” --Coleman Parkes Research

2. “2016 State of DevOps Report” – Puppet and DORA3. http://www.itproportal.com/news/jobs-requiring-microservices-skills-

up-133-per-cent-in-the-last-year/4. Google Trends – as of 5.23.17

27/05/2012 27/05/2013 27/05/2014 27/05/2015 27/05/2016

Google Searches for DevOps (Worldwide)4 87% have implemented DevOps in their organization1

87%

DevOps teams increased from 16% in 2014 to 22% in 2016 3

22%

2012 2013 2014 2015

45%45% Increase in posted DevOps Job Positions2

Digital AdoptionWhilst DevOps reaches critical mass

2016

http://www.itproportal.com/news/jobs-requiring-microservices-skills-up-133-per-cent-in-the-last-year/



Digital

Value-driven delivery, adaptive business models, innovation, digital disruption, experiences and engineeringV

elo

city

Mastery

DevOps

Increases collaboration between developers and operations.

Scaled Agile

Accelerates software development with iterative, incremental work cadences.

Digital MasteryJourney to becoming Digitally Enabled

Poll Question #2

What is the current level of Digital maturity within your organization?

• Level 0 – Innovation – Rapid experimenting and prototyping (LeanUX)

• Level 1 – Evolution - Establish solution / design thinking (User Centric Design)

• Level 2 – Differentiation – Change in behaviours are defined, planned,

performed, measured, and controlled

• Level 3 – Adaptive – Continuous delivery and deployment can be validated

against expected value streams

• Level 4 – Quantified – Predictability of changes to behaviours and digital

delivery modes (Harmonisation)

• Level 5 – Optimising – Behaviour variation has statistical predictability

(Systematized Epistemic & Systemic Entropy)

Poll Question #2


DesignOpsCreate and deliver Ideas to Outcomes

Pervasive Security

Redefine how work is planned, managed and

executed

Agile Management

Provide a flawless app experience optimized for

performance

Agile Operations

Accelerate and streamline development, testing and

release

Continuous Delivery

Continuous Development Continuous Adaptive Testing Continuous Release

Digital DeliveryShift Left even further … introducing DesignOps


http://www.computing.co.uk/digital_assets/634fe325-aa28-41d5-8676-855b06567fe2/CTG-DevOps-Review-2017.pdf

Of self-proclaimed DevOps practitioners, 63% experience delays in the Testing/QA area*

29 per cent of DevOps practitioners told us that quality was being sacrificed

A 2017 survey found that the majority of delays were occurring at the Test/QA stage of the cycle.

Where are the main hold-ups in the software production process?

32%16% 22%

63%

21% 23% 30%

Plan code Pre-test Build Test/QA Release Deploy Review/Improve

What tends to suffer the most in a DevOps environment?

Speed

Security Quality

Nothing

42%

Security

13%

Speed

16%

Quality

29%

Digital TestingQA is STILL a Bottleneck .. Even with DevOps

http://www.computing.co.uk/digital_assets/634fe325-aa28-41d5-8676-855b06567fe2/CTG-DevOps-Review-2017.pdf



ACCELERATING SOFTWARE INNOVATION

Reducing the impact of time-consuming, manual IT processes to completely transform the software delivery pipeline and deliver software faster.

improvement in time-to-market

for new apps and software updates

97%KEY CHALLENGES

Speed responsiveness tobusiness trends

Global financial services group with

48 million clients in 40+ countries.


Replace inefficient manual processes

Increase the rate of apps delivery

Digital EnablementAutomating test and release to speed delivery and responsiveness


The ability to reliably release high-quality solutions at any time

DIGITAL ASSURANCE

Accelerate Deliveries

Reduce Errors

Manage Complexity

Increase Visibility

Enterprise Collaboration

Continuous Improvement

Digital AssuranceShifting to a more Dynamic, Adaptive and Continuous business models



Testing Volumeand Coverage

EnvironmentSetup Time

Catch CodeChange Defect

Daily Run Frequency

Build Validation Cycle

66% Reductionin minutes

14xIncrease indaily runs

On Demand

75%Reduction

4300%volume increase &

70%coverage increase

Digital Ready

BEFORE TODAY

▪ Release Every Month▪ Feature Focused Releases▪ Committed at Mid-Sprint

▪ Beta Features in Sandbox▪ All Features Reviewed by

Customers Prior to GA

1 Major Release Every YEAR

… along with 1-2 .dot releases

Drinking our own Champagne


DesignOps – “Shift Left” (AND Right)

CONTINUOUS ADAPTIVE TESTING

CODE

SHIFT LEFT SHIFT RIGHT

BUILD DELIVERY PRODUCTION


CODE


BUILD DELIVERY PRODUCTION

CONTINUOUS ADAPTIVE TESTING




Generate test cases and data automatically

Automate Functional and non-functional

testing

Virtualized testing resources to

eliminate bottlenecks

CX / DX Insight to validate real live

test scenarios

Integrated risk assessment and security testing



COGNITIVE ADAPTIVE TESTING



http://rewrite.ca.com/us/articles/management-cloud/customer-obsessed.aspx

“Getting that insight in production is fantastic, but what is perhaps more brilliant is getting that insight in the development - and - test environment. We have been able to show that by moving monitoring into development and test — making it part of the process in those areas — you can stop defects from getting into production”.

Prevented 10 high-severity incidents, saving more than a dozen hours of investigations.

Another partner improved performance by 85%.

DesignOps – “Shift Right”Continuous Operations enables ‘Insight-Driven’ Business Models

http://rewrite.ca.com/us/articles/management-cloud/customer-obsessed.aspx



DELIVERING A 5 STAR CUSTOMER EXPERIENCE

Around 95 percent of testing for the apps is automated, and the bank is using the App Experience Analytics tool to monitor performance and ensure the bank can jump on any

issues before customers need to report them

Reduction in time to identify an an application performance issue 86%

Provide a rich digital experience – 3secs to reach any feature

Leading Australian Bank serving 10 million customers at more than 800 locations

https://www.itnews.com.au/tools/print.aspx?ciid=441118

KEY CHALLENGES


Zero downtimeGet code to production within 1 hour being implemented

Digital ExperienceMonitoring apps performance to drive continuous improvement

https://www.itnews.com.au/tools/print.aspx?ciid=441118

29 © 2016 CA. ALL RIGHTS RESERVED.29 © 2017 CA. ALL RIGHTS RESERVED.

Project & Portfolio Management

Unify long term strategy, investment and portfolio planning.

Agile Management

Collaboratively plan, prioritize and track work across the enterprise.

Develop & Test

Synchronize efforts to dramatically speed app development & increase quality

Manage & Monitor

Make a great customer experience a competitive advantage

Release & Deploy

Control the release process, to continuously advance application quality, improve the customer experience and reduce costs.

ContinuousDelivery

Minimum Viable Experience

Minimum Viable Quality

Value-Driven Delivery

BUSINESS INITIATIVE

Complexity-Informed Organizational Change

BUSINESS VALUE

MinimumViableProduct

CUSTOMER

THINK

MAKE

Value-Driven DeliveryEnabling Complexity-Informed Organizational Change


IdeasBeliefs, Values, Culture

Heuristics

Behaviors

Value

AgileLean

Methods and Skills

http://catechnologies.podbean.com

Ray Arell

Value-Driven DeliveryWebinar - Continuous Testing 101


Where next?


Digital Assurance & Quality

DIGITAL TESTING, QUALITY & ASSURANCE

http://bit.ly/digital-assurance http://a.co/jlxMHWp


© 2017 CA. All rights reserved.

Thank you!


CA Continuous Delivery Director

Orchestrate testing functions parallel or sequentially

Automatically generate test case straight from requirements

Quickly stand up simulated test environments

Start API and backend system “requests & response” testing prior to the development of UI

Access test data on-demand

Orchestrate the release engine to promote code as soon as test cases pass

Democratize performance testing for DevOps era

Integrate open source testing tools like JMeter, Jenkins, Selenium, Appium, Gatling, Locust, and more.

Capture user issues in production and implement a feedback loop to development/ teams

1

2

3

4

5

6

7

8

CA Testing™ - Continuous Testing Ready

CA is Positioned as a Leader in the Gartner MQ for ARA … Forrester Wave SV Leader

Faster time to deploy releases*

20x

Reduced testing costs & improved efficiency*

25%

Reduction in production errors*

98%

Differentiation Customer Success

5 of the top 5Telecom Companies

4 of the top 5 Retailers

4 of the top 5 Banks

Market Validation

Nominated in the “Best Use of Technology in a Project” category for

work with the London Metal Exchange

*Based on Global 500*Forrest TEI Research

Don’t Take Our Word For it

Jonathon Wright, CA Technologies

[email protected]

Jim Love, ITWC

[email protected]

Evaluation Form