ADM - TestOps - Gone in Sixty Seconds

© Copyright 2015 Hewlett-Packard Enterprise Company, L.P. The information contained herein is subject to change without notice.1

HP Software EMEA Customer Forum 2015

Application Delivery Management

Prague, Czech Republic

June 9-12

© Copyright 2015 Hewlett-Packard Enterprise Company, L.P. The information contained herein is subject to change without notice.

TestOps – Gone in Sixty SecondsJonathon Wright / 9th June, 2015

Director Testing Quality Assurance at Hitachi Consulting

© 2015 Hitachi Consulting Corporation. All rights reserved. Proprietary and confidential.

$93.4

Billion947Companies

320,000+Employees

$3.4

Billion

Hitachi - a global industry leader.Society Changes, Hitachi Transforms It.

© 2015 Hitachi Consulting Corporation. All rights reserved. Proprietary and confidential.

Information & Telecommunication Solutions Distribution Solutions

Railway Solutions Smart Cities

Service Opportunities

IT Service, Data Centre Solutions, Consulting

System Solutions

Large-scale systems, Highly reliable systems

Finger Vein Authentication

Worlds Fastest Elevator

Hardware, Software

Rolling stock + maintenance

Electrical components

Train control systems

Nuclear Power Business

Mining Equipment

Platforms

Smart eco cities

Big Data Infrastructure

Energy Consumption

Water & Natural Resources

Hitachi – Digital Engineering in Europe


The creation of new business designs that connect people, business and things (physical objects that are active players and contribute to business value) to drive revenue and efficiency.


Digital Enterprise is not just about “disrupters”



Digital Evolution & XaaS

Innovation Projects (FluidIT)

Experimenting / testing / piloting / experiencing to define new ideas

• Rapid Experimentation & Prototyping

• Continuous Delivery / Deployment

Differentiation Projects (FluidIT)

Needs that can be defined now

• Agile Delivery / Short Release Cycles

Evolution of Core Systems (CoreIT)

Well defined needs essential for organisational operation

• Iterative / Waterfall

© Copyright 2015 Hewlett-Packard Enterprise Company, L.P. The information contained herein is subject to change without notice.* Hitachi Consulting, ‘Legacy infrastructure a barrier to digital evolution’, www.hitachiconsulting.com/digitalenterprise, 8th June 2015

http://www.hitachiconsulting.com/digitalenterprise

= DevOps


DevOps in the Cloud

* HP Discover, Todd DeCapua, Chief Technology Evangelist and Co-founder, www.techbeacon.com/devops, 4th June 2015

http://www.techbeacon.com/devops

TestOps in the Cloud


TestOps BUILD then TEST vs. DevOps BUILD then DEPLOY?

De-coupling

Solutions (SOA)

Continuous

Build, Integration

& Delivery

Good Coding

PracticesConfigurability &

Maintainability

Ops Hub

Infra as Code

Extend QA

(Ops)

Resolution

Practices

Agile

Engineering

(Shift Left)

Agile

Engineering

(Shift Right)

CodarBlueprints Recipes PatternsHelionBlueprints PatternsLeanFT SV

TestOps (Dev-Test) with Automated Testing DevOps (Dev-Ops) with Automated Deployment

Journey to DevOps with HP

Ops

Monitoring

(Testing)

Monitoring

(Ops)

Modelling

(Testing)

Modelling

(Ops)

Dev Test / QA

* Ajay Nair & Faraz Syed, ‘Journey to DevOps with HP’, BrightTALK, 23th April 2015


Recipes


Codar

DevTest BUILD then REWORK vs. DevOps BUILD then RELEASE?

Blueprints Recipes Patterns

DevOps (Dev-Ops) with Automated Deployment

HelionBlueprints PatternsLeanFT SV

TestOps (Dev-Test) with Automated Testing

Recipes



CodarBlueprints Recipes Patterns

DevOps (Dev-Ops) with Automated Deployment

HelionBlueprints PatternsLeanFT SV

TestOps (Dev-Test) with Automated Testing

Recipes

TestOps in the CloudLifecycleOps DEFINE then DECOM vs. DevOps BUILD then FIX in Production?

Continuous Assessment


Unified Lifecycle

Center of excellence

Level 0

Ad-hoc

Level 1

Initializing

Level 2

Standardized

Level 4

Optimized

• No documented

QA processes

• No architectural

governance

processes

• Adoption is

project-focused

• Testing is ad-

hoc

Project Based

• Project-based

processes/tools

• Testing may be

structured, but

mostly manual

• Achievement based

on personnel heroics

• Lack of

organizational

metrics and

baselines

Product Utility

• Centralize/

consolidate

technology, licenses,

admin & support

• Standardized use of

tools, templates,

naming conventions,

asset sharing, some

automation

• Best practices for

tools usage

• Some level of

organization metrics

Service Utility

• Standardized

organizational

processes and

practices

• Service bureau for

providing

consulting/support

• Org QA audits,

metrics,

governance, risk-

based quality

• Process automation

across ALM

lifecycle

Shared Platform

• Consolidated QA

personnel providing

services to LOBs

• Well-defined

governance and

service levels;

chargeback models

• High levels of

automation, re-use

and efficiency in

execution

• Organizational

capability metrics

and real-time

dashboards

• ALM lifecycle

integration

Increasing Maturity

Silo-ed execution

Product and process standardization

Level 3

Managed

Level 5

Predictive

Shared Service

• Testing as a Service

models providing

global testing / QA

capabilities &

solutions;

• Well defined XaaS

models with

enforceable service

levels; pay as you

consume models;

• Seamless Smart

Automated Build,

Release, Testing,

Deployment,

Monitoring

• Portfolio capability

metrics and real-

time dashboards

• ULM integration

Maturity Model index


• Predictive ALM

– Machine Learning

– Code Analysis

• Predictive Analysis

– Prediction(Cost/Accuracy/Defects)

– Predictive Planning

– Velocity / QA Impact

• Predictive Testing

– Smart Test (Test Impact Analysis)

– Open Test Frameworks

(LeanFT/Phantom.JS/xCode/jUnit/qUnit/nUnit/TestNG)

• Predictive Builds

– Smart Build (Analyze Commits)

• Predictive Release

– Release Health

QualityGate™ Map

Confidence Level 69%

QualityGate™ Recommendations PBIs

QualityGate™ MapConfidence Level Assurance

http://www.testops.net/


Dynamic test asset cubes based on of fuzzy logic, meta mathematics & descriptive languages

QualityGate™ Map


40-50 secs – Predictive Testing (HP ALM 12.5)

50-60 secs - Predictive Release (HP OneSync)

1-5 secs – Smart Analysis (MVC)

5-10 secs – Smart Build (HP Codar) 30-40 secs – Smart Testing (HP LeanFT 12.5)

10-20 secs – Smart Asset Cube (TAaaS.net)

QualityGate™ Testing


QualityGate™ ReleaseSmart & Predictive Solution Delivery Lifecycle (SDLCi) integration

6-10 secs – Check-in / Analyse / Commit (GIT)

0-6 secs – Minor UX change (Dev to TestOps) 10-40 secs – Predictive Testing (ALM 12.5)

QualityGate™ Map


40-50 secs – Predictive Deploy (HP Codar)

50-60 secs – Predictive Release (HP Helion)

6% chance to break build

66% Quality Gate Map (confidence rate)

88% Quality Gate Map (confidence rate)

92% Quality Index Score (Predictive Analysis)


Continuous Innovation (LeanFT™)Continuous testing that provides higher predictability & quality throughout the SDLCi

Continuous Insight (XaaS)


Continuous ImprovementXaaS providers are continuously evolving


Continuous TestingDesign and test the XaaS before deployment


Continuous DeploymentSet the stage for success deployment then promotion of the XaaS


Continuous SupportOperational insight through continuous support, maintenance & improvement

Summary

• Automate solution delivery release times and ramp up release velocity• Infrastructure as code (topology-base model(s) - HP Codar/Release Management)

• Automate build to Cloud 2.0 (platform / technology agnostic solution delivery)• Infrastructure to code (automation (build) model(s) – Chef/Docker)

• Automate deploy to reduced failure rates, lead times between fixes and rates of

recovery• Platform as code (deployment model(s) - HP DevOps Insight/Jenkins/IDE)

• Monitor release in the wild • Operational Insights (release model(s) – HP AppPulse)

• Report on ULM with support for Enterprise Gamification• Build(s) / release(s) / Quality index scores (reporting model(s) - HP Executive Scorecard/PPM)

• Collaborate with enterprise grade communication (between Dev, Test & Ops)• Connected intelligence (synchronisation model(s) - HP OneSync/ALI)

Unified Lifecycle Management

© Copyright 2015 Hewlett-Packard Enterprise Company, L.P. The information contained herein is subject to change without notice.29

Questions and Answers


“Evolution over Revolution” technology is no longer the enabler, everything is continuously evolving the tools and techniques that worked yesterday may no longer be the correct approach for tomorrow … continuous innovation (open innovation) as strategic partnerships as part of the digital transformation through digital engineering.

Jonathon Wright, Hitachi, HP Discover, Video Interview, 1st June 2015

Visionary in emerging technologies, open innovation & automation