EuroSTAR - TestOps in the Cloud

@jonathon_wright

#esconfs www.eurostarconferences.com

TestOps in the Cloud

BetterTestOps

.net

[email protected]

Jonathon Wright, Director, Testing, Quality, Assurance

1

27th April 2015@jonathon_wright

#esconfs

mailto:[email protected]

2

@jonathon_wright


Mission Objectives

TestOps across the Galaxy

I. What is BiModal? and how is FluidIT going to affect CoreIT?

II. How to move away from Testing as a Function to Testing as an Activity?

III. What is Solution Delivery Lifecycle integration (SDLCi)

IV.Introduction to Model Based Design (MBD)

V. Introduction to Model Driven Delivery integration (MDDi)

VI.Distributed Engineering Agile Delivery (DEAD)

VII.The Force Awakens (TestOps)

Episode

Episode

Episode

Episode

Episode

Episode

Episode

DevOps = Mitigating Risk TestOps = Identifying Riskvs.

*All Original Content ‘Star Wars: Episode 1 to 7” ©DISNEY 2015 ©Lucasfilm Ltd. & TM, 1977 to 2015

3

@jonathon_wright


4

@jonathon_wright


Hitachi – Digital Business in Europe

Information & Telecommunication Solutions Distribution Solutions

Railway Solutions Smart Cities

Service Opportunities

IT Service, Data Centre Solutions, Consulting

System Solutions

Large-scale systems, Highly reliable systems

Finger Vein Authentication

Worlds FastestElevator (40mph)

Hardware, Software

Rolling stock + maintenance

Electrical components

Signaling / Train control systems

Nuclear Power Business

Mining Equipment

Platforms

Smart eco cities

Big Data Infrastructure

Energy Consumption

@jonathon_wright

#esconfs

Water & Natural Resources

Floating train 500kmph

5

@jonathon_wright


What is BiModal? and how is FluidIT going to affect CoreIT?

5

@jonathon_wright

#esconfs

“the creation of new business designs

that connect people, business and things

(physical objects that are active players

and contribute to business value)

to drive revenue and efficiency. ”Gartner ® 2014

Episode I

6

@jonathon_wright


Digital Enterprise - BiModal

How is FluidIT going to affect CoreIT?

Fluid IT• Agile and fluid

• Innovation, brand,

profit measures

• Think continuous

• Think days, weeks

Core IT• Reliable,

compliant, secure

• Think price/performance

• Plan and approvals driven

• Long life-cycles

Episode I

7

@jonathon_wright


Digital Enterprise is not about “disrupters”

6

@jonathon_wright

#esconfs

Episode I

8

@jonathon_wright


Digital Business Transformation

Testing in the Digital Transformation Age

Core IT Fluid IT

Digital Transformation

Assisting Clients(Journey to value?)

Episode I

“Bet on technical insight,

not market research.”

*Jonathan Rosenberg & Eric Schmidt, 2014, ‘How Google Works’, ISBN: 9781455582341, 23rd September 2014

9

@jonathon_wright


How to move away from Testing as a Function to Testing as an Activity?

9

@jonathon_wright

#esconfs

“How we bring Digital Enterprise to life”Gartner ® 2014

Episode II

Digital Transformation

*All Original Content ‘The Force Awakens” (Trailer B) ©DISNEY 2015 ©Lucasfilm Ltd. & TM, 23rd April, 2015

10

@jonathon_wright


Testing as a Function

Legacy 1.0 Methodologies

Software Development Lifecycle

Hardware Analysis

Testing

Process

MethodologyBusiness

Software Development Lifecycle (SDLC) Model

Episode II

11

@jonathon_wright


Testing industry is changing forever

Intel© XDK IoT in 2015

Does ‘Testing as a Function’ still have a future?

Episode II

12

@jonathon_wright


Testing as a Activity

Future Methodologies

Solution Delivery Lifecycle

Application

Portfolio

Business

IntegrationEnterprise

Management

* Testing as a Service Models – Discussion Paper, TestingAsAService.com or https://leanpub.com/taas

Solution Delivery Lifecycle integration (SDLCi) Model

Episode II

http://www.testing-store.com/


13

@jonathon_wright


What is Solution Delivery Lifecycle integration (SDLCi)

13 Episode III

*All Original Content ‘Star Wars: Rogue One” ©DISNEY 2015 ©Lucasfilm Ltd. & TM, 16th December, 2016

Internet of Everything

14

@jonathon_wright


SMART (Sensors, Making machines, Augmentation, Robotics, Thinking machines)

Global challenge not suitable ‘Agile’ silos (not small a)

Complex eco-

infrastructures

intelligent

machine-to-

machine inter-

connections

empowered by

‘Big Data’

* http://www.libelium.com/libelium-smart-world-infographic-smart-cities-internet-of-things/

Episode III

http://www.libelium.com/libelium-smart-world-infographic-smart-cities-internet-of-things/

15

@jonathon_wright


Lean = Open

Open (Digital) Innovation results in Open (Digital) Businesses

Open Digital Platforms

Lean Testing

Enterprise

Practices

BlueprintsSmart

Episode III

“Sharing intellectual property such as software code or research

rules, adhering to open standards rather than creating your own,

and giving customers the freedom to easily exit your platform”

@jonathon_wright

#esconfs *Jonathan Rosenberg & Eric Schmidt, 2014, ‘How Google Works’, ISBN: 9781455582341, 23rd September 2014

Open Digital Enterprises

16

@jonathon_wright


Open Innovation 1.0 - Real World Example

SDLCi - Grid-Tools connected intelligence to PerfectoMobile

Business

Solution Discovery

Business

Solution Delivery

@jonathon_wright

#esconfs

Episode III

*Llyr Wyn Jones, ‘End-to-end vs. interface testing: the mathematics’, 31st March 2015

17

@jonathon_wright


Connected Intelligence - Real World Example

Support for business intelligence powered by ‘small data’

✔

Hitachi Content Platform Solution

During deployment of

the Hitachi Content

Platform Solution

70TB of satellite

information was

ingested into the

solution platform with

a daily growth rate of

50GB/day.

Business

Intelligence

Platforms

Business

Intelligence

Infrastructure

* http://www.hds.com/assets/pdf/hitachi-storage-solutions-at-work-nasa.pdf

Episode III

http://www.hds.com/assets/pdf/hitachi-storage-solutions-at-work-nasa.pdf

18

@jonathon_wright

#esconfs www.eurostarconferences.com*Jonathon Wright, 2011, ‘Testing as a Service’ presented at BCS SIGIST, London, 5th December 2011

Solution Delivery Lifecycle Integration (SDLCi)

TestOps – Gone in Sixty Seconds

Testing as a Service - Models

Portfolio Lifecycle Management

Business Lifecycle Management

Solution Lifecycle ManagementBusiness Delivery Management

AdviceProblem

Business

Solution Discovery

Business

Solution DeliveryContinuous Delivery Continuous Deploymentvs.

Service Layer (Lean)

Episode III

19

@jonathon_wright


Introduction to Model Based Design (MBD)

19 Episode IV

@jonathon_wright

#esconfs

Business

Solution Discovery

Business

Solution Delivery

*Jonathon Wright, 2014, ‘Testing as Service’ Models’ discussion paper published, 26th October 2014

‘Testing as a Service’ Models

20

@jonathon_wright


New Model for Testing*

Model Based Testing (MBT)

*Paul Gerrard, 2014, ‘New Model for Testing’ discussion paper published, 6th August 2014

New Model for Testing

Episode IV

21

@jonathon_wright

#esconfs www.eurostarconferences.com*Jonathon Wright, 2014, ‘Testing as Service’ models’ discussion paper published, 26th October 2014


@jonathon_wright

#esconfsTesting as a Service - models

https://leanpub.com/taas

Episode IV

https://leanpub.com/taas

22

@jonathon_wright


Introduction to Model Based Design (MBD)


Blueprint(s) Pattern(s) Recipe(s)

@jonathon_wright

#esconfs www.eurostarconferences.com* Test Automation Patterns, testautomationpatterns.wikispaces.com & testing-store.com

Episode IV

http://testautomationpatterns.wikispaces.com/


23

@jonathon_wright


Model Based Design (MBD) – Blueprint(s)


We used drawing (visual 2D art)

to represent the foundation

of basic blueprints

GEN 1

GEN 1k

“Truly wonderful, the mind of a child is.”

This demonstrates that models created from

a single entity (transcendence) only represent

ontology of the domain of discourse and

exclude the quantitative intelligence of others.

“No matter their experience, masters can still

learn from their apprentices.“

“That’s No Moon!”

In Digital Enterprise

= Business on a Page

Enterprise Collaboration is the Evolution

(not revolution) of detailed expert Blueprints

Episode IV

24

@jonathon_wright


Model Based Design (MBD) – Blueprint(s) – Real World Example

SAFe™ 4.0

An example

Blueprint(s) could

be any process

template that

defines the

high level

flows

“The best aspects

of these proven

test approaches

demonstrate how

they have evolved

over the past

decade, and this

echoes some of

the changes

towards more lean

and agile business

methodologies.

They are in a

constant state of

evolution – just as

the underpinning

technology evolves

over time.”

Episode IV

25

@jonathon_wright


Model Based Design (MBD) – Pattern(s)


Death Star Interior / Inner Chasm & Corridors

Collaboration of individual applies unique

patterns that will refine, predict and

inform the model through exploration

(enquiring and challenging) each other

Quantum Multifractality

Applying constructive patterns

from two or more point sources

(interference) to render multi-

dimensional (3D) models

GEN 2k

GEN 1080Each iteration can increase the

representation of the model by

applying and interpreting data

Episode IV

26

@jonathon_wright


Model Based Design (MBD) – Pattern(s) – Real World Example

Test Infrastructure as a Service (TIaaS.net) – TestOps 1.0 (VM Role Dispenser)

* Test Automation as a Service – Architecture, TAaaS.net or TestOps.net

“The best aspects

of these proven

test approaches

demonstrate how

they have evolved

over the past

decade, and this

echoes some of

the changes

towards more lean

and agile business

methodologies.

They are in a

constant state of


the underpinning

technology evolves

over time.”

“Over the last five

years we have been

developing a azure

cloud based solution to

provide true

Test Automaton as a

Service using the

hybrid approach

specifically designed

with the Hybrid Cloud

(Private/Public) in

mind to utilise the

instant scalability,

flexibility and

availability of the

Cloud.”

Episode IV



27

@jonathon_wright


Model Based Design (MBD) – Recipe(s)


Early recipes date back to

1600BC, IFTTT recipes

(conditional statements) =

DestroyDeathStar1.0I. All wings report in

II. Lock S-foils in attack position

III. Switch deflectors ON

IV. Keep visual scanning

V. Start attack run

VI. Move into position

VII. Stay in attack formation

VIII. Stay on target

IX. Use the FORCE

GEN 4k

• Channels are the basic

building blocks

• Triggers are the "this" part

of a recipe

• Actions are the “that” part

of the recipe

• Recipes are the

“equations” made from

Triggers and Actions

• Ingredients are the basic

data model, node, quantum

materials (dot) particles

or even atom(s)

Enterprise Gamification

represents the success criteria

e.g.

“Great shot kid that

was one in a million.”

Episode IV

28

@jonathon_wright


Model Based Design (MBD) – Recipe(s) – Real World Example

Test Automation as a Service (TAaaS.net) – TestOps 1.0 (>5 Years)

Select the Business Process Tests Generated Recipe

“The best aspects

of these proven

test approaches

demonstrate how

they have evolved

over the past

decade, and this

echoes some of

the changes

towards more lean

and agile business

methodologies.

They are in a

constant state of


the underpinning

technology evolves

over time.”

“Based on

business process

modelling to

create business

level keywords

written in natural

language

validated against

content sensitive

validation to

create reusable,

jigsaw pieces

representing the

Solution Under

Test (SUT).”

Episode IV

Test Automation as a Service

* Jonathon Wright, 2010, STARWest Track, ”Test Automation as a Service”, http://www.TaaS.net, 2nd October 2012

@jonathon_wright

#esconfs

http://www.taas.net/

29

@jonathon_wright


Distributed Enterprise Agile Lifecycle (DEAL) Collaboration in the Wild

Model Based Design (MBD) – TestOps - Blueprints > Patterns > Recipes

@jonathon_wright

#esconfs

Team - Confederacy of Independent Systems

Enterprise Architect - Wilhuff Tarkin

Sprint 1 - Top-secret Imperial weapons project

Sprint 2 – Raids on Vergesso and Raltiir

Sprint 3 – Technical Data from Tantive IV

Sprint 4 – Battle of Toprawa

Sprint 5 – Raid on Polis Massa

Sprint 6 – Moff Kalast and the Bothan Spynet

Colla

bora

tion

“The Death Star

blueprints are

not in the main

computer”

- Stormtrooper

Blueprint – Death Star

Data Storage – R2-D2

Sprint 7 – Delivery blueprints to Bail Organa

Sprint 8 – Delivery blueprints to Jan Dodonna

CIBD - Release Management – General Jan Dodonna Showcases “Thermal Exhaust Port”

Pattern – Featuring Fleet of 22 X-wing, 8 Y-wing, 2 R-22 Spearhead Starfighters Defect – Found by Skywalker

* Release notes: Death Star, http://starwars.wikia.com/wiki/Death_Star_plans

Deliv

ery

Pattern

sR

ecip

es

Recipe - DestoryDeathStar1.0 - Continuous, Integration, Build and Delivery

Define

Design

Develop

(Plan)

Deploy

Deliver

Episode IV

http://starwars.wikia.com/wiki/Death_Star_plans

30

@jonathon_wright


Introduction to Model Driven Delivery integration (MDDi)

Agile Engineering

Core IT Fluid IT

Agile Engineering

Episode V

* Adam Mann, Google Innovation Officer, ‘Creating the inter-planetary Internet protocol’, Wired.com, 6th May 2013

Open Innovation

31

@jonathon_wright


Introduction to Model Driven Delivery (MDDi) - Mission(s) / Charter(s)

Test First Delivery (TFD) First Day Delivery (FDDi)

TDD

* Jonathon Wright, 2014, Gartner, http://www.slideshare.net/mobile/Jonathon_Wright/addi-ha-apiytestinghybridcloud

Domain Driven Design (DDD) Domain Driven Delivery (DDDi)

Transcendence Driven Delivery (TDDi)

Test First Delivery (TFD)

Episode V

http://www.slideshare.net/mobile/Jonathon_Wright/addi-ha-apiytestinghybridcloud

32

@jonathon_wright


Mission / Charter – First Day Delivery (FDDi)

Model Driven Delivery (MDDi) integration

*The Advanced Research Projects Agency Network (ARPA) Network, 1969, 2 & 4 Nodes the precursor to the Internet

Business Process Modelling

Blueprint

Business Process Scenarios

Patterns

Business Process Components

RecipesNode Maps Node Learning Node Strengthening

• Model the proposed solution • Learning (Turing machine)

adapting to simulate logic

algorithms

• Validate all possible states

Smart Learning Machines

Episode V

33

@jonathon_wright


Mission / Charter – Transcendence Driven Delivery (TDDi)



Patterns Node (View)

• Each Node creation (LOC)

passes requirement, story,

behaviour, acceptance test

• Each Node generates a

testable view (UI, Service,

or Data layer) of the solution

• Models Nodes and Links


Recipes NodeJS (Controller)


Blueprint Node (Model)

* Visual Studio 2015 CP6 & NodeJS, https://www.visualstudio.com/en-us/news/vs2015-vs.asp http://nodejstools.codeplex.com/

Episode V

https://www.visualstudio.com/en-us/news/vs2015-vs.asp

http://nodejstools.codeplex.com/

34

@jonathon_wright


Mission / Charter – Domain Driven Delivery (DDDi)



Blueprint


Patterns


RecipesNode Discovery Node ValidationNode Systems

• Model the current solution • Validate all possible states

@jonathon_wright

#esconfs

• Apply:• Systems Dynamics

(epistemic & systemic

entropy)

• Systems Thinking

• Learn:• Ontology – formal naming,

definition of node types,

properties and

interrelationships

• Domain – universal set of

nodes (domain of discourse)

• Context – nouns/verb

discovery to enable context

sensitive validation.

* Huw Price, 2015, Grid-Tools, http://www.agile-designer.com/resources/model-based-testing-using-agile-designer/

Episode V

https://www.grid-tools.com/solutions/agile-designer/

35

@jonathon_wright



Advanced Modelling Simulation Technologies

Watershed management

Pipe-network Management

Prediction of water pollution

Pipe-network analysis

© Hitachi Europe Ltd. 2014. All rights reserved.

Models can be analysed, visualized, and optimized

Models can provide assurance through, analysis, simulation and prediction

* http://www.computerweekly.com/news/2240233919/Societys-values-moving-from-Mono-to-Koto-says-Hitachi

Episode V

http://www.computerweekly.com/news/2240233919/Societys-values-moving-from-Mono-to-Koto-says-Hitachi

36

@jonathon_wright


First Day Delivery integration (FDDi) – Wearables - Apple iWatch

“The physical nature of wearables

technology makes it vital to testing using

real devices…. helps to mitigate

syncing/connectivity issues.”

Episode V

Connected Intelligence – Real World Example

37

@jonathon_wright


Distributed Engineering Agile Delivery (DEAD)

37 Episode VI

*All Original Content ‘The Force Awakens” (Trailer B) ©DISNEY 2015 ©Lucasfilm Ltd. & TM, 23rd April, 2015

@jonathon_wright

#esconfs

Ultimately, all businesses will be

‘digitally re-mastered.’Gartner ® 2014

38

@jonathon_wright


Enterprise Collaboration in the Crowd – Real World Example

Test Intelligence 2.0 – Global Testing Insight (UX, Exploratory & Testing in the Wild)

* Real Crowd Tester, Liam Warrilow, 24th Friday 2015 @15:13 (Ramp up to 100 iWatch testers in under 24hrs)

Episode VI

Enterprise CrowdTesting

Testing in the Wild

Microsoft© HQ Seattle

https://www.gartner.com/doc/2698423

https://www.gartner.com/doc/2698423

39

@jonathon_wright


Agile 1.0 Legacy

Legacy Methodologies

Agile Development Practices

Waterfall Engineering

Delivery

Processes

MethodologywAgile

Manifesto for Agile Software Development (1957-2001)

Software

Hardware

Business

Episode VI

40

@jonathon_wright


Metrics Driven Delivery vs. Results Driven Delivery

Distributed Engineering Agile Delivery (DEAD)

* Scrumtroopers: AxisAgile.com.au, http://www.axisagile.com.au/resources/scrumtrooper-images/

Episode VI

Open Enterprise Collaboration

http://www.axisagile.com.au/resources/scrumtrooper-images/

41

@jonathon_wright


The Agile Legacy – Agile Strikes Back

Agile DAD(MoM)

SAFe(Committee)

LeSS(Anarchy)

Rey SoloPrincess Leia Organa SoloQueen Padmé AmidalaEmperor Palpatine

Role – Supreme Leader

Alignment - Empire

Goals – Rule the galaxy

Role – Galactic Senate

Alignment - Republic

Goals – Peace

Role – Senator Alderaan

Alignment – Rebellion

Goals – Freedom

Role – Jakku Citizen

Alignment – Rogue

Goals – Anarchy

*All Original Content ‘Star Wars: Episode 1 to 7” ©DISNEY 2015 ©Lucasfilm Ltd. & TM, 25th May 1977

Episode VI

42

@jonathon_wright


Agile is DEAD

Agile 2.0 models (LeSS SAFe than DAD)

Distributed Enterprise Agile

Application

Organisation-wide

Engineering

AnarchyBusiness

Waterfall

Distributed Enterprise Agile Lifecycle (DEAL)

Delivery

Management

Lifecycle

Episode VI

43

@jonathon_wright


Enterprise Collaboration CrowdTesting in the Wild

Han Solo (Anarchy) vs. Jedi (Agile) Order

Han Solo - Iteration VI Han Solo - Iteration VII

Follow your own path– “What the galaxy needs is one language, one system of

measurement.”

Look after yourself– “Look, I ain't in this for your revolution, & I'm not in it for you.”

Do what you think is right– “Hokey religions (Agile) and ancient weapons (Scrumban) is no

substitute for a (Waterfall) blaster.”

Forget the Results or Metric Driven Delivery– “Never tell me the odds.”

Become part of the team– “The biggest problem in the universe is no one helps each other!”

Evolution not revolution– “There has been an awaking, have you felt it?”

Teamwork equals success– “Try not. do… or do not. There is no try.”

Never underestimate the value of individuals– “Sometimes it is the people no one imagines anything of who do the

things that no one can image?”

– “Wars not make one great!”

@jonathon_wright

#esconfs

Episode VI

44

@jonathon_wright


Agile Engineering – Real World Example

The Force Awakens

* Proton beams are back, 5th April 2015, http://home.web.cern.ch/about/updates/2015/04/proton-beams-are-back-lhc

2 Year Iterations = 6.5 to 13 TeV per beam

2 Week Iterations = 50 to 25 nanoseconds

Episode VI

Agile Engineering Practices

http://home.web.cern.ch/about/updates/2015/04/proton-beams-are-back-lhc

45

@jonathon_wright


The Force Awakens (TestOps)

45 Episode VII

*All Original Content ‘The Force Awakens” (Trailer A) ©DISNEY 2015 ©Lucasfilm Ltd. & TM, 28th November, 2014

@jonathon_wright

#esconfsThe dark side (DevOps) and the light (TestOps)

“DevOps is a framework that

allows development, testing,

and operations to meet

customer needs. This

integrated team approach

facilitates communication,

collaboration, and integration

to manage today’s rapidly

changing business

demands.”

46

@jonathon_wright


The Force Awakens - Test-Ops in the Cloud

• Automate solution delivery release times and ramp up release velocity

– Infrastructure as code (topology-base model(s) - HP Codar/Release Management)

• Automate build to Cloud 2.0 (platform / technology agnostic solution delivery)

– Infrastructure to code (automation (build) model(s) – Chef)

• Automate deploy to reduced failure rates, lead times between fixes and rates of recovery

– Platform as code (deployment model(s) - HP DevOps Insight/Jenkins/IDE)

• Monitor release in the wild

– (release model(s) – HP AppPulse / Operational Insights)

• Report on Portfolio Lifecycle Management (PLM) with support for Enterprise Gamification

– Build(s) / release(s) / Quality index scores (reporting model(s) - HP Executive Scorecard/PPM)

• Collaborate with enterprise grade communication (between Dev, Test & Ops)

– Connected lifecycle intelligence (synchronisation model(s) - HP OneSync/ALI)

Solution Delivery Lifecycle Integration (SDLCi) = Unified Lifecycle Management (ULM)

Episode VII

HP Codar / DevOps Insight / AppPulse / OneSync

47

@jonathon_wright



TestOps BUILD then TEST vs. DevOps BUILD then Deploy?

De-coupling

Solutions (SOA)

Continuous

Build, Integration

& Delivery

Good Coding

PracticesConfigurability &

Maintainability

Ops Hub

Infra as Code

Extend QA

(Ops)

Resolution

Practices

Agile

Engineering

(Shift Left)

Agile

Engineering

(Shift Right)

CodarBlueprints Recipes PatternsHelionBlueprints Recipes PatternsUFT SV

TestOps (Test-Dev) with Automated Testing DevOps (Dev-Test) with Automated Deployment

Journey to DevOps with HP

Ops

Monitoring

(Testing)

Monitoring

(Ops)

Modelling

(Testing)

Modelling

(Ops)

Episode VII

Dev Test

* Ajay Nair & Faraz Syed, ‘Journey to DevOps with HP’, BrightTALK, 23th April 2015

48

@jonathon_wright


Codar



Blueprints Recipes Patterns

TestOps (Test-Dev) with Automated Testing

UFT SV Blueprints Recipes Patterns

DevOps (Dev-Test) with Automated Deployment

Helion

Episode VII

Journey to DevOps with HP

49

@jonathon_wright


Codar



Blueprints Recipes Patterns

TestOps (Test-Dev) with Automated Testing

UFT SV Blueprints Recipes Patterns

DevOps (Dev-Test) with Automated Deployment

Helion

Episode VII

* Ajay Nair & Faraz Syed, ‘Journey to DevOps with HP’, BrightTALK, 23th April 2015

Journey to DevOps with HP@jonathon_wright

#esconfs

50

@jonathon_wright


Test-Ops in the Cloud

QualityGate™ Map

• Predictive ALM

– Machine Learning

– Code Analysis

• Predictive Analysis

– Prediction(Cost/Accuracy/Defects)

– Predictive Planning

– Velocity / QA Impact

• Predictive Testing

– Smart Test (Test Impact Analysis)

– Open Test Frameworks

(SeleniumRWD/Phantom.JS/xCode/jUnit/qUnit/nUnit/TestNG)

• Predictive Builds

– Smart Build (Analyze Commits)

• Predictive Release

– Release Health

QualityGate™ Map

Confidence Level 74%

QualityGate™ Recommendations PBIs

Episode VII

http://www.testops.net/

51

@jonathon_wright


Test-Ops in the Cloud – XaaS – Design

@jonathon_wright

#esconfs

Episode VII

HP Codar feat. Chef

52

@jonathon_wright


Test-Ops in the Cloud – XaaS – Define / Architect (3-Tier)

@jonathon_wright

#esconfs

Episode VII

HP Codar feat. Chef

53

@jonathon_wright


Test-Ops in the Cloud – XaaS – Deploy - Testing

@jonathon_wright

#esconfs

Episode VII

HP Codar feat. DevOps Insight

www.eurostarconferences.com

54

@jonathon_wright


Test-Ops in the Cloud – XaaS – Manage - Testing

Episode VII

HP ALM 12.5 feat. Jenkins/Chef

55

@jonathon_wright


Test-Ops in the Cloud – XaaS – Testing in the Wild

Episode VII

HP AppPulse

56

@jonathon_wright


Test-Ops in the Cloud – Gone in Sixty Seconds

0-6 secs – Minor UX change (Dev to TestOps)

6-8 secs – Click Save button (VS2015-CTP6) feat. CodeLens

10-20 secs – Predictive Build (Jenkins) 50-60 secs – Predictive Release (HP Helion)

20-40 secs – Predictive Testing (ALM 12.5)

8-10 secs – Check-in / Analyse / Commit (GIT)

6% chance to break build

74% Quality Gate Map (confidence rate)

40-50 secs – Predictive Deploy (HP Codar)



92% Quality Index Score (Predictive Analysis)

* Visual Studio 2015 CP6 (incl. TypeScript 1.4), http://www.typescriptlang.org/playground & http://go.microsoft.com/fwlink/?LinkId=400496

Predictive vs. Smart

Episode VII

http://www.typescriptlang.org/playground

http://go.microsoft.com/fwlink/?LinkId=400496

Ask a Jedi?http://testhuddle.com/forums/topic/testops-in-the-cloud/

http://testhuddle.com/forums/topic/testops-in-the-cloud/

58

@jonathon_wright


TestOps in the Cloud - Summary

BusinessAssurance

BusinessQuality

BusinessTesting

Business Assurance provides the visibility and

transparency throughout the solution delivery lifecycle• Digital Enterprise

• Business on a Page

• Business Delivery Management

• Business Intelligence (Actionable Business Insight)

• Business Innovation (Enterprise Gamification)

Business Quality allows enforceable quality across the

entire solution delivery lifecycle owned by everyone• Business Lifecycle Management

• Business Solution Discovery / Delivery

• Business Enterprise Collaboration

• Business Acceptance Testing

Business Testing

• Testing as a Service - Models

• Solution Delivery Lifecycle integration (SLDCi)

• Test First Delivery / First Day Testing

• Continious, Integration, Build & Delivery

• Shift Everywhere (UP/DOWN/LEFT/RIGHT)

• All Channel Customer Experience

59

@jonathon_wright


Hitachi - a Digital Enterprise Company.Society Changes, Hitachi Transforms It.

$93.4

Billion947Companies

320,000+Employees

$3.4

Billion

Hitachi ranks 78th on the 2014 FORTUNE Global 500®.

© Hitachi Europe Ltd. 2014. All rights reserved.

Technology

EuroSTAR - TestOps in the Cloud