Virtualization: Improve Speed and Increase Quality

W8

Test Techniques

10/15/2014 1:45:00 PM

Virtualization: Improve Speed

and Increase Quality

Presented by:

Clint Sprauve

HP

Brought to you by:

340 Corporate Way, Suite 300, Orange Park, FL 32073 888-268-8770 ∙ 904-278-0524 ∙ [email protected] ∙ www.sqe.com

Clint Sprauve

HP Clint Sprauve is the senior product marketing manager for HP Software Functional Testing. Previously, Clint was the director of product strategy for the Borland Solutions division of Micro Focus, where he created Borland’s mobile strategy for functional test automation. With more than twenty years of experience in the software development and quality assurance industry, Clint has served as the senior product marketing manager for the Silk Testing Solutions at Borland Software and Segue Software, and as a senior technical sales engineer for both companies. He has been an independent consultant, specializing in test management and test automation.

http://starwest.techwell.com/sme-profiles/clint-sprauve

© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Virtualization: Improve Speed, Increase Quality Clint Sprauve - HP Product Marketing Manager, Functional Testing


© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 2

Today’s Agenda

• Industry TestingCchallenges

• Agile Testing Challenges

• Service Virtualization

• Network Virtualization

• Q&A


About HP Software

Top10 Software company

95% Customer satisfaction

7,000 technologists

driving innovation

#1 in each of our categories #2

Customers

50,000+

94% of Fortune 100

10+ years

delivering SaaS

Software


Surging application numbers

A tipping point for application delivery

2010 4 per app

2015 36 per app

2020 120 per app

“60% of on-line devices are now smartphones are tablets”

– Business Intelligence

“In 2016, total global mobile application revenue will reach estimated $46 billion.”

--ABI Research

2013

Number of releases per app per year

• Apps everywhere

• Accessed through multiple devices

• 30x increase in application releases

• Closed feedback loop with customers

• Focus on time-to-value and ROI

What we expect:


Composite applications?

Search

Product

Pay

Payment

Buy Ship

Shipping

Track

Track package Public cloud Traditional Managed cloud Composite

Business processes are often an integration of existing components and services

Example:

The online shopping process

Each of these steps are interconnected software components, also called services

Customer profiles


Delivering change continuously and fast is risky

Quality assurance by validation throughout the Application Lifecycle will address these risks

Q

The risks:

Change is constant

• New implementations • Support packs • Customizations

Speed impacts bottom line • Time to revenue • Cost of implementation

Interdependence increases business risk

• Apps are interdependent • Each change adds to risk

Composite application


The Internet of things

Smart thermostats Connected cars Activity trackers Smart outlets Parking sensors


The Internet of things

Things get interesting when these connected devices and services start creating

compound applications within their own verticals and across industries

Home Consumer

Buildings Infrastructure

Cities Industry

Transport Mobility

Health Body

Transportation and smart cities

In downtown San Francisco 20-30% of all traffic congestion is caused by people hunting for a parking spot. – San Francisco Municipal Transportation Agency

Healthcare and smart home

40 million adults age 65 and over will be living alone in the U.S., Canada and Europe – U.S. Department of Health


Streamlining development and operations: on-premise or in the cloud

Continuous delivery

Deploy test app

Run test cases

Test results

Dev-test with lab management automation 1

Provision dev and test

environments

Production patterns, snapshots, and monitors back to dev and test 3

Management, collaboration, risk management and security for the complete lifecycle 4

Provision and deploy to staging

Provision and deploy to prod

Automated deployment across development and operations

Monitor

2

Agile testing


The Agile Manifesto vs. the Enterprise Agile Manifesto

The Agile Manifesto

• Individuals & interactions over processes & tools

• Working software over comprehensive docs

• Customer collaboration over contract negotiation

• Responding to change over following a plan

The Enterprise Agile Manifesto

• Individuals & interactions with lean processes & tools

• Working software with essential docs

• Stakeholder collaboration with agile contracts

• Responding to change as intrinsic part of the plan

• Delivered agile architecture which reuses and evolves enterprise frameworks and patterns

http://agilemanifesto.org http://davidsprottsblog.blogspot.com/2012/10/agile-manifesto-for-enterprise.html

http://agilemanifesto.org/



http://davidsprottsblog.blogspot.com/2012/10/agile-manifesto-for-enterprise.html







Service Virtualization


Advantages and disadvantages

Stubbing (mocking)

Reduces external dependencies

Promotes a test driven development approach

Allows some testing of code with limited functionality

Stubs have to be created from scratch

Doesn’t foster proper re-use (multiple developers using different versions of the stubs)

Real world test conditions are very difficult to recreate


Composite Application

API

Mobile App

Web browser

Application under test Existing infrastructure

The service virtualization concept

Virtual services are created to stand in for the real service when developers or testers need access

Mainframe

JDBC

SOAP

RFC/IDOC

MQ/CICS

Third party

SAP System

Existing database

Web service and legacy application

REST

Pay-per-transaction

SOAP REST JDBC MQ RFC CICS

Data

Perf.

Config

Service virtualization

Simulation

Under construction


For continuous development and quality

Service virtualization addresses the challenges

1. Composite applications and software re-use

2. Highly-visible demand for quality

3. Proliferation of mobility…

4. and cloud service integration

5. Release faster-test earlier: shift left testing (development and infrastructure testing)Service virtualization removes constraints and wait times frequently experienced by development and test teams needing to access components, architectures, databases, mainframes, and so on.


End-to-end system virtualization

Traditional test environment

End-to-end virtualization

+

Wifi 3g 2g LTE

Ne

two

rk

Services

ERP Virtual LDAP

3rd Party

Network Virtualization


Application Complexity

The average application connects to 38 discreet services

Mainframe

Storage

DB

Servers

Web

Services

App

Servers

Web

Servers

Load

Balancers

Mobile

Components

Major ISP

3rd Party

Cloud Services

Content

Delivery

Networks

Mobile Carriers

& ISPs Browser

s &

Devices

Customers

Employees

Private or Public

Cloud Services

How Important is the Network?


It’s All About Bandwidth

Network Misconceptions

10Mbps 20Mbps 2Mbps 500kbps

Latency 25ms

Bandwidth

No Impact No Impact No Impact Some Impact

All Traffic Impacted

Packet Loss = Further Impact


It’s All About Bandwidth

Less Critical Due to 4G (5G, 6G …)


Carrier Frequency: • Increased Interference 2G 3G 4G 5G … 20% of all 4G Transfers Drop to 3G or Lower

Cisco Mobile Forecast: • Mobile data traffic will grow 7-fold from 2013 to 2018

= compound annual growth rate of 50%

Ofcom: • Current UK Mobile Data capacity will be exhausted by

2018

Shannon-Hartley Theorem: • Every Mobile Cell can only support a maximum channel

capacity


It’s All About Bandwidth …


It Doesn’t Make Much Difference …


Web Users – Average Transaction Response Time (s)

20x to 35x slower

Baseline

London Web

Dublin Web






Mobile Users – Average Transaction Response Time (s)

80x to 400x Slower

Functional Failures

Baseline

London 3G

Dublin 3G

London 2.5G





It’s Only About Performance …


Load Test with NV Local Load Test

Transaction Time

Transaction Time VUsers VUsers

Capacity > 500+ Users Response < 10 seconds

Capacity < 200 Users Response > 40 seconds







No Network With Remote With Web With Mobile

Thread Count

No Network Remote Web Users

50% CPU Increase

22% Thread Count Increase






NV is Only For Mobile …


Remote Office Web Cloud Deployments All Other Connectivity (Wifi, Satellite, BT) Back-End Splits DCR … Wherever Applications Meet Networks


When to Use Network Virtualization

Development Manual, Unit Test, Emulators

Functional Test Desktop or On-Device – Manual or Mobile test automation

Load/Performance Test On premise or Cloud

Network/System Test WAN Acceleration, VDI

Service Virtualization End-to-End Lifecycle virtualization

Powerful combination!


Continuous Testing with Virtualization for Real World Conditions

The ideal Agile picture

Sprint 4 1 Sprint 3 Sprint 2 Sprint 1 Sprint 5

C1 C1

G1

C1

G1

C2

G2

C1

G1

C2

G2

C3

B1

C1

G1

C2

G2

C3

B1

G1

C2

Longevity testing (independent of sprint cycles)

Regression 1

Regression 2

Regression 3

CI CI CI CI CI

Regression 4

ET ET ET ET ET


Relentless automation – Agile sprint to enterprise release…

Shift left, then test continuously

Solving key testing challenges

Exploratory testing

Automated testing

Continuous integration

Regression testing

Longevity testing

Lack of the right test tools to create re-usable test sets

Difficulty in re-using and repeating tests across sprints / iterations


Continuous testing for faster app delivery

“Shift-left”

with confidence

• Improve development efficiency

• Reduce the test burden

• Accelerate application delivery

Validate Security

Summary - Continuous testing is more critical than ever


Closing and questions


Thank you

Technology

Virtualization: Improve Speed and Increase Quality