Voke Research & Skytap Webinar: Virtual and Cloud Based Labs

© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.

◉Web Premiere Market SnapshotTM Report:

Virtual and Cloud-based Labs

Theresa Lanowitz

voke Founder

2 December, 2014


◉Agenda

• Trends

• Embracing Virtual and Cloud-based Labs

• voke Research Data – Virtual and Cloud-based Labs

- The Problem

- The Solution – Virtual and Cloud-based Labs

- ROI – Virtual and Cloud-based Labs

• Net/Net


๏ Trends


◉Current Reality


◉Why Are Software Failures Making Headlines?

• Economy

- Is your budget expanding, declining, or remaining flat?

• Faster, faster, faster

- Does your organization prioritize speed-to-market at the exclusion of cost and

quality?

• Old technology

- Are you up to date on the latest version of your testing platform?

- Are you using new technologies to increase your productivity?


๏ Embracing Virtual and Cloud-based Labs


Virtual and Cloud-based Labs – The creation of a virtual

instance of a physical environment to enable anyone to

access a virtual equivalent of any environment on demand at

any time without the need to wait for a physical machine set-

up or additional hardware.

Cloud and virtual labs offer the server virtualization

equivalent for the dev/test use case.

Source: voke Market SnapshotTM Report: Cloud and Virtual Labs – August 2014

◉Virtual and Cloud-based Labs – Definition


1. Cost, quality, schedule complexity

2. Release frequency and parallel development

3. Immediate defect reproduction

4. Proliferation of mobile devices and platforms

5. Internet of things

6. Demand for quality

7. Global workforce and on-demand access

8. Budgetary constraints

9. Desire for simplicity

◉The Need for Virtual and Cloud-based Labs

Nine Market Forces and Trends

Source: voke Market SnapshotTM Report: Cloud and Virtual Labs– August 2014


๏ voke Research Data –



◉Survey Methodology

• Conducted by voke from March – June 2014

• Interviews on-line and in-person (over 500 participants)

• Survey participation is anonymous

• Responses are confidential

• Question types

- Multiple choice

- Check all that apply

- Open-ended

Thank you to all survey participants!


๏ The Problem


Environment – the collection of hardware and software used by

development and testing for pre-production purposes.

Environment examples include: development, QA/test, regression

test, system test, UAT, production reference, performance, pre-

production, staging, archive of current release, maintenance, etc.

◉Environment – Definition



◉Waiting for Environments – Availability

63%Development

work delayed

while waiting


68%QA work

delayed while

waiting


◉Access to Lab Environments – Scheduling

46%Required to

schedule

access to labs



◉Lab Access – Wait Time

18 days

average

wait


Wait Time to Access Lab Participant PercentagesOn Demand 19%

1-3 Hours 5%

4-5 Hours 5%

1 Day 14%

2 Days 11%

3 Days 10%

1 Week 10%

2 Weeks 9%

3 Weeks 10%

1 Month 4%

2 Months to 1 Year 3%


◉Lab Configuration Time – Dev and QA/Test


Development Setup Time Participant PercentagesImmediate 9%

30 minutes or less 9%

1 hour 10%

2-3 hours 8%

4-6 hours 9%

1 day 17%

2 days 8%

3 days 5%

1 week 12%

2-3 weeks 7%

1 month or more 6%

QA/Test Setup Time Participant PercentagesImmediate 4%

30 minutes or less 10%

1 hour 15%

2-3 hours 8%

4-6 hours 7%

1 day 17%

2 days 7%

3 days 7%

1 week 9%

2-3 weeks 10%

1 month or more 6%

14 days

average

setup for dev

12 days

average

setup for

QA/Test


◉Lab Access – Restrictions


43%Lab access

restrictions14

Day average

time limit for

lab use


◉The Problem – Shrinking Lab



◉Physical Labs – Average Cost

$12Million average per lab



๏ The Solution –



◉Virtual and Cloud-based Labs – Adoption


54%Virtual and

cloud-based

labs used more

than 2 years

Length of Use Participant PercentagesLess than 1 year 21%

Between 1 to 2 years 25%




More than 5 years 14%

Virtual and cloud-based labs are preferred

over generic cloud solutions for

development and test labs to gain the full

benefit of an “out of box” solution

customized to deliver full featured on-

demand access for development and test

lab use scenarios.


◉Virtual and Cloud-based Labs – Use


62%Project and

departmental

Nature of Use Participant PercentagesPilot project 20%

Project-based 35%

Departmental 27%

Available via center of excellence (CoE) 17%

Enterprise-wide 27%

Accessible to third party offshore teams 10%

Accessible to entire software supply chain

including third party partners and suppliers 6%

44%CoE or

Enterprise-wide

16%Third-party

access


◉Virtual and Cloud-based Labs – Benefits


Benefits of Cloud and Virtual Labs Participant PercentagesOn-demand access to environments 58%

Reduced capital expenditures (CAPEX) 53%

Reduced operational expenditures (OPEX) 46%

Consistent environments as close to production as possible for

testing with no time constraints

41%

Sufficient environments available for parallel development 40%

Eliminate defects prior to production 39%

Improved availability of maintenance environments 38%

The ability to test in an isolated environment outside of a

development or production environment

38%

Improved audits and compliance 33%

Efficient defect reproduction 31%

Improved time-to-market 31%

Less dependencies on other organizations to create and maintain a

lab environment

30%

Configuration files under version control (“ configuration as code” ) 18%

Improved relationships with other functional groups 16%


๏ ROI –



◉ROI – Before and After Virtual and Cloud-based Labs


41%Provisioning time

2 weeks – 3

months

75%Provisioning

time 1 day or

less

Before Virtual and Cloud-based Labs After Virtual and Cloud-based Labs


◉ROI – Reduced Defect Reproduction Time



◉ROI – Reduced Production Defects



◉ROI – Reduced Total Defects



◉ROI – Increased Platforms Tested



◉ROI – Increased Versions Tested



◉ROI – Increased Test Coverage



◉ROI – Increased Tests Executed



◉ROI – Reduced Test Cycle Times



๏ Net/Net


◉Net/Net

• Consequences of software failures are real

• Embrace virtual and cloud-based labs to manage cost, quality, and

schedule

• Virtual and cloud-based lab solutions deliver double digit

improvements in

- Reduced time to reproduce defects

- Reduced defects entering production

- Reduced total defects

- Increased platforms tested

- Increased versions tested

- Increased test coverage

- Increased number of tests executed

- Reduced testing cycles

• Virtual and cloud-based lab solutions offer a purpose-built dev/test

lab


Thank You!!!


๏ Q&A


◉ voke Contact

voke, inc.

2248 Meridian Boulevard

Suite H

Minden, NV 89423

P: +1.866.895.9045

W: www.vokeinc.com

T: @vokeinc

http://www.vokeinc.com/

© 2014 Forrester Research, Inc. Reproduction Prohibited

Full On-Demand Webinar

Click Here:

http://bit.ly/vokeresearch

http://bit.ly/vokeresearch