Trends in DevOps, Continuous Delivery and Application ...simplydirect.com/wp-content/uploads/FINAL_PULSE... · Electric Cloud is the leader in DevOps Release Automation. We help organizations

Summary Results • May 2016

Trends in DevOps, Continuous Delivery

and Application Release Automation


Program Overview

Between February and March 2016, Gatepoint Research invited selected IT executives to participate in a survey themed Trends in DevOps, Continuous Delivery & Application Release Automation.

Candidates were invited via email and 146 executives have participated to date.

Management levels represented are predominantly senior decision makers: 5% hold the title CxO, 8% are VPs, 60% are Directors, and 27% are Managers.

Survey participants represent firms from a wide variety of industries financial services, business services, high tech manufacturing, telecom services, general manufacturing, wholesale trade , and media.

81% of survey responders work in Fortune 1000 companies with revenues over $1.5 billion; – 9% work in Large firms whose revenues are between $500 million and $1.5 billion; – 10% work in Small to Mid-Market firms with less than $250 million to $500 million

in revenues.

100% of responders participated voluntarily; none were engaged using telemarketing.


Observations and Conclusions

Production application releases are ongoing. Over half of survey respondents (51%) report the frequency of their production application release schedule is weekly - or less. And they usually encounter challenges. 69% of respondents say they run into problems with production application releases occasionally to frequently.

Sticking points: complexity, environment differences. Respondents encounter production problems when the process involves complex dependencies and workflows (61%) or when processes move from development to production (53%).

Missed release dates are fairly common. Although 14% of those surveyed boast that they “never” miss release dates, 36% report missing them occasionally to frequently. There’s a lack of deployment continuity. Asked if development, QA, and production deployments are performed the same way, 37% of respondents said “No.”

Production deployment requests: not an automated process. Only 12% of respondents report their handling of production deployment requests is automated. 17% of those surveyed say it is a manual process.

Release stabilization time is a wide window. 27% of respondents claim that their application releases achieve production stability within minutes. But for the other 72%, production stability takes hours, days, weeks… even months.

Wish List: Reduce delivery time, increase quality, reduce errors. Asked to rate the impact that improving various aspects of software development would have on their business, reducing change delivery time, increasing quality, and reducing errors virtually tie for first place

Big changes are coming soon. Over 40% of those surveyed report they intend to implement initiatives in DevOps, Continuous Integration, and Deployment/App Release Automation within the next six months.

Summary Results • May 2016Copyright © 2015 Gatepoint Research. All rights reserved. The information contained in this report is the sole property of Gatepoint Research and may not be

used, reproduced, redistributed in any form including, but not limited to, print and digital form without the express written consent of Gatepoint Research.

How often do you perform production application releases?

Production application releases are ongoing. Over half of survey respondents (51%) report the frequency of their production application release schedule is

weekly - or less.

27%

24%

27%

14%

4% 4%

0%

5%

10%

15%

20%

25%

30%

More than once aweek

Weekly Monthly Quarterly Yearly N/A



How often do you have challenges with production application releases?

Production application releases usually encounter challenges. 69% of respondents say they run into problems with production application releases

occasionally to frequently.

5%

27%

51%

17%

1%0%

10%

20%

30%

40%

50%

60%

Never Rarely Occasionally Frequently Not sure



What are the top challenges with production application releases?

Sticking points: complexity, environment differences. Respondents encounter production problems when the process involves complex dependencies and

workflows (61%) or when processes move from development to production (53%).

61%

53%

49%

34%

19%

13%

5%

0% 10% 20% 30% 40% 50% 60% 70%

Complex application dependenciesand workflows

Environment differences, e.g., it worked inDevelopment but not in Production

Manual, error-prone steps

Troubleshooting deployment failures

Security compliance

Logging and audit requirements

Other



How often do you miss production application release dates?

Missed release dates are fairly common. Although 14% of those surveyed boast that

they “Never” miss release dates, 36% report missing them occasionally to frequently.

14%

50%

30%

3% 3%0%

10%

20%

30%

40%

50%

60%

Never Rarely Occasionally Frequently Not sure



Are all of your deployments to development, quality assurance testing

and production performed the same way?

Lack of deployment continuity. Asked if development, QA, and production

deployments are performed the same way, 37% of respondents said “No.”

Yes63%

No37%



How are production deployment requests handled?

Production deployment requests: not an automated process. Only 11% of respondents report handling production deployment requests automatically. 17% of

those surveyed say it is a totally manual process.

Mostly manual17%

Mostly automated26%

Both manual and automated

46%

Fully automated with optional

approval gates11%



How long do releases generally take before they are stable in production?

Release stabilization is a wide window. 27% of respondents claim that their application releases achieve production stability within minutes. But for the other

72%, production stability takes hours, days, weeks… even months.

27%

44%

20%

6%3%

0%

5%

10%

15%

20%

25%

30%

35%

40%

45%

50%

Minutes Hours Days Weeks Months



Which of the following software development aspects, if addressed,

would have a significant impact to your business?

Wish List: Reduce delivery time, increase quality, reduce errors. Asked to rate the impact that improving various aspects of software development would have on their business, reducing change

delivery time, increasing quality, and reducing errors virtually tie for first place.

55%

53%

51%

27%

25%

24%

0% 10% 20% 30% 40% 50% 60%

Reducing the time to deliver change

Increase release quality

Reduce deployment errors

Reduce cost of application delivery

Address audit, security and compliance issues

Increase utilization ofexisting infrastructure



Please indicate the time frame in which you plan

to implement the following initiatives.

Big changes are coming soon. More than 40% of those surveyed report they intend to implement initiatives in DevOps, Continuous Integration, and

Deployment/App Release Automation within the next six months.

DevOps

Continuous Integration

Deployment/Application Release Automation

43%

14%

10%

29%

0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50%

0 to 6 months

7 to 12 months

13+ months

No plans

42%

16%

8%

33%

0% 5% 10% 15% 20% 25% 30% 35% 40% 45%

0 to 6 months

7 to 12 months

13+ months

No plans

42%

18%

11%

23%

0% 5% 10% 15% 20% 25% 30% 35% 40% 45%

0 to 6 months

7 to 12 months

13+ months

No plans



Profile of Responders:

Industry Sectors

Responders work in a range of industry sectors.

Financial Services42%

Business Services27%

Mfg - High Tech16%

Telecom Services

7%

Mfg - General3%

Wholesale Trade3%

Media2%




Revenue

81% of responders work in Fortune 1000 companies

with annual revenues over $1.5 billion.

>$1.5billion81%

$500 million -

$1.5 billion

9% $250 - 500 million7%

<$250 million3%




Job Level

73% of responders hold executive level positions in their organizations.

Manager, 27%

Director, 60%

VP, 8%

CxO, 5%


Electric Cloud is the leader in DevOps Release Automation. We help

organizations developing enterprise web/IT, mobile, and embedded

systems applications deliver better software faster by automating and

accelerating build, deployment, and release processes at scale. Leading

organizations like Cisco, E*TRADE, Gap, GE, HP, Intel, Lockheed Martin,

Sony and Qualcomm use Electric Cloud solutions and services to boost

DevOps productivity and Agile throughput, while providing a scalable,

auditable, predictable, and high-performance pathway to production.

Documents

Trends in DevOps, Continuous Delivery and Application ...simplydirect.com/wp-content/uploads/FINAL_PULSE... · Electric Cloud is the leader in DevOps Release Automation. We help organizations