26
1 © Copyright 2015 EMC Corporation. All rights reserved. EMC DevOps Transformation Best Practices and Lessons from the field

Enterprise DevOps Transformation

Embed Size (px)

Citation preview

1© Copyright 2015 EMC Corporation. All rights reserved.

EMC DevOps TransformationBest Practices and Lessons from the field

2© Copyright 2015 EMC Corporation. All rights reserved.

Success is a companies ability to see the window of opportunity and capitalize on it.

https://www.ted.com/talks/bill_gross_the_single_biggest_reason_why_startups_succeed?language=en

3© Copyright 2015 EMC Corporation. All rights reserved.

Traditional Enterprise IT

COMPLEX MANUAL CONTROLLED

4© Copyright 2015 EMC Corporation. All rights reserved.

Industry Analysts and Reports

TRADITIONAL MODELS TRANSFORMED IT

http://www.appex.fr/fr/mediasanalystes.html?file=files/appex/media_analystes/telechargements/CIO%20Magazine%20AppDev%20Survey%2010-4-2012%20SUMMARY.pdfhttp://puppetlabs.com/2014-devops-reporthttp://stateofagile.versionone.com/http://velocityconf.com/velocity2014/public/schedule/detail/35184

of IT Executives admit delivering project on-time and on-budget is challenging

Say this challenge has remained the same or gotten worseover time

~90%

~75%

30x More frequent code deployments

Higher rate of success deploying change

Faster Mean Time ToRecovery (MTTR)

>80%Report improvements in productivity, quality, visibility, alignment, and responsiveness

60x

168x

5© Copyright 2015 EMC Corporation. All rights reserved.

6© Copyright 2015 EMC Corporation. All rights reserved.

What are We Seeing in the Marketplace?

So…

7EMC CONFIDENTIAL—INTERNAL USE ONLYEMC CONFIDENTIAL—INTERNAL USE ONLY

• Agility & Speed– Faster time-to-market capability– Shorter feedback loops with

customers– Ability to experiment or pivot– Ability to introduce new

technologies

• Simplify & Stabilize– Improve standardization and

configuration management– Extend Policy-based administration– Reduce portfolio complexity– Control sprawl and shadow IT– Reduce risk associated with

deployments and upgrades

Common Challenges

• Cost– Reduce OPEX support cost associated with legacy portfolio– Improve efficiency and effectiveness of existing team and systems

FASTER BETTER CHEAPER

8EMC CONFIDENTIAL—INTERNAL USE ONLYEMC CONFIDENTIAL—INTERNAL USE ONLY

DEVELOPMENT QUALITY ASSURANCE (UAT) STAGING PRODUCTIONManual Manual Manual

DEVELOPMENT QUALITY ASSURANCE (UAT) STAGING PRODUCTIONAUTO AUTO Manual

AUTO

Build Automation

Version Control

Code Analysis

Automated Unit Testing

Developer Image Automation

Agile Development Practices

Agile Teaming Model

SOA/MicroService Architecture

Agile Testing Methods

Branching Practices

Application Frameworks

Dev/Test Workstation Automation

Automated Functional Testing

Automated Regression Testing

Infrastructure Automation

Configuration Automation

Automated Deployment

Workflow/Pipeline Management

Automated Application Bootstrapping

Release Management/Change Control Optimized for Daily PRODUCTION Release

Automated Penetration Testing

Automated Security/Compliance Checks

Dashboard/Reporting/Audit

Test Workstation Automation

Automated Performance Testing

Automated Load Testing

Collaboration Systems/Tooling

Modernize Enterprise Architecture Model

or

Automated Deploy

Hybrid Cloud Dev/Test Burst

Policy-driven Design w/Financials

Service Portal

Data Services

Monitoring

Logging Services

DR & Rollback

Resiliency Testing

Feature Toggling

Cloud Bursting (all)

RM/CC for Auto PROD Deploy

Agile Portfolio

Operating Model

ALM Factory

DevOps is a Pervasive Transformation

9© Copyright 2015 EMC Corporation. All rights reserved.

Start small and scale with confidence

Incremental Methodology

APP

APP

APP

APPAPP

APP

APP

APP

APP

APPAPP

APPAPPAPP

APP

APPAPP

APP APP

APP

APP

APP

APP

APP

APPAPP

APP

APP

APP

APP

APP

APP

APPAPP

APP

APP

APP

APPAPP

APP

APP

APP

APP

APP

APPAPP

APP

APP

APP

APP

APP

APP

APPAPP

APP

APP

APP

APPAPP

APP

APP

APP

APP

APP

APPAPP

APP

APP

APP

APP

APP

APP

APPAPP

APP

APP

APP

APPAPP

APP

APP

APP

APP

APP

APPAPP

APP

APP

APP

APP

APP

APP

APPAPP

APP

APP

APP

APPAPP

APP

APP

APP

APP

APP

APPAPP

APP

APP

APP

APP

APP

APP

APPAPP

APP

APP

APP

APPAPP

APP

APP

APP

APP

APP

APPAPP

APP

APP

APP

APP

APP

APP

APPAPP

APP

APP

APP

APPAPP

APP

APP

APP

APP

APP

APPAPP

APP

APP

APP

APP

APP

APP

APPAPP

APP

APP

APP

APPAPP

APP

APPAPP

APP

APP

Single Application(Project Team)

Dependent Applications(Program Teams)

10-100s Applications(Line-of-Business Portfolio)

100-1000s Applications(Enterprise)

PH

AS

E

1

PH

AS

E

2P

HA

SE

4

PH

AS

E

3

GOAL

GOAL

GOAL

GOAL

Goal+ +

+ +

10EMC CONFIDENTIAL—INTERNAL USE ONLYEMC CONFIDENTIAL—INTERNAL USE ONLY

Best Practices from the Field

11© Copyright 2015 EMC Corporation. All rights reserved.

Top 5 Must Haves for DevOps

1. Common vision and unified approach

2. Success criteria and measures

3. Collaborative, cross functional teams

4. Automated delivery pipelines

5. TRUST

12© Copyright 2015 EMC Corporation. All rights reserved.

the “WHAT” – defines outcomes; sets enterprises standards to maintain quality and provide a consistent work environment across the enterprise

Employ a Top Down & Bottoms Up Change Model

Vision & Approach

CHANGE ADOPTION

LEADERSHIP TEAM

DELIVERY TEAM

the “HOW” – determines the best approach for achieving the standards defined at the enterprise level

13© Copyright 2015 EMC Corporation. All rights reserved.

• Reduce cycle time by 300%

• Reduce recovery/rollback time to less than 4hrs

• Improve process efficiency by 10%

• Reduce break/fix workload from 50% to 30%

• Solution is extensible and parameterized

Success Criteria & MeasuresDefine the Outcomes of Transformation

14© Copyright 2015 EMC Corporation. All rights reserved.

Challenges• Pain points around delivery and quality of software produced• Agile development with waterfall testing & release with no clear process defined

to coordinate agile and waterfall teams• Lean SDLC initiative across the enterprise to save costs, improve architecture,

speed-up time to market, better quality software in shorter release cycles

Strategy engagement on enabling a scalable Agile Factory solution across one of the largest banks in the world

GLOBAL BANK

Solution• The ability to deliver a discrete set of deliverables from two or more tightly

integrated teams all the way to PROD on-demand• Strategy on how Continuous Delivery (CD) elegantly solves most of the historical

challenges preventing the bank from achieving agility at scale• Enablement of automation throughout the tool chain & SDLC

Results• Model to execute the multi-year transformational roadmap for the bank for an

omni-channel consumer experience while keeping “as a service” in mind so the model can be leveraged for the entire wholesale bank

• Actionable roadmap on how CD would radically reduces the time and cost of building valuable software

15© Copyright 2015 EMC Corporation. All rights reserved.

Introduce Matrix Organization

Cross-Functional, Collaborative Teaming

GROUPING DYNAMIC TEAMING MODEL

GOAL

Operational SilosCentralized Management

Cross-functional TeamSelf-managed; Product Aligned

16© Copyright 2015 EMC Corporation. All rights reserved.

Release Candidate Pipelines

Delivery Pipelines

VERSIONCONTROL

COMMITCREATECHANGE

• New software• Enhancements/fixes• Upgrades• Patches• Configurations

TEST UAT STAGE

PROD

Development & Build Process

1.1

1.2

1.3

1.4

1.5

1.2

Automated Tool Chain

17© Copyright 2015 EMC Corporation. All rights reserved.

Integrated & Automated Tool Chain

Version Control

Assemble Dependencies

Unit Test BuildCompile BuildAnalyze Code

IaaS Provisioning

Configuration Automation

Middleware & Runtime

DeploymentPortal

Command Line

Code Commit

Manifest/Profile Creation

Analyze Code Unit Test Code

Workflow/Deployment

Engine

Service Catalogue

Environment Profiles/

Controller (CMDB) Application

Deployment & Configuration

Application Bootstraping

CONTINUOUS BUILD/INTEGRATION

PLATFORM AUTOMATION SCRIPTING

Application Environment-as-a-Service

TEST AUTOMATION SUITE

System Test

Compliance Test

UI Test

Perform. Test

Penetration Test

Integration Test

Smoke Test

Functional Test

Regression TestDashboard/

Management

Monitoring, Logging, &

Management

18© Copyright 2015 EMC Corporation. All rights reserved.

App/Dev Accelerator Proof of Concept (POC)

Large Insurance Provider

ChallengeVirtualized environments contained waste and were generally

overprovisioned and under utilizedCreating new virtual environments for development and integration

testing took too much time

SolutionImplemented service catalog in vCAC, orchestration with App

Director, infrastructure automation and configuration with Puppet

Environment monitoring with vCOPS, configuration drift monitoring with Puppet

ResultsDefined self service catalog, automated infrastructure provisioning &

configuration, deployed apps, provided monitoring for configuration drift and utilization

Provided configuration drift and environment utilization monitoringCreated self service workflow that allows

user to select, provision and deploy applications

to a cluster in ~20 minutes

19© Copyright 2015 EMC Corporation. All rights reserved.

Challenges• 37+ week lead time to change patient facing software along with suffering quality• Legacy systems and software supporting business critical applications• Heavy compliance restrictions• Business & Technical Units performing in silos• Environmental starvation for large development teams

Onboarding DevOps and building a Continuous Delivery (CD) ecosystem for the largest HMO in the United States

Large Nonprofit HMO

Solution• Design & deploy a Continuous Delivery Ecosystem leveraging hybrid cloud

technology integrated with a DevOps tool chain• Executive coaching, DevOps workshops, and talent seeding to help change the

overall company culture• Modernize two application services to demonstrate CD as well as replatform from

end of life systems, spearheading a larger replatform effort

Results• Expanded architecture design of current cloud to accommodate CD & Compliance

requirements, enabling an organizational technical standard for DevOps• Demonstrated the automated builds of two services through CD, allowing sponsors to

showcase speed and agility• Relieved environmental starvation issues• Brought two integrated product development team from apprentice to practitioner level• Proved CD can accelerate replatform & migration efforts

20© Copyright 2015 EMC Corporation. All rights reserved.

• Solution globally; implement locally

• Elicit input from SMEs and Stakeholders

• Be transparent

• Allow time to build trust

TRUST

ADOPTION over COMPLETION

21© Copyright 2015 EMC Corporation. All rights reserved.

So how can the EMC

Federation help?

22© Copyright 2015 EMC Corporation. All rights reserved.

Service Models

Strategic and planning services that design and define a roadmap and phase 1 (MVP) devops/continuous delivery plan tailored to an enterprise’s unique maturity and readiness.

Joint partnership to implement continuous

delivery tool chains and seed a devops cultures within an enterprise

Federation-led project to implement prescribed

continuous delivery tool chains that compliment and influence devops initiatives within an

enterprise

Federation-managed hybrid cloud infrastructure with

devops lab services based on prescribe tooling to

support development, test, and production workloads

* Need to validate that we can deliver these services

ADVISOR

NAVIGATOR DRIVER MANAGED*

23© Copyright 2015 EMC Corporation. All rights reserved.

Full Spectrum Portfolio Support

Bare Metal VirtualizedContainers &

Services

Enterprise Application Portfolio

DEVOPS ENABLED CONTINUOUS DELIVERY

TOOL CHAIN

• API Driven Architecture• Multi-Modal Capability• Software Defined• Policy Driven

RESILIENCY AGILITY SPEED

24© Copyright 2015 EMC Corporation. All rights reserved.

BU

ILD

RE-ENGINEER

MEA

SU

RE

The Federation Approach

CROSS FUNCTIONALDEVOPS TEAM

OPTIMIZED PROCESSES

CONTINUOUS DELIVERY TOOL CHAINS

INDUSTRY LEADING TOOOLS

OPEN PARTNER COMMUNITYAPPLICATION DELIVERY

PIPELINE (SDLC)

25© Copyright 2015 EMC Corporation. All rights reserved.

Why the Federation for DevOps?Single source for DevOps best-of-breed solutions

• Puppet Labs

• Chef

• Microsoft

• CloudBees

Focus on People & Process; Not just technology

Strategic Partnerships w/Leading Vendors

• Business alignment• Organizational structure• Application lifecycle policies and procedures

• Development languages (Java, .Net, Ruby, etc.)

• Virtualization platforms (vSphere, HyperV, OpenStack)

• DevOps tools (Puppet, Chef, TFS, etc.)

Evolutionary approach to the cloud

Agnostic approach

• DevOps enabled Cloud Migrations• Maximize value of brownfield applications• Empower greenfield application development

Enterprise Experience & Storage Automation

Cloud & Infrastructure Automation

Enterprise Security & Compliance

PaaS Solutions

Enabling IT@Velocity

Thank You.

Email: [email protected] Twitter:@bartdriscollBlog:Infocus.emc.com

Bart Driscoll