33
© 2012 IBM Corporation CDO-1884: DevOps Review and Roadmap Daniel Berg, Chief Architect for DevOps Ruth Willenborg, DE, Cloud and DevOps Andrew Hans, Senior Dev Manager DevOps

Les outils de Devops IBM

Embed Size (px)

Citation preview

© 2012 IBM Corporation

CDO-1884: DevOps Review and RoadmapDaniel Berg, Chief Architect for DevOpsRuth Willenborg, DE, Cloud and DevOpsAndrew Hans, Senior Dev Manager DevOps

2

Please note

IBM’s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM’s sole discretion.

Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision.

The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract. The development, release, and timing of any future features or functionality described for our products remains at our sole discretion.

Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user’s job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.

3

experience delays in integration, configuration

and testing of applications*

41%41%experience delays

due to troubleshooting and fine-tuning issues

in production*

45%45%applications rolledback due to qualityissues escaping into production*

51%51%

Up to to deliver a simple code change** 4-6 Weeks 4-6 Weeks

Businesses are challenged to meet time pressures with quality software

….34% of all new IT Projects deploy late*

* Forrester/IBM Study: A New View of IBM’s Opportunity for Integrated Optimized Systems Address , 2011** Forrester “Five Ways To Streamline Release Management”, 2011* Forrester/IBM Study: A New View of IBM’s Opportunity for Integrated Optimized Systems Address , 2011** Forrester “Five Ways To Streamline Release Management”, 2011

GAPGAP

Business Owners CustomersIT OperationsDevelopment

& TestLine of

Business

4

Patterns of challenges

Differences in dev and ops environments

cause failures

Backlog of agile releases that Ops

cannot handle

Manual (tribal) processes for release

lack repeatability/speed

Lack of feedback and quality metric leads to

missed service level targets

Daily Build

MonthlyDelivery

Who did this last time?

Dave…

Dave’s not here

man…

Dev

Prod

5

Software delivery is at the heart of today’s top technology trends

Mobile AppsModern workforce expects

constantly updatedsoftware to connect to

enterprise systems

CloudHigh application demand requires

fast, scalable environmentsfor development / testing

Intelligent/Connected Systems

The software component in smart products drives value

and competitive differentiation 

CollaborationDevelopment and Operations teams

work in continuous application delivery cycles

Big DataNew applications provide insights by interpreting

massive quantities of data

Software Delivery

6

Our view of DevOps

A core enterprise capability for…

Continuous delivery of software to

Seize market opportunities and

Make rapid improvements based on customer

feedback while

Balancing speed, quality, and costs

People

Process

Tools

People

Process

Tools

7

Cultural challenges adopting DevOps

DeveloperOperator

Why does it take so long to get a test environment?

I like using new open source libraries.

I’ve checked in my code now it just needs to be deployed (easy).

Application deployment failed againbecause of new libraries.

Our processes ensure environment stability.

Development is always making bad operational decisions.

CDO-1511: How IBM Leverages SmartCloud Continuous Delivery to Streamline DevOpsCDO-1511: How IBM Leverages SmartCloud Continuous Delivery to Streamline DevOps CDO-1741: ShadowOps versus DevOpsCDO-1741: ShadowOps versus DevOps

8

DevOps Principles and Values

Develop and test against a production-like system

Iterative and frequent deployments using repeatable and reliable processes

Continuously monitor and validate operational quality characteristics

Amplify feedback loops

People

Process

Tools

People

Process

Tools

9

Rational Team ConcertRational Team Concert

Agile Development

Agile Development

Deployment of Virtual SystemsDeployment of Virtual Systems

ProvisioningProvisioning

StandardizeStandardize Automate DeliveryAutomate Delivery FeedbackFeedbackManage ChangesManage ChangesPlan & TrackPlan & Track

IBM Workload Deployer

IBM PureApplication Systems

10

StandardizeCommunicate and share environment patterns

IssuesDev environments different from production environmentsDifficult to provision test environmentsEnvironment provisioning creates new “snowflakes”

SolutionDefine standard Virtual System Patterns for environmentsShare patterns between Dev and Ops to improve communicationsRepeatable and reliable process to provision base environments (rubber stamps)

Functional Verification

Test Environment

Functional Verification

Test Environment

User Acceptance Test EnvironmentUser Acceptance Test Environment

11

Plan and TrackCommon tools to plan and track changes across Dev and Ops

IssuesConfiguration tasks are not planned or trackedDifferent tools/processes for tracking work

SolutionUse collaborative development tools to track and plan application and configuration changesEnsures work is properly planned in the proper orderEnsures audit trail for planned changes to environments

11

12

Manage ChangesVersion and manage application and configuration changes

IssuesConfiguration changes vary between environmentsConfiguration changes are not well managedRelease artifacts are randomly created and applied

SolutionVersion control configuration changes as code in an SCM close to the application changesVersion and track release artifacts in an Artifact LibraryTrack release dependencies

13

Automate DeliveryRepeatable and reliable processes

IssuesApplication deployment is generally an unreliable, manual processDifficult to replicateSlow to executeLong delays between deployments increases size of change sets making problem determination difficult

SolutionTooling to define and configure an automated delivery processReliable and repeatable delivery processDeploy early and often to “fail fast” and resolve even faster

14

FeedbackImmediate feedback of changes

IssuesWeeks, months pass before getting any feedback of a change (if any)Often cannot determine where/if a build was deployedLong delays in feedback makes problem determination more difficult

SolutionReport results of automated delivery process directly in context of development toolsPreserve traceability of delivery output with build processReport automated tests results in a timely fashion

15

Enterprise capability for continuous delivery of software innovation

Open Lifecycle Integration Platform

Continuous Delivery

Continuous Monitoring

Collaborative Development

ContinuousTesting

ContinuousRelease

Business Planning

DevOps Lifecycle

Continuous Feedback and Improvements

Operations/ProductionDevelopment/TestCustomers Business Owners

16

Application Release

Automation

Application Release

Automation

Environment ProvisioningEnvironment Provisioning

Quality Management

Quality Management

Test Automation

Test Automation

Open Lifecycles Integration Platform

Continuous Delivery

Continuous Monitoring

Change Management

Change Management

Source Control Management

Source Control Management

Build Automation

Build Automation

Delivery PipelineDelivery Pipeline

Application Performance MonitoringApplication Performance Monitoring

Continuous ReleaseContinuous TestingCollaborative Development

DevOps capabilities for continuous testing

Service Virtualization

Service Virtualization

17

Application Release

Automation

Application Release

Automation

Environment ProvisioningEnvironment Provisioning

Quality Management

Quality Management

Test Automation

Test Automation

Open Lifecycles Integration Platform

Continuous Delivery

Continuous Monitoring

Change Management

Change Management

Source Control Management

Source Control Management

Build Automation

Build Automation

Delivery PipelineDelivery Pipeline

Application Performance MonitoringApplication Performance Monitoring

Continuous ReleaseContinuous TestingCollaborative Development

DevOps tool chain for continuous testing

Service Virtualization

Service Virtualization

IBM Rational Team ConcertIBM Rational

Team Concert

IBM Rational Build Forge

IBM Rational Build Forge JenkinsJenkins IBM Rational

Quality ManagerIBM Rational

Quality Manager

IBM Rational Test Workbench

IBM Rational Test Workbench

IBM SmartCloud Provisioning

IBM WorkloadDeployer

IBM Pure Systems

IBM SmartCloud Provisioning

IBM WorkloadDeployer

IBM Pure Systems

IBM Rational Automation Framework

IBM Rational Automation Framework

ChefChef

IBM SmartCloud Application Performance Management

IBM SmartCloud Application Performance Management

IBM SmartCloud Continuous Delivery

IBM SmartCloud Continuous Delivery

18

IBM SmartCloud Continuous Delivery flow

Artifact LibraryArtifact Library

Cloud Platform Provider

Cloud Platform Provider

Automation Agent(execute delivery process)

Automation Agent(execute delivery process)

18

Deliver changes

Post changes

Post results

Publish packages

Request cloud resources

Provision resources

Retrieve packages

Developer ToolsDeveloper Tools

Source Control and Change Management server

Source Control and Change Management server

Test AutomationTest Automation

Execute tests

Build ServerBuild Server

Publish packages

Virtual System

Trigger delivery

19

Discover where we are going next

20

Business Planning Development Planning

Application Release Management

SmartCloud Continuous DeliverySmartCloud Continuous Delivery

New Feature!New Feature!

End-to-end release planningReal-time feedback for the delivery of business value

ProjectProjectBusiness Need

Business Need

RequirementRequirement

Dev Release Plan

Dev Release Plan StoryStory

BuildBuild

Test PlanTest Plan Test CaseTest Case

Application Release

Application Release EnvironmentEnvironment

SmartCloud OrchestratorSmartCloud Orchestrator

Virtual SystemVirtual System

New integrationNew integration

NewNew

21

Continuous testing with virtualized servicesAvoid testing bottlenecks due to dependencies on external services

• Automate setup and management of test virtualization server in the cloud

• Automates configuration of virtualized services for an application under test

• Automate setup of production-like test environments with low cost

Databases Mainframeapplications

Third-partyServices

Rational Test Virtualization Server

Continuous Delivery

ContinuousTesting

Continuous Feedback and Improvements

SmartCloud Continuous Delivery

SmartCloud Continuous Delivery

Rational Test WorkbenchRational Test Workbench Application changes being tested

virtualized services

IBM SmartCloud Provisioning

IBM Workload Deployer

IBM PureApplication System

NEW!Continuous testing using Green Hat virtualized

services in the Cloud

NEW!Continuous testing using Green Hat virtualized

services in the Cloud

22

Multi-stage Continuous Delivery Pipelines

Delivery Pipeline

BuildStageBuildStage

SCM(Source code & configurations)

QA StageQA Stage

Artifact Library

Performance StagePerformance Stage

Pre-Production Stage

Pre-Production Stage

Promote to ProductionPromote to Production

Changes trigger pipeline

execution

Changes trigger pipeline

execution

Each stage defines tasks to provision an environment

with entrance and exit criteria

Each stage defines tasks to provision an environment

with entrance and exit criteria

Approval gates with automated/manual approvals provide

compliance checking

Approval gates with automated/manual approvals provide

compliance checkingStages can be run in parallelStages can be run in parallel

Pipeline dashboards provide feedback for the flow of

changes through the pipeline

Pipeline dashboards provide feedback for the flow of

changes through the pipeline

Business Owners

Customers

23

Rational Development and Test Environment for System z

Continuous build and test of distributed systems

COBOL, PL/I, C++, Java, EGL, Batch, Assembler, Debug Tool

x86 PC running Linux

IMS

z/OS

WAS

DB2

MQ

CICS

Note: This Program is licensed only for development and test of applications that run on IBM z/OS. The Program may not be used to run production workloads of any kind, nor more robust development workloads including without limitation production module builds, pre-production testing, stress testing, or performance testing.

23

DevOps Lifecycle

Continuous Feedback and Improvements

Operations/ProductionDevelopment/TestCustomers Business Owners

IBM Rational Test Workbench

IBM Rational Test Workbench

IBM Continuous Integration Solutions

for System Z

IBM Continuous Integration Solutions

for System Z

IBM SmartCloud Continuous Delivery

IBM SmartCloud Continuous Delivery

New integrationNew integration

24

Open Lifecycle Integration Platform

Continuous Delivery

Continuous Monitoring

Collaborative Development

ContinuousTesting

ContinuousRelease

Business Planning

DevOps Lifecycle

Continuous Feedback and Improvements

Operations/ProductionDevelopment/TestCustomers Business Owners

Continuous delivery for mobile

Device fragmentation Additional governance required Curated app-stores impose review processes Device testing is difficult

Builds are pulled from app-stores vs push Injection of app-store feedback into delivery

process Native plus back-end services required for

mobile applications

There are mobile-specific challenges in achieving continuous delivery

Device AnywhereDevice Anywhere Mobile simulatorMobile simulator

AppCenterAppCenterIBM Mobile Development

Lifecycle SolutionIBM Mobile Development

Lifecycle Solution

IBM SmartCloud Continuous Delivery

IBM SmartCloud Continuous Delivery

IBM Rational Test Workbench for Mobile

IBM Rational Test Workbench for Mobile

March BETA March BETA

New integrationNew integration

25

Open, dynamic orchestration of resources, workloads and services

Reduce time-to-market to deliver new business services

Improve administrator productivity

• Fully automates the deployment and lifecycle management of cloud services across resources, workloads and services

• Built on a foundation of open standards – TOSCA, OpenStack, OSLC

• Accelerated deployments with reusable workload patterns and Chef recipes

• Unified management of heterogeneous environments

• Supports deployment of hybrid & public clouds

• Works with SmartCloud Continuous Delivery to provide extended DevOps platform

Continuous delivery pipeline

Orchestrator Open Beta

© 2013 IBM Corporation | IBM Confidential until 11am ET March 4th, 2013

NewNew

26

Orchestration Engine

Network Domain

Storage Domain

IT ManagementMonitoring

DomainData

Availability Domain

Compute Domain

Monitoring IT Asset

Management

Service Desk

Storage

Domain

Change Manageme

nt

Provision PatternProvision Pattern

Network

Domain

Workload Orchestration Workload aware placement, optimization and operation

Resource OrchestrationOnboard, provision,

manage CPU, Storage and Network

Service OrchestrationManage the lifecycle of business applications

DBAppWeb

Managing workloads across the lifecycle requires orchestration

27

Rational Team ConcertRational Team Concert

Agile Development

Agile Development

IBM SmartCloud OrchestratorIBM SmartCloud Orchestrator

Extended platforms

More cloudsMore clouds More patternsMore patterns

EC2EC2 TOSCATOSCA

Virtual ApplicationsVirtual Applications

28

OpsCode ChefChef ServerHosted Chef

OpsCode ChefChef ServerHosted Chef

Your InfrastructureYour Infrastructure

QAQA

SmartCloud Orchestrator Promotion Control SmartCloud Orchestrator Promotion Control

PRODPROD

inst

Retrieve list of buildsChange environment mappings

Changeinstance

environments

DEVDEVinstinst

Deliver andtest new buildsDeliver andtest new builds

OrchestratorOrchestrator

IntegratedApproval

Processing

IntegratedApproval

Processing

Drive Build Promotion Drive Build Promotion

Pedestal 74: Marrying Apps & Infrastructure: Deliver Working Code More Quickly and with Greater Consistency than Ever Before

Pedestal 74: Marrying Apps & Infrastructure: Deliver Working Code More Quickly and with Greater Consistency than Ever Before

Continuous Delivery

Continuous Delivery

29

How we plan to get there …

Continuous testing with Service Virtualization

New Platforms: Openstack & SmartCloud Orchestrator

Continuous testing with Service Virtualization

New Platforms: Openstack & SmartCloud Orchestrator

End-to-end release planning

Multi-stage pipelines

Continuous delivery for Mobile and Mainframe

End-to-end release planning

Multi-stage pipelines

Continuous delivery for Mobile and Mainframe

Simplified developer experience for building engaging systems

Simplified developer experience for building engaging systems

Phase 1 Phase 2 Future

30

Summary

Challenges to deliver software-driven innovation

Disruptive technologies driving greater need to innovate

DevOps is critical to your success

IBM has first class DevOps solutions and is continuing to invest and improve upon these solutions

31

We want to hear you!

Workshop: DevOps / Continuous Delivery•60-minute, small group discussion (fewer than 10)•Hosts:

• Neeraj Chandra, VP - Strategy• Randy Newell, Director - Capabilities Marketing

Tuesday, March 5, 5:15 – 6:15 pm pt

Pulse Expo Hall - Marquee Ball Room, Room B5

Limited seats – please RSVP: [email protected] or 203-521-9157

31

The IBM Technical Summit

Register by March 15 and save $300!

Top Five Reasons to AttendLearn how you can make the most of Agile, DevOps, Cloud, Mobile, Big Data, Social Business and other key trends to release products faster, improve processes, increase quality, and meet business objectives.

Get detailed Rational technical training trough hundreds of breakouts, hands-on technical workshops, open labs and a wide variety of certification testing

Explore Innovation Labs, observe interoperability in action and meet face to face with experts in a high-energy Exhibit Hall.

Network with over 4000 attendees from around the world and collaborate with your peers from a wide variety of roles, industries and locations.

Enjoy top-notch keynotes and entertainment, including strategic presentations, dynamic guest speakers and customer success stories.

Innovate 2013: The IBM Technical Summit is the event for software

practitioners and product developers. Attendees will learn to improve the

practices, predictability and economics of software delivery through detailed

education and insights into key technical trends!

Innovate 2013: The IBM Technical Summit is the event for software

practitioners and product developers. Attendees will learn to improve the

practices, predictability and economics of software delivery through detailed

education and insights into key technical trends!

ibm.com/innovate

33

Acknowledgements and Disclaimers:

© Copyright IBM Corporation 2013. All rights reserved.

U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

Please update paragraph below for the particular product or family brand trademarks you mention such as WebSphere, DB2, Maximo, Clearcase, Lotus, etc

IBM, the IBM logo, ibm.com, [IBM Brand, if trademarked], and [IBM Product, if trademarked] are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or ™), these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at “Copyright and trademark information” at www.ibm.com/legal/copytrade.shtml

If you have mentioned trademarks that are not from IBM, please update and add the following lines:

[Insert any special 3rd party trademark names/attributions here]

Other company, product, or service names may be trademarks or service marks of others.

Availability. References in this presentation to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates.

The workshops, sessions and materials have been prepared by IBM or the session speakers and reflect their own views. They are

provided for informational purposes only, and are neither intended to, nor shall have the effect of being, legal or other guidance or advice to any participant. While efforts were made to verify the completeness and accuracy of the information contained in this presentation, it is provided AS-IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, this presentation or any other materials. Nothing contained in this presentation is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software.

All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer. Nothing contained in these materials is intended to, nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific sales, revenue growth or other results.