42
©2015, Amazon Web Services, Inc. or its affiliates. All rights reserved Accelerating DevOps Pipelines with AWS Konstantin Wilms, Solutions Architect Rick Houlihan, Solutions Architect

Accelerating DevOps Pipelines with AWS

Embed Size (px)

Citation preview

Page 1: Accelerating DevOps Pipelines with AWS

©2015,  Amazon  Web  Services,  Inc.  or  its  affiliates.  All  rights  reserved

Accelerating DevOps Pipelines with AWS

Konstantin Wilms, Solutions Architect Rick Houlihan, Solutions Architect

Page 2: Accelerating DevOps Pipelines with AWS

‘Ops is slowing us down’

Page 3: Accelerating DevOps Pipelines with AWS

‘Devs are going to break things’

Page 4: Accelerating DevOps Pipelines with AWS

‘We can’t train everyone’

Page 5: Accelerating DevOps Pipelines with AWS

Background The End to End Development Pipeline

Page 6: Accelerating DevOps Pipelines with AWS
Page 7: Accelerating DevOps Pipelines with AWS

Production

Build

QA, Integration

& Test

Staging

Artifacts

Page 8: Accelerating DevOps Pipelines with AWS

Manage Store Build Deploy Code

Page 9: Accelerating DevOps Pipelines with AWS

Monitor Provision Deploy Test Build Code

Elastic Beanstalk

OpsWorks

Cloud Watch

Cloud Formation

Code Deploy

Code Commit

Code Pipeline

Integration

Development / QA / I&T Operations

Deployment Agile

EC2

Page 10: Accelerating DevOps Pipelines with AWS
Page 11: Accelerating DevOps Pipelines with AWS

Artifacts – code, data, binaries, containers? …

Page 12: Accelerating DevOps Pipelines with AWS

‘Where do we start?’

Page 13: Accelerating DevOps Pipelines with AWS

Infrastructure Core Base Level Design

Page 14: Accelerating DevOps Pipelines with AWS

MFA, Users,

Groups, Roles

Linked Accounts,

Alerts

Resource Separation

Log & Audit

CloudFormation

Page 15: Accelerating DevOps Pipelines with AWS

Self Service DIY – Sometimes at a Cost

Page 16: Accelerating DevOps Pipelines with AWS

•  BYOS –  Flexibility - but sometimes at a time+complexity price

•  Dependency Hell –  Cross-functional – OSS + Commercial 3rd Party

•  Integration –  Problematic - multiple GUIs, services, etc. often NAS bound

•  Portable –  Most ‘compatible’ with lift and shift (in and out) – to a point

Page 17: Accelerating DevOps Pipelines with AWS

Custom AMIs CloudInit VM Import Marketplace

Page 18: Accelerating DevOps Pipelines with AWS

Infrastructure Services Overview & Application Areas

Page 19: Accelerating DevOps Pipelines with AWS
Page 20: Accelerating DevOps Pipelines with AWS

Elastic Beanstalk Quickly Deploy & Manage Applications

Page 21: Accelerating DevOps Pipelines with AWS

•  Fast and Simple –  Upload code and deploy in minutes, multi-version capable

•  Developer Productivity –  Focus on the code and not the infrastructure

•  Impossible to Outgrow –  Resilience & scalability are built in

•  Complete Resource Control –  Full control over deployed infrastructure

Page 22: Accelerating DevOps Pipelines with AWS
Page 23: Accelerating DevOps Pipelines with AWS
Page 24: Accelerating DevOps Pipelines with AWS

OpsWorks Model & Manage the Entire Stack

Page 25: Accelerating DevOps Pipelines with AWS

•  Supports any Application –  Any architecture via custom Chef recipes, bash scripts & configs

•  Configuration as Code –  Define and deploy from source repositories

•  Automation to run at Scale –  Dynamic configuration and orchestration

•  Resource Organization –  Logically organize and apply permissions to resources

Page 26: Accelerating DevOps Pipelines with AWS

Stack

Page 27: Accelerating DevOps Pipelines with AWS

OpsWorks Stack Define

Instance On-Prem

Install Agent

Stack Integration

Page 28: Accelerating DevOps Pipelines with AWS

CloudFormation Infrastructure as Code

Page 29: Accelerating DevOps Pipelines with AWS

•  Easy to Use & Repeatable –  ‘Describe anything’ via simple JSON-based syntax

•  Full Control –  Open-ended template-based deployment, Callbacks, Triggers

•  Customized via Parameters –  Customize templates at run-time for specific use cases

•  Introspective Deployment –  Build by hand and abstract with CloudFormer

Page 30: Accelerating DevOps Pipelines with AWS
Page 31: Accelerating DevOps Pipelines with AWS

Create Skeleton

Define Resources

Execute

Page 32: Accelerating DevOps Pipelines with AWS

Service Catalog CloudFormation as a Product

Page 33: Accelerating DevOps Pipelines with AWS

•  Product Catalog –  Create custom catalogs containing products incorporating

standard CloudFormation architectures and configurations

•  Centralized Control –  Provides IT with central management over portfolio of services

that end users can browse and launch

•  Full Integration –  Integration with existing self service systems via rich APIs

Page 34: Accelerating DevOps Pipelines with AWS

Create Portfolio

Define Product

Attach Template

Add Constraints

Page 35: Accelerating DevOps Pipelines with AWS

Code Services CodeCommit, CodePipeline, CodeDeploy

Page 36: Accelerating DevOps Pipelines with AWS

•  CodeCommit –  Fully managed source control service for hosting private Git

repositories

•  CodePipeline –  Standardizes and automates your software release process,

allowing you to rapidly release new features to users

•  CodeDeploy –  Deploys your released code to a "fleet" of EC2 instances

Page 37: Accelerating DevOps Pipelines with AWS

Code Commit

Code Pipeline

Code Deploy

Page 38: Accelerating DevOps Pipelines with AWS

CodeCommit CodePipeline CodeDeploy

Page 39: Accelerating DevOps Pipelines with AWS

Summary Wrap Up & Some Things We Missed

Page 40: Accelerating DevOps Pipelines with AWS

•  AWS Lambda & Amazon S3 Events –  Use to plumb up a simple artifact-based CI/CD workflow –  Process all your ancillary data types – media, thumbs, etc.

•  AWS Config –  Continuously track configuration changes to your infrastructure –  Use for Audit, Discovery, Troubleshooting

•  Amazon EC2 Container Service –  Highly scalable, performant container management service –  Docker containers, custom scheduler

Page 41: Accelerating DevOps Pipelines with AWS
Page 42: Accelerating DevOps Pipelines with AWS

SAN FRANCISCO