AWS re:Invent 2016: Get Technically Inspired by Container-Powered Migrations (GPSSI403)

Preview:

Citation preview

© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Todd Gleason, Mandus Momberg

November 29, 2016

Get Technically Inspired by

Container-Powered Migrations

SI Technical Track: GPSSI403

Please Meet

Mandus MombergPartner Solutions Architect

Todd GleasonExecutive Cloud Strategist

Seattle, We Have a Problem...

"It was the best of times, it was the worst of times."- Charles Dickens, A Tale of Two Cities

We Have To Get Better at This…

“The broader your vision, the clearer your purpose”- Jeff Smith

CEO, Suncorp

https://aws.amazon.com/solutions/case-studies/suncorp/

Let’s Solve a Problem…

Traditional migrations

Slow

Easily blocked

Expensive

Difficult to assign correct

resources

Full of friction

Linear workflows

Monolithic, problem-specific

solutions

Containerized migration

Fast

De-coupled

Pay when you use

Each team owns their own

resources

Asynchronous

Dynamic workflows

Reusable, problem -agnostic

solutions

What to Expect from the Session

A quick recap of migration

Why we like containers and you should too.

Now we build migration factories

See how a friend of ours did it in the real world

Migration

The AWS Cloud Migration Process

Migration cost considerations

- Labor

- Process

- Technology

Breaking Down the Economics

Team Setup: Workload-Oriented Sprint Model

Sprint 1 Sprint 2 Sprint 3

Timeline

Sprint 4

Mon

Sample Sprint Schedule

Tue Wed Thu Fri Sat/

Sun

Plan /

DesignMigrate

Cut

over

Discover

/ AnalyzeOrdered Backlog

2 Applications 4 Applications 6 Applications 6 Applications

App 1App 2App 3App 4App 5

App n

Team Setup: Activity-Oriented Sprint Model

Timeline

Design & Plan

Migrate

Integrate

Validate

Ordered Backlog

App 1App 2App 3App 4App 5

App n

App Group 1 10 Apps

App Group 1

App Group 1

App Group 1

App Group 2 15 Apps App Group 3 20 Apps App Group 4 20 Apps

Tracking the Migration Process.

• Range of tools

• Difficult to set up

• Time-consuming

• Tedious to maintain

• Hard to scale

• Static

Add a dash of container

• Range of tools

• Reusable Images

• Fast set up

• Simple to maintain

• Built for scale

• Dynamic

Containers

Why We Like Containers

Speed and agility

Ease of use

Ephemeral

Scalable

Efficiency

Migration Factories

What Is It?

A migration factory is a reproducible workflow of items which

enables your teams to easily transition their applications into

new environments.

Business factory

• Governs every micro factory

• Business rule-oriented

• Dependency mapping and

control

Two Key Concepts for Today

Micro factory

• Independent from other micro

factories

• Tailored for team-specific

migration

• Short-lived

• Technical governance (DR /

HA)

Business Factory

Rehost Micro Factory

Serverless Micro Factory

Let’s Hear From Our Partners

SAP Hybris in Docker Containers

Aater Suleman

Co-Founder & CEO Flux7

Faculty, UT Austin

Cloud and DevOps Solutions

Headquartered in Austin, Texas

Containers@AWS Projects at Flux7

2013 2014 2015 2016

Dev Environments

DockerCon’14

50+ successful Docker projects on AWS since 2013, some famous ones:

New App Marketplace

AWS Summit Santa

Clara 2016

HIPAA-compliant IoT

AWS re:Invent’14 Keynote

PCI Compliant Setups

AWS Summit 2016 and AWS Re:invent

2016

Multi-tenant IoT

CloudExpo 2014

OARS

DockerCon’16

Goals

Set up an SAP Hybris

ecommerce platform to

scale to 2 million users a

month

Ability to support

Black Friday traffic

Secure for PCI

Compliance

Stateless infrastructure -

HA across all components

including DR

Create an agile developer

workflow for rapid

execution

No downtime

deployment

Performance Scalability Security

High Availability Agility CI/CD

High-Level Diagram

Lambda ECS

Aurora

S3CloudFront WAF

ECR

Private subnetPublic subnet

Storefront

Admin

Aurora

CloudWatch

CloudFormation

CloudTrail

KMS

SES

Route 53S3

bucket

(static

assets)

NAT

gateway

WAF

CloudFront

Lambda

CodeCommit

ACM

Direct Connect

Each subnet represents a pair in two AZs.

All components configured to span two AZs.

Private subnetPublic subnet

Storefront

Admin

Aurora

CloudWatch

CloudFormation

CloudTrail

KMS

SES

Route 53S3

bucket

(static

assets)

NAT

gateway

WAF

CloudFront

Lambda

CodeCommit

ACM

Direct Connect

Each subnet represents a pair in two AZs.

All components configured to span two AZs.

ECS:

1. App agnostic clusters

2. Hosting Apache, Hybris

storefront, Solr

Private subnetPublic subnet

Storefront

Admin

Aurora

CloudWatch

CloudFormation

CloudTrail

KMS

SES

Route 53S3

bucket

(static

assets)

NAT

gateway

WAF

CloudFront

Lambda

CodeCommit

ACM

Direct Connect

Each subnet represents a pair in two AZs.

All components configured to span two AZs.

Application Auto Scaling:

Developed a method for

scaling ECS containers and

instances using Lambda

Private subnetPublic subnet

Storefront

Admin

Aurora

CloudWatch

CloudFormation

CloudTrail

KMS

SES

Route 53S3

bucket

(static

assets)

NAT

gateway

WAF

CloudFront

Lambda

CodeCommit

ACM

Direct Connect

Each subnet represents a pair in two AZs.

All components configured to span two AZs.

Aurora:

1. High performance

2. Scaling

3. Low management

Private subnetPublic subnet

Storefront

Admin

Aurora

CloudWatch

CloudFormation

CloudTrail

KMS

SES

Route 53S3

bucket

(static

assets)

NAT

gateway

WAF

CloudFront

Lambda

CodeCommit

ACM

Direct Connect

Each subnet represents a pair in two AZs.

All components configured to span two AZs.

AWS WAF and CloudFront:

1. AWS Native

2. Self-configuring WAF

with help of Lambda

SCM

Dev

Build

Code +

Dockerfile

On-

premisesAWS

Update

ECS

ImageECR

ECS

Nodes

Code Deployment

DeployUpdate

ECS Nodes

Key Features

Infrastructure as code Agile and flexible

infrastructure

Automated delivery of

infrastructure, code,

containers, and security rules

Self-healing Automatic scaling PCI-ready

… and in time. Finished before deadline.

More Information:

● Session 8872 [ Deploying Scalable SAP Hybris Clusters using

Docker ] at re:Invent 2016 to learn more

● Presentation video from AWS Chicago Summit on how RAC

started: http://bit.ly/2fhVmdw

● Presentation with Docker: http://bit.ly/2faEwjg

● Blog on Application Auto Scaling for ECS: http://amzn.to/2eGoSLK

Q & A

© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Register for a Bootcamp

Get in-depth knowledge and

training from AWS Instructors and

Solutions Architects.

reinvent.awsevents.com/training

#AWSTraining

Get AWS Certified Onsite

Demonstrate your technical

proficiency and receive special

recognition onsite. Register today.

reinvent.awsevents.com/certification

#AWSCertified

Take Hands-on Labs

Practice with AWS in a live

environment. Choose from 100+

lab topics and attend a Spotlight

Lab session.

Free Onsite

Thank you!

Remember to complete

your evaluations!