Building Global, Multi -Region Serverless Backends - Amazon Web...

Ian Massingham, Developer Technology Evangelism, AWS

@IanMmmm

Building Global, Multi-Region Serverless Backends(powered by DynamoDB Global Tables)

Session objectives

1. Understand System Reliability and Availability.

2. Understand why we build a Multi-Region Active-Active architecture.

3. Understand how to build a Multi-Region Active-Active architecture

on AWS.

4. How To: Building Multi-Region Serverless Applications

5. Conclusion.

System Reliability and Availability

Failures are a given and everything will eventually fail over time.

Werner VogelsCTO – Amazon.com

“ “

System failure rateEarly FailuresWear Out Failures

Observed Failures

Random Failures

System failure rateFor high-velocity deployments

Early FailuresWear Out Failures

Observed Failures

Random Failures

System Availability

Availability = Normal Operation Time

Total Time

MTBF**

MTBF** + MTTR*=

* Mean Time To Repair (MTTR)

**Mean Time Between Failure (MTBF)

Availability

Availability Downtime per year Categories

95% (1-nine) 18 days 6 hoursBatch processing, Data extraction, Load jobs.

99% (2-nines) 3 days 15 hours Internal Tools, Project Tracking

99.9% (3-nines) 8 hours 45 minutes Online Commerce

99.99% (4-nines) 52 minutes Video Delivery, Broadcast systems

99.999% (5-nines) 5 minutes Telecom Industry (ATM Transactions)

99.9999% (6-nines) 31 seconds Answering to my loved one*

* Joke J

http://royal.pingdom.com/wp-content/uploads/2015/04/pingdom_uptime_cheat_sheet.pdf

Availability in Series

Part X Part Y

A = Ax Ay

Availability in Series

Component Availability Downtime

X 99% (2-nines) 3 days 15 hours

Y 99.99% (4-nines) 52 minutes

X and Y Combined 98.99% 3 days 16 hours 33 minutes

Availability in Parallel

A = 1 – (1 – Ax)2

Part X

Availability in Parallel

Component Availability Downtime

X 99% (2-nines) 3 days 15 hours

Two X in parallel 99.99% (4-nines) 52 minutes

Three X in parallel 99.9999% (6-nines) 31 seconds

“Component redundancy increases availability significantly!”

Availability Zone A Availability Zone B Availability Zone C

AWS Region

Availability Zone A Availability Zone B Availability Zone C

Multi-AZ Well-Architected

Application

AmazonDynamoDB

AmazonRDS

Amazon ElastiCache

AmazonS3

Amazon EFS

AmazonSQS

Amazon Kinesis

Amazon ElasticSearch

Default

Configurable for multi-AZ deployment

Some of the Regional AWS Services

AWSLambda

AmazonAPI Gateway

AWSELB

Regional services

AZ1 AZ2 AZ3

Service XYZ

No servers to provision or manage

Scales with usage

Never pay for idle Availability and fault tolerance built in

Why Serverless components??

• 18 Geographic Regions • 50 Availability Zones (AZs) • 4 regions and 12 more Availability Zones announced

Cost of Availability (approx.)

Availability

plexity

Generally speaking a reliable machine has high availability but an available machine may or

may not be very reliable.

On reliability

Ability of a system to :

1. Recover from infrastructure or service disruptions

2. Dynamically acquire computing resources to meet demand

3. Mitigate disruptions such as misconfigurations or transient network issues.

2 important lesson learned

Exponential Backoff

Message passing for async. patterns

AQueue

BListener

Pub-Sub

W eb Instances

W orkerInstance

APIInstance

API: {DO foo}

PUT JOB: {JobID: 0001, Task: DO foo}

API: {JobID: 0001}

GET JOB: {JobID: 0001, Task: DO foo}

Result: {

JobID: 0001, Result: bar

W orkerInstance

Q ueue

APIInstance

Am azon SN S

Push N otification

Well-Architected Framework

Operational Excellence

Security

Reliability

Performance Efficiency

Cost Optimization

https://aws.amazon.com/architecture/well-architected/

Why build a Multi-Region Active-Active architecture?

Why Multi-Region?

1. Improve Latency for end-users

~300ms

~140ms

Why Multi-Region?

1. Improve Latency for end-users2. Disaster Recovery

Applications in US West

Applications in US East

Users from San Francisco

Users from New York

Service 1

Service 2

Service 3

Service 4

Service 1

Service 2

Service 3

Service 4

Why Multi-Region?

1. Improve Latency for end-users2. Disaster Recovery3. Business Requirements

Netflix 2013

Netflix 2016

Chaos Engineering

How to build a Multi-Region Architecture on AWS.

Data Replication

Component A

Component B

Component C

Latency < 5 msSynchronous Asynchronous

Latency > 5 ms

Process A Process B Process A Process B

Synchronous Asynchronous

WaitingWorkingContinues

get or fetch resultGet result

Reliable & Secure Network

AWS RegionA

AWS RegionBAmazon Global Network

James Hamilton – 2016 re:InventV i c e P r e s i d e n t & D i s t i n g u i s h e d E n g i n e e r

Multi-Region Multi-VPC Connectivity

S3 - Cross-Region Replication

Cross-Region Read Replicas for Amazon RDS

** For Aurora, MySQL, MariaDB and PostgreSQL engines.

“Simple” Cross-Region Usage Pattern

• Regional Reads• All critical writes traffic

to a single master

Aurora multi-master - scale out reads & writes First MySQL compatible DB service with scale-out across multiple data centers

Zero application downtime from ANY instance failure

Zero application downtime from ANY AZ failure

Faster write performance and higher scale

Sign up for single-region multi-master preview today;

Multi-Region Multi-Master coming in 2018Availability

Zone 1

Scale out both reads and writes

Availability Zone 2

Availability Zone 3

Application

Read/WriteMaster 1

Shared distributed storage volume

Read/WriteMaster 2

Read/WriteMaster 3

Amazon DynamoDBFast and flexible NoSQL database service for any scale

Fast, consistent performance

Highly scalable Fully managed Business critical reliability

Consistent single-digit millisecond latency; DAX in-memory

performance reduces response times to microseconds

Auto-scaling to hundreds of terabytes of data that

serve millions of requests per second

Automatic provisioning, infrastructure

management, scaling, and configuration with

zero downtime

Data is replicated across fault tolerant Availability Zones, with fine-grained

access control

Prime Day 2017 Metrics

Block Storage – Use of Amazon Elastic Block Store (EBS) grew by 40% year-over-year, with aggregate data transfer jumping to 52 petabytes (a 50% increase) for the day and total I/O requests rising to 835 million (a 30% increase).

NoSQL Database – Amazon DynamoDB requests from Alexa, the Amazon.com sites, and the Amazon fulfillment centers totaled 3.34 trillion, peaking at 12.9 million per second.

Stack Creation – Nearly 31,000 AWS CloudFormation stacks were created for Prime Day in order to bring additional AWS resources on line.

API Usage – AWS CloudTrail processed over 50 billion events and tracked more than 419 billion, all in support of Prime Day.

Configuration Tracking – AWS Config generated over 14 million Configuration items for AWS resources.

Amazon DynamoDB Global Tables (GA)First fully managed, multi-master, multi-region database

Build high performance, globally distributed applications

Low latency reads & writes to locally available tables

Disaster proof with multi-region redundancy

Easy to set up and no application rewrites required

Globally dispersed users

Replica (N. America)

Replica (Europe)

Replica (Asia)

Global App

Global Table

Amazon DynamoDB Streams

• Each stream record appears exactly once in the stream.• For each item that is modified in a DynamoDB table, the

stream records appear in the same sequence as the actual modifications to the item

AmazonDynamoDB

AWSLambda

Streams

Amazon Route 53

• AWS’s Authoritative Domain Name Service.• Highly available and scalable.• Supports Traffic Flow through a variety of routing, all

of which can be combined with DNS Failover.• Enable a variety of low-latency, fault-tolerant

architectures.

Traffic Routing with Route53

1. Latency Based Routing

Amazon Route53

Resource A

Resource B

137ms latency

76ms latency

1. Latency Based Routing2. Geo DNS

Amazon Route53

Resource AIn US

Resource B in EU

User in US

1. Latency Based Routing2. Geo DNS3. Weighted Round Robin

Amazon Route53

Resource AIn US

Resource B in EU

1. Latency Based Routing2. Geo DNS3. Weighted Round Robin4. DNS Failover

Amazon Route53

Resource AIn US

Resource B in EU

User in US

How To: Building Multi-Region Serverless Applications

Amazon DynamoDB

AWS LambdaAmazon API Gateway

Amazon DynamoDB

Amazon Route53

eu-west-1

us-east-1

Global Tables

https://globalddb.adhorn.me/

Amazon DynamoDB

eu-west-1

us-east-1

Global Tables

Amazon DynamoDB

AWS Lambda

Amazon DynamoDB

AWS Lambda

eu-west-1

us-east-1

Global Tables

AWS Lambda Function

Amazon DynamoDB

eu-west-1

us-east-1

Global Tables

us-west-2

us-east-1

C lient

Am azonRoute 53

RegionalAPI

Endpoint

RegionalAPI

Endpoint

Custom Domain Name

API Gateway

Lambda

CNAM E

Multi-Region with API Gateway

Route53: Traffic Policy

Amazon DynamoDB

Amazon Route53

eu-west-1

us-east-1

Global Tables

https://globalddb.adhorn.me/

Conclusion

We learned about

1. System Reliability and Availability.

2. Why to build a Multi-Region Active-Active architecture.

3. How to build a Multi-Region Active-Active architecture on AWS.

4. We looked at a Multi-Region Serverless App

Thanks!@adhorn

https://medium.com/@adhorn

Building Global, Multi -Region Serverless Backends - Amazon Web...

Documents

HL7 FHIR DevDays...HL7 FHIR DevDays 19 - 21 June 2018 | Boston, MA All the rumors are true HL7 ® FHIR DevDays is the place to be! We started this event as a small gathering of developers

Microservices and modern backends - Azure Meetup Frankfurt

Nt ser4 sg

PHP And Silverlight - DevDays session

Power Training DevDays 2009

HL7 FHIR DevDays - Home - FHIR · HL7 FHIR DevDays Program, speakers and registration: Save the date. Validate a resource

Great Single Page Apps Need Great Backends

Devdays profiling with clin fhir

A Taste of Python - Devdays Toronto 2009

Recommendations in Drupal (Drupal DevDays Barcelona 2012)

Web Services, for DevDays Belfast

Testing data and metadata backends with ClawIO

MAP CDA to FHIR and Back - FHIR DevDays

ADO.NET Entity Framework DevDays

Blow up the monolith? - SDJUG · • Data Processing • Real-time File Processing • Real-time Stream Processing • Extract, Transform, Load • IoT Backends • Mobile Backends

FHIR DevDays 2015 - introduction to FHIR

DevDays 2011 Html5 sessie

Adventures in Serverless Backends

Stackoverflow DevDays: jQuery Introduction for Developers

DevDays 2011- Lightswitch basics: Building your first Lightswitch Application