129
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Dave Hahn, CORE Team / Netflix November 30, 2016 DEV209 Day in the Life of a Netflix Engineer

AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Embed Size (px)

Citation preview

Page 1: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Dave Hahn, CORE Team / Netflix

November 30, 2016

DEV209

Day in the Life

of a Netflix Engineer

Page 2: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

How the world

sees Netflix

AWS re:Invent 2016

Page 3: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 4: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 5: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 6: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 7: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 8: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 9: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 10: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 11: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 12: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 13: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 14: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 15: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 16: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 17: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 18: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Cannot connect to the Netflix Service

Please Try Again

Page 19: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Go Outside & Play

Sunshine!!

Page 20: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

That’s not why

we’re here

AWS re:Invent 2016

Page 21: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

A Byte About Netflix

Page 22: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Big Data

& Telemetry

Page 23: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Byproduct

streaming

video

Page 24: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 25: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

OPEN CONNECT

Page 26: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 27: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Netflix is big

Page 28: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

You just

won’t believe

Page 29: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

How

vastly

Page 30: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

How

vastly

hugely

Page 31: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

How

vastly

hugely

mind-bogglingly

Page 32: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Big it is

Page 33: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 34: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Big

Page 35: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Big

EC2 Instances

>100,000

Page 36: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Big

CPU Cores

>800,000

Page 37: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Big

Autoscaling

± 20%

Page 38: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Big

Cores

×

± Auto Scaling

Page 39: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Big

ELB Traffic

> 50Gbps

Page 40: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Big

ELB Traffic

> 50Gbps

per region

Page 41: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Big

ELB Traffic

> 25Gbps

Page 42: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Big

Internet Traffic

> 37%

Page 43: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Big

Accounts

Page 44: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Big

Our Bill

Page 45: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Fast

Page 46: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Fast

Velocity of

Innovation

Page 47: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Fast

100s

countries

Page 48: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 49: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Fast

1,000s

changes

Page 50: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Fast

1,000,000s

new customers

Page 51: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Fast

1,000,000,000s

hours streamed

Page 52: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Big

Page 53: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Fast

Page 54: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Big Fast

Page 55: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 56: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Big FastAvailable

Page 57: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 58: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 59: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 60: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Enabling

Big & Fast

AWS re:Invent 2016

Page 61: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Chaos

Page 62: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Principles of Chaos Engineering

Page 63: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Principles of Chaos Engineering

Hypothesize

Page 64: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Principles of Chaos Engineering

Hypothesis

Vary Events

Page 65: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Principles of Chaos Engineering

Hypothesis

Vary Events

Experiment

Page 66: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Principles of Chaos Engineering

Hypothesis

Vary Events

Experiment

Automate

Page 67: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Chaos Engineering in Practice

Page 68: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 69: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 70: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 71: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

http://principlesofchaos.org

Page 72: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Enable

Resiliency

Page 73: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Intuition

Page 74: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 75: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

The Pain Suit

Page 76: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 77: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 78: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 79: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Enable

Insight

Page 80: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Deployments

Page 81: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 82: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 83: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 84: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 85: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 86: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 87: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 88: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 89: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 90: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Enable

Velocity

Page 91: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Polylots-of-things

Page 92: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Languages

Page 93: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Systems

Page 94: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Enable

Choice

Paved Road

Page 95: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Containers

Page 96: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 97: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 98: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Amazon EC2

Why

When

Page 99: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Amazon EC2

Microservices

&

Immutable

Infrastructure

Page 100: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Why

Page 101: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Why

Not Budget

Page 102: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Why

Not Budget

Not Optimization

Page 103: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Why

Not Budget

Not Optimization

Not Isolation

Page 104: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 105: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 106: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 107: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

+ ?

Page 108: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 109: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Why

Page 110: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 111: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Enable

Options

Page 112: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Partnerships

Page 113: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Page 114: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Enable

Focus

Page 115: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Culture

Page 116: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Values

Page 117: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Freedom &

Responsibility

Page 118: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Context not Control

Page 119: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Enable

Success

Page 120: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Big & Fast

By

AWS re:Invent 2016

Page 121: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Big & Fast

By

Enabling

Resiliency

AWS re:Invent 2016

Page 122: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Big & Fast

By

Enabling

Insight

AWS re:Invent 2016

Page 123: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Big & Fast

By

Enabling

Choice

AWS re:Invent 2016

Page 124: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Big & Fast

By

Enabling

Focus

AWS re:Invent 2016

Page 125: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Big & Fast

By

Enabling

People

AWS re:Invent 2016

Page 126: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Netflix Booth #720

jobs.netflix.com

Page 127: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Thank you!

Page 128: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Remember to complete

your evaluations!

Page 129: AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)

Dave Hahn

Senior SRE

[email protected]

@relix42

AWS re:Invent 2016