58
© 2013 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon.com, Inc. Charlie Bell and Khawaja Shams November 13, 2013 Managing the Pace of Innovation: Behind the Scenes at AWS

Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

Embed Size (px)

DESCRIPTION

AWS launched in 2006, and since then we have released more than 530 services, features, and major announcements. Every year, we outpace the previous year in launches and are continuously accelerating the pace of innovation across the organization. Ever wonder how we formulate customer-centric ideas, turn them into features and services, and get them to market quickly? This session dives deep into how an idea becomes a service at AWS and how we continue to evolve the service after release through innovation at every level. We even spill the beans on how we manage operational excellence across our services to ensure the highest possible availability. Come learn about the rapid pace of innovation at AWS, and the culture that formulates magic behind the scenes.

Citation preview

Page 1: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

© 2013 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon.com, Inc.

Charlie Bell and Khawaja Shams

November 13, 2013

Managing the Pace of Innovation: Behind the Scenes at

AWS

Page 2: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

we will share organization and

mechanisms used by AWS.

do try this at home.

Page 3: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

culture is the principal component in

speed of innovation

Page 4: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

amazon leadership principles

http://bit.ly/leadershipValues

Page 5: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

customer obsession

ownership

invent and simplify

right, a lot

hire and develop the best

insist on highest standards

think big bias for action

frugality

vocally self critical

earn trust

dive deep

have backbone; disagree & commit

deliver results

Page 6: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

customer

obsession

invent &

simplify

insist on highest

standards

think big

bias for

action

Page 7: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

ownership

Page 8: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

deliver

results

have backbone;

disagree & commit dive deep

vocally self critical earn trust

frugality

hire and develop the best

Page 9: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

builder mechanisms

Page 10: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

if you want something done right …

create a single-

threaded team

Page 11: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

two pizza teams

Page 12: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

fitness functions

Page 13: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

the Amazon decision making process relies

heavily on narratives.

Page 14: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

writing a narrative helps you make best use

of time of everyone at the meeting.

Page 15: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

the processing of writing your ideas helps you refine your

thoughts and articulate them effectively, while exposing key

gaps that you can refine before the meeting.

Page 16: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

presentations are not the best medium for

consumption of highly analytical information

Page 17: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

Page 18: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

Page 19: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

slides have choppy transitions that make it very

difficult to share a continuous stream of thought.

Page 20: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

most interesting details are often

hidden in sub-sub-sub bullets.

Page 21: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

slides are open for interpretation, and the same slides

can be used to present completely different stories.

Page 22: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

audience is at the mercy of presenter to

gloss over details,

which is much more difficult to do in a narrative.

Page 23: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

At Amazon, we always work

backwards from the customer.

Page 24: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

each new idea, starts with a write-up of a press release

/ FAQ that helps capture the customer perspective of

the problem we are trying to solve.

Page 25: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

this process helps us exercise customer obsession by

compelling us to put on the shoes of the customers and

see the story from a customer’s perspective.

Page 26: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

It helps us understand the problem we are

trying to solving, and if it is worth solving.

Page 27: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

once we have identified the problems we

want to solve, we immediately start working

on finding the right primitives.

We put these

primitives

behind

hardened APIs.

notice how we

almost missed

this key detail

Page 28: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

putting primitives behind hardened APIs helps our

teams innovate independently, while reaping benefit

from each other’s innovations.

Page 29: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

once we have the right primitives, we ask ourselves

“can we simplify?”

Page 30: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

We eat our own dog food, which enables us to put

ourselves in the shoes of the customers, and again,

compels us to be vocally self-critical to innovate on

behalf of our customers.

Page 31: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

Consuming our own APIs allows us to

build primitives on top of primitives.

Page 32: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

back to the

regularly scheduled programming

Page 33: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

S3 for highly durable

object storage.

Page 34: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

EC2 for computing

Page 35: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

EBS for block storage.

Page 36: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

Route53 health checks as a

monitoring and failover

primitive.

Page 37: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

RDS is a composition of

these primitive for managed

databases.

Page 38: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

EBS PiOPs: Inheritance

Page 39: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

complete the innovation loop

with customers.

Page 40: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

Amazon has a very metrics driven culture.

Page 41: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

operational excellence

Page 42: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

weekly ops metrics meeting.

Page 43: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

A Scorecard for each service team.

Page 44: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

a graph for

every metric that customers care about.

Page 45: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

each graph has a line…

Page 46: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

recall the fitness function?

Page 47: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

Any metric going beyond the line is

considered a breach worthy of

correction.

Page 48: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

Correction of Error (COE)

process

Page 49: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

Integration with the Trouble

Ticketing System

Page 50: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

discussed at the OPS

metrics meetings

Page 51: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

DevOps

Page 52: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

old cycle

Page 53: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

continuous deployments

Page 54: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

new cycle

Page 55: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

deployment once every 12 seconds

Page 56: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

Page 57: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

@ksshams

f(innovation) = (org * arch) (mechanisms * culture)

Page 58: Managing the Pace of Innovation: Behind the Scenes at AWS (SPOT201) | AWS re:Invent 2013

Please give us your feedback on this

presentation

As a thank you, we will select prize

winners daily for completed surveys!

SPOT 201

@ksshams