47
State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com

State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

State of the CloudAWS Summit, New York

Dr. Werner Vogels, CTO Amazon.com

Page 2: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

Amazon’s Three Businesses

Consumer (Retail)Business

Tens of millions of active customer accounts

Eight countries: US, UK, Germany, Japan, France, Canada, China, Italy

SellerBusiness

Sell on Amazon websites

Use Amazon technology for your own retail website

Leverage Amazon’s massive fulfillment center network

IT InfrastructureBusiness

Cloud computing infrastructure for hosting web-scale solutions

Hundreds of thousands of registered customers in over 190 countries

Page 3: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

Our Mission

Enable businesses and developers to use web services

(what people now call “the Cloud”) to build scalable,

sophisticated applications

Page 4: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

» AWS Services in N. California

» AWS Multi-Factor Authentication

» AWS Management Console

» AWS Economics Center

» AWS in Education

» AWS Security Center

» SAS70 Type II Audit

» More services in EU

» Lower EC2 Pricing

» Lower S3 Pricing

» Lower pricing for

Outbound Data Transfer

» AWS Solution Provider Program

» Amazon EC2

» Amazon S3

» Developer Portal &

Forums

» Amazon SQS

» Amazon Mechanical Turk

» Amazon SimpleDB

» Amazon Flexible Payments Service

» S3 in Europe

» EC2 new instance types

» AWS Start-Up Challenge

» Amazon Simple Notification Service

» RDS Multi-Availability Zone Support

» S3 Reduced Redundancy Storage

» New Locations and Features for

CloudFront

» S3 Bucket Policies

» Cluster Instances for EC2» Premium Support

» Amazon CloudFront

» EC2 Elastic IP addresses

& Availability Zones

» Windows Server, MySQL,

Oracle, & JBoss on EC2

» Lower Data Transfer Costs

» EC2 Reserved Instances

» New SimpleDB Features

» IBM on EC2

» Windows Server 2008 on EC2

» Amazon RDS

» Amazon Virtual Private Cloud

» Amazon Elastic MapReduce

» EBS Shared Snapshots

» Monitoring, Auto Scaling &

Elastic Load Balancing for EC2

» AWS Import/Export

» AWS Services in Singapore

» RDS Reserved Database Instances

» RDS Read Replicas & Lower Pricing

» Lower Outbound Transfer Pricing

» Data Transfer Usage Tiers

» Consolidated Billing for AWS

» Amazon S3 Versioning Feature

» EC2 High Memory Instances

» Micro Instances

» Lower Pricing for EC2

High Mem Instances

» Identity & Access Management

» Amazon Linux AMI

» Oracle on EC2

» New EC2 Features

» SUSE Linux on EC2

» Public Data Sets

» Elastic Block Store

» EC2 SLA

» EC2 in EU

» S3 Tiered Pricing

AWS Pace of Innovation

Page 5: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

» Amazon RDS Read Replicas

» Suse EC2 Linux

» Amazon SNS Console

» Amazon ELB HTTPS

» AWS Free Tier

» EMR Resizing Cluster

» RDS Reserved

» CloudFront Default Root

» Startup Challenge 2010

» Cloudfront Invalidation

» CloudFront HTTPS

» NYC Edge Location

» Lowers Pricing HTTP

» AWS Import Export GA

» Amazon SNS

» Amazon S3 Console

» Amazon EBS Cloudwatch

» Amazon SNS

» Combined AWS Data Transfer

Savings

» Amazon EMR BootStrap Actions

» Amazon ELB Session Stickiness

» Amazon RDS in EU

» New Singapore Region

» EMR JobFlow Debugging

» Simple DB Consistent Reads

» Simple DB Conditional Puts

» VPC in EU

» Amazon RDS in US-west

» Amazon CloudFront Access

Logs

» Amazon RDS Multi-AZ

» Amazon S3 RRS

» Amazon RDS Console

» Amazon SQS Longer

retention, Free Tier

Amazon S3 Bucket Policies

» Amazon VPC IP Address

» Cluster Compute Instances

» Amazon S3 RRS

Notifications » Lowered Pricing EC2

» AWS IAM

» Amazon VPC Console

» Micro Instances

» Amazon Linux AMI

» Amazon EC2 Tagging,

Filtering, Idempotency,

» Oracle Certified AWS

» AWS PHP SDK

» Amazon S3 Lowered Pricing

» CloudFront GA, SLA

» S3 MultiPart

» GPGPU Instance Types

» ISO27001/2 Certification

» AWS Elastic Beanstalk

» Amazon Simple Email Service

» Improved AWS Support “Bronze”

» Amazon CloudWatch Console

» AWS CloudFormation

» Amazon S3 Static Websites

» AWS IAM Website Login

» Paris Edge Location

» VM Connector

» Tokyo Region

» AWS Support JP

» Amazon EC2 Reserved Instances

with Windows, Extra Large High

Memory Instances

» Amazon S3 Versioning Feature

» Consolidated Billing for AWS

» Lower pricing for Outbound Data

Transfer

» AWS Java SDK

» Windows BYOL

» Singapore Pop

» CloudFront

Private Streaming

» Free Monitoring EC2

» Amazon Route 53

» PCI DSS Level 1 Certification

» Mobile SDKs (Android, iPhone)

» Large Object S3 Support

» Florida POP

» Import/Export APAC

AWS Innovation in 2010

Page 6: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

» CloudFront Public Beta

» Access Logging Capability

» CloudFront Management Console

CloudFront Pace of Innovation

» New Lower Pricing Tiers

» Private Content

» Streaming Video on Demand

» Singapore Edge Location

» Private Streaming

» Price Drop

» HTTPS Support

» Lower 1-Hour TTLs

» Access Logs for Streaming

» New York City Edge Location

» Enhanced CloudFront Logs

» Default Root Object

» Invalidation

» Custom Origins

» Service Level Agreement

» Jacksonville Edge Location

» Route 53 Public Beta

» Paris Edge Location

» (IAM) Identity &

Access Management

Page 7: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

The Platform is Expanding

Your Application

Page 8: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

Business Functions - BPEL

Web Services from Oracle and Bespoke

Technology Layer

Oracle

eBusiness

Customer

Order

Finance

MySQL

Folders

AI Enterprise Architecture

8

Oracle

BI

Oracle

Beehive

Doc

Man

OracleOracleOracle Internet

Outside

Web

MSSQL

Active

Dir

Oracle

Agile

Oracle Internet

EDI

Gateway

PSTN

Telecom

SMS

CAD

CAM

Folders

MS

Office

Get

Customer

Get

Order

Get

Part

Validate

Login

Write

Order

Write

Customer

Write

Part

Send

Email

Build

RFQ .....

....

Workflow & Notification ServicesMessage & Routing Bus -

OSBData Transformation Service XML Parser

Order

Entry

Billing

Payables

Inventory

Management

Engineering

Documents

Sourcing

RFQ

Order

Tracking

Shared

Folders .....

Event Manager

Presentation – Web Center

Enhanced

Customer

Data Form

Shipment

Tracking

Form

Inventory

Management

Form

BOM

Entry

Form

Manage

RFQ

Form

Order

Entry

Form

Landing

Pad

Web 2.0 .....

Workflow

Notifications

Page 9: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

US East (Northern Virginia)

US West (Northern California)

Europe (Dublin)

Asia Pacific (Singapore)

Asia Pacific (Tokyo)

AWS Regions Amazon Edge LocationsHong Kong

Tokyo

Singapore

Ashburn, VA

Dallas, TX

Jacksonville, FL

Los Angeles, CA

Miami, FL

Newark, NJ

New York, NY

Palo Alto, CA

Seattle, WA

St. Louis, MO

Amsterdam

Dublin

Frankfurt

London

Paris

Page 10: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

AWS Cloud Architecture

Page 11: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

Billions of Objects in Amazon S3

Peak Requests:

Page 12: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

Each day AWS adds the equivalent server

capacity to power Amazon when it was

a global, $2.76B enterprise(circa 2000)

Page 13: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

The Key to Success?

Listening to Our Customers

Page 14: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

You Asked For…

Expanded Global Footprint

Lower Prices & New Pricing

Features

Make it Easier to Use

Improved Support Offerings

New Instance Types

Expand Platform Up and Out

Page 15: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

Expanded Global Footprint

Singapore Region

Tokyo Region

New POPs for CloudFront & Route53

(New York, Paris, Singapore, Tokyo,

Jacksonville)

Page 16: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

Lower Prices and New Pricing Features

Lower Outbound Data Transfer Prices

Consolidated Billing

Combined Data Transfer Prices

Lower Prices for S3 and Reduced

Redundancy Storage (lower

price/less durability)

Lower Prices on Gold & Silver Support

Page 17: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

Make It Easer To Use

More Services Available in AWS Console

CloudFormation

New SDKs: Java, PHP, Android

AWS Elastic Beanstalk

Page 18: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

New Instance Types

Extra Large High Memory

Cluster Compute & GPUs

Micro

Page 19: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of
Page 20: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

Expand Up & OutVM Import

Route53

S3 Large Object Support &

Versioning

CloudFront SLA, Custom Origin &

HTTPS Support

RDS Multi-AZ Deployments, Read

Replicas, & RIs

Simple Email Service

Security Features & Compliance:

AWS Identity and Access Management

(IAM), PCI Compliance, ISO 27001

Free Monitoring of EC2 Instances

And More…

Page 21: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

Some Big Priorities for 2011

Add more geographies

Make it easier to build and manage applications

on AWS

Release new database offerings

Broaden support offerings

Add billing, user management, and identity

features

Page 22: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

AWS Management

Console

Developer Tools

& SDKs

Page 23: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of
Page 24: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

AWS CloudFormation

AWS CloudFormation enables system administrators and developers to create repeatable AWS infrastructure deployments (Stacks) using customizable architecture templates.

Define a JSON template

Create an AWS stack

(Console, CLI, API)

CloudFormation Stack

Page 25: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

AWS CloudFormation: Service Highlights

Fully declarative system

Document based infrastructure specification

Logical naming convention

Atomically creates / destroys groups of AWS objects

Deploy multi-tier and multi-AZ stacks

Handles the bookkeeping and muck of provisioning multiple related resources

Focuses on AWS resources, while sys admins and developers focus on OS and application provisioning

Customers can use existing automation tools like Opscode Chef, Puppet Labs, Capistrano

Page 26: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of
Page 27: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

Elastic Beanstalk

Amazon Linux AMI

CloudWatch

Auto-Scaling

Route53

Simple Notification Service

Elastic Load Balancer

Elastic Cloud Compute

Elastic Block Store

Simple Storage Service

Your Application Goes Here

Page 28: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of
Page 29: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

What Makes AWS Elastic

Beanstalk Different?

• Root access to your EC2 instances

• Easily manage configuration changes in one place

EC2 instance type, security group, load balancer settings, auto-scaling, multi-AZ, notifications, and other settings.

• Use any database

Amazon RDS, Amazon SimpleDB, Microsoft SQL Server, or Oracle.

• Create custom AMIs

• Run other services side-by-side in EC2

• Easily move your application out of Elastic Beanstalk

Developers retain ownership and full control over their AWS

resources.

Page 30: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

AWS Elastic Beanstalk Under-the-Hood

AWS Elastic

Beanstalk

Application Auto

Scaling

http://myapp-staging.elasticbeanstalk.com/

Apache

Tomcat

Amazon Linux AMI

Your Running Application

VersionVersion

VersionEnvironment

Ela

stic B

ea

nsta

lk

Host M

an

age

r

Page 31: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

What do Cloudformation and

AWS Elastic Beanstalk cost?

Page 32: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

Amazon

Relational Database Service

RDS

Page 33: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

Highly Available, Durable, & Scalable MySQL Deployments

Multi-AZ Deployments Read Replicas

Page 34: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of
Page 35: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of
Page 36: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

SECURITY, CERTIFICATION

& COMPLIANCE

Page 37: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of
Page 38: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of
Page 39: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

• SAS70 Type II Audit

• ISO-27001 Certification

• PCI Level 1 Service Provider

• FISMA A&A

• Sarbanes-Oxley (SOX) Compliant Platform

Page 40: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

Identity and Access Management (IAM)

Create and Manage Users

Improved Security

Multiple users, with individual permissions

Secure by default

Individual security credentials (access keys, password, MFA)

Improved Control

Centralized control of user access

Fine-grained permissions

Control Users’ access to APIs and AWS Console

Integrated

No changes to service APIs

Page 41: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of
Page 42: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

Customer’s

Network

Amazon

Web Services

CloudSecure VPN

Connection over

the Internet

Subnets

Customer’s isolated

AWS resources

Amazon VPC

RouterVPN

Gateway

Page 43: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

Current VPC

Page 44: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of

NewVPC

Page 45: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of
Page 46: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of
Page 47: State of the Cloud - Amazon S3...State of the Cloud AWS Summit, New York Dr. Werner Vogels, CTO Amazon.com Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of