S3 + Snowball

Preview:

Citation preview

© 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Guy Farber, AWS Business Development

11/18/2015

S3 and Data Ingest Update

Increased 120% YoY(Q2 2014 vs Q2 2015)

Amazon S3 Momentum - Data Transfer Growth

2014 Q2 2014 Q3 2014 Q4 2015 Q12014 Q2 2015 Q2

Introducing S3 Standard-Infrequent Access

Standard Standard-IA Glacier

The newest storage class in Amazon S3

Standard-Infrequent Access (SIA) Definition

What’s the same?

Access: Almost identical to S3 Standard with same buckets and URLs

Durability: 11 9’s, same as S3 Standard

Performance: Same characteristics as S3 Standard; low latency, high

throughput

What’s different?

Availability: Designed for 99.9%, SLA of 99%

Cost: Lower capacity fees, retrieval fees, minimum object size and

retention

Selecting the right Storage class for your needs

S3

S3-IA

Glacier

L

i

f

e

c

y

c

l

e

AvailableS3: 99.99%

S3-IA: 99.9%

PerformantLow Latency

High Throughput

SecureSSE, client

encryption, IAM

integration

Event

NotificationsSQS, SNS, and

Lambda

VersioningKeep multiple

copies

automatically

Cross Region

Replication

Common

NamespaceDefine storage

class per object

Durable99.999999999%

ScalableElastic capacity

No preset limits

“Hot” DataActive and/or

Temporary Data

“Warm” DataInfrequently

Accessed Data

“Cold” DataArchive and

Compliance Data

Selecting the right Storage class for your needs

S3

S3-IA

Glacier

L

i

f

e

c

y

c

l

e

AvailableS3: 99.99%

S3-IA: 99.9%

PerformantLow Latency

High Throughput≥ 30 Days≥ 128K

≥ 90 Days

Durable99.999999999%

ScalableElastic capacity

No preset limits

> 0K$0.007/GB per month

$0.0125/GB per month

“Hot” DataActive and/or

Temporary Data

“Warm” DataInfrequently

Accessed Data

“Cold” DataArchive and

Compliance Data

≥ 0 Days> 0K$0.0275 - $0.03/GB per

month

3 – 5 Hrs

$0.01/GB retrieval

$0.01/GB retrieval < 5%

Object Storage Use Cases

S3

S3-IA

Glacier

Cloud

Applications

Big Data

Analytics

Content

DistributionPrimary Data

File Sync &

Share

Active

Archive

Enterprise

BackupMedia

Transcoding

Disaster Recovery /

Geo Redundancy

Deep /

Offline

Archives

Tape Vaulting

Replacement

WORM

Compliant

Data

Temporary &

Small

Objects

New S3 Features

S3 Storage Metrics

Monitor and set alarms on

Amazon S3 storage usage

through CloudWatch

Supported metrics include:Total bytes for Standard Storage

Total bytes for Reduced-Redundancy Storage

(RRS)

Total bytes for Reduced-Redundancy Storage

(S3-IA)

Total number of objects for a given S3 bucket.

Migrating Large

Volumes of Data

Never underestimate

the bandwidth of a

FedEx truck

Shipping Physical Media Today

Manage Data and

Physical Media

Manage Data and

Physical Media

Need to Manage Multiple

Drives for Large Imports

Shipping Physical Media Today

Apply Some

‘Inside The Box’ Thinking…

Amazon Snowball

Highly secure, storage appliance

Shipping now, starting at 50TB

Simplified, Secure Data Transfer in Large Scale

Secure

EnclosureStrong Encryption,

End-to-End

50TB, Shipped

in Parallel

Simplified

Logistics

Complex Customer Requirements

Snowball – Petabyte Scale Data Transport

Service

50 TB

E Ink Shipping Label

Ruggedized Case “8.5G Impact”

Rain & Dust Resistant

Tamper Resistant Case & Electronics

All Data Encrypted End-to-end

Encryption Keys Managed Off-Device

How it works

What does it cost?

• $200 / job plus shipping

• Includes 10 days to fill the device at your site

• $15/day after the tenth day on site

• Standard Amazon S3 charges apply

• $0.03/GB to transfer data out

• $0.00/GB to transfer data in

How fast is that truck full of drives?

• Less than 1 day to transfer 250TB via 5x10G connections with 5

Snowballs, less than 1 week including shipping

• Number of days to transfer 250TB via the Internet at typical

utilizations

InternetConnectionSpeed

Utilization 1Gbps 500Mbps 300Mbps 150Mbps

25% 95 190 316 632

50% 47 95 158 316

75% 32 63 105 211

Thank you!