17
Ingestion Options on AWS ©2015, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Ingest Options on AWS

Embed Size (px)

Citation preview

Page 1: Ingest Options on AWS

Ingestion Options on AWS

©2015, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Page 2: Ingest Options on AWS

Managed IT

Services

Secure

High AvailabilityGlobal

Scale

Page 3: Ingest Options on AWS

AWS Global Infrastructure

11 Regions

28+ Availability Zones

50+ Edge locations

Page 4: Ingest Options on AWS

AWS Regions and Availability Zones

Customer decides where applications and data reside

Asia Pacific (Tokyo) US West (Oregon)EU (Ireland) US East (N. Virginia)

US West (N. Cal)(Asia Pacific) Singapore

AWS GovCloud (US) South America (Sao Paulo) Asia Pacific (Sydney)

Availability

Zone

Availability

Zone

Availability

Zone

Availability

Zone Availability

Zone

Availability

Zone

Availability

ZoneAvailability

Zone

Availability

Zone

Availability

Zone

Availability

Zone

Availability

Zone

Availability

Zone

Availability

Zone

Availability

Zone

Availability

ZoneAvailability

Zone

Availability

Zone

Availability

Zone

Availability

Zone

Availability

Zone

Availability

Zone

Availability

Zone

China (Beijing - BETA)

Availability

Zone

Availability

Zone

Page 5: Ingest Options on AWS

Data Ingestion Options

AWS Direct ConnectDedicated bandwidth between

your site and AWS

InternetTransfer data in a secure SSL tunnel over

the public Internet

AWS Import/ExportPhysical transfer of media into and

out of AWS

Page 6: Ingest Options on AWS

AWS Ingest OptionsInternet / One Common Theme: Parallel Uploads

1. Multipart upload

2. Request rate optimization

3. TCP window scaling

4. TCP selective

acknowledgement

AWS has customers that ingest roughly 1 PB per day

Page 7: Ingest Options on AWS

Reducing Object Storage Costs

Amazon Simple

Storage Service

(S3)

Amazon Glacier

Single API access

(regardless of the

storage class)

> Durability

>> Scale

>>> Cost Amazon S3 (RRS)

<$0.03/GB

<$0.024/GB

<$0.01/GB

Page 8: Ingest Options on AWS

S3 & Working with Large Files

S3 Bucket

S3 SDK

AWS S3

S3 multi-part Upload

Files

corporate data center S3 Object <= 5TB

Page 9: Ingest Options on AWS

Amazon S3 Encryption Options

1. Sever-Side Encryption (SSE)– Provides an integrated solution where Amazon handles key

management

2. SSE-Customer (SSE-C)– Perform the encryption and decryption of your objects while retaining

control of the keys used to encrypt objects.

3. Client library (e.g. Amazon S3 Encryption Client)– Objects encrypted before they are sent to Amazon S3 for storage.

Page 10: Ingest Options on AWS

AWS Ingest OptionsAWS Direct Connect

• Private connectivity to AWS– Physical connection – 1 Gbps or 10 Gbps

port

• Consistent network performance• Consider burst models on ingest• Reduces costs for bandwidth-

heavy outbound workloads

Locations• CoreSite 32 Avenue of the Americas, NY

• CoreSite One Wilshire & 900 North Alameda, LA

• Equinix DC1 – DC6 & DC10 - DC11, Ashburn, VA

• Equinix SV1 & SV5, San Jose, CA

• Equinix SE2 & SE3, Seattle, WA

• Equinix SG2, Singapore

• Equinix SY3, Sydney

• Equinix TY2, Tokyo

• Eircom, Clonshaugh

• TelecityGroup Docklands, London

• Terremark NAP do Brasil, Sao Paulo

Page 11: Ingest Options on AWS

AWS Ingest OptionsAWS Import/Export

• Rapidly move data into and

out of AWS

• Portable storage device

shipment to AWS

• Supports– Amazon EBS

– Amazon S3

– Amazon Glacier

• Use cases– Initial data migration

– Content distribution via portable

devices

– Disaster recovery

Page 12: Ingest Options on AWS

AWS Storage Gateway

• On-premises, virtual iSCSI

storage appliance

• $125 / Month

• Local cache enables low

latency access to data

• Server Side Encryption (SSE)

• 5 TB of throughput per day

• Recover to Amazon EBS

Page 13: Ingest Options on AWS

Media Ingest for AWS

AWS Import/

Export

Amazon S3

(multi-part Upload)

AWS Storage Gateway

Service

AWS Direct

Connect

Page 14: Ingest Options on AWS

Media S/W in the AWS Marketplace

AWS Marketplace: Online Software Store

• Find, research, try & buy software

• 1-Click launch – application running minutes

• S/W Billing fully integrated into AWS account

• 1700 products across 25 categories

Developer Tool Categories Include

• Media Servers

• Transcoding

• Media Publishing

• Digital Asset Management

• Image Resizing

Page 15: Ingest Options on AWS

M&E Partner Eco-System Highlights

4/29/2015 –

[email protected]

INGEST STORE MANAGE SECUREPROCESS

CREATEMONETIZE

INTEGRATEDELIVER

Page 16: Ingest Options on AWS

Thank you!

©2015, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Page 17: Ingest Options on AWS

AWS SDKs

Java Python (boto) PHP .NET Ruby Node.js

iOS Android AWS Toolkit for

Visual Studio

AWS Toolkit

for Eclipse

AWS Tools for

Windows

PowerShell

AWS CLI

JavaScript

©2015, Amazon Web Services, Inc. or its affiliates. All rights reserved.