33
rt Lyon Design Review November 11,

Robert Lyon Design Review November 11, 2011

Embed Size (px)

Citation preview

Page 1: Robert Lyon  Design Review  November 11, 2011

Robert Lyon Design Review November 11, 2011

Page 2: Robert Lyon  Design Review  November 11, 2011

Transitionary Time

Page 3: Robert Lyon  Design Review  November 11, 2011
Page 4: Robert Lyon  Design Review  November 11, 2011

Filebucket

Page 5: Robert Lyon  Design Review  November 11, 2011
Page 6: Robert Lyon  Design Review  November 11, 2011

Smoke

Page 7: Robert Lyon  Design Review  November 11, 2011

Not quite the cloudBut works the same way

Page 8: Robert Lyon  Design Review  November 11, 2011

Simple Storage Service (S3)

Page 9: Robert Lyon  Design Review  November 11, 2011

Ruby

Rack

Page 10: Robert Lyon  Design Review  November 11, 2011

Buckets

No folders!

Page 11: Robert Lyon  Design Review  November 11, 2011

Objects / Keys

path/to/my/file.txt

Page 12: Robert Lyon  Design Review  November 11, 2011

Use the same tools to access data stored on standard file systems as

you do for the cloud.

Page 13: Robert Lyon  Design Review  November 11, 2011

Request received by the Proxy

Server

Page 14: Robert Lyon  Design Review  November 11, 2011

REST

Page 15: Robert Lyon  Design Review  November 11, 2011

GET, PUT, DELETE, POSTIndex, Show, Edit, Update, New, Create and Destroy

Page 16: Robert Lyon  Design Review  November 11, 2011

PUT /bucket/file.txt HTTP/1.0Content-Md5: c8fdb181845a4ca6b8fec737b3581d76Content-Type: text/plainContent-Length: 1024Date: Thu, 17 Nov 2005 18:49:58 GMTX-Amz-Meta-Author: [email protected]: abracadabra….Body….

Page 17: Robert Lyon  Design Review  November 11, 2011

Authentication

Proxy Auth

Page 18: Robert Lyon  Design Review  November 11, 2011

Signed request based on access ID and secret key.

Page 19: Robert Lyon  Design Review  November 11, 2011

Authorization: AWS 44CF9590006BF252F707:5m+HAmc5JsrgyDelh9+a2dNrzN8=

Page 20: Robert Lyon  Design Review  November 11, 2011

Action

Proxy AuthParse Action

GET

PUT

DELETE

POSTAlso HEAD

Page 21: Robert Lyon  Design Review  November 11, 2011

Retrieve Information

Proxy Auth Parse Action

Get Data

Page 22: Robert Lyon  Design Review  November 11, 2011

Backing DatabasePostgreSQL Volatile MemoryMySQL SQLite

Page 23: Robert Lyon  Design Review  November 11, 2011

Generate Response

Proxy Auth Parse Action

Get Data

Respond

Page 24: Robert Lyon  Design Review  November 11, 2011

Generate Response

Proxy Auth Parse Action

Get Data

Respond

Page 25: Robert Lyon  Design Review  November 11, 2011

Why not build this directly into filebucket?

Page 26: Robert Lyon  Design Review  November 11, 2011

ScalabilityFlexibility

Transitional BridgeLong Term Goals

Page 27: Robert Lyon  Design Review  November 11, 2011

Phase 1

Page 28: Robert Lyon  Design Review  November 11, 2011

Location InfrastructureVersioning

ACLsRemote Clients

Filebucket Integration

Page 29: Robert Lyon  Design Review  November 11, 2011

Why not other faux S3 implementations?

Page 30: Robert Lyon  Design Review  November 11, 2011

Why S3?

Page 31: Robert Lyon  Design Review  November 11, 2011

Identified Issues

• DNS Style Buckets• Many Different Request Styles

Page 32: Robert Lyon  Design Review  November 11, 2011

Direct Cost: $0Indirect Cost: $10,000

~400 personnel hours required

Page 33: Robert Lyon  Design Review  November 11, 2011

December 14th

Phase 1 Completed