Robert Lyon Design Review November 11, 2011

Robert Lyon Design Review November 11, 2011

Transitionary Time

Filebucket

Smoke

Not quite the cloudBut works the same way

Simple Storage Service (S3)

Ruby

Rack

Buckets

No folders!

Objects / Keys

path/to/my/file.txt

Use the same tools to access data stored on standard file systems as

you do for the cloud.

Request received by the Proxy

Server

REST

GET, PUT, DELETE, POSTIndex, Show, Edit, Update, New, Create and Destroy

PUT /bucket/file.txt HTTP/1.0Content-Md5: c8fdb181845a4ca6b8fec737b3581d76Content-Type: text/plainContent-Length: 1024Date: Thu, 17 Nov 2005 18:49:58 GMTX-Amz-Meta-Author: foo@bar.comX-Amz-Magic: abracadabra….Body….

Authentication

Proxy Auth

Signed request based on access ID and secret key.

Authorization: AWS 44CF9590006BF252F707:5m+HAmc5JsrgyDelh9+a2dNrzN8=

Action

Proxy AuthParse Action

GET

PUT

DELETE

POSTAlso HEAD

Retrieve Information

Proxy Auth Parse Action

Get Data

Backing DatabasePostgreSQL Volatile MemoryMySQL SQLite

Generate Response

Proxy Auth Parse Action

Get Data

Respond

Generate Response

Proxy Auth Parse Action

Get Data

Respond

Why not build this directly into filebucket?

ScalabilityFlexibility

Transitional BridgeLong Term Goals

Phase 1

Location InfrastructureVersioning

ACLsRemote Clients

Filebucket Integration

Why not other faux S3 implementations?

Why S3?

Identified Issues

• DNS Style Buckets• Many Different Request Styles

Direct Cost: $0Indirect Cost: $10,000

~400 personnel hours required

December 14th

Phase 1 Completed