Embed Size (px)
Citation preview
AWS Data Stores
Brock TubreINSTRUCTOR
AWS Data StoresAWS DATA STORES
S3
AWS Data StoresAWS DATA STORES
AWS DATA STORES
Amazon Simple Storage Service (S3)Unlimited data storage that provides object based storage for any type of data.
Go to place for storing Machine Learning data. S3
What is S3?
• Files can be from 0 bytes to 5 TB.
• There is unlimited storage.
• Files are stored into buckets (similar to folders).
• S3 is a universal namespace. That is, names must be unique globally.
• https://s3-us-east-1.amazonaws.com/machinelearningdata
• https://machinelearning.s3.amazonaws.com/
AWS DATA STORES
What is S3?
S3
• Files can be from 0 bytes to 5 TB.
• There is unlimited storage.
• Files are stored into buckets (similar to folders).
• S3 is a universal namespace. That is, names must be unique globally.
• https://s3-us-east-1.amazonaws.com/machinelearningdata
• https://machinelearning.s3.amazonaws.com/
AWS DATA STORES
What is S3?
S3
Get Data into S3
S3
AWS DATA STORES
Get Data into S3AWS DATA STORES
Relational Database Service
Data Stores
S3 RDS Dynamo DB Document DBRed Shift Timestream
AWS DATA STORES
Relational Database ServiceAWS DATA STORES
Relational Database ServiceAWS DATA STORES
Dynamo DBAWS DATA STORES
Data Stores
S3 RDS Dynamo DB Document DBRed Shift Timestream
Dynamo DBAWS DATA STORES
{ "Characters" : [
{ "ID": 1, "Name": “Luke”, "Evil": 0, “Affiliation": “Rebel”, "Weapon": “lightsaber”
}, {
"ID": 2, "Name": “Jabba the Hutt”, "Evil": 1, “Affiliation": null
} ] }
table
Dynamo DBAWS DATA STORES
{ "Characters" : [
{ "ID": 1, "Name": “Luke”, "Evil": 0, “Affiliation": “Rebel”, "Weapon": “lightsaber”
}, {
"ID": 2, "Name": “Jabba the Hutt”, "Evil": 1, “Affiliation": null
} ] }
{ "Characters" : [
{ "ID": 1, "Name": “Luke”, "Evil": 0, “Affiliation": “Rebel”, "Weapon": “lightsaber”
}, {
"ID": 2, "Name": “Jabba the Hutt”, "Evil": 1, “Affiliation": null
} ] }
table
table name
Dynamo DBAWS DATA STORES
{ "Characters" : [
{ "ID": 1, "Name": “Luke”, "Evil": 0, “Affiliation": “Rebel”, "Weapon": “lightsaber”
}, {
"ID": 2, "Name": “Jabba the Hutt”, "Evil": 1, “Affiliation": null
} ] }
item
Dynamo DBAWS DATA STORES
{ "Characters" : [
{ "ID": 1, "Name": “Luke”, "Evil": 0, “Affiliation": “Rebel”, "Weapon": “lightsaber”
}, {
"ID": 2, "Name": “Jabba the Hutt”, "Evil": 1, “Affiliation": null
} ] }
key value
Dynamo DBAWS DATA STORES
{ "Characters" : [
{ "ID": 1, "Name": “Luke”, "Evil": 0, “Affiliation": “Rebel”, "Weapon": “lightsaber”
}, {
"ID": 2, "Name": “Jabba the Hutt”, "Evil": 1, “Affiliation": null
} ] }
attribute
Dynamo DBAWS DATA STORES
Dynamo DBAWS DATA STORES
Data Stores
S3 RDS Dynamo DB Document DBRedshift Timestream
RedshiftAWS DATA STORES
SQL Client / BI / Analytics Tools
Source 1
Source 2
Source 3 Redshift
RedshiftAWS DATA STORES
RedshiftAWS DATA STORES
S3 QuickSightRedshiftSpectrum
Redshift SpectrumAWS DATA STORES
Data Stores
S3 RDS Dynamo DB Document DBRed Shift Timestream
Amazon TimestreamAWS DATA STORES
Time series data SQL Client / BI / Analytics ToolsTimestream
Amazon TimestreamAWS DATA STORES
Document DBAWS DATA STORES
Data Stores
S3 RDS Dynamo DB Document DBRed Shift Timestream
Document DBAWS DATA STORES
S3
AWS Data StoresAWS DATA STORES
