12
AWS Helper Tools Brock Tubre INSTRUCTOR

AWS Helper Tools… · Redshift Spectrum • Query S3 data • Must have Redshift Cluster • Made for existing Redshift customers Athena • Query S3 data • No need for Redshift

  • Upload
    others

  • View
    11

  • Download
    0

Embed Size (px)

Citation preview

Page 1: AWS Helper Tools… · Redshift Spectrum • Query S3 data • Must have Redshift Cluster • Made for existing Redshift customers Athena • Query S3 data • No need for Redshift

AWS Helper Tools

Brock TubreINSTRUCTOR

Page 2: AWS Helper Tools… · Redshift Spectrum • Query S3 data • Must have Redshift Cluster • Made for existing Redshift customers Athena • Query S3 data • No need for Redshift

Elastic Map Reduce (EMR)AWS HELPER TOOLS

Helper Tools

EMR Athena

Page 3: AWS Helper Tools… · Redshift Spectrum • Query S3 data • Must have Redshift Cluster • Made for existing Redshift customers Athena • Query S3 data • No need for Redshift

APACHE Zookeeper

Elastic Map Reduce (EMR)AWS HELPER TOOLS

Page 4: AWS Helper Tools… · Redshift Spectrum • Query S3 data • Must have Redshift Cluster • Made for existing Redshift customers Athena • Query S3 data • No need for Redshift

Hive ETL Service

Spark ML and MLib ETL and Machine

Learning Library

Hadoop Distributed File System

Persistant Datastore

Presto SQL Query

Engine

Jupyter Notebooks Code Sharing

MXNet Machine Learning

Framework

Elastic Map Reduce (EMR)

Mahout Machine Learning

Framework

TensorFlow Machine Learning

Framework

AWS HELPER TOOLS

Page 5: AWS Helper Tools… · Redshift Spectrum • Query S3 data • Must have Redshift Cluster • Made for existing Redshift customers Athena • Query S3 data • No need for Redshift

Create Cluster - Advanced Options

Elastic Map Reduce (EMR) ClusterAWS HELPER TOOLS

Page 6: AWS Helper Tools… · Redshift Spectrum • Query S3 data • Must have Redshift Cluster • Made for existing Redshift customers Athena • Query S3 data • No need for Redshift

Athena

Helper Tools

EMR Athena

AWS HELPER TOOLS

Page 7: AWS Helper Tools… · Redshift Spectrum • Query S3 data • Must have Redshift Cluster • Made for existing Redshift customers Athena • Query S3 data • No need for Redshift

S3

RDS

DynamoDB

Redshift

Database onEC2

AWS Glue

EMR

Athena

S3

Redshift

AthenaAWS HELPER TOOLS

Page 8: AWS Helper Tools… · Redshift Spectrum • Query S3 data • Must have Redshift Cluster • Made for existing Redshift customers Athena • Query S3 data • No need for Redshift

AthenaAWS HELPER TOOLS

Page 9: AWS Helper Tools… · Redshift Spectrum • Query S3 data • Must have Redshift Cluster • Made for existing Redshift customers Athena • Query S3 data • No need for Redshift

AthenaAWS HELPER TOOLS

Page 10: AWS Helper Tools… · Redshift Spectrum • Query S3 data • Must have Redshift Cluster • Made for existing Redshift customers Athena • Query S3 data • No need for Redshift

AthenaAWS HELPER TOOLS

Page 11: AWS Helper Tools… · Redshift Spectrum • Query S3 data • Must have Redshift Cluster • Made for existing Redshift customers Athena • Query S3 data • No need for Redshift

Redshift Spectrum vs AthenaAWS HELPER TOOLS

Redshift Spectrum• Query S3 data• Must have Redshift Cluster• Made for existing Redshift customers

Athena• Query S3 data• No need for Redshift cluster• New customers quickly want to query S3 data

Page 12: AWS Helper Tools… · Redshift Spectrum • Query S3 data • Must have Redshift Cluster • Made for existing Redshift customers Athena • Query S3 data • No need for Redshift

Get Data into S3AWS HELPER TOOLS

S3 SageMaker