S U M M I TB E R L I N

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Using Machine Learning for Serverless AnalyticsDanilo PocciaPrincipal Evangelist, ServerlessAWS

@danilop

S e s s i o n I D

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

What is serverless?

No infrastructure provisioning, no management

Automatic scaling

Pay for value Highly available and secure

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

More machine learning happens on AWS than anywhere else

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

M L F R A M E W O R K S &

I N F R A S T R U C T U R E

The Amazon ML stack: Broadest & deepest set of capabilities

A I S E R V I C E SR E K O G N I T I O N

I M A G EP O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D

& C O M P R E H E N D M E D I C A L

L E XR E K O G N I T I O NV I D E O

Vis ion Speech Chatbots

A M A Z O N S A G E M A K E R

B U I L D T R A I N

F O R E C A S TT E X T R A C T P E R S O N A L I Z E

D E P L O Y

Pre-bui l t a lgor i thms & notebooks

Data label ing (G R O U N D T R U T H )

One-c l ick model t ra in ing & tuning

Opt imizat ion (N E O )

One-c l ick deployment & host ingM L S E R V I C E S

F r a m e w o r k s I n t e r f a c e s I n f r a s t r u c t u r e

E C 2 P 3 & P 3 d n

E C 2 C 5 F P G A s G R E E N G R A S S E L A S T I CI N F E R E N C E

Reinforcement learn ingAlgor i thms & models ( A W S M A R K E T P L A C E F O R M A C H I N E L E A R N I N G )

Language Forecast ing Recommendat ions

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Put AI to work for your business

Pre-trained AI services that require no ML skills or training

Easily add intelligence to your existing apps and workflows

Quality and accuracy from continuously-learning APIs

A I S E R V I C E SR E K O G N I T I O N

I M A G EP O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D

& C O M P R E H E N D M E D I C A L

L E XR E K O G N I T I O NV I D E O

Vis ion Speech Chatbots

F O R E C A S TT E X T R A C T P E R S O N A L I Z E

Language Forecast ing Recommendat ions

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Can I build a completely serverless data analytics platform?

Can I process both batch and streaming data?

Can I use Machine Learning to get insights from data?

What about text, audio, images, and videos?

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Serverless Machine Learning + Analytics

Files S3 Bucket

AWS IoT Core

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Serverless Machine Learning + Analytics

Files S3 Bucket

AWS IoT Core

S3 Bucket

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Serverless Machine Learning + Analytics

Files S3 Bucket

AWS IoT Core

S3 Bucket

• Validate syntax• Enrich data• External lookups

• DynamoDB Table• RDS Database

• Anything, it’s your code!

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Serverless Machine Learning + Analytics

Files S3 Bucket

AWS Glue(Crawlers, Jobs

&Data Catalog)

AWS IoT Core

S3 Bucket

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Serverless Machine Learning + Analytics

Files S3 Bucket

AWS Glue(Crawlers, Jobs

&Data Catalog)

AWS IoT Core

S3 Bucket

• Integrated Data Catalog• Automatic schema discovery• Code generation• Developer endpoints• Flexible job scheduler

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Serverless Machine Learning + Analytics

Files S3 Bucket

AmazonAthena

AWS Glue(Crawlers, Jobs

&Data Catalog)

AWS IoT Core

S3 Bucket

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Serverless Machine Learning + Analytics

Files S3 Bucket

AmazonAthena

AmazonQuickSight

AWS Glue(Crawlers, Jobs

&Data Catalog)

AWS IoT Core

S3 Bucket

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Serverless Machine Learning + Analytics

Files

Data Stream

S3 Bucket

AmazonAthena

AmazonQuickSight

AWS Glue(Crawlers, Jobs

&Data Catalog)

AWS IoT Core

KinesisData

Firehose

S3 Bucket

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Serverless Machine Learning + Analytics

Files

Data Stream

S3 Bucket

AmazonAthena

AmazonQuickSight

AWS Glue(Crawlers, Jobs

&Data Catalog)

AWS IoT Core

KinesisData

Streams

KinesisData

Analytics

KinesisData

Firehose

S3 Bucket

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Serverless Machine Learning + Analytics

Files

Data Stream

S3 Bucket

AWS IoT Core

KinesisData

Streams

KinesisData

Analytics

KinesisData

Firehose

• Capture• Transform• Load data streams

• Process data streams in real time with SQL

• Sliding windows• Tumbling windows

• Use built-in functions that are optimized for stream processing

• Anomaly detection• Top-K analysis

• Process or analyze streaming data

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Serverless Machine Learning + Analytics

Files

Data Stream

Video Stream

S3 Bucket

KinesisVideo

StreamAmazonAthena

AmazonQuickSight

AWS Glue(Crawlers, Jobs

&Data Catalog)

AWS IoT Core

KinesisData

Streams

KinesisData

Analytics

KinesisData

FirehoseOutside of AWS

S3 Bucket

CustomProcessing

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Serverless Machine Learning + Analytics

Video Stream KinesisVideo

Stream

AWS IoT Core

CustomProcessing

Securely stream video from connected devices to AWS for analytics, machine learning (ML), and other processing

Kinesis Video Producer SDK• Gstreamer-plugin,• Docker images for Ubuntu,

MacOS, and Raspberry Pi • Kinesis Video Streams applications get data, such as fragments and frames, from a Kinesis video stream to view, process, or analyze it

• Get media with low-latency using the Kinesis Video Stream Parser Library

Serverless

But you may need it :)

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Serverless Machine Learning + Analytics

Files

Data Stream

Video Stream

S3 Bucket

KinesisVideo

StreamAmazonAthena

AmazonQuickSight

AWS Glue(Crawlers, Jobs

&Data Catalog)

IoTDevice AWS IoT Core

KinesisData

Streams

KinesisData

Analytics

KinesisData

FirehoseOutside of AWS

S3 Bucket

CustomProcessing

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Serverless Machine Learning + Analytics

Files

Data Stream

Video Stream

S3 Bucket

KinesisVideo

StreamAmazonAthena

AmazonQuickSight

AWS Glue(Crawlers, Jobs

&Data Catalog)

AWS IoTAnalytics

IoTDevice AWS IoT Core

KinesisData

Streams

KinesisData

Analytics

KinesisData

FirehoseOutside of AWS

S3 Bucket

CustomProcessing

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Serverless Machine Learning + Analytics

AWS IoTAnalytics

IoTDevice AWS IoT Core

• Standard SQL queries• Run time-series analyses• Cleans false readings• Fill gaps in the data• Perform mathematical

transformations of message data

• Use Lambda functions to enrich your device data from external sources

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Serverless Machine Learning + Analytics

Files

Data Stream

Video Stream

S3 Bucket

KinesisVideo

Stream

CustomProcessing

AmazonAthena

AmazonQuickSight

AWS Glue(Crawlers, Jobs

&Data Catalog)

AWS IoTAnalytics

IoTDevice AWS IoT Core

KinesisData

Streams

KinesisData

Analytics

KinesisData

Firehose

AWSGreengrass

Outside of AWS

S3 Bucket

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Serverless Machine Learning + Analytics

Video Stream

IoTDevice AWS IoT Core

AWSGreengrass

Outside of AWS

• Local compute (Lambda functions)• Messaging• Data caching• Synchronize data• ML inference

Connected devices

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Serverless Machine Learning + Analytics

Files

Data Stream

Video Stream

S3 Bucket

KinesisVideo

Stream

MachineLearning

Text

Audio

ImageVideo

AmazonAthena

AmazonQuickSight

AWS Glue(Crawlers, Jobs

&Data Catalog)

AWS IoTAnalytics

IoTDevice AWS IoT Core

KinesisData

Streams

KinesisData

Analytics

KinesisData

Firehose

AWSGreengrass

Outside of AWS

Text

ScannedDocumen

t

S3 Bucket

Custom Models

MachineLearning

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Serverless Machine Learning + Analytics

Files

Data Stream

Video Stream

S3 Bucket

KinesisVideo

Stream

AmazonRekognition

AmazonRekognition

AmazonComprehend

AmazonTranscribe

Text

Audio

ImageVideo

AmazonAthena

AmazonQuickSight

AWS Glue(Crawlers, Jobs

&Data Catalog)

AmazonSageMaker

AWS IoTAnalytics

IoTDevice AWS IoT Core

KinesisData

Streams

KinesisData

Analytics

KinesisData

Firehose

AWSGreengrass

AmazonTranslate

AmazonTextract

Outside of AWS

Text

ScannedDocumen

t

S3 Bucket

Custom Models

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Serverless Machine Learning + Analytics

Files

Video Stream

S3 Bucket

KinesisVideo

Stream

AmazonRekognition

AmazonRekognition

AmazonComprehend

AmazonTranscribe

Text

Audio

ImageVideo

AmazonSageMaker

AmazonTranslate

AmazonTextract

Text

ScannedDocumen

t

Custom Models

• Dominant language• Entities• Key Phrases• Sentiment• Topic Modeling

• Transcribe to text

• Labels• Faces• Celebrities• Moderation• Text• Tracking

• Extracts text and data

• Built-in algorithms• Your own algorithms

Same Lambda function for all formats, or different Lambda functions using object key name filtering (e.g. by suffix)

• Translate to common language

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Serverless Machine Learning + Analytics

Files

Video Stream

S3 Bucket

KinesisVideo

Stream

AmazonRekognition

AmazonRekognition

AmazonComprehend

AmazonTranscribe

Text

Audio

ImageVideo

AmazonSageMaker

AmazonTranslate

AmazonTextract

Text

ScannedDocumen

t

Custom Models

Built-in algorithms

• Linear Learner• Factorization Machines• XGBoost Algorithm• Image Classification Algorithm• Sequence to Sequence (seq2seq)• K-Means Algorithm• Principal Component Analysis (PCA)• Latent Dirichlet Allocation (LDA)• Neural Topic Model (NTM)• DeepAR Forecasting• BlazingText• Random Cut Forest• …

Your own algorithms

• TensorFlow• Apache MXNet• Chainer• PyTorch• Apache Spark• …

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Serverless Machine Learning + Analytics

Files

Data Stream

Video Stream

S3 Bucket

KinesisVideo

Stream

AmazonRekognition

AmazonRekognition

AmazonComprehend

AmazonTranscribe

Text

Audio

ImageVideo

AmazonAthena

AmazonQuickSight

AWS Glue(Crawlers, Jobs

&Data Catalog)

AmazonSageMaker

AWS IoTAnalytics

IoTDevice AWS IoT Core

KinesisData

Streams

KinesisData

Analytics

KinesisData

Firehose

AWSGreengrass

AmazonTranslate

AmazonTextract

Outside of AWS

Text

ScannedDocumen

t

S3 Bucket

Custom Models

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Serverless Machine Learning + Analytics

Files

Data Stream

Video Stream

S3 Bucket

KinesisVideo

Stream

AmazonRekognition

AmazonRekognition

AmazonComprehend

AmazonTranscribe

Text

Audio

ImageVideo

AmazonAthena

AmazonQuickSight

AWS Glue(Crawlers, Jobs

&Data Catalog)

AmazonSageMaker

AWS IoTAnalytics

IoTDevice AWS IoT Core

KinesisData

Streams

KinesisData

Analytics

KinesisData

Firehose

AWSGreengrass

AmazonForecast

AmazonPersonalize

AmazonTranslate

AmazonTextract

Outside of AWS

Text

ScannedDocumen

t

S3 Bucket

Custom Models

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Serverless Machine Learning + Analytics

AmazonForecast

AmazonPersonalize

S3 Bucket

Time-series forecasting

Real-time personalization and recommendation

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Serverless Machine Learning + Analytics

Files

Data Stream

Video Stream

S3 Bucket

KinesisVideo

Stream

AmazonRekognition

AmazonRekognition

AmazonComprehend

AmazonTranscribe

Text

Audio

ImageVideo

AmazonAthena

AmazonQuickSight

AWS Glue(Crawlers, Jobs

&Data Catalog)

AmazonSageMaker

AWS IoTAnalytics

IoTDevice AWS IoT Core

KinesisData

Streams

KinesisData

Analytics

KinesisData

Firehose

AWSGreengrass

AmazonForecast

AmazonPersonalize

AmazonTranslate

AmazonTextract

Outside of AWS

Text

ScannedDocumen

t

S3 Bucket

Custom Models

Notebook

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Data Format Optimization

Partitioning

Compression

Columnar Formats (Parquet, ORC)

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

I t ’s not just Serverless

Amazon Redshift & Redshift Spectrum

Amazon Elastic MapReduce (EMR) & Apache Spark

Amazon SageMaker & Jupiter Notebooks

S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Thank you!

S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Danilo Poccia@danilop

S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.