Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Building Smart Applications with Conversational Interfaces and Language ServicesAlex Casalboni


About me

• Software Engineer & Web Developer• Startupper for 4.5 years• Serverless Lover & AI Enthusiast• ServerlessDays Organizer• AWS Customer since 2013

S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Put machine learning in the hands of every developer

Our mission


Our Approach

Customer-focusedroadmap (90%+)

Most popular frameworks (Tensorflow, MXNET)

200+ new launchesduring 2018

Wide range of services in production

Security and analytics capabiities

Embedded Research & Development


M L F R A M E W O R K S &

I N F R A S T R U C T U R E

Amazon ML Stack

A I S E R V I C E SR E K O G N I T I O N

I M A G EP O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D L E XR E K O G N I T I O N

V I D E O

Vis ion Speech Chatbots

A M A Z O N S A G E M A K E R

B U I L D T R A I N

F O R E C A S TT E X T R A C T P E R S O N A L I Z E

D E P L O YM L S E R V I C E S

F r a m e w o r k s I n t e r f a c e s I n f r a s t r u c t u r e

E C 2 P 3 & P 3 d n

E C 2 C 5 F P G A s G R E E N G R A S S E L A S T I CI N F E R E N C E

Language Forecast ing Recommendat ions


AI capabilitiesVision

Speech-to-Text (STT)

Text-to-Speech (TTS)

Natural Language Understanding

Language Translation

Uniform programming interfacefor text and voice apps


AI capabilities on AWS *Vision

Speech-to-Text (STT)

Text-to-Speech (TTS)

Natural Language Understanding

Language Translation

Chatbot Interface

Amazon Rekognition

Amazon Transcribe

Amazon Polly

Amazon Comprehend

Amazon Translate

Amazon Lex

* and more!


Audio Input

End-to-end workloads (media)

trigger

store

in cascade

call aggregate analyze


Add intelligent image and videoanalysis to your applications


Deep Learning-Based Image and Video Analysis


Optical Character Recognition (OCR)


Object & Scene Detection


Facial Analysis


Face Search/Comparison


Marinus Analytics uses facial recognition to stop human trafficking

“Now with Traffic Jam’s FaceSearch, powered by

Amazon Rekognition, investigators are able to take effective action by

searching through millions of records in seconds to find

victims.”


Discover insights and relationships in text


NLU Functionalit ies

Sentiment Entities LanguagesKeyphrases Topic

modeling

Syntax


EnglishItalianFrench

GermanPortuguese

Suppor ted Languages


Syntax detection$ aws comprehend detect-syntax

--language-code 'en' --text 'I love cloud!’{

"SyntaxTokens": [

{

"TokenId": 1,

"Text": "I",

"BeginOffset": 0,

"EndOffset": 1,

"PartOfSpeech": {

"Tag": "PRON",

"Score": 0.9999802112579346

}

},

...


Sentiment Analysis$ aws comprehend detect-sentiment

--language-code 'en' --text 'I love cloud!’

{

"Sentiment": "POSITIVE”,

"SentimentScore": {

"Mixed": 0.012617903761565685,

"Positive": 0.9599817991256714,

"Neutral": 0.021758323535323143,

"Negative": 0.005641999188810587

}

}


« Amazon Comprehend helps us analyzethe key sentiments, objects, and geos in our30 million plus reviews & testimonies. Nowwe are able to discover new insights into theunique experiences available at eachproperty, so our customers can make thebest decision possible for their travel.”

Matt Fryer, VP and Chief Data Science Officer, Hotels.com


Extract health information from patient notes, clinical trial reports, and other electronic health records


Turn text into lifelike speech using deep learning


Amazon Polly

• Content creation• Mobile & desktop

applications• Internet of Things (IoT)• Education & e-learning• Telephony• Game development

Use cases

• 58 voices across 28 languages

• Lip-syncing & text highlighting

• Fine-grained voice control• Custom vocabularies• Available in 17 AWS Regions

Key features


“With Amazon Polly our users benefit from the most lifelike Text-to-Speech voices

available on the market.”

Severin HackerCTO, Duolingo


Yes, natural language translation


Supported languages *

ArabicSimplified Chinese

FrenchGermanSpanish

Portuguese

JapaneseTraditional Chinese

ItalianRussianTurkishCzech

* 417 translation combinations

DanishDutchFinnishSwedishPolish

Hebrew


«We operate 90 localized websites in 41 languages. (…) Having evaluated Amazon Translate and several other solutions, we believethat Amazon Translate presents a quick, efficient and most importantly, accuratesolution. »

Matt Fryer, VP and Chief Data Science Officer, Hotels.com


Turn speech into text


EnglishItalianFrenchSpanish

Portuguese

Suppor ted Languages


Use cases

Call centers

Subtitles for VOD

Broadcast closed captions

Transcribe meetings


ringDNA• End-to-end communications platform for

sales teams. • Hundreds of enterprise organizations

use RingDNA to dramatically increase productivity, engage in smarter sales conversations, gain predictive sales insights and improve their win rate.

Speech to Text"A critical component of RingDNA’s Conversation AIrequires best of breed speech-to-text to delivertranscriptions of every phone call. RingDNA isexcited about Amazon Transcribe since itprovides high-quality speech recognition at scale,helping us to better transcribe every call to text "

Howard Brown, CEO & Founder, RingDNA

https://www.youtube.com/watch?v=1ZJ_f1bDdog

https://www.youtube.com/watch?v=1ZJ_f1bDdog


Conversational interfaces for your applications powered by the same deep learning technologies as Alexa


Amazon Lex

End to End

Speech to Intent

ASR+NLU integrated into one

API

Dialog Management

Native support &maintains context

Text to Speech

Amazon Polly integrated into API

Business Logic

Native integration with AWS Lambda

Deployment

One click deployment

Security

Encrypted data in transit & at rest

Scale

Completely managed service

Analytics

Monitor and improve

End to End



OCR++ service to extract data from virtually any document(No ML experience required)


Amazon Textract: How it works


Accurate time-series forecasting service(No ML experience required)


The perils of poor predictions in forecasting

TIME

SALES

FORECAST

SALES


Historical dataSupply chain, inventory, etc.

Customized forecasting API

Inspect data

Identify features

Selectfrom 8

algorithms

SelectHyperparameters

Host models

Loaddata

Trainmodels

Optimizemodels

Related “causal” dataWeather, special offers, product

details

Amazon Forecast

Amazon Forecast: How it works


Real-time personalization and recommendation service(No ML experience required)


Activity stream from app

Views, signups, conversion, etc.

InventoryArticles, products,

videos, etc.

Demographics (optional)

LOAD DATA(EMR Cluster)

INSPECT DATA

IDENTIFY FEATURES

SELECTALGORITHMS

SELECTHYPERPARAMETERS

TRAINMODELS

OPTIMIZEMODELS

HOST MODELS

BUILD FEATURESTORE

CREATEREAL-TIME

CACHES

Customizedpersonalization &recommendation

API

F u l l y m a n a g e d b y A m a z o n P e r s o n a l i z e

Amazon Personalize

Age, location, etc.

Amazon Personalize: How it works


Documents

Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni