36
Building Applications for Amazon's Alexa Platform Ben Northrop Distinguished Technical Consultant Summa Follow Along bennorthrop.com/alexa github.com/throp/mathwhiz

Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

Building Applications for Amazon's Alexa Platform

Ben NorthropDistinguished Technical Consultant

Summa

Follow Alongbennorthrop.com/alexa

github.com/throp/mathwhiz

Page 2: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

About Me

● Oldish guy who still writes code● Full stack developer● Not an expert in voice technology

– Recently deployed Alexa skill for retail client

– Worked for voice technology company prior

Page 3: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

Disclaimer

Page 4: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

Agenda

1. Intro to Alexa2. Desiging Voice UIs3. Building "Skills" with Java

Page 5: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

1. Intro to Alexa

Page 6: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

What is Alexa?

● Voice driven, virtual personal assistant● Delivered via Echo, Dot, Tap, or Show● Cloud-based● Offers skills from third-party developers

Page 7: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

What can it do?

● Read the news, stories, facts...● Look up recipes, weather, TV guide...● Play music, podcasts, background noise...● Order a pizza, uber, doll house...● Control lights, thermostat, TV remote...● Quiz you on trivia, vocabulary, math...

Page 8: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

Popular Skills

Page 9: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

Skills, Skills, and More Skills

Page 10: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

In November 2016, a total of 5 million Amazon Echos, Dots, and Taps had been sold. In 6

months that number almost doubled.

Alexa Sales

Page 11: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

Exciting things in the News

Page 12: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

Voice Catching On

Page 13: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

Major Limitations

● No voice recognition● Unable to push messages or notifications *● No coordination between multiple devices● Unable to record voice● Continuous interaction needed -->

Page 14: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

Other Concerns

● Not as sticky as apps on other platforms● No clear way to monetize yet ● Less natural interaction or conversation

– Who does the “heavy lifting”?

User Developer

<------------------------------------->

or

Page 15: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

Crossed the Chasm?

Page 16: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

2. Designing Voice User Interfaces

Page 17: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

The Domain of Alexa

Page 18: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

New Skill: “Math Whiz”

Page 19: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

Skill

● Can be one of three types:– Smart home ---------------------------->

– Flash briefing -------------------------->

– Custom ---------------------------------->

● Activated via an invocation name – “math whiz”

● Defined in a given language

Page 20: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

Intent

An intent represents an action that fulfills a user’s spoken request.

Intent Schema

Page 21: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

Utterance

The words people say to interact with your skill.

Page 22: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

Slot Type

● Number– “three”, “one oh four”, “nine eight nine”

● Date– “may 4th”, “today”, “next week”, “this winter”

● Duration– “ten minutes”, “three days”, “seven years”

● Time– “noon”, “six am”, “two fifteen pm”

● List Type– airline, city, country, animal, artist, person, organization, etc.

Page 23: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

Alexa Console

User Interface

Page 24: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

3. Building Alexa Skills with Java

Page 25: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

Architecture

Page 26: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

JSON Request

Page 27: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

Java Speechlet Framework

Page 28: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

Speechlet

Page 29: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

SpeechletRequestStreamHandler

Page 30: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

Maven

Page 31: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

Hosting Options

● Amazon– Beanstalk

– Lamda

● Web Service

Page 32: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

Amazon Lamda

Page 33: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

Testing

Page 34: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

Account Linking

Page 35: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

Other Features

● Session● Audio● Built-in Intents

Page 36: Building Applications for Amazon's Alexa Platforma user’s spoken request. Intent Schema Utterance The words people say to interact with your skill. Slot Type Number – “three”,

Demo and

Questions?