27

Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons

  • Upload
    others

  • View
    5

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons
Page 2: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons

Natural language interfaces for your connected car2018-05-29 Tomas Carlfalk – Chief Architect – WirelessCar

Page 3: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons

• Tomas Carlfalk

• WirelessCar since 15 years, currently Chief Architect

• Software Developer & Architect

• Computing Science at Göteborg University

Who am I?

Page 4: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons

What WirelessCar offer

Page 5: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons

Beijing

Gothenburg

GreensboroAllentown

connected cars across 5 continents, increasing with 70,000 vehicles per month.

2 300 000 Active

through long track record and unique knowledge in connected off-board platforms combined with vehicle integration expertise.

Global reach

Highly skilled and experienced staff across the globe. Specialized in telematics and connected car services.

300 staff > 3000 years of experience

WirelessCar Today

Page 6: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons

Connected brands

In total 13 programs in 65 markets over 18 years

Page 7: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons

Some history

Voice call services (late 1990’s)

Data (SMS)

Data (IP)

VoiceEmergency CallAutomatic Crash NotificationRoadside AssistanceConcierge Call

Icons made by Freepik from Flaticon are licensed by Creative Commons BY 3.0

Page 8: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons

Some history

Theft services (late 1990’s)

Data (SMS)

Data (IP)

Voice

Theft NotificationStolen Vehicle Tracking

Request (SMS)

Request (IP)

Icons made by Freepik from Flaticon are licensed by Creative Commons BY 3.0

Page 9: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons

Some history

Remote services with app (around 2010)

Data (IP/SMS)

Data (IP)

Vehicle Health StatusVehicle LocationRemote Heater Start

Page 10: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons

Why natural language interfaces?• Intuitive

• Accessible

• Technology is available

• Technology is becoming good enough

Icons made by Freepik from Flaticon are licensed by Creative Commons BY 3.0

Page 11: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons

Use Cases for natural language interface

Voice based services

Data (SMS)

Data (IP)

Voice

$$$Hard to add or change services

Emergency CallAutomatic Crash NotificationRoadside AssistanceConcierge CallTheftIcons made by Freepik from Flaticon are licensed by Creative Commons BY 3.0

Page 12: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons

What we’re working on now

Automate voice based services

Data

Data

Voice

Roadside AssistanceConcierge Call

Voice

Emer

genc

y Ca

llCr

ash

Not

ifica

tion

Icons made by Freepik from Flaticon are licensed by Creative Commons BY 3.0

Page 13: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons

What we’re working on now

Automate voice based services

Data

Data

Voice

Roadside AssistanceConcierge Call

Voice

Emer

genc

y Ca

llCr

ash

Not

ifica

tion

AmazonConnect

Amazon Lex

AmazonLambda

Amazon Polly

Icons made by Freepik from Flaticon are licensed by Creative Commons BY 3.0

Page 14: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons
Page 15: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons

Polly is a text-to-speech service from AWS.In our usecase, we use it via Amazon Connect. But Polly can be used also as a standalone service.

Polly

Page 16: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons

Amazon Lex

Page 17: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons

Amaz

on L

ambd

a

Page 18: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons

Use Cases for natural language interface

Remote Services

Data (IP/SMS)

Data (IP)

Vehicle Health StatusVehicle LocationRemote Heater Start

Complement or replacement for apps and portals

Page 19: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons

Communication by user

CloudWatch schedules events

Foreca sends possible weather info

Lex interprets input

Queries to car are made through API:s

The car reacts to request by sending

info or executing task

Lambda decides and delivers answer

CloudWatch logs event

What we’re working on now

Chat with your car for remote services

Icons made by Freepik from Flaticon are licensed by Creative Commons BY 3.0

Page 20: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons

Chat example(Facebook Messenger)

Page 21: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons

What we’re working on now

Amazon Alexa for remote services

AWS Lambda

Platform

Icons made by Freepik from Flaticon are licensed by Creative Commons BY 3.0

Page 22: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons

• Designing conversational interfaces is really hard

Learnings

• The UI is quite different from Mobile / Web UIs• Technology is becoming very good and easily accessible• Background noise can be a problem for voice interfaces• Accents can be a problem for voice interfaces

Page 23: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons

Recommendations• Embrace the fact that conversational interface design is different from GUI design• Include linguistics experts in your development teams• Use advanced Machine Learning based services that adapt to user input• Adopt voice-first design patterns

Page 24: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons

What’s next?

Chat with your car – the entire lifecycle

Build

online

Order

Manufacture

Page 25: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons

What’s next?

Improve conversations with insights from data

Data

DataData

Insights

Icons made by Freepik from Flaticon are licensed by Creative Commons BY 3.0

Page 26: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons

http://wirelesscar.com/career/

We’re hiring!

Page 27: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons

If you want to know more about our technology or talk career opportunities –come and visit us in the exhibition area!