Natural language - Lindholmen Software Development Day · Natural language interfaces for ......

Preview:

Citation preview

Natural language interfaces for your connected car2018-05-29 Tomas Carlfalk – Chief Architect – WirelessCar

• Tomas Carlfalk

• WirelessCar since 15 years, currently Chief Architect

• Software Developer & Architect

• Computing Science at Göteborg University

Who am I?

What WirelessCar offer

Beijing

Gothenburg

GreensboroAllentown

connected cars across 5 continents, increasing with 70,000 vehicles per month.

2 300 000 Active

through long track record and unique knowledge in connected off-board platforms combined with vehicle integration expertise.

Global reach

Highly skilled and experienced staff across the globe. Specialized in telematics and connected car services.

300 staff > 3000 years of experience

WirelessCar Today

Connected brands

In total 13 programs in 65 markets over 18 years

Some history

Voice call services (late 1990’s)

Data (SMS)

Data (IP)

VoiceEmergency CallAutomatic Crash NotificationRoadside AssistanceConcierge Call

Icons made by Freepik from Flaticon are licensed by Creative Commons BY 3.0

Some history

Theft services (late 1990’s)

Data (SMS)

Data (IP)

Voice

Theft NotificationStolen Vehicle Tracking

Request (SMS)

Request (IP)

Icons made by Freepik from Flaticon are licensed by Creative Commons BY 3.0

Some history

Remote services with app (around 2010)

Data (IP/SMS)

Data (IP)

Vehicle Health StatusVehicle LocationRemote Heater Start

Why natural language interfaces?• Intuitive

• Accessible

• Technology is available

• Technology is becoming good enough

Icons made by Freepik from Flaticon are licensed by Creative Commons BY 3.0

Use Cases for natural language interface

Voice based services

Data (SMS)

Data (IP)

Voice

$$$Hard to add or change services

Emergency CallAutomatic Crash NotificationRoadside AssistanceConcierge CallTheftIcons made by Freepik from Flaticon are licensed by Creative Commons BY 3.0

What we’re working on now

Automate voice based services

Data

Data

Voice

Roadside AssistanceConcierge Call

Voice

Emer

genc

y Ca

llCr

ash

Not

ifica

tion

Icons made by Freepik from Flaticon are licensed by Creative Commons BY 3.0

What we’re working on now

Automate voice based services

Data

Data

Voice

Roadside AssistanceConcierge Call

Voice

Emer

genc

y Ca

llCr

ash

Not

ifica

tion

AmazonConnect

Amazon Lex

AmazonLambda

Amazon Polly

Icons made by Freepik from Flaticon are licensed by Creative Commons BY 3.0

Polly is a text-to-speech service from AWS.In our usecase, we use it via Amazon Connect. But Polly can be used also as a standalone service.

Polly

Amazon Lex

Amaz

on L

ambd

a

Use Cases for natural language interface

Remote Services

Data (IP/SMS)

Data (IP)

Vehicle Health StatusVehicle LocationRemote Heater Start

Complement or replacement for apps and portals

Communication by user

CloudWatch schedules events

Foreca sends possible weather info

Lex interprets input

Queries to car are made through API:s

The car reacts to request by sending

info or executing task

Lambda decides and delivers answer

CloudWatch logs event

What we’re working on now

Chat with your car for remote services

Icons made by Freepik from Flaticon are licensed by Creative Commons BY 3.0

Chat example(Facebook Messenger)

What we’re working on now

Amazon Alexa for remote services

AWS Lambda

Platform

Icons made by Freepik from Flaticon are licensed by Creative Commons BY 3.0

• Designing conversational interfaces is really hard

Learnings

• The UI is quite different from Mobile / Web UIs• Technology is becoming very good and easily accessible• Background noise can be a problem for voice interfaces• Accents can be a problem for voice interfaces

Recommendations• Embrace the fact that conversational interface design is different from GUI design• Include linguistics experts in your development teams• Use advanced Machine Learning based services that adapt to user input• Adopt voice-first design patterns

What’s next?

Chat with your car – the entire lifecycle

Build

online

Order

Manufacture

What’s next?

Improve conversations with insights from data

Data

DataData

Insights

Icons made by Freepik from Flaticon are licensed by Creative Commons BY 3.0

http://wirelesscar.com/career/

We’re hiring!

If you want to know more about our technology or talk career opportunities –come and visit us in the exhibition area!

Recommended