67
Talk to Me. Voice UX: Now, Future & Best Practice Adi Mazor Kario, Product Design & UX

Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

  • Upload
    others

  • View
    5

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Talk to Me.Voice UX: Now, Future & Best Practice

Adi Mazor Kario, Product Design & UX

Page 2: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Adi Mazor Kario

MSc Cognitive Science, Experience Expert, GDE, Google Sprint Master

[email protected]

Page 3: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Language makes us human

Page 4: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Talking to machines

Page 5: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

The next 60 min

● What’s happening with voice?

● The future of Voice

● 6 tips for great VUI Experience

Page 6: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

What’s Happening with Voice?

Page 7: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

In the last year, the user base of voice

devices grew in 129%(e.g. Google home, Amazon Echo)

Page 8: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Since 2008 Voice based

Google searches have been

increased

X 35

Page 9: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Millennials are the quickest to

adopt voice assistants

Page 11: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations
Page 12: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations
Page 13: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

2/2017

Page 14: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

2/2017

Page 15: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

3 Voice Apps Examples

Page 16: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Copyrights: LHBS

Page 17: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Copyrights: LHBS

Page 18: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Copyrights: LHBS

Page 19: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

The future?

Page 20: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

of interfaces by 2020 will be

speech recognition based82%

Page 21: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

of searches will be

screenless by 202030%

Page 22: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Let’s imagine the future

Page 23: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Bad day at work

Page 24: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

The future?

● Conversation is frictionless and natural

● Voice will be more human

● Voice will know you personally

● Voice will convey character

● Voice will react to your emotions

Select your friend

Page 25: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Voice will REVOLUTIONIZE how we experience things

Page 26: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Personalization and customization

Personalize services (biometric voice/emotional recognition).

Brands will tailor Voice UX to the interests, needs, wants and desires of their customers.

Page 27: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Voice will react to emotions

Emotional Experience (identify and enhance emotions).

Brands will harness empathy and emotional utterance to create interactions that truly affect your customers.

Page 28: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Voice will revolutionize how we experience things

Frictionless, natural UX

Brands will create device-less experiences, focusing on how to create a seamless. Brand moments using

contactless interactions

Page 29: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Voice will learn (and remember) to be more human

Human-like UX

Brands will talk with their users in a natural way, remember and create relevant content to their customers

Page 30: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Voice will convey personality of a brand

Brand Personality

Voice could BE the brand, with human-like connection with the persona

Page 31: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

So how do we make it happen?

Page 32: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Visual VS Auditory Perception (input)

Screens VS Voice

Page 33: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Visual VS Auditory Perception (input)

Screens VS Voice

1. I

2. See

3. A

4. Red

5. Dinosaur

6. ….

A picture is worth a thousand words

Page 34: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Visual VS Auditory communication (output)

Screens VS Voice

Humans can type 40 words per minute vs speak 150 words per minute

Page 35: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

GUI +TTS = VUI

Page 36: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

The key to building a good voice interface is not to fall into a trap of simply converting

a GUI into a VUI.

“Starbucks, Please order my usual.”

Page 37: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

6 Tips for an great VUI Experience

Page 38: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

1. The Design Process

Page 39: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Is Conversation the right fit?

● Intuitive

● Less effort than a screen

● Enables multitasking

● Speak freely

1. The Design Process

Page 40: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Is Conversation the right fit?

Use case #1: "How much are flights to Paris?"

1. The Design Process

Page 41: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Is Conversation the right fit?

Use case #1: "Purchase tickets for my family to visit Paris"

1. The Design Process

Page 42: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Requirements stages

1. The Design Process

Page 43: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Detailed Design

1. The Design Process

Page 44: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

2. Understand your users

Pizza Ordering app

Page 45: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Pizza Ordering app

2. Understand your users

Page 46: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

3. Context matters

Page 47: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

4. Create a persona

Page 48: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

4. Create a persona for your users & their needs

● Voice

● Tone

● Word+ phrases choices

● Pace

● Energy level

● Style

● Emotional state

Page 49: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

4. Create a persona for your users & their needs

● Voice

● Tone

● Word+ phrases choices

● Pace

● Energy level

● Style

● Emotional state

Page 50: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

4. Create a persona for your users & their needs

Kim Kardashian

Fashion app

Lionel Messi

Sports app

Jamie Oliver

Cooking app

Gandalf

Fantasy game

Page 51: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

5. Create a conversation

Page 52: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

4. Create a conversation

Principles

● Turn Taking

● The Cooperative Principle

● Threading

● Context

● Variations

● Repair

Page 53: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

5. Create a conversation

Do you know who is coming to the party tonight?

Yes

Page 54: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

5. Create a conversation

Getting the conversation forward toward the same goal

Example 1 Example 2

Page 55: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

5. Create a conversation

Page 56: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

5. Create a conversation

Page 57: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

5. Create a conversation

Happy Path

Page 58: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Error Path

5. Create a conversation

Page 59: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

5. Create a conversation

A screenplay

Page 60: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

5. Create a conversation

A screenplay

Act out: Discuss, Re Discuss,

Refine

A Wizard of Oz Prototype

Page 61: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

5. Create a conversation- In conversation there is no “errors”

Page 62: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

6. Support your VUI with GUI

Once conversation is more complete- how will the screen support it?

Page 63: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Lets Conclude

● Understand your user

● Pick the right use cases

● Create a persona that match your users and brand

● Write dialogs

● Test it out

● Build and iterate

Page 64: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

And don’t forget- what you design and build matters.

Do it right.

Page 66: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

References

Designing voice user interfaces

Actions on Google- Conversation Design

Conversation Design: Speaking the Same Language. Six principles of human conversation poised to revolutionize Voice User Interface design by James Giangola Conversation & Persona Design Lead @ Google

● Give your VUI a personality● Move the conversation forward● Be brief, be relevant● Leverage context● Direct the user’s focus through word order and stress● Don’t teach “commands”—speaking is intuitive

Voice User Interface Design by Michael Cohen, James P. Giangola and Jennifer Balogh

The Social Stratification of English in New York City by William Labov (PDF)

Page 67: Talk to Me. · Cooking app. Gandalf. Fantasy game. 5. Create a conversation. 4. Create a conversation . Principles Turn Taking The Cooperative Principle Threading Context Variations

Q&A