Speech Graffiti Tutorial

FlightLine version

Fall 03

What is Speech Graffiti?SPEECH GRAFFITI is a special way of speaking that makes it faster for you to exchange information with a computer that understands your speech. Speech Graffiti is easy to learn This tutorial will teach you how

This tutorial uses a flight information system as an example, and afterwards you should be able to use any Speech Graffiti application. Let's get started!

With Speech Graffiti, you provide information to the system as if you were filling in a form.

Say you're wondering what time USAirways flight 28 leaves Los Angeles….

On a form, you'd have to fill in this information:

Phrases

With Speech Graffiti, you speak this information in PHRASES just as if you were filling out a form: one phrase for each piece of information

The phrases always sound like this:

airline is USAirways, flight number is 28, departure city is Los Angeles

Phrases

See the pattern?

With Speech Graffiti, you speak this information in PHRASES just as if you were filling out a form: one phrase for each piece of information

The phrases always sound like this:

airline is USAirways, flight number is 28, departure city is Los Angeles

With Speech Graffiti, you provide information to the system as if you were filling in a form.

Say you're wondering what time USAirways flight 28 leaves Los Angeles….

On a form, you'd have to fill in this information:

Phrases

See the pattern? You always give the type of thing you're talking about…

With Speech Graffiti, you speak this information in PHRASES just as if you were filling out a form: one phrase for each piece of information

The phrases always sound like this:

airline is USAirways, flight number is 28, departure city is Los Angeles

With Speech Graffiti, you provide information to the system as if you were filling in a form.

Say you're wondering what time USAirways flight 28 leaves Los Angeles….

On a form, you'd have to fill in this information:

Phrases

See the pattern? You always give the type of thing you're talking about…

then say is…

With Speech Graffiti, you speak this information in PHRASES just as if you were filling out a form: one phrase for each piece of information

The phrases always sound like this:

airline is USAirways, flight number is 28, departure city is Los Angeles

With Speech Graffiti, you provide information to the system as if you were filling in a form.

Say you're wondering what time USAirways flight 28 leaves Los Angeles….

On a form, you'd have to fill in this information:

Phrases

See the pattern? You always give the type of thing you're talking about… then say is… then state the value you want to specify for that field.

With Speech Graffiti, you speak this information in PHRASES just as if you were filling out a form: one phrase for each piece of information

The phrases always sound like this:

airline is USAirways, flight number is 28, departure city is Los Angeles

With Speech Graffiti, you provide information to the system as if you were filling in a form.

Say you're wondering what time USAirways flight 28 leaves Los Angeles….

On a form, you'd have to fill in this information:

Other applicationsAs you just learned, input might look like this in a flight application airline is USAirways, flight number is 28, departure city is Los Angeles

But Speech Graffiti works with many different applications

For instance, in a movie info system, you might say movie is Titanic, theater is the

Manor, day is Tuesday

So you can see that although the vocabulary is different, the structure

is the same

If things go wrong

If the system doesn’t understand a phrase, it won’t confirm it, and it will also play this sound to alert you that it missed something.  Then you can simply repeat the missing phrase, like this:   

airline is USAir, flight number is 630

airline is USAir 

USAirways

...flight 630!

!

flight 1059

Sometimes the system confirms the wrong information If this happens, you can erase your whole last utterance by saying scratch that, and then re-entering the erased info:

If things go wrong

airline is Northwest, flight number is 1059

scratch that 

scratched

to Atlanta, flight 1059

airline is Northwest

Northwest

flight number is 1059

Delta

If you ever find yourself wondering what information the system has successfully understood and retained from your query, you can just ask where was I?

Where was I?

departure city is Pittsburgh

from Pittsburgh

where was I?

departure city is Pittsburgh, arrival city is Detroit

airline is Delta

airline is Delta, arrival airport is Detroit

…to Detroit!

ReviewSo now you know how to give information in Speech Graffiti phrases… airline is United

How to recover from problems start over scratch that

How to find out what the system has stored where was I?

But you don't want to just give info to the system – you want to get info from it That's the next thing you'll learn…

To get information, ask a what?-question

Asking questions

airline is United, flight number is 1123

United, flight 1123

arrival city is Las Vegas, what is the arrival time? 

to Las Vegas, arriving at 6:29pm

To get information, ask a what?-question

Asking questions

So you just say…

airline is United, flight number is 1123

United, flight 1123

arrival city is Las Vegas, what is the arrival time? 

to Las Vegas, arriving at 6:29pm

To get information, ask a what?-question

Asking questions

So you just say… what is (or what are)…

airline is United, flight number is 1123

United, flight 1123

arrival city is Las Vegas, what is the arrival time? 

to Las Vegas, arriving at 6:29pm

To get information, ask a what?-question

Asking questions

So you just say… what are (or what is) and then the thing you want to know about

airline is United, flight number is 1123

United, flight 1123

arrival city is Las Vegas,

what is the arrival time? to Las Vegas, arriving at 6:29pm

To get information, ask a what?-question

Asking questions

So you just say… what is (or what are) and then the thing you want to know about

As another example, you could ask what is the departure gate?

airline is United, flight number is 1123

United, flight 1123

arrival city is Las Vegas, what is the arrival time? 

to Las Vegas, arriving at 6:29pm

Other applications

As with specifying phrases, when you ask questions in other Speech Graffiti systems, the vocabulary is different but the structure is the same theater is the Manor,

movie is Titanic,

what are the show times?

For general Speech Graffiti help, just say helpSpeech Graffiti can also let you know what kinds of things you can talk about in the system you're using just say options

Getting help

optionsyou can specify or ask about airline, flight number, departure airport …

departure airport can be Atlanta, Chicago O'Hare, Detroit …

airline is Delta, departure airport options 

moreLos Angeles, Pittsburgh, or you can ask, what is the departure airport?

The Speech Graffiti system plays this sound that you saw in the last slide when it is telling you about a long list

Whenever you hear this sound, you can say more to hear the next chunk of the listWhen you're browsing a list, you can also navigate through the list by saying next – gives you the next single item previous – gives you the previous chunk first – goes back to the first item in the list last – skips ahead to the last item in the list repeat

Lists…

Practice: questions & helpHow would do the following in Speech Graffiti?

1. find out which airlines are flying to Las Vegas

2. find out all the airlines you can ask about

3. hear the next chunk of a list

How would do the following in Speech Graffiti?

1. find out which airlines are flying to Las Vegas

2. find out all the airlines you can ask about

3. hear the next chunk of a list

Practice: questions & help

arrival city is Las Vegas, what are the airlines?

How would do the following in Speech Graffiti?

1. find out which airlines are flying to Las Vegas

2. find out all the airlines you can ask about

3. hear the next chunk of a list

Practice: questions & help

arrival city is Las Vegas, what are the airlines?

airline options

How would do the following in Speech Graffiti?

1. find out which airlines are flying to Las Vegas

2. find out all the airlines you can ask about

3. hear the next chunk of a list

Practice: questions & help

arrival city is Las Vegas, what are the airlines?

airline options

more

ReviewIn Speech Graffiti, you provide information in phrases & ask what-questions to get info flight number is 102, what is the departure gate?

start over and scratch that help you recover from errors

where was I? lets you know what the system knows

means the system didn’t understand something you said, and means there are more items in a list

!…

HintsWhen you’re using a new application for the first time, say options to learn what you can talk about with that system

Talk to the system in a normal voice

Speech Graffiti remembers what you enter until you say start over see example on next slide

where was I?

departure airport is Denver, what is departure time?, airline is USAirways

USAirways, 5 departure times, 7:05am, 11:50am, 1:35pm …

where was I?

departure airport is Denver, what is departure time?

departure airport is Denver, what are the departure times?

airline is USAir, go ahead

from Denver, 97 departure times: 6:00am, 6:10am, 6:13am …

If the system already has a question stored, saying go ahead will re-ask that question

OK – that's all there is to know about Speech Graffiti! Have fun!

Ready?