TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99...

Preview:

Citation preview

26-8-99

TUDelftKnowledge Based Systems Group

Zuidplantsoen 42628 BZ Delft, The Netherlands

Dialogue Controlin the Alparon System

Niels Andeweg

Dialogue Control in the Alparon System 2 TUDelft

Information Technology and Systems

Knowledge Based Systems– Artificial Intelligence

Alparon– multi-media– automatic speech processing– dialogue management

Dialogue Control in the Alparon System 3 TUDelft

Assignment design dialogue control for the Alparon

system implement prototypes of the components

for dialogue control

Dialogue Control in the Alparon System 4 TUDelft

Contents Automatic speech processing (ASP) Alparon system Dialogue control Train timetable information system Conclusions

Dialogue Control in the Alparon System 5 TUDelft

Contents Automatic speech processing (ASP) Alparon system Dialogue control Train timetable information system Conclusions

Dialogue Control in the Alparon System 6 TUDelft

ASP system

dialogue manager

application

speech recognition

speechgeneration

natural languagecomponent

meaning extraction

response generation

Dialogue Control in the Alparon System 7 TUDelft

Dialogue managementWhy dialogue management? spread out user requirements discourse phenomena

Tasks: provide context problem solving response generation

Dialogue Control in the Alparon System 8 TUDelft

Contents Automatic speech processing (ASP) Alparon system Dialogue control Train timetable information system Conclusions

Dialogue Control in the Alparon System 9 TUDelft

Alparon system information retrieval and transaction

services natural language speech interface mixed-initiative focus on dialogue management strategies in human-human dialogues

Dialogue Control in the Alparon System 10 TUDelft

Alparon model

Text tospeech

Parser CoderSpeech

recognition

Textgeneration

Dialoguemanager

Userinterface

bytelephone

Languageatmosphere

Dialogue Control in the Alparon System 11 TUDelft

Alparon DM

Task coordinator

Blackboard system

Discourse manager

Databasemanager

Rest of theASP system

Dialogue manager

Dialogue Control in the Alparon System 12 TUDelft

Discourse Manager

Task coordinator

Disambi-guation

Contextupdating

Referencehandling

QueryResponsegeneration

Dialogueact

generation

Discourse Manager

Dialogue Control in the Alparon System 13 TUDelft

Blackboard system

Task coordinator

Blackboard system

Informationboard

Statusboard

HistoryBoard

Controlboard

Presentationboard

Dialogue Control in the Alparon System 14 TUDelft

Contents Automatic speech processing (ASP) Alparon system Dialogue control Train timetable information system Conclusions

Dialogue Control in the Alparon System 15 TUDelft

Dialogue controlTasks structure dialogue generate responses

Two kinds of information

‘What time does the train to Amsterdam leave?’

Dialogue Control in the Alparon System 16 TUDelft

Approach task-oriented dialogues plan-based goal structure

– level of abstraction– task & dialogue goals

determine departure station

verify departure station– dynamic

Dialogue Control in the Alparon System 17 TUDelft

Achievement operations

– deductions– default behaviour

interaction– ‘Departure at 8:30.’– ‘What is your departure station?’

strategy

Dialogue Control in the Alparon System 18 TUDelft

Implementation framework rulesets

Two steps– determine consequences of user’s turn

dialogue updating module– generate response

response generation module

Java

Dialogue Control in the Alparon System 19 TUDelft

Dialogue updating moduleProcess effects of user’s turn new information conflicts choices reaction

Dialogue Control in the Alparon System 20 TUDelft

Response generation moduleGenerate a system response actions candidates combine

Dialogue Control in the Alparon System 21 TUDelft

Control boardStore information for dialogue control goalstack conflicts choices response

Dialogue Control in the Alparon System 22 TUDelft

Strategy 1 decomposition

achievementslot Time contains departure time

slot DeparturePlace is verified

communicated

operationscity(Delft) station(Delft)

date = today

CdetermineNeed…..

AdetermineDep, AdetermineArr

…..AdetermineTime, AdetermineDate

Dialogue Control in the Alparon System 23 TUDelft

Strategy 2 reactions

reconfirmation of departure place reconfirm(DepPlace)

start dialogue ChelpUser

actionsAverify(time) [VerifyExplicit(time), VerifyImplicit(time)]

Adetermine(DepPlace) [Ask(DepPlace), Ask(Where), Encourage)]

combinations– VerifyImplicit(*): {Ask(*)}

Dialogue Control in the Alparon System 24 TUDelft

Contents Automatic speech processing (ASP) Alparon system Dialogue control Train timetable information system Conclusions

Dialogue Control in the Alparon System 25 TUDelft

Train timetable information travelplan for train connections mixed-initiative information needed

– departure station– arrival station– departure or arrival time– date

Dialogue Control in the Alparon System 26 TUDelft

Phases greeting determination of user’s need query presentation further needs goodbye

Dialogue Control in the Alparon System 27 TUDelft

Example actionsAdetermine(DepPlace): [Ask(DepPlace),

Ask(Place), Encourage]

Adetermine(ArrPlace): [Ask(ArrPlace), Ask(Place), Encourage]

Adetermine(Time): [Ask(DepTime), Ask(Time), Ask(When)]

Adetermine(Date): [Ask(date), Ask(When)]

Averify(*): [VerifyExplicit(*), VerifyImplicit(*)]

Dialogue Control in the Alparon System 31 TUDelft

Example dialogue 4U4: I want to go to Den

Haag central station.

Gs: Cclose

CfurtherNeeds

Cpresent

Cquery

Adetermine(Time)

Res: Ask(When)

S4: When do you want to travel?

Achoice(*): communicated

Adetermine(ArrPlace):

ArrPlace is station & ArrPlace has user

Adetermine(Time): [Ask(DepTime), Ask(Time), Ask(When)]

Dialogue Control in the Alparon System 32 TUDelft

Example dialogue 5U5: …???…

Gs: Cclose

CfurtherNeeds

Cpresent

Cquery

Adetermine(Time)

Res: Ask(Time)

S5: At what time do you want to travel?

Adetermine(Time): [Ask(DepTime), Ask(Time), Ask(When)]

Dialogue Control in the Alparon System 33 TUDelft

Example dialogue 6U6: I want to arrive at half

past nine.

Gs: Cclose

CfurtherNeeds

ApresentPart(3)

ApresentPart(2)

ApresentPart(1)

Res: PresentPart(1)

S6: OK. Departure at 7:35 in Baarn to Utrecht.

Adetermine(Time):

Time is ArrTime(*)

Cquery: [[Aquery]]

Aquery:

true : send(QM, query, empty body, queryDone)

Cpresent: [[ApresentPart(*)]]

ApresentPart(*): [PresentPart(*)]

Dialogue Control in the Alparon System 40 TUDelft

Contents Automatic speech processing (ASP) Alparon system Dialogue control Train timetable information system Conclusions

Dialogue Control in the Alparon System 41 TUDelft

Conclusions two modules and a blackboard generic framework with rulesets mixed-initiative reactions adequate rulesets testing with complete system

Recommended