32
26-8-99 TUDelf t Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands Dialogue Control in the Alparon System Niels Andeweg

TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Embed Size (px)

Citation preview

Page 1: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

26-8-99

TUDelftKnowledge Based Systems Group

Zuidplantsoen 42628 BZ Delft, The Netherlands

Dialogue Controlin the Alparon System

Niels Andeweg

Page 2: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 2 TUDelft

Information Technology and Systems

Knowledge Based Systems– Artificial Intelligence

Alparon– multi-media– automatic speech processing– dialogue management

Page 3: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 3 TUDelft

Assignment design dialogue control for the Alparon

system implement prototypes of the components

for dialogue control

Page 4: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 4 TUDelft

Contents Automatic speech processing (ASP) Alparon system Dialogue control Train timetable information system Conclusions

Page 5: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 5 TUDelft

Contents Automatic speech processing (ASP) Alparon system Dialogue control Train timetable information system Conclusions

Page 6: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 6 TUDelft

ASP system

dialogue manager

application

speech recognition

speechgeneration

natural languagecomponent

meaning extraction

response generation

Page 7: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 7 TUDelft

Dialogue managementWhy dialogue management? spread out user requirements discourse phenomena

Tasks: provide context problem solving response generation

Page 8: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 8 TUDelft

Contents Automatic speech processing (ASP) Alparon system Dialogue control Train timetable information system Conclusions

Page 9: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 9 TUDelft

Alparon system information retrieval and transaction

services natural language speech interface mixed-initiative focus on dialogue management strategies in human-human dialogues

Page 10: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 10 TUDelft

Alparon model

Text tospeech

Parser CoderSpeech

recognition

Textgeneration

Dialoguemanager

Userinterface

bytelephone

Languageatmosphere

Page 11: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 11 TUDelft

Alparon DM

Task coordinator

Blackboard system

Discourse manager

Databasemanager

Rest of theASP system

Dialogue manager

Page 12: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 12 TUDelft

Discourse Manager

Task coordinator

Disambi-guation

Contextupdating

Referencehandling

QueryResponsegeneration

Dialogueact

generation

Discourse Manager

Page 13: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 13 TUDelft

Blackboard system

Task coordinator

Blackboard system

Informationboard

Statusboard

HistoryBoard

Controlboard

Presentationboard

Page 14: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 14 TUDelft

Contents Automatic speech processing (ASP) Alparon system Dialogue control Train timetable information system Conclusions

Page 15: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 15 TUDelft

Dialogue controlTasks structure dialogue generate responses

Two kinds of information

‘What time does the train to Amsterdam leave?’

Page 16: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 16 TUDelft

Approach task-oriented dialogues plan-based goal structure

– level of abstraction– task & dialogue goals

determine departure station

verify departure station– dynamic

Page 17: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 17 TUDelft

Achievement operations

– deductions– default behaviour

interaction– ‘Departure at 8:30.’– ‘What is your departure station?’

strategy

Page 18: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 18 TUDelft

Implementation framework rulesets

Two steps– determine consequences of user’s turn

dialogue updating module– generate response

response generation module

Java

Page 19: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 19 TUDelft

Dialogue updating moduleProcess effects of user’s turn new information conflicts choices reaction

Page 20: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 20 TUDelft

Response generation moduleGenerate a system response actions candidates combine

Page 21: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 21 TUDelft

Control boardStore information for dialogue control goalstack conflicts choices response

Page 22: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 22 TUDelft

Strategy 1 decomposition

achievementslot Time contains departure time

slot DeparturePlace is verified

communicated

operationscity(Delft) station(Delft)

date = today

CdetermineNeed…..

AdetermineDep, AdetermineArr

…..AdetermineTime, AdetermineDate

Page 23: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 23 TUDelft

Strategy 2 reactions

reconfirmation of departure place reconfirm(DepPlace)

start dialogue ChelpUser

actionsAverify(time) [VerifyExplicit(time), VerifyImplicit(time)]

Adetermine(DepPlace) [Ask(DepPlace), Ask(Where), Encourage)]

combinations– VerifyImplicit(*): {Ask(*)}

Page 24: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 24 TUDelft

Contents Automatic speech processing (ASP) Alparon system Dialogue control Train timetable information system Conclusions

Page 25: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 25 TUDelft

Train timetable information travelplan for train connections mixed-initiative information needed

– departure station– arrival station– departure or arrival time– date

Page 26: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 26 TUDelft

Phases greeting determination of user’s need query presentation further needs goodbye

Page 27: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 27 TUDelft

Example actionsAdetermine(DepPlace): [Ask(DepPlace),

Ask(Place), Encourage]

Adetermine(ArrPlace): [Ask(ArrPlace), Ask(Place), Encourage]

Adetermine(Time): [Ask(DepTime), Ask(Time), Ask(When)]

Adetermine(Date): [Ask(date), Ask(When)]

Averify(*): [VerifyExplicit(*), VerifyImplicit(*)]

Page 28: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 31 TUDelft

Example dialogue 4U4: I want to go to Den

Haag central station.

Gs: Cclose

CfurtherNeeds

Cpresent

Cquery

Adetermine(Time)

Res: Ask(When)

S4: When do you want to travel?

Achoice(*): communicated

Adetermine(ArrPlace):

ArrPlace is station & ArrPlace has user

Adetermine(Time): [Ask(DepTime), Ask(Time), Ask(When)]

Page 29: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 32 TUDelft

Example dialogue 5U5: …???…

Gs: Cclose

CfurtherNeeds

Cpresent

Cquery

Adetermine(Time)

Res: Ask(Time)

S5: At what time do you want to travel?

Adetermine(Time): [Ask(DepTime), Ask(Time), Ask(When)]

Page 30: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 33 TUDelft

Example dialogue 6U6: I want to arrive at half

past nine.

Gs: Cclose

CfurtherNeeds

ApresentPart(3)

ApresentPart(2)

ApresentPart(1)

Res: PresentPart(1)

S6: OK. Departure at 7:35 in Baarn to Utrecht.

Adetermine(Time):

Time is ArrTime(*)

Cquery: [[Aquery]]

Aquery:

true : send(QM, query, empty body, queryDone)

Cpresent: [[ApresentPart(*)]]

ApresentPart(*): [PresentPart(*)]

Page 31: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 40 TUDelft

Contents Automatic speech processing (ASP) Alparon system Dialogue control Train timetable information system Conclusions

Page 32: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

Dialogue Control in the Alparon System 41 TUDelft

Conclusions two modules and a blackboard generic framework with rulesets mixed-initiative reactions adequate rulesets testing with complete system