Upload
jamal-reddan
View
213
Download
0
Tags:
Embed Size (px)
Citation preview
26-8-99
TUDelftKnowledge Based Systems Group
Zuidplantsoen 42628 BZ Delft, The Netherlands
Dialogue Controlin the Alparon System
Niels Andeweg
Dialogue Control in the Alparon System 2 TUDelft
Information Technology and Systems
Knowledge Based Systems– Artificial Intelligence
Alparon– multi-media– automatic speech processing– dialogue management
Dialogue Control in the Alparon System 3 TUDelft
Assignment design dialogue control for the Alparon
system implement prototypes of the components
for dialogue control
Dialogue Control in the Alparon System 4 TUDelft
Contents Automatic speech processing (ASP) Alparon system Dialogue control Train timetable information system Conclusions
Dialogue Control in the Alparon System 5 TUDelft
Contents Automatic speech processing (ASP) Alparon system Dialogue control Train timetable information system Conclusions
Dialogue Control in the Alparon System 6 TUDelft
ASP system
dialogue manager
application
speech recognition
speechgeneration
natural languagecomponent
meaning extraction
response generation
Dialogue Control in the Alparon System 7 TUDelft
Dialogue managementWhy dialogue management? spread out user requirements discourse phenomena
Tasks: provide context problem solving response generation
Dialogue Control in the Alparon System 8 TUDelft
Contents Automatic speech processing (ASP) Alparon system Dialogue control Train timetable information system Conclusions
Dialogue Control in the Alparon System 9 TUDelft
Alparon system information retrieval and transaction
services natural language speech interface mixed-initiative focus on dialogue management strategies in human-human dialogues
Dialogue Control in the Alparon System 10 TUDelft
Alparon model
Text tospeech
Parser CoderSpeech
recognition
Textgeneration
Dialoguemanager
Userinterface
bytelephone
Languageatmosphere
Dialogue Control in the Alparon System 11 TUDelft
Alparon DM
Task coordinator
Blackboard system
Discourse manager
Databasemanager
Rest of theASP system
Dialogue manager
Dialogue Control in the Alparon System 12 TUDelft
Discourse Manager
Task coordinator
Disambi-guation
Contextupdating
Referencehandling
QueryResponsegeneration
Dialogueact
generation
Discourse Manager
Dialogue Control in the Alparon System 13 TUDelft
Blackboard system
Task coordinator
Blackboard system
Informationboard
Statusboard
HistoryBoard
Controlboard
Presentationboard
Dialogue Control in the Alparon System 14 TUDelft
Contents Automatic speech processing (ASP) Alparon system Dialogue control Train timetable information system Conclusions
Dialogue Control in the Alparon System 15 TUDelft
Dialogue controlTasks structure dialogue generate responses
Two kinds of information
‘What time does the train to Amsterdam leave?’
Dialogue Control in the Alparon System 16 TUDelft
Approach task-oriented dialogues plan-based goal structure
– level of abstraction– task & dialogue goals
determine departure station
verify departure station– dynamic
Dialogue Control in the Alparon System 17 TUDelft
Achievement operations
– deductions– default behaviour
interaction– ‘Departure at 8:30.’– ‘What is your departure station?’
strategy
Dialogue Control in the Alparon System 18 TUDelft
Implementation framework rulesets
Two steps– determine consequences of user’s turn
dialogue updating module– generate response
response generation module
Java
Dialogue Control in the Alparon System 19 TUDelft
Dialogue updating moduleProcess effects of user’s turn new information conflicts choices reaction
Dialogue Control in the Alparon System 20 TUDelft
Response generation moduleGenerate a system response actions candidates combine
Dialogue Control in the Alparon System 21 TUDelft
Control boardStore information for dialogue control goalstack conflicts choices response
Dialogue Control in the Alparon System 22 TUDelft
Strategy 1 decomposition
achievementslot Time contains departure time
slot DeparturePlace is verified
communicated
operationscity(Delft) station(Delft)
date = today
CdetermineNeed…..
AdetermineDep, AdetermineArr
…..AdetermineTime, AdetermineDate
Dialogue Control in the Alparon System 23 TUDelft
Strategy 2 reactions
reconfirmation of departure place reconfirm(DepPlace)
start dialogue ChelpUser
actionsAverify(time) [VerifyExplicit(time), VerifyImplicit(time)]
Adetermine(DepPlace) [Ask(DepPlace), Ask(Where), Encourage)]
combinations– VerifyImplicit(*): {Ask(*)}
Dialogue Control in the Alparon System 24 TUDelft
Contents Automatic speech processing (ASP) Alparon system Dialogue control Train timetable information system Conclusions
Dialogue Control in the Alparon System 25 TUDelft
Train timetable information travelplan for train connections mixed-initiative information needed
– departure station– arrival station– departure or arrival time– date
Dialogue Control in the Alparon System 26 TUDelft
Phases greeting determination of user’s need query presentation further needs goodbye
Dialogue Control in the Alparon System 27 TUDelft
Example actionsAdetermine(DepPlace): [Ask(DepPlace),
Ask(Place), Encourage]
Adetermine(ArrPlace): [Ask(ArrPlace), Ask(Place), Encourage]
Adetermine(Time): [Ask(DepTime), Ask(Time), Ask(When)]
Adetermine(Date): [Ask(date), Ask(When)]
Averify(*): [VerifyExplicit(*), VerifyImplicit(*)]
Dialogue Control in the Alparon System 31 TUDelft
Example dialogue 4U4: I want to go to Den
Haag central station.
Gs: Cclose
CfurtherNeeds
Cpresent
Cquery
Adetermine(Time)
Res: Ask(When)
S4: When do you want to travel?
Achoice(*): communicated
Adetermine(ArrPlace):
ArrPlace is station & ArrPlace has user
Adetermine(Time): [Ask(DepTime), Ask(Time), Ask(When)]
Dialogue Control in the Alparon System 32 TUDelft
Example dialogue 5U5: …???…
Gs: Cclose
CfurtherNeeds
Cpresent
Cquery
Adetermine(Time)
Res: Ask(Time)
S5: At what time do you want to travel?
Adetermine(Time): [Ask(DepTime), Ask(Time), Ask(When)]
Dialogue Control in the Alparon System 33 TUDelft
Example dialogue 6U6: I want to arrive at half
past nine.
Gs: Cclose
CfurtherNeeds
ApresentPart(3)
ApresentPart(2)
ApresentPart(1)
Res: PresentPart(1)
S6: OK. Departure at 7:35 in Baarn to Utrecht.
Adetermine(Time):
Time is ArrTime(*)
Cquery: [[Aquery]]
Aquery:
true : send(QM, query, empty body, queryDone)
Cpresent: [[ApresentPart(*)]]
ApresentPart(*): [PresentPart(*)]
Dialogue Control in the Alparon System 40 TUDelft
Contents Automatic speech processing (ASP) Alparon system Dialogue control Train timetable information system Conclusions
Dialogue Control in the Alparon System 41 TUDelft
Conclusions two modules and a blackboard generic framework with rulesets mixed-initiative reactions adequate rulesets testing with complete system