Embed Size (px)
Citation preview
cse@buff
alo
The GLAIR Cognitive Architecture
Stuart C. Shapiro and Jonathan P. BonaDepartment of Computer Science & Engineering
Center for Cognitive ScienceState University of New York at Buffalo
[email protected]@buffalo.edu
cse@buff
alo
Outline
Overview
Integration of Acting and Reasoning
Symbol Grounding
BICA 2009Shapiro & Bona 2
cse@buff
alo
Grounded Layered Architecture with Integrated Reasoning
• Major Concern:– Knowledge Representation and Reasoning
• Driving Motivation:– Natural Language Understanding & Generation
• Additional Concern:– Agents that act
• Question:– Where do beliefs come from?
• Partial Answer:– Agent’s being embodied– Agent’s being situated in the world
BICA 2009 Shapiro & Bona 3
cse@buff
alo
Shapiro & Bona
BICA 2009 4
KL
PMLa
PMLb
PMLc
SAL
Mind
BodyIndependentof lower-body
implementation
Hearing
Vision
Motion
Speech WORLD
I/P s o c k e t s
GLAIR Architecture
Dependenton lower-bodyimplementation
Proprioception
cse@buff
alo
Sensori-Actuator Layer
• Sensor and effector controllers
BICA 2009Shapiro & Bona 5
cse@buff
alo
Perceptuo-Motor Layer
• PMLa• PMLb• PMLc
BICA 2009Shapiro & Bona 6
cse@buff
alo
PMLc
• Abstracts sensors & effectors• Body’s behavioral repertoire
BICA 2009Shapiro & Bona 7
cse@buff
alo
PMLb
• Translation & Communication– Between PMLa & PMLc
• Highest layer that knows body implementation
BICA 2009Shapiro & Bona 8
cse@buff
alo
PMLa• Grounds KL symbols
– Perceptual structures– Implementation of primitive actions
• Registers for Embodiment & Situatedness– Deictic Registers– Modality Registers
BICA 2009Shapiro & Bona 9
cse@buff
alo
The Knowledge Layer• Implemented in SNePS• Agent’s Beliefs• Representations of conceived of entities• Semantic Memory• Episodic Memory• Quantified & conditional beliefs• Plans for non-primitive acts• Plans to achieve goals• Beliefs re. preconditions & effects of acts• Policies: Conditions for performing acts• Self-knowledge• Meta-knowledge
BICA 2009 Shapiro & Bona 10
cse@buff
alo
Outline
Overview
Integration of Acting and Reasoning
Symbol Grounding
BICA 2009Shapiro & Bona 11
cse@buff
alo
SNePS
• A KRR system• Every non-atomic expression is simultaneously
– An expression of SNePS logic– An assertional frame– A propositional graph
• Every SNePS expression is a term– Denoting a mental entity
BICA 2009Shapiro & Bona 12
cse@buff
alo
Ontology of Mental Entities• Entity
– PropositionAgent can believe it or its negationIncludes quantified & conditional beliefs
– ActAgent can perform it
– PolicyCondition-act rule agent can adopt
– ThingOther entities: individuals, categories, properties, etc.
BICA 2009Shapiro & Bona 13
cse@buff
alo
PoliciesReasoning Acting
• Forward Reasoningwhendo(φ, α)wheneverdo(φ, α)
• Backward Reasoningifdo(φ, α)
BICA 2009Shapiro & Bona 14
cse@buff
alo
Types of Acts I• External Acts
affect the environmentsupplied by agent designer
• Mental Actsaffect the knowledge layerbelieve, disbelieveadopt, unadopt
• Control Actssequence, selection, loop, etc.
BICA 2009 Shapiro & Bona 15
cse@buff
alo
Types of Acts II
• Primitive ActsImplemented in PMLa
• Composite ActsStructured by control acts
• Defined ActsDefined by ActPlan(α, p) belief
BICA 2009Shapiro & Bona 16
cse@buff
alo
Acting ReasoningControl Acts
snif({if(φ1, α1), …, if(φn, αn), [else(δ)]})
sniterate({if(φ1, α1), …, if(φn, αn), [else(δ)]})
withsome(x, φ(x), α(x), [δ])
withall(x, φ(x), α(x), [δ])
BICA 2009Shapiro & Bona 17
cse@buff
alo
Goal Talk
GoalPlan(φ, p)
achieve(φ)
BICA 2009Shapiro & Bona 18
cse@buff
alo
Shapiro & Bona
Behavior CycleEnglish
(Statement, Question, Command) (Current) Set of Beliefs
(Updated) Setof Beliefs
Actions(New Belief)
English sentence expressingnew belief answering question reporting actions
Answer
NL Analysis
NL Generation
ReasoningClarification DialogueLooking in World
Reasoning
BICA 200919
cse@buff
alo
Outline
Overview
Integration of Acting and Reasoning
Symbol Grounding
BICA 2009Shapiro & Bona 20
cse@buff
alo
Shapiro & Bona
Entities, Terms, Symbols, Objects
• Agent’s mental entity: a person named Stu
• SNePS term: B4
• Object in world:
21BICA 2009
cse@buff
alo
Shapiro & Bona
AlignmentMind (KL)
Body (PML/SAL)
World
KL term
PML structure
Object/Phenomenon Action
BICA 2009 22
cse@buff
alo
Deictic Registers
For being situated in the worldPML registers hold KL terms
I term denoting agentYOU term denoting dialogue partnerNOW term denoting current time
BICA 2009Shapiro & Bona 23
cse@buff
alo
Modality Registers
For privileged first-person knowledge of what agent is doing
Register for each modality holdsKL term denoting act modality is engaged in
BICA 2009Shapiro & Bona 24
cse@buff
alo
Building Episodic Memory
BICA 2009Shapiro & Bona 25
KL
PML
e1
I
a1 b1
!
t1 e2
a2
!
t2
!
NOW
COUNT n
hom0
q!
before afterevent eventtime
time
time
act act
agent
agent
duration
ACT
cse@buff
alo
For More DetailsSee the Paper
BICA 2009 Shapiro & Bona 26
cse@buff
alo
BICA 2009Shapiro & Bona 27
Collaborators
Past and present members ofSNeRG: The SNePS Research Grouphttp://www.cse.buffalo.edu/sneps/
