Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of...

cse@buff

alo

The GLAIR Cognitive Architecture

Stuart C. Shapiro and Jonathan P. BonaDepartment of Computer Science & Engineering

Center for Cognitive ScienceState University of New York at Buffalo

shapiro@buffalo.edujpbona@buffalo.edu

cse@buff

alo

Outline

Overview

Integration of Acting and Reasoning

Symbol Grounding

BICA 2009Shapiro & Bona 2

cse@buff

alo

Grounded Layered Architecture with Integrated Reasoning

• Major Concern:– Knowledge Representation and Reasoning

• Driving Motivation:– Natural Language Understanding & Generation

• Additional Concern:– Agents that act

• Question:– Where do beliefs come from?

• Partial Answer:– Agent’s being embodied– Agent’s being situated in the world

BICA 2009 Shapiro & Bona 3

cse@buff

alo

Shapiro & Bona

BICA 2009 4

KL

PMLa

PMLb

PMLc

SAL

Mind

BodyIndependentof lower-body

implementation

Hearing

Vision

Motion

Speech WORLD

I/P s o c k e t s

GLAIR Architecture

Dependenton lower-bodyimplementation

Proprioception

cse@buff

alo

Sensori-Actuator Layer

• Sensor and effector controllers

BICA 2009Shapiro & Bona 5

cse@buff

alo

Perceptuo-Motor Layer

• PMLa• PMLb• PMLc

BICA 2009Shapiro & Bona 6

cse@buff

alo

PMLc

• Abstracts sensors & effectors• Body’s behavioral repertoire

BICA 2009Shapiro & Bona 7

cse@buff

alo

PMLb

• Translation & Communication– Between PMLa & PMLc

• Highest layer that knows body implementation

BICA 2009Shapiro & Bona 8

cse@buff

alo

PMLa• Grounds KL symbols

– Perceptual structures– Implementation of primitive actions

• Registers for Embodiment & Situatedness– Deictic Registers– Modality Registers

BICA 2009Shapiro & Bona 9

cse@buff

alo

The Knowledge Layer• Implemented in SNePS• Agent’s Beliefs• Representations of conceived of entities• Semantic Memory• Episodic Memory• Quantified & conditional beliefs• Plans for non-primitive acts• Plans to achieve goals• Beliefs re. preconditions & effects of acts• Policies: Conditions for performing acts• Self-knowledge• Meta-knowledge

BICA 2009 Shapiro & Bona 10

cse@buff

alo

Outline

Overview

Integration of Acting and Reasoning

Symbol Grounding

BICA 2009Shapiro & Bona 11

cse@buff

alo

SNePS

• A KRR system• Every non-atomic expression is simultaneously

– An expression of SNePS logic– An assertional frame– A propositional graph

• Every SNePS expression is a term– Denoting a mental entity

BICA 2009Shapiro & Bona 12

cse@buff

alo

Ontology of Mental Entities• Entity

– PropositionAgent can believe it or its negationIncludes quantified & conditional beliefs

– ActAgent can perform it

– PolicyCondition-act rule agent can adopt

– ThingOther entities: individuals, categories, properties, etc.

BICA 2009Shapiro & Bona 13

cse@buff

alo

PoliciesReasoning Acting

• Forward Reasoningwhendo(φ, α)wheneverdo(φ, α)

• Backward Reasoningifdo(φ, α)

BICA 2009Shapiro & Bona 14

cse@buff

alo

Types of Acts I• External Acts

affect the environmentsupplied by agent designer

• Mental Actsaffect the knowledge layerbelieve, disbelieveadopt, unadopt

• Control Actssequence, selection, loop, etc.

BICA 2009 Shapiro & Bona 15

cse@buff

alo

Types of Acts II

• Primitive ActsImplemented in PMLa

• Composite ActsStructured by control acts

• Defined ActsDefined by ActPlan(α, p) belief

BICA 2009Shapiro & Bona 16

cse@buff

alo

Acting ReasoningControl Acts

snif({if(φ1, α1), …, if(φn, αn), [else(δ)]})

sniterate({if(φ1, α1), …, if(φn, αn), [else(δ)]})

withsome(x, φ(x), α(x), [δ])

withall(x, φ(x), α(x), [δ])

BICA 2009Shapiro & Bona 17

cse@buff

alo

Goal Talk

GoalPlan(φ, p)

achieve(φ)

BICA 2009Shapiro & Bona 18

cse@buff

alo

Shapiro & Bona

Behavior CycleEnglish

(Statement, Question, Command) (Current) Set of Beliefs

(Updated) Setof Beliefs

Actions(New Belief)

English sentence expressingnew belief answering question reporting actions

Answer

NL Analysis

NL Generation

ReasoningClarification DialogueLooking in World

Reasoning

BICA 200919

cse@buff

alo

Outline

Overview

Integration of Acting and Reasoning

Symbol Grounding

BICA 2009Shapiro & Bona 20

cse@buff

alo

Shapiro & Bona

Entities, Terms, Symbols, Objects

• Agent’s mental entity: a person named Stu

• SNePS term: B4

• Object in world:

21BICA 2009

cse@buff

alo

Shapiro & Bona

AlignmentMind (KL)

Body (PML/SAL)

World

KL term

PML structure

Object/Phenomenon Action

BICA 2009 22

cse@buff

alo

Deictic Registers

For being situated in the worldPML registers hold KL terms

I term denoting agentYOU term denoting dialogue partnerNOW term denoting current time

BICA 2009Shapiro & Bona 23

cse@buff

alo

Modality Registers

For privileged first-person knowledge of what agent is doing

Register for each modality holdsKL term denoting act modality is engaged in

BICA 2009Shapiro & Bona 24

cse@buff

alo

Building Episodic Memory

BICA 2009Shapiro & Bona 25

KL

PML

e1

I

a1 b1

!

t1 e2

a2

!

t2

!

NOW

COUNT n

hom0

q!

before afterevent eventtime

time

time

act act

agent

agent

duration

ACT

cse@buff

alo

For More DetailsSee the Paper

BICA 2009 Shapiro & Bona 26

cse@buff

alo

BICA 2009Shapiro & Bona 27

Collaborators

Past and present members ofSNeRG: The SNePS Research Grouphttp://www.cse.buffalo.edu/sneps/