26
Connecting Brain, Connecting Brain, Purpose & Language: Purpose & Language: Understanding Language Understanding Language Behavior Behavior as the Control of as the Control of Perception Perception Gary A. Cziko Gary A. Cziko University of Illinois at Urbana- University of Illinois at Urbana- Champaign Champaign [email protected] [email protected] ; garycziko.net ; garycziko.net

Connecting Brain, Purpose & Language: Understanding Language Behavior as the Control of Perception Gary A. Cziko University of Illinois at Urbana-Champaign

Embed Size (px)

Citation preview

Page 1: Connecting Brain, Purpose & Language: Understanding Language Behavior as the Control of Perception Gary A. Cziko University of Illinois at Urbana-Champaign

Connecting Brain, Purpose & Connecting Brain, Purpose & Language:Language:

Understanding Language Understanding Language BehaviorBehavior

as the Control of Perceptionas the Control of PerceptionGary A. CzikoGary A. Cziko

University of Illinois at Urbana-University of Illinois at Urbana-ChampaignChampaign

[email protected]@uiuc.edu; garycziko.net; garycziko.net

Page 2: Connecting Brain, Purpose & Language: Understanding Language Behavior as the Control of Perception Gary A. Cziko University of Illinois at Urbana-Champaign

(start recording)(start recording)

Page 3: Connecting Brain, Purpose & Language: Understanding Language Behavior as the Control of Perception Gary A. Cziko University of Illinois at Urbana-Champaign

Apologies Apologies (5)(5)

1.1. Not a brain or neuroscientistNot a brain or neuroscientist

2.2. Will not summarize or synthesize Will not summarize or synthesize findings from neural sciencefindings from neural science

3.3. Theory and computer simulations I will Theory and computer simulations I will present are not my own (Wm. T. Powers)present are not my own (Wm. T. Powers)

4.4. Relativity little research has been done Relativity little research has been done to support theory and arguments I will to support theory and arguments I will makemake

5.5. Don’t have fancy PowerPoint slidesDon’t have fancy PowerPoint slides

Page 4: Connecting Brain, Purpose & Language: Understanding Language Behavior as the Control of Perception Gary A. Cziko University of Illinois at Urbana-Champaign

Excuses Excuses (3)(3)

1.1. Am interested in biological bases of Am interested in biological bases of complex human behavior: education & complex human behavior: education & languagelanguage

• Without Miracles (1995): DarwinianWithout Miracles (1995): Darwinian• The Things We Do (2000): BernardianThe Things We Do (2000): Bernardian

2.2. Will share with you a fundamental Will share with you a fundamental building block for understanding how building block for understanding how mind might be created from neuronsmind might be created from neurons

3.3. Will do some research, simulations and Will do some research, simulations and data analysis with you to demonstrate data analysis with you to demonstrate some behavioral phenomena and their some behavioral phenomena and their possible underlying neural basispossible underlying neural basis

Page 5: Connecting Brain, Purpose & Language: Understanding Language Behavior as the Control of Perception Gary A. Cziko University of Illinois at Urbana-Champaign

Goals of presentation Goals of presentation (4)(4)

1.1. Explain how we can get human language from Explain how we can get human language from neurons (in well under an hour!)neurons (in well under an hour!)

2.2. Provide a different perspective on behaviorProvide a different perspective on behavior• Neither behavioristic (S-R)Neither behavioristic (S-R)

nor cognitive (S-O-R) (lineal A -> B causality)nor cognitive (S-O-R) (lineal A -> B causality)• Behavior as purposeful (circular causality)Behavior as purposeful (circular causality)

3.3. Offer preliminary implications for understanding Offer preliminary implications for understanding language and its underlying neural basislanguage and its underlying neural basis

4.4. How we might get mind from neuronsHow we might get mind from neurons• From the simplest unit of perception, thought & From the simplest unit of perception, thought &

behavior to the highest form of human perception, behavior to the highest form of human perception, thought & behaviorthought & behavior

Page 6: Connecting Brain, Purpose & Language: Understanding Language Behavior as the Control of Perception Gary A. Cziko University of Illinois at Urbana-Champaign

““Presence of mentality”Presence of mentality”(read-along quote)(read-along quote)

““The pursuance of future ends and theThe pursuance of future ends and the choice of means for their attainment are …choice of means for their attainment are … the mark and criterion of the presence ofthe mark and criterion of the presence of mentality in a phenomenon. We impute nomentality in a phenomenon. We impute no mentality to sticks and stones, because theymentality to sticks and stones, because they never seem to move for the sake of anything,never seem to move for the sake of anything, but always when pushed, and then but always when pushed, and then

indifferentlyindifferently and with no sign of choice. So we and with no sign of choice. So we

unhesitatinglyunhesitatingly call them senseless.”call them senseless.” --Wm. James, 1890 (American psychologist)--Wm. James, 1890 (American psychologist)

Page 7: Connecting Brain, Purpose & Language: Understanding Language Behavior as the Control of Perception Gary A. Cziko University of Illinois at Urbana-Champaign

Behavior demonstratingBehavior demonstrating“presence of mind”“presence of mind”

The rubber-band demo The rubber-band demo

What is the subject doing?What is the subject doing?

Page 8: Connecting Brain, Purpose & Language: Understanding Language Behavior as the Control of Perception Gary A. Cziko University of Illinois at Urbana-Champaign

Computerized Rubber-Computerized Rubber-Band DemoBand Demo Powers’ computer demo of Powers’ computer demo of

compensatory tracking (Demo 1; compensatory tracking (Demo 1; Step F)Step F)– Correlation between (visible) Cursor Correlation between (visible) Cursor

and Handle (S-R)and Handle (S-R)– Correlation between (invisible) Correlation between (invisible)

Disturbance and HandleDisturbance and Handle

Page 9: Connecting Brain, Purpose & Language: Understanding Language Behavior as the Control of Perception Gary A. Cziko University of Illinois at Urbana-Champaign

Towards a modelTowards a model(read-along quote)(read-along quote)

““What we have is a circuit, not an arc orWhat we have is a circuit, not an arc or broken segment of a circle. This circuit is morebroken segment of a circle. This circuit is more truly termed organic than reflex, because thetruly termed organic than reflex, because the motor response determines the stimulus, just asmotor response determines the stimulus, just as truly as sensory stimulus determines movement. truly as sensory stimulus determines movement. Indeed, the movement is only for the sake ofIndeed, the movement is only for the sake of determining the stimulus, of fixing what kind ofdetermining the stimulus, of fixing what kind of a stimulus it is . . .”a stimulus it is . . .” --John Dewey, 1986 (American psychologist & --John Dewey, 1986 (American psychologist &

educator)educator)

Page 10: Connecting Brain, Purpose & Language: Understanding Language Behavior as the Control of Perception Gary A. Cziko University of Illinois at Urbana-Champaign

A model of A model of “compensatory “compensatory tracking”tracking” Demo 2; Step G; “closing the Demo 2; Step G; “closing the

loop”loop”– Explain componentsExplain components– Behavior with open loopBehavior with open loop– Close loopClose loop– Vary reference level (purpose)Vary reference level (purpose)

StepStep ContinuouslyContinuously

Page 11: Connecting Brain, Purpose & Language: Understanding Language Behavior as the Control of Perception Gary A. Cziko University of Illinois at Urbana-Champaign
Page 12: Connecting Brain, Purpose & Language: Understanding Language Behavior as the Control of Perception Gary A. Cziko University of Illinois at Urbana-Champaign

Characteristics ofCharacteristics ofPerceptual ControlPerceptual Control

Provides a model of purposeful (intentional) behaviorProvides a model of purposeful (intentional) behavior– Internal reference level (goal, purpose, objective, intention) Internal reference level (goal, purpose, objective, intention)

essentialessential Perception (“stimulus”) affects behavior (“response”) AND Perception (“stimulus”) affects behavior (“response”) AND

behavior affects perceptionbehavior affects perception– Circular rather than lineal (one-way) causationCircular rather than lineal (one-way) causation

Perceptual control shown by LOW correlation between Perceptual control shown by LOW correlation between perception (“input”) and behavior (“output”)perception (“input”) and behavior (“output”)– Test of the “controlled variable”Test of the “controlled variable”

Behavior understood as a means of controlling perceptionBehavior understood as a means of controlling perception– Not vice versa as in both behaviorism(S -> R) & cognitive Not vice versa as in both behaviorism(S -> R) & cognitive

psychology (S -> O -> R)psychology (S -> O -> R)– No clear “independent” or “dependent” variableNo clear “independent” or “dependent” variable– Circular not straight line (lineal) causalityCircular not straight line (lineal) causality

Page 13: Connecting Brain, Purpose & Language: Understanding Language Behavior as the Control of Perception Gary A. Cziko University of Illinois at Urbana-Champaign

A Hierarchy of Perceptual A Hierarchy of Perceptual Control Control (3)(3)

1.1. More complex behavior seen as control More complex behavior seen as control of more complex perceptionsof more complex perceptions

2.2. Inputs from lower-level perceptions Inputs from lower-level perceptions combined to form higher-level combined to form higher-level perceptionsperceptions

• not new, e.g, complex cells, neural netsnot new, e.g, complex cells, neural nets

3.3. Outputs from higher levels sent to levels Outputs from higher levels sent to levels as reference levels (goals, purpose)as reference levels (goals, purpose)

• newnew

Page 14: Connecting Brain, Purpose & Language: Understanding Language Behavior as the Control of Perception Gary A. Cziko University of Illinois at Urbana-Champaign
Page 15: Connecting Brain, Purpose & Language: Understanding Language Behavior as the Control of Perception Gary A. Cziko University of Illinois at Urbana-Champaign

Demonstration of HierarchyDemonstration of Hierarchy

Volunteer maintains arm parallel to groundVolunteer maintains arm parallel to ground Told to drop arm to side when hand pushed from Told to drop arm to side when hand pushed from

aboveabove Predictions?Predictions?

Change in reference level from horizontal to verticalChange in reference level from horizontal to vertical Lower level will perceive push before upper level Lower level will perceive push before upper level

perceives it and is able to change the reference level perceives it and is able to change the reference level for the lower systemfor the lower system

Watch what happens!Watch what happens!

Page 16: Connecting Brain, Purpose & Language: Understanding Language Behavior as the Control of Perception Gary A. Cziko University of Illinois at Urbana-Champaign

The Whys and Hows of The Whys and Hows of Behavior Behavior (2)(2)

1.1. Answers to “why” questions about Answers to “why” questions about behavior found by going up to higher-behavior found by going up to higher-level perceptual control systemslevel perceptual control systems

• Why am I saying these sentences right now?Why am I saying these sentences right now?

2.2. Answers to “how” questions about Answers to “how” questions about behavior found by going down to lower-behavior found by going down to lower-level perceptual control systemslevel perceptual control systems

• How am I saying these sentences right now?How am I saying these sentences right now?

Page 17: Connecting Brain, Purpose & Language: Understanding Language Behavior as the Control of Perception Gary A. Cziko University of Illinois at Urbana-Champaign

Applications of PCT to Applications of PCT to Language Language (4)(4)

1.1. Language behavior is purposeful, Language behavior is purposeful, intentional, functional, goal-directedintentional, functional, goal-directed

2.2. Provides a social means of controlling Provides a social means of controlling one’s perceptionone’s perception

3.3. Language is hierarchicalLanguage is hierarchical• auditory intensities > phonetic features > auditory intensities > phonetic features >

phonemes > morphemes > lexemes > phonemes > morphemes > lexemes > phrases > clauses > discoursephrases > clauses > discourse

• Hierarchy of control from articulation to Hierarchy of control from articulation to pragmaticspragmatics

4.4. Language behavior is usually successful Language behavior is usually successful despite many disturbances (e.g., despite many disturbances (e.g., environmental noise; objects in mouth)environmental noise; objects in mouth)

Page 18: Connecting Brain, Purpose & Language: Understanding Language Behavior as the Control of Perception Gary A. Cziko University of Illinois at Urbana-Champaign

PCT provides a particular form PCT provides a particular form of a connectionist model of a connectionist model (3)(3)

1.1. Circular perceptual control systems Circular perceptual control systems arranged hierarchicallyarranged hierarchically

2.2. Neurons can compute (perceptrons) Neurons can compute (perceptrons) and transmit information (senory and transmit information (senory and motor systems)and motor systems)

3.3. Neurons can act as a comparators Neurons can act as a comparators (using inhibitory and excitatory (using inhibitory and excitatory synapses)synapses)

Page 19: Connecting Brain, Purpose & Language: Understanding Language Behavior as the Control of Perception Gary A. Cziko University of Illinois at Urbana-Champaign

PCT provides an architecture PCT provides an architecture for research & discovery for research & discovery (4)(4)

1.1. Sensory (afferent) systems combining Sensory (afferent) systems combining signals from lower levelssignals from lower levels

2.2. Motor (efferent) systems sending Motor (efferent) systems sending reference levels to lower-level reference levels to lower-level comparators (desired perceptions, not comparators (desired perceptions, not motor commands)motor commands)

3.3. Comparators (comparing upper-level Comparators (comparing upper-level outputs with lower-level inputs, with outputs with lower-level inputs, with difference sent as reference level to difference sent as reference level to lower level)lower level)

4.4. Evidence of control: behavioral and Evidence of control: behavioral and neural (controlled variable)neural (controlled variable)

Page 20: Connecting Brain, Purpose & Language: Understanding Language Behavior as the Control of Perception Gary A. Cziko University of Illinois at Urbana-Champaign

Conclusions Conclusions (3)(3)

1.1. Advances in neurosciences are providing Advances in neurosciences are providing details at the micro leveldetails at the micro level

2.2. An understanding of behavior as the control An understanding of behavior as the control of perception provides a macro framework of perception provides a macro framework for understanding the micro-level detailsfor understanding the micro-level details

3.3. Combining the two Combining the two provides new important provides new important insights into the connections among brain, insights into the connections among brain, behavior, language and human purposesbehavior, language and human purposes

• i.e., how mind (and mindful behavior) might be i.e., how mind (and mindful behavior) might be constructed from neuronsconstructed from neurons

Page 21: Connecting Brain, Purpose & Language: Understanding Language Behavior as the Control of Perception Gary A. Cziko University of Illinois at Urbana-Champaign

ResourcesResources Powers, W. T. (1973). Powers, W. T. (1973). Behavior: The control Behavior: The control

of perceptionof perception. Chicago: Aldine de Gruyter.. Chicago: Aldine de Gruyter. Gary Cziko’s books (full text online via Gary Cziko’s books (full text online via

garycziko.net)garycziko.net)– Without MiraclesWithout Miracles (1995) (1995)– *The Things We Do*The Things We Do (2000) (2000)

Control Systems Group website:Control Systems Group website:– www.ed.uiuc.edu/csgwww.ed.uiuc.edu/csg (these & other computer (these & other computer

demos)demos) Joel Walters (English, Bar-Ilan U)Joel Walters (English, Bar-Ilan U)

– Application of PCT to understanding bilingualismApplication of PCT to understanding bilingualism

Page 22: Connecting Brain, Purpose & Language: Understanding Language Behavior as the Control of Perception Gary A. Cziko University of Illinois at Urbana-Champaign

Connecting Purpose, Brain, Connecting Purpose, Brain, and Language:and Language:

Understanding Language Understanding Language BehaviorBehavior

as the Control of Perceptionas the Control of PerceptionGary A. CzikoGary A. Cziko

University of Illinois at Urbana-University of Illinois at Urbana-ChampaignChampaign

[email protected]@uiuc.edu; garycziko.net; garycziko.net

Page 23: Connecting Brain, Purpose & Language: Understanding Language Behavior as the Control of Perception Gary A. Cziko University of Illinois at Urbana-Champaign
Page 24: Connecting Brain, Purpose & Language: Understanding Language Behavior as the Control of Perception Gary A. Cziko University of Illinois at Urbana-Champaign

““What we have is a circuit, not an arc or broken What we have is a circuit, not an arc or broken segment of a circle. This circuit is more truly segment of a circle. This circuit is more truly termed organic than reflex, because the motor termed organic than reflex, because the motor response determines the stimulus, just as truly as response determines the stimulus, just as truly as sensory stimulus determines movement. Indeed, sensory stimulus determines movement. Indeed, the movement is only for the sake of determining the movement is only for the sake of determining the stimulus, of fixing what kind of a stimulus it the stimulus, of fixing what kind of a stimulus it is, of interpreting it.”(J. Dewey 1986, p. 353)is, of interpreting it.”(J. Dewey 1986, p. 353)

””It is possible to step back and treat the mind as It is possible to step back and treat the mind as one big monster response function from the total one big monster response function from the total environment over the total past of the organism environment over the total past of the organism to future actions.“--Allen Newell (1998).to future actions.“--Allen Newell (1998).

Page 25: Connecting Brain, Purpose & Language: Understanding Language Behavior as the Control of Perception Gary A. Cziko University of Illinois at Urbana-Champaign

(Overview)(Overview)

IntroductionIntroduction Demonstration & model of purposeful Demonstration & model of purposeful

behaviorbehavior Hierarchies of perceptual controlHierarchies of perceptual control Applications to languageApplications to language Implications for neural scienceImplications for neural science Resources for further explorationResources for further exploration

Page 26: Connecting Brain, Purpose & Language: Understanding Language Behavior as the Control of Perception Gary A. Cziko University of Illinois at Urbana-Champaign

Demonstration & Model of Demonstration & Model of Perceptual Control (overview)Perceptual Control (overview)

Rubber-band demoRubber-band demo Powers’ computer demo of Powers’ computer demo of

compensatory tracking (Demo 1; compensatory tracking (Demo 1; Step F)Step F)

Dewey quoteDewey quote Powers’ computer model of Powers’ computer model of

compensatory tracking (Demo 2; compensatory tracking (Demo 2; Step G; “closing the loop)Step G; “closing the loop)