Upload
hana
View
38
Download
0
Embed Size (px)
DESCRIPTION
CSE 599 Lecture 5: Neurobiology. Why study neurobiology (if you are a computer scientist/software engineer/hardware designer)? Animal brains routinely solve problems that we would like computers to solve, e.g. computer vision, speech understanding, robot navigation, etc. - PowerPoint PPT Presentation
Citation preview
1R. Rao, Week 5: Neurobiology
CSE 599 Lecture 5: Neurobiology
Why study neurobiology (if you are a computer scientist/software engineer/hardware designer)?
Animal brains routinely solve problems that we would like computers to solve, e.g. computer vision, speech understanding, robot navigation, etc.
Neurobiology provides a model for machine intelligence and learning, e.g. artificial neural networks, learning algorithms, etc.
Neurobiology can provide new paradigms for computer design, e.g. parallel computing, graceful degradation, fault-tolerant computing, etc.
2R. Rao, Week 5: Neurobiology
“I suspect that a deeper mathematical study of the nervous system will affect our understanding of the aspects of mathematics itself that are involved. In fact, it may alter the way in which we look on mathematics and logics proper.”
-- John von Neumann (The Computer and the Brain, 1958)
A quotable quote…
3R. Rao, Week 5: Neurobiology
The Church-Turing Thesis and Neurobiology
Church-Turing Thesis
No general model of algorithmic computation is more powerful than a Turing machine
Are animal brains algorithmic computers?
“There is no doubt that the brain can perform algorithmic computations, but that does not mean that its underlying computational mechanism is algorithmic. It is quite possible that the brain can perform computations not expressible with Turing machines”
Fundamentals of the Theory of ComputationRay Greenlaw and H. James Hoover, p. 85
4R. Rao, Week 5: Neurobiology
Physical basis of computation in animal brains
Animal brains are physical machines Built from hydrocarbons and ionic solutions Basic processing elements are called neurons
Animal brains represent information using physical quantities Real-valued electrical and chemical signals, with noise Transmitted on real organic wires or in real chemical solutions
Do a small set of primitives underlie neuronal computing? Digital computers
Transistors switches Boolean algebra symbol processing machines
Neurobiology ??? neurons? networks? ... adaptive sensory-motor
machines
5R. Rao, Week 5: Neurobiology
Neurobiology and Digital Computing
Comparing neurobiology and silicon-based digital computers Device count:
Human brain: 1011 neurons and 1015 synapses (connections) between neurons (each neuron ~ 104 connections)
IC: 109 transistors with sparse connectivity Device speed:
Biology has 100µs temporal resolution Digital circuits will have a 100ps clock (10 GHz)
Computing paradigm: Animal brains employ massively parallel computation with local
and global feedback, and adaptive connectivity Digital computers: sequential information processing via CPU
with fixed connectivity Capabilities:
Digital computers will always be better at math… Will animal brains always be better at speech or vision?
6R. Rao, Week 5: Neurobiology
A starting point
Hypothesis:Hypothesis: Digital computers and animal brains are efficient Digital computers and animal brains are efficient at computing in their respective domains, as a consequence of at computing in their respective domains, as a consequence of their underlying information representationtheir underlying information representation
Hypothesis:Hypothesis: The primitives underlying neuronal computation The primitives underlying neuronal computation are simpleare simple Neuronal structure and action-potential (spike-based) signaling are
conserved across the animal kingdom Just like transistor switches and Boolean algebra are conserved
across all digital computers
A starting point: Neurons, action-potentials, and synapses
7R. Rao, Week 5: Neurobiology
Primary computational units: Neurons
From Kandel, Schwartz, Jessel, Principles of Neural Science, 3rd edn., 1991, pg. 21
8R. Rao, Week 5: Neurobiology
Basic Input-Output Transformation
Input Spikes
Output Spike
(Excitatory Post-Synaptic Potential)
9R. Rao, Week 5: Neurobiology
Example of signaling in a sensory neuron
From Kandel, Schwartz, Jessel, Principles of Neural Science, 3rd edn., 1991, pg. 28
10R. Rao, Week 5: Neurobiology
Mechanisms of electrical signaling in neurons
Neuron cell membrane is a lipid bilayer Impermeable to charged ion species
such as Na+, Cl-, K+, and Ca2+
Each neuron maintains a potential difference across its membrane Typically –70 to –80 mV [Na+], [Cl-] and [Ca2+] higher
outside the cell; [K+] and organic
anions [A-] higher insideFrom Kandel, Schwartz, Jessel, Principles of Neural
Science, 3rd edn., 1991, pg. 67
11R. Rao, Week 5: Neurobiology
Membrane proteins allow current flow
Proteins in membranes act as pores or channels that are ion-specific E.g. Pass K+ but not Cl- or Na+
These ionic channels are gated Voltage gated: Probability of opening
depends on membrane voltage Chemically gated: Neurotransmitter
binding causes channel to open e.g. Electron microscope picture of
an ACh (acetyl choline) channel Mechanically gated: Sensitive to
pressure or stretch
Ionic pump expels Na+ ions out of cell and takes K+ ions in (consumes ATP) Maintains –70mV potential difference From Kandel, Schwartz, Jessel, Principles of Neural
Science, 3rd edn., 1991, pgs. 68 & 137
12R. Rao, Week 5: Neurobiology
13R. Rao, Week 5: Neurobiology
Channel opening is probabilistic and discrete
Patch clamping (recording from an isolated patch) allows measurement of current through a single channel
Current influx is probabilistic and determined by: Probability of opening Duration of opening
Population of channels conveys smooth, graded membrane currents
From Kandel, Schwartz, Jessel, Principles of Neural Science, 3rd edn., 1991, pg. 71
14R. Rao, Week 5: Neurobiology
Gated channels allow neuronal signaling
Inputs to a neuron change its local membrane potential via chemically-gated channels at “synapses” (connections).
Changes in local membrane potential are integrated spatially and temporally in dendrites and soma of the neuron.
Changes in membrane potential trigger opening/closing of voltage-gated channels in dendrites, soma, and axon, causing depolarization (positive change in voltage) and hyperpolarization (negative change).
When a large positive change in membrane potential occurs, crossing a particular voltage threshold, a spike or action potential is generated and transmitted to other neurons.
15R. Rao, Week 5: Neurobiology
Neuronal Output: Action potentials
Voltage-gated channels cause action-potentials (spikes)Rapid Na+ influx causes
rising edgeNa+ pores deactivateK+ outflux restores
membrane potential
Positive feedback causes spikeNa+ influx depolarizes
membrane, causing more Na+ influx From Kandel, Schwartz, Jessel, Principles of Neural
Science, 3rd edn., 1991, pg. 110
16R. Rao, Week 5: Neurobiology
Here is anotherillustration of thesame concept.
The permeability changesresult in the large swingsof membrane potential that are shown above.
17R. Rao, Week 5: Neurobiology
An increase in permeability at one location of the membrane can spread to neighboring locations
Axons have very large concentrations of voltage-gated Na+ channels, causing the excitation to actively travel forward.
18R. Rao, Week 5: Neurobiology
19R. Rao, Week 5: Neurobiology
[lower resistance][lower resistance]
20R. Rao, Week 5: Neurobiology
Vertebrates have developed another method of speeding up spike propagation, by adding a wrapping of myelin. This forces the electric current further down the axon, as it can only conduct where the resistance is low ---that is, at the node of Ranvier
21R. Rao, Week 5: Neurobiology
Active Wiring: Myelination of axons
Schwann cells (glia) enable long-range spike communication Active wire allows lossless signal
propagation, unlike electric signals in a copper wire
From Kandel, Schwartz, Jessel, Principles of Neural Science, 3rd edn., 1991, pgs. 23 & 44
22R. Rao, Week 5: Neurobiology
Communication between neurons: Synapses
Synapses: Connections between neurons Electrical synapses (gap junctions) Chemical synapses (use
neurotransmitters)
Synapses can be excitatory or inhibitory
Synapses are integral to memory and learning
23R. Rao, Week 5: Neurobiology
Distribution of synapses on a real neuron…
24R. Rao, Week 5: Neurobiology
postsynaptic element, such asanother neuron
postsynaptic element, such asanother neuron
25R. Rao, Week 5: Neurobiology
26R. Rao, Week 5: Neurobiology
Synaptic biochemistry
Note: even this isa gross simplification!
From Kandel, Schwartz, Jessel, Principles of Neural Science, 3rd edn., 1991
27R. Rao, Week 5: Neurobiology
Electron micrographs of synapses
From Kandel, Schwartz, Jessel, Principles of Neural Science, 3rd edn., 1991
Synaptic Vesicles and
Synaptic Cleft
Fusion of vesicles and release of
neurotransmitter
Retrieval andformation of new vesicles
28R. Rao, Week 5: Neurobiology
Importance of Synapses
The gap between the axon and postsynaptic membrane (the synaptic cleft) allows electrical isolation of neurons
Hypothesis: Synaptic plasticity forms the basis of learning and memory
From Kandel, Schwartz, Jessel, Principles of Neural Science, 3rd edn., 1991
29R. Rao, Week 5: Neurobiology
Synaptic plasticity: Adapting the connections
Long Term Potentiation (LTP): Increase in synaptic strength that lasts for several hours or more Measured as an increase in the excitatory postsynaptic potential
(EPSP) caused by a presynaptic spike
Increase in size of EPSP observedwhen the same presynaptic input is activated before and after LTP
30R. Rao, Week 5: Neurobiology
Types of Synaptic Plasticity
Hebbian Long Term Potentiation: synaptic strength increases after prolonged pairing of presynaptic and postsynaptic spiking (correlated firing of two connected neurons).
Long Term Depression (LTD): Reduction in synaptic strength that lasts for several hours or more Anti-Hebbian LTD: Correlated spiking of two connected neurons
decreases the strength of their connecting synapse Homosynaptic LTD: Presynaptic spiking without postsynaptic
spiking Heterosynaptic LTD: Postsynaptic spiking without presynaptic
spiking
Spike-Timing Dependent Plasticity: LTP/LTD depends on relative timing of pre/postsynaptic spiking
31R. Rao, Week 5: Neurobiology
Types of Synaptic Plasticity
32R. Rao, Week 5: Neurobiology
Examples of measured synaptic plasticity
- and + are thresholds for LTD and LTP respectively
Hebbian LTP
33R. Rao, Week 5: Neurobiology
Spike-Timing Dependent Plasticity
Amount of increase/decrease in synaptic strength (LTP/LTD) depends on relative timing of pre/postsynaptic spikes
LTP
LTD
pre before postpre after post
34R. Rao, Week 5: Neurobiology
The mechanisms of neuronal structure and function are being rapidly unraveled via molecular, imaging, and electrophysiological techniques
But our knowledge of how networks of neurons give rise to perception, action, cognition, and
consciousness remains sketchy at best.
We will review some of this next…
35R. Rao, Week 5: Neurobiology
5 minute break…
Next: Brain organization and information processing in networks of neurons
36R. Rao, Week 5: Neurobiology
Organization of the Nervous System
CentralCentralNervous SystemNervous System
BrainBrain Spinal CordSpinal Cord
PeripheralPeripheralNervous SystemNervous System
SomaticSomatic AutonomicAutonomic
37R. Rao, Week 5: Neurobiology
Skeletal/Somatic Nervous System
Nerves that connect to voluntary skeletal muscles and to sensory receptors
Afferent Nerve FibersAfferent Nerve FibersAxons that carry info away from the
periphery to the CNS
Efferent Nerve FibersEfferent Nerve FibersAxons that carry info from
the CNS outward to the periphery
38R. Rao, Week 5: Neurobiology
Autonomic and Central Nervous System
Autonomic: Nerves that connect to the heart,blood vessels, smooth muscles, and glands
CNS: Brain + Spinal CordSpinal Cord:
• Local feedback loops control reflexes• Descending motor control signals from
the brain activate spinal motor neurons• Ascending sensory axons transmit
sensory feedback information from muscles and skin back to brain
39R. Rao, Week 5: Neurobiology
Major Brain Regions: Brain Stem
Cer r Thalamus
Corpus collosumHypothalamus
l C t
Pons
Medulla
Spinal cord
Cerebellum
MedullaMedullaBreathing, muscle tone
and blood pressure
PonsPonsConnects brainstem withcerebellum & involved
in sleep and arousal
CerebellumCerebellumCoordination of voluntary
movements andsense of equilibrium
40R. Rao, Week 5: Neurobiology
Major Brain Regions: Brain Stem
MidbrainMidbrainEye movements, visual and
auditory reflexes
Thalamus
Corpus collosumHypothalamus
l C
Pons
Medulla
Spinal cord
Cerebellum
Midbrain
Reticular FormationReticular FormationModulates muscle
reflexes, breathing & pain perception. Also
regulates sleep, wakefulness &
arousal
41R. Rao, Week 5: Neurobiology
e Thalamus
Corpus co losHypothalamus
rebral Cortex
Pons
Medulla
Spinal cord
Cerebellum
Major Brain Regions: Diencephalon
ThalamusThalamusRelay station for all sensory
info (except smell)to the cortex
HypothalamusHypothalamusRegulates basic needs
fighting, fleeingfighting, fleeingfeeding, andfeeding, and
matingmating
Corpus
callosum
42R. Rao, Week 5: Neurobiology
Major Brain Regions: Cerebral Hemispheres
Consists of: Cerebral cortex, basal ganglia, hippocampus, and amygdala
Involved in perception and motor control, cognitive functions, emotion, memory, and learning
Thalamus
Corpus collosumHypothalamus
rebral Cortex
Pons
Medulla
Spinal cord
Cerebellum
Cerebrum/Cerebral CortexCerebrum/Cerebral Cortex
43R. Rao, Week 5: Neurobiology
Cerebral cortex comprises a sheet of neurons
From Kandel, Schwartz, Jessel, Principles of Neural Science, 3rd edn., 1991, pgs.
Cerebral Cortex: Convoluted surface of cerebrum about 1/8th of an inch thick
Six layers of neurons
Approximately 30 billion neurons + 270 billion Glial cells
Each nerve cell makes about 10,000 synapses: approximately 300 trillion connections in total
44R. Rao, Week 5: Neurobiology
Summary
From Kandel, Schwartz, Jessel, Principles of Neural Science, 3rd edn., 1991
45R. Rao, Week 5: Neurobiology
How do these brain regions interact to produce cognition and behavior?
Current knowledge is based on electrophysiological, imaging, molecular, and psychophysical techniques in conjunction with anatomical and lesion (brain damage) studies
46R. Rao, Week 5: Neurobiology
The brain is specialized by region: Language
Broca’s Area
Important inthe
productionof speech
Wernicke’sArea
Important inthe
comprehensionof language
47R. Rao, Week 5: Neurobiology
Specialization of function in Cerebral Cortex
VisualProcessing
somatosensorycortex
Motor Planning,Higher cognitive
functions
Visual and auditoryrecognition
Spatial reasoning
and motion
48R. Rao, Week 5: Neurobiology
Specialization is based on connectivity
Brain regions perform elementary operations Basic computing units are neurons and synapses Specialization arises from differences in local connectivity, numbers
of neurons, and input-output connectivity to/from areas
Complex behavior arises from the interaction of multiple brain regions Example: Damage to Broca’s area
Person can understand language Person can say words or sing Person can’t speak or write grammatically
49R. Rao, Week 5: Neurobiology
Regional activity is problem-dependent
PET scan of human brain during visual stimulation PET scan measures local blood glucose uptake
Visual stimulation excites visual cortex Regional activation depends on stimulus complexity
From Kandel, Schwartz, Jessel, Principles of Neural Science, 3rd edn., 1991, p. 315
50R. Rao, Week 5: Neurobiology
The brain tackles complexity hierarchically
Example: Motor system Reflexive responses are handled by the spinal cord Movement is handled by the cerebellum Activity is scheduled by the cortex
Example: Speech learning by children Babies learn sounds (phonemes), then letters Toddlers learn words, then sentences Children learn grammar Teenagers learn composition
51R. Rao, Week 5: Neurobiology
Hierarchical processing in the visual system
Retina Thalamus (LGN)
Primary Visual Cortex (V1)
V2 …
52R. Rao, Week 5: Neurobiology
Hierarchical Organization of Visual Cortex
53R. Rao, Week 5: Neurobiology
Hierarchical Visual Processing
Photoreceptors are sensitive to lightRGB wavelength color sensitivity
Retinal ganglion cells are sensitive to simple patterns
Figure: Color-opponent retinal cells detect color spots in visual field
Successively higher levels of visual processing detect successively more complex features
First in LGN, then in cortex
First spots/lines/bars and movement, then complex features and motion, then objects/faces and spatial reasoning
From Kandel, Schwartz, Jessel, Principles of Neural Science, 3rd edn., 1991, pg. 473
54R. Rao, Week 5: Neurobiology
The Visual ProcessingHierarchy
55R. Rao, Week 5: Neurobiology
Predictive coding in the retina
From Ward, Sensation and Perception, 3rd edn., 1989
Retinal Ganglion cells act as predictive coders:
On-center cell: Sensitive to light turning on in the center of the field
Off-center cell: Sensitive to light turning off in the center
Predictive coding: only relative differences matter - predict the central pixel values from surrounding pixels, and send the difference. “Efficient Coding”
Why does it work? Correlations in natural images.
56R. Rao, Week 5: Neurobiology
Visual Illusion 1
Which ring is brighter?
From Kandel, Schwartz, Jessel, Principles of Neural Science, 3rd edn., 1991, pgs. 411
Both rings have the same hue: visual system measures brightness relative to background
57R. Rao, Week 5: Neurobiology
Neurobiology uses relative measures
A Key point:
The brain doesn’t use absolute measures or values
Relative values, adaptation, and habituation appear at all levels of neuronal processing
58R. Rao, Week 5: Neurobiology
Visual Illusion 2
Both women are the same size in both photosOur brain compares objects using relative perspective
measures
From Kandel, Schwartz, Jessel, Principles of Neural Science, 3rd edn., 1991, pgs. 411 & 444
59R. Rao, Week 5: Neurobiology
An important open question
Does the timing of a spike matter or is a stimulus encoded in terms of the firing rates of neurons (no. of spikes/second)?
Traditional Answer: Firing rate Motor neurons in spinal cord appear to use a rate code High variability of a neuron’s response: for the same stimulus, a
neuron emits spikes at different times but at the same firing rate Is the variability stochastic noise (synapses, channels, etc.) or is our
definition of “stimulus” too restrictive?? Maybe we are not considering other inputs to the neuron?
Recent results: Spike timing important too? Spike-timing dependent plasticity Certain auditory areas do use spike timing for localization Reliable spiking if we inject fluctuating current into a neuron in slice In some animals, correlations between spiking neurons are crucial
60R. Rao, Week 5: Neurobiology
Example: Spike correlations allow recognition
Locust olfactory system
A Neuronal spiking phase-locks when insect detects an odor
B Toxins end the synchronization, but not the spiking
Figures courtesy Kate MacLeod, Caltech
61R. Rao, Week 5: Neurobiology
Conclusions
The brain computes! Information storage: The physical/chemical structure (synapses,
wires) Information transmission: Electrical and chemical signaling Computing elements: Neurons Computational basis (information coding, functions): Unknown
We can understand neuronal computation by discerning the underlying primitives A starting model: Artificial neural networks
Types of artificial neural networks Learning rules
More sophisticated models: Compartmental/biophysical models Computational models of specific brain areas and their interactions
62R. Rao, Week 5: Neurobiology
Next week: Neural networks and models
DNA computing homework due next class…
Reading: See on-line chapters/articles for more information on today’s topics (Textbook/MIT on-line encyclopedia)
Mini-Project: Project ideas are up on the web site. Select one of these or come up
with your own topic – send email to check with instructor and TA Sign-up for 10-min presentation time slot on class web site
Have a great weekend!