37
1 COMP 546 Lecture 4 Retina Tues. Jan. 23, 2018

Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

Embed Size (px)

Citation preview

Page 1: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

1

COMP 546

Lecture 4

Retina

Tues. Jan. 23, 2018

Page 2: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

Layers of the Retina

light signals

To the brain 2

(rods and cones)

Page 3: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

Photoreceptor (rod and cone) density

3

This is the left eye. Why?

Cone density is very high in the center of the field of view. This area of the retina is called the fovea.

Page 4: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

continuous

discrete (“spikes”)

Responses of cells in the Retina

4

Page 5: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

5

ASIDE:

neural coding using spikes

(retinal ganglion cells)

I mentioned this in lecture 0.

Page 6: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

Response of neuron (measured by experimenter)

6

Membrane potential (mV)

-70

0

depolarized

hyperpolarized

time

average

Page 7: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

pre-synaptic cell post-synaptic cell

Signalling between cells at synapse(not measured by experimenter)

7

Release rate of neurotransmitters depends on the membrane potential.

Neurotransmitters can be either excitatory (depolarizing) or inhibitory (hyperpolarizing).

Page 8: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

Q: How do nerve cells signal over long distances ?

8

input synapses

output synapses

Axon can be quite long (cm, or up to 1 m).

Page 9: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

A: Spikes (“Action Potentials”)

9

http://www.youtube.com/watch?v=ifD1YG07fB8

Page 10: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

10

• shape

• speed

• frequency (“firing rate”)

• information (see book)

https://mitpress.mit.edu/books/spikes

Page 11: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

Receptive Field of a Retinal Cell

x

y

11

Page 12: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

Receptive field sizes increase with eccentricity

12

Page 13: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

Receptive field diameter of retinal ganglion cells

6 arcmin = 1

10degree

13

2 arcmin = 1

30degree

NOTE:Log scale

Page 14: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

Retinal ganglion cells encode image sums and differences :

• spectral (wavelength l) , “chromatic”

• spatial (x,y)

• temporal (t)

• spectral-spatio-temporal (l, x, y, t)

14

Page 15: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

Spectral sums and differences

“L + M”

red + green = yellow

“L - M”

red – green

“(L + M) - S”

yellow – blue

15

Page 16: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

L – M

(L + M) - S

L + MS

L

M

Spectral sums and differences

Photoreceptors (cones) Retinal ganglion cells16

Page 17: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

red

yellow

white

17

Orange is reddish-yellow. Purple is blueish-red. Cyan is greenish-blue.

Colors cannot appear reddish-green, blueish-yellow, blackish-white.

“Color Opponency”(Hering, 19th century)

black

blue

green

L – M

(L + M) - S

L + M

Neural Mechanism(modern theory)

Page 18: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

ASIDE: Classical Color Wheel

Art class ROYGBV theory of primary, secondary, and complementary colors is based on mixing pigments, not mixing lights.

18

Page 19: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

Polar coordinates for color

19

angle = “hue” radius = “saturation”

Page 20: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

20

'color‘ name purity intensity

(for HSV)

Page 21: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

RGB and HSL (similar to HSV)

21

Page 22: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

Retinal ganglion cells encode image differences :

• spectral (wavelength l) , “chromatic”

• spatial (x,y)

• temporal (t)

• spectral-spatio-temporal (l, x, y, t)

22

Page 23: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

Spatial differences: “center-surround receptive fields”

OFF center, ON surround

+

++

++

+

-+

--

--

-

-

ON center, OFF surround

23

+ and - indicate where the cell is excited or inhibited (depolarized or polarized) by bright image spot in its receptive field.

Page 24: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

e.g. Retinal ganglion cells(first experiments on cats done in 1953)

24

+- -

--- +

- ---

- +- -

---

Shine light only in center.(ON center)

Shine light only in surround.(OFF surround)

Shine light in center and surround.

timetime time

Page 25: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

Proposed Mechanism (Rodieck, 1965)

25

+- -

--- +

++

++

+

-

+- +

-

Page 26: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

Gaussian model

26

1

2𝜋 𝜎𝑒−𝑥2

2𝜎2G(𝑥) =

Page 27: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

Difference of Gaussians (DOG) model

27

1

2𝜋𝜎1𝑒−𝑥2

2𝜎12𝐷𝑂𝐺 𝑥, 𝜎1, 𝜎2 = −

1

2𝜋𝜎2𝑒−𝑥2

2𝜎22

+

-=

Page 28: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

2D Gaussian and 2D DOG

28

=1

2𝜋𝜎𝑒−𝑥2

2𝜎2

𝐺 𝑥, 𝑦, 𝜎 ≡ 𝐺 𝑥, 𝜎 𝐺 𝑦, 𝜎

∗1

2𝜋𝜎𝑒−𝑦2

2𝜎2

=1

2𝜋𝜎2𝑒−𝑥2+𝑦2

2𝜎2

𝐷𝑂𝐺 𝑥, 𝑦, 𝜎1, 𝜎2 = 𝐺 𝑥, 𝑦, 𝜎1 - 𝐺 𝑥, 𝑦, 𝜎2

Page 29: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

Response of a cell (DOG)

29

𝐿 = 𝐼 𝑥, 𝑦 𝐷𝑂𝐺 𝑥 − 𝑥0 , 𝑦 − 𝑦0 , 𝜎1, 𝜎2 𝑑𝑥 𝑑𝑦

Response depends on:

+- -

---DOG cell centered at (𝑥0 , 𝑦0 )

Here I am ignoring temporal properties for simplicity.

Page 30: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

Linear response model

30

𝐿 = 𝐷𝑂𝐺 𝑥 − 𝑥0 , 𝑦 − 𝑦0 , 𝜎1, 𝜎2 𝐼 𝑥, 𝑦 𝑑𝑥 𝑑𝑦

Alternatively we can write it as a sum:

𝐿 =

𝑥,𝑦

𝐷𝑂𝐺 𝑥 − 𝑥0 , 𝑦 − 𝑦0 , 𝜎1 , 𝜎2 𝐼 𝑥, 𝑦

Page 31: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

“Static Non-linearity”

31

Spike firing rate (spikes per second)

𝐿

~200

10

𝑡Spike train

Page 32: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

Half-wave rectification model

32

Spike “firing rate”

𝐿

Max firing rate: in practice there is a cutoff

𝐿 = max( 0,

𝑥,𝑦

𝐷𝑂𝐺 𝑥 − 𝑥0 , 𝑦 − 𝑦0 , 𝜎1 , 𝜎2 𝐼 𝑥, 𝑦 )

Page 33: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

Responses of a population of DOGs

33

+- -

---+

- ---

- +- -

---+

- ---

-

+- -

---+

- ---

- +- -

---+

- ---

-

+- -

---+

- ---

- +- -

---+

- ---

-

… and many overlapping ones which I am not showing because it would be too messy

Page 34: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

“Cross correlation”

34

+- -

---

image

DOG

Page 35: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

Responses of a population of DOGs

35

Cross correlation operator

𝐿 𝑥0, 𝑦0 ≡ 𝐷𝑂𝐺 𝑥 , 𝑦 , 𝜎1, 𝜎2 ⨂ 𝐼 𝑥, 𝑦

𝑥,𝑦

𝐷𝑂𝐺 𝑥, 𝑦 𝐼 𝑥0 + 𝑥, 𝑦0 + 𝑦

𝑢,𝑣

𝐷𝑂𝐺 𝑢 − 𝑥0 , 𝑣 − 𝑦0 𝐼 𝑢, 𝑣

change of variables

Page 36: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

Cross correlation

36

𝑢,𝑣

𝑓 𝑢 − 𝑥, 𝑣 − 𝑦 𝐼 𝑢, 𝑣

Convolution (to be discussed later)

𝑓 𝑥, 𝑦 ⨂ 𝐼 𝑥, 𝑦

𝑢,𝑣

𝑓 𝑥 − 𝑢, 𝑦 − 𝑣 𝐼 𝑢, 𝑣𝑓 𝑥, 𝑦 ∗ 𝐼 𝑥, 𝑦

Page 37: Retina - McGill CIMlanger/546/4-retina-slides.pdf · Photoreceptor (rod and cone) density 3 This is the left eye. Why? Cone density is very high in the center of the field of view

Technical detail (boundary effects)

37

+- -

---

image (photoreceptors)

+- -

---

+- -

---

+- -

---

Not well defined responses

Well defined response