Transcript
Page 1: Anticipation in the retina and the primary visual cortex

HAL Id: hal-02150600https://hal.inria.fr/hal-02150600

Submitted on 7 Jun 2019

HAL is a multi-disciplinary open accessarchive for the deposit and dissemination of sci-entific research documents, whether they are pub-lished or not. The documents may come fromteaching and research institutions in France orabroad, or from public or private research centers.

L’archive ouverte pluridisciplinaire HAL, estdestinée au dépôt et à la diffusion de documentsscientifiques de niveau recherche, publiés ou non,émanant des établissements d’enseignement et derecherche français ou étrangers, des laboratoirespublics ou privés.

Anticipation in the retina and the primary visualcortex : towards an integrated retino-cortical model for

motion processingBruno Cessac, Selma Souihel, Matteo Di Volo, Frédéric Chavane, Alain

Destexhe, Sandrine Chemla, Olivier Marre

To cite this version:Bruno Cessac, Selma Souihel, Matteo Di Volo, Frédéric Chavane, Alain Destexhe, et al.. Anticipationin the retina and the primary visual cortex : towards an integrated retino-cortical model for motionprocessing. Workshop on visuo motor integration, Jun 2019, Paris, France. �hal-02150600�

Page 2: Anticipation in the retina and the primary visual cortex

Anticipation in the retina and the primary visual cortex :towards an integrated retino-cortical model for motion

processing

Bruno Cessac, Selma Souihel Biovision

Page 3: Anticipation in the retina and the primary visual cortex

Anticipation in the retina and the primary visual cortex :towards an integrated retino-cortical model for motion

processing

Bruno Cessac, Selma Souihel Biovision

Page 4: Anticipation in the retina and the primary visual cortex

Anticipation in the retina and the primary visual cortex :towards an integrated retino-cortical model for motion

processing

Bruno Cessac, Selma Souihel

In collaboration with :

Frédéric ChavaneSandrine Chemla

Olivier MarreMatteo Di VoloAlain Destexhe

Biovision

Page 5: Anticipation in the retina and the primary visual cortex

4

The visual flow

Source : Wikipedia

Page 6: Anticipation in the retina and the primary visual cortex

5

The visual flow

Source : Wikipedia

Source : Ryskampet al. 2014

Upcoming light

Page 7: Anticipation in the retina and the primary visual cortex

6

The visual flow

Source : Wikipedia

Source : Ryskampet al. 2014

Upcoming light

Page 8: Anticipation in the retina and the primary visual cortex

7

The visual flow

Source : Wikipedia

Source : Ryskampet al. 2014

Upcoming light

Page 9: Anticipation in the retina and the primary visual cortex

8

The visual flow

Source : Wikipedia

Source : Ryskampet al. 2014

Upcoming light

Decoding spike trains

Page 10: Anticipation in the retina and the primary visual cortex

9

The visual flow

Source : Wikipedia

Source : Ryskampet al. 2014

Upcoming light

Decoding spike trains

Encoding motion

Page 11: Anticipation in the retina and the primary visual cortex

10

The visual flow

Source : Wikipedia

Source : Ryskampet al. 2014

Upcoming light

Decoding spike trains

« Analogic computing »Low energy consumpution

Dedicated circuitsSmall number of neurons

Specialized synapses

Encoding motion

Page 12: Anticipation in the retina and the primary visual cortex

11

The visual flow

Source : Wikipedia

Source : Ryskampet al. 2014

Upcoming light

Page 13: Anticipation in the retina and the primary visual cortex

12

The visual flow

Source : Wikipedia

Source : Ryskampet al. 2014

Upcoming light

Too slow !

Page 14: Anticipation in the retina and the primary visual cortex

13

Visual Anticipation

Source : Benvenutti et al. 2015

Page 15: Anticipation in the retina and the primary visual cortex

14

Visual Anticipation

Source : Benvenutti et al. 2015

Anticipation is carried out by the primary visual cortex (V1) through an activation wave

Page 16: Anticipation in the retina and the primary visual cortex

15

Visual Anticipation

Source :Berry et al.1999

Anticipation also takes place in the retina

Page 17: Anticipation in the retina and the primary visual cortex

16

Visual Anticipation

What are the respective :

➢Mechanisms underlying retinal and corticalanticipation?

➢Role of each part ?

TrajectoryTrajectory

Page 18: Anticipation in the retina and the primary visual cortex

17

Visual Anticipation

Page 19: Anticipation in the retina and the primary visual cortex

18

Visual Anticipation

No thalamus ...

Page 20: Anticipation in the retina and the primary visual cortex

19

Visual Anticipation

Which animal ?No thalamus ...

Page 21: Anticipation in the retina and the primary visual cortex

20

Visual Anticipation

No thalamus ... Which animal ?

Page 22: Anticipation in the retina and the primary visual cortex

21

Visual Anticipation

No thalamus ... Which animal ?

Page 23: Anticipation in the retina and the primary visual cortex

22

Visual Anticipation

No thalamus ... Which animal ?

Page 24: Anticipation in the retina and the primary visual cortex

23

Visual Anticipation

No thalamus ... Which animal ?

Page 25: Anticipation in the retina and the primary visual cortex

24

Visual Anticipation

No thalamus ... Which animal ?

Page 26: Anticipation in the retina and the primary visual cortex

25

Visual Anticipation

Developping a retino-cortical model of anticipation soas to

understand / propose

possible mechanisms for anticipation in the retina and in the cortex.

Page 27: Anticipation in the retina and the primary visual cortex

26

Anticipation in the retina

Page 28: Anticipation in the retina and the primary visual cortex

27

The Hubel-Wiesel view of vision

Ganglion cells

Nobel prize 1981

Ganglion cells response is the convolution of the stimulus with a spatio-temporalreceptive field followed by a non linearity

Ganglion cells are independent encoders

Page 29: Anticipation in the retina and the primary visual cortex

28

The Hubel-Wiesel view of vision

Source : Berry et al. 1999

Ganglion cells

Nobel prize 1981

Page 30: Anticipation in the retina and the primary visual cortex

29

Building a 2D retina model for motionanticipation

Gain control (Chen et al. 2013)

Page 31: Anticipation in the retina and the primary visual cortex

30

Building a 2D retina model for motionanticipation

Page 32: Anticipation in the retina and the primary visual cortex

31

Building a 2D retina model for motionanticipation

Gain control (Chen et al. 2013)

Page 33: Anticipation in the retina and the primary visual cortex

32

Building a 2D retina model for motionanticipation

Gain control (Chen et al. 2013)

Page 34: Anticipation in the retina and the primary visual cortex

33

1D results : smooth motion anticipationwith gain control

Bipolar layer Ganglionlayer

Page 35: Anticipation in the retina and the primary visual cortex

34

1D results : smooth motion anticipationwith gain control

Anticipation variability with stimulusparameters

Page 36: Anticipation in the retina and the primary visual cortex

35

Building a 2D retina model for motionanticipation

Ganglion cells are independent encoders

Page 37: Anticipation in the retina and the primary visual cortex

36

Building a 2D retina model for motionanticipation

Ganglion cells are not independent encoders

Gap junctions connectivity

Page 38: Anticipation in the retina and the primary visual cortex

37

Building a 2D retina model for motionanticipation

Gap junctions connectivity

Page 39: Anticipation in the retina and the primary visual cortex

38

Building a 2D retina model for motionanticipation

Gap junctions connectivity

Page 40: Anticipation in the retina and the primary visual cortex

39

Building a 2D retina model for motionanticipation

Gap junctions connectivity

Page 41: Anticipation in the retina and the primary visual cortex

40

Building a 2D retina model for motionanticipation

Diffusive wave of activity ahead of the motion

Gap junctions connectivity

Page 42: Anticipation in the retina and the primary visual cortex

41

1D results : smooth motion anticipationwith gap junctions

6

Page 43: Anticipation in the retina and the primary visual cortex

42

1D results : smooth motion anticipationwith gap junctions

Anticipation variability with stimulusparameters

Page 44: Anticipation in the retina and the primary visual cortex

43

Building a 2D retina model for motionanticipation

Page 45: Anticipation in the retina and the primary visual cortex

44

Building a 2D retina model for motionanticipation

Ganglion cells are not independent encoders

Amacrine cells connectivity

Page 46: Anticipation in the retina and the primary visual cortex

45

Amacrine cells connectivity

● A class of RGCs are selective to differential motion

Building a 2D retina model for motionanticipation

Page 47: Anticipation in the retina and the primary visual cortex

46

Amacrine cells connectivity

● The circuitry involves amacrine cells connectivity upstream of ganglion cells

Building a 2D retina model for motionanticipation

● A class of RGCs are selective to differential motion

Page 48: Anticipation in the retina and the primary visual cortex

47

Connectivity pathways

Amacrine cells connectivity

Page 49: Anticipation in the retina and the primary visual cortex

48

Connectivity pathways

Amacrine cells connectivity

Page 50: Anticipation in the retina and the primary visual cortex

49

Connectivity pathways

Amacrine cells connectivity

Anti diffusive wave of activityahead of the bar

Page 51: Anticipation in the retina and the primary visual cortex

50

1D results : smooth motion anticipationwith amacrine connectivity

Bipolar layer Ganglion layer

Page 52: Anticipation in the retina and the primary visual cortex

51

1D results : smooth motion anticipationwith amacrine connectivity

Anticipation variability with stimulusparameters

Page 53: Anticipation in the retina and the primary visual cortex

52

Comparing the performance of the three layers

Page 54: Anticipation in the retina and the primary visual cortex

53

Suggesting new experiments : 2D results

1) Angular anticipation

Stimulus

t = 0 ms 100 200 ms 300 ms 400 ms 500 ms 600 ms 700 ms

Bipolar linearresponse

Bipolar gainresponse

Ganglion linearresponse

Ganglion gainresponse

A)

B) C)

Page 55: Anticipation in the retina and the primary visual cortex

54

Suggesting new experiments : 2D results

1) Angular anticipation

Page 56: Anticipation in the retina and the primary visual cortex

55

Anticipation in V1

Page 57: Anticipation in the retina and the primary visual cortex

56

Anticipation in V1

Page 58: Anticipation in the retina and the primary visual cortex

57

A mean field model to reproduce VSDIrecordings Zerlaut et al 2016

Chemla et al 2018

Page 59: Anticipation in the retina and the primary visual cortex

58

A mean field model to reproduce VSDIrecordings Zerlaut et al 2016

Chemla et al 2018

Page 60: Anticipation in the retina and the primary visual cortex

59

A mean field model to reproduce VSDIrecordings Zerlaut et al 2016

Chemla et al 2018

Affords a retino thalamic input

Page 61: Anticipation in the retina and the primary visual cortex

60

A mean field model to reproduce VSDIrecordings Zerlaut et al 2016

Chemla et al 2018

Page 62: Anticipation in the retina and the primary visual cortex

61

A mean field model to reproduce VSDIrecordings Zerlaut et al 2016

Chemla et al 2018

Page 63: Anticipation in the retina and the primary visual cortex

62

A mean field model to reproduce VSDIrecordings Zerlaut et al 2016

Chemla et al 2018

Page 64: Anticipation in the retina and the primary visual cortex

Response of the cortical model to a LNretina drive

Page 65: Anticipation in the retina and the primary visual cortex

Response of the cortical model to a retinadrive with gain control

Page 66: Anticipation in the retina and the primary visual cortex

Anticipation in the cortex : VSDI dataanalysis (Data courtesy of F.

Chavane et S. Chemla)

Page 67: Anticipation in the retina and the primary visual cortex

Comparing simulation results to VSDIrecordings

Cortex experimentalrecordings

Simulation resultsResponse to an LNmodel of the retina

Simulation resultsResponse to a gaincontrol model of theretina

Page 68: Anticipation in the retina and the primary visual cortex

Conclusions

● We developped a 2D retina with three ganglion cell layers,implementing gain control and connectivity.

● We use the output of our model as an input to a mean field model ofV1, and were able to reproduce anticipation as observed in VSDI

Page 69: Anticipation in the retina and the primary visual cortex

Conclusions

● How to improve object identification ● 1) exploring the model's parameters and

● 2) using connectivity ?

● Is our model able to anticipate more complex trajectories, withaccelerations for instance ?

● How to calibrate connectivity using biology ?

● How does anticipation affect higher order correlations ?

● Would it be possible to design psycho-physical tests clearly showingthe role of the retina in visual anticipation ?

Page 70: Anticipation in the retina and the primary visual cortex

Thank you for your attention !


Recommended