Motion Perception Chapter 8

Lecture 13

Jonathan PillowSensation & Perception (PSY 345 / NEU 325)

Spring 2019

Strabismus• eyes are not aligned, so different images fall on the fovea• If not corrected at an early age, stereopsis will not develop

stereoblindness: inability to use binocular disparity as a depth cue.

Defects in Stereopsis

Binocular Rivalry

Two stimuli battle for dominance of

the percept

• monocular depth cues • binocular depth cues (vergence, disparity)• horopter • crossed / uncrossed disparities• free fusing• random dot stereogram• stereoscope• “correspondence problem”• panum’s fusional area• strabismus / stereoblindness• binocular rivalry (in book)

Chapter 6 Summary:

Motion Perception Chapter 8

Main point of this chapter:

Motion = Orientation in Space-Time

which motion is faster?

slow fast

Real vs. Apparent motion

Apparent motion - motion percept that results from rapid display of stationary images in different locations

apparent(movies, flip-books) “real”

Q: why don’t we notice the difference?

How does the nervous system encode motion? What makes a Motion Receptive Field?

Answer: a surprisingly simple neural circuit called a “Reichardt detector”

Reichardt

detector

simple summing neuron

delay line

excitatoryinhibitory

Reichardt detector in space-time

firstRF

secondRF

2nd neuron has a spatially separated Receptive Field (RF), and a shorter temporal delay

Smoother Reichardt detector

Like an oriented V1 receptive field, but oriented in space-time!

Reichardt detectors respond to real and apparent motion

Figure 7.3 Constructing a neural circuit for the detection of rightward motion (Part 1)

Figure 7.3 Constructing a neural circuit for the detection of rightward motion (Part 2)

Clockwise or Counter-clockwise rotation?

(web demo)

Correspondence problem (motion): • problem of knowing the correspondence between features in successive frames (which points in frame 1 are the same objects in frame 2?)

https://oup-arc.com/access/content/sensation-and-perception-5e-student-resources/sensation-and-perception-5e-activity-8-4?previousFilter=tag_chapter-08

• Aperture problem: when a moving object is viewed through an aperture, the direction of motion may be ambiguous

• this is a problem because each neuron only sees the scene through a small aperture (its receptive field!)

• how can the brain figure out the “global” direction of motion?

• Aperture problem:

aperture problem / correspondence problemhttps://oup-arc.com/access/content/sensation-and-perception-5e-student-resources/sensation-and-perception-5e-activity-8-3?previousFilter=tag_chapter-08

building a global motion detector

Motion aftereffect (MAE): The illusion of motion that occurs after prolonged exposure to a moving stimulus

http://www.michaelbach.de/ot/mot-adapt/index.html

Motion after-effect

• Always gives rise to motion in the opposite direction of the adapting motion

• Also known as: “waterfall illusion” - stare at a waterfall; stationary objects will then appear to move upwards.

• evidence for “opponent channels” in processing motion

Interocular transfer: The transfer of an effect (such as adaptation) from one eye to another

• MAE: exhibits interocular transfer

• Remember: Input from both eyes is combined in area V1

Q: What does this tell us about where in the brain motion is computed?

Computation of Visual Motion

Newsome and Pare (1988) conducted a study on motion perception in monkeys

• Trained monkeys to respond to dot motion displays • Area MT of the monkeys was lesioned • Result: Monkeys needed about ten times as many dots

to correctly identify direction of motion

Figure 7.7 The middle temporal lobe and other regions of the cortex involved in motion perception

Nichols & Newsome 1999

Interesting result: electrical stimulation of area MT => monkeys report seeing motion, even when no motion present!

(to read on your own)

• optic flow• focus of expansion • biological motion

http://www.psy.vanderbilt.edu/faculty/blake/BM/BioMot.html

courtesy of R Blake

Biological motion non-biological motion

Motion Perception Chapter 8 - Princeton...

Documents

Depth Perception 1 Depth Perception Binocular … · Depth Perception 1 Depth Perception Part II Binocular Monocular ... Binocular Vision: Vision with Two Eyes Binocular cues to depth:

Depth Perception. Depth perception is the ability to see things in a 3-Dimensional way and to judge distance. We use depth cues to gather information

Effect of depth cues on visual search in a web-based environment › smash › get › diva2:1084759 › FULLTEXT0… · Effect of depth cues on visual search in a web-based environment

Combining Stereo and Atmospheric Veil Depth Cues for 3D ...perso.lcpc.fr/tarel.jean-philippe/publis/jpt-cva14.pdf · Combining Stereo and Atmospheric Veil Depth Cues for 3D Reconstruction

PERCEIVING DEPTH AND SIZEmajumder/vispercep/depthsize.pdf · Depends on depth estimation • All depth cues present • Closing one eye • No binocular cues • Through a peephole

Stereo Rendering - University of Cambridge · Stereo rendering 2 Rafał Mantiuk, Univ. of Cambridge. Depth perception Stereoscopic depth cues: binocular disparity We see depth due

Distance, depth, and 3D shape Basic distinctionsMsl/Courses/0022X/Slides/Sl-depth.pdfDistance, depth, and 3D shape cues • Pictorial depth cues: familiar size, relative size,

Person tracking using audio and depth cues - Surrey › CVSSP › Publications › papers › Liu-ICCVW-201… · Person tracking using audio and depth cues Qingju Liu, Teoﬁlo de

Physiological Depth Cues – Convergence. Physiological Depth Cues – Convergence – small angle of convergence = far away – large angle of convergence =

Depth perception from pairs of overlapping cues in ... · depth cues is inevitable. It is furthermore stated that such a cooperation of cues, or sharing of information, must occur

Depth Cues Pictorial Depth Cues: aspects of 2D images that imply depth Physiological Depth Cues: Proprioception in ocular muscles indicates accommodation

Fusion of Multiple Cues from Color and Depth Domains using Occlusion Aware Bayesian Tracker

Missing depth cues in virtual reality limit performance

Psyc2320 Midterm II Review. Physiological Depth Cues – Accommodation

Polarized 3D: High-Quality Depth Sensing With Polarization Cues · 2015-10-24 · Polarized 3D: High-Quality Depth Sensing with Polarization Cues Achuta Kadambi∗1, Vage Taamazyan1,2,

Novel Depth Cues from Uncalibrated Near-field Lighting

-Binocular depth cues (Requiring the use of both eyes) =>Convergence =>Retinal Disparity. -Monocular depth cues (Requiring the use of one eye only)

Motion Depth Cues – Motion 1. Parallax. Motion Depth Cues – Parallax

Depth Cues Basic Principles The 3D Camera Rig Displaying & … › projects › lm-3d › 3D_files › depth.pdf · depth cues to make a more convincing 3D image. The eight depth

Reading Bar Graphs: Effects of Extraneous Depth Cues and ... · of depth cues on accuracy with graph-like stimuli. In one study, Spence (1990) assessed accuracy judgments with seven