9
THE ROLE OF LATEST FIXATIONS ON ONGOING VISUAL SEARCH A MODEL TO EVALUATE THE SELECTION MECHANISM Giacomo Veneri, Pamela Federighi,Francesca Rosini, Elena Pretegiani, Antonio Federico, Alessandra Rufa Eye tracking & Vision Applications Lab (EVA Lab) Department of Neurological Neurosurgical and Behavioral Science University of Siena, Italy 11/09/22 1 www.evalab.unisi.it

THE ROLE OF LATEST FIXATIONS ON ONGOING VISUAL SEARCH

Embed Size (px)

DESCRIPTION

The aim of the study is to understand the selection process, that modulates the exploration mechanism, during the execution of a high cognitively demanding task. The main purpose is to identify the mechanism competition mechanism between top-down and bottom-up. We developed an adaptive system trying to emulate this mechanism.

Citation preview

Page 1: THE ROLE OF LATEST FIXATIONS ON ONGOING VISUAL SEARCH

THE ROLE OF LATEST FIXATIONS ON ONGOING VISUAL SEARCH

A MODEL TO EVALUATE THE SELECTION MECHANISM

Giacomo Veneri, Pamela Federighi,Francesca Rosini, Elena Pretegiani, Antonio Federico, Alessandra Rufa

Eye tracking & Vision Applications Lab (EVA Lab) Department of Neurological Neurosurgical and Behavioral Science

University of Siena, Italy

12/04/23 1www.evalab.unisi.it

Page 2: THE ROLE OF LATEST FIXATIONS ON ONGOING VISUAL SEARCH

Outline

• Top-Down vs Bottom-Up on ongoing visual search

• Efficiency on Visual search• (Bayesian) Model on visual search

12/04/23 www.evalab.unisi.it 2

Page 3: THE ROLE OF LATEST FIXATIONS ON ONGOING VISUAL SEARCH

Task

12/04/23 www.evalab.unisi.it 3

“Visual Search depends on sensory, perceptual and cognitive processes” [colby 2009]

Il TMT misuar la capcità di esplorare ed eseguire una sequenza in modo corretto

TMTB è un mappa TMTB è un mappa viariante in cui i target viariante in cui i target diventano distrattoridiventano distrattori

[Wolwer 2003]

Page 4: THE ROLE OF LATEST FIXATIONS ON ONGOING VISUAL SEARCH

Mathematical Method

12/04/23 www.evalab.unisi.it 4

Fixations

Page 5: THE ROLE OF LATEST FIXATIONS ON ONGOING VISUAL SEARCH

Direction vs Previous fixations

12/04/23 www.evalab.unisi.it 5

In order to test an overall validity of the model, we calculated for each test the DEMINFIX(T) – DEMINFIX and the DEMAXFIX(T) – DEMAXFIX.Figures

show that saccade direction take in consideration mainly fixations of last 1000ms (1s).

Page 6: THE ROLE OF LATEST FIXATIONS ON ONGOING VISUAL SEARCH

12/04/23 www.evalab.unisi.it 6

Page 7: THE ROLE OF LATEST FIXATIONS ON ONGOING VISUAL SEARCH

Model

12/04/23 www.evalab.unisi.it 7

Page 8: THE ROLE OF LATEST FIXATIONS ON ONGOING VISUAL SEARCH

Human vs Machine

12/04/23 www.evalab.unisi.it 8

Page 9: THE ROLE OF LATEST FIXATIONS ON ONGOING VISUAL SEARCH

Conclusion

• We found significant differences among tasks and a correlation between the efficiency (time elapsed) to explore the task and the ability to inhibit the BAF.

• The command constraint (goal-driven) which is modulated by the image salience versus BAF.

• The selection mechanism that drives this competition. Further works will be directed to evaluate the relation between the BAF and the inhibition of return.

12/04/23 www.evalab.unisi.it 9