11
Point-of-Gaze Estimation: Theory and Applications Jeff Kang , Elias Guestrin, Moshe Eizenman, Erez Eizenman [email protected] June 9, 2006

Point-of-Gaze Estimation: Theory and Applications Jeff Kang, Elias Guestrin, Moshe Eizenman, Erez Eizenman [email protected] June 9, 2006

Embed Size (px)

Citation preview

Page 1: Point-of-Gaze Estimation: Theory and Applications Jeff Kang, Elias Guestrin, Moshe Eizenman, Erez Eizenman jeff.kang@utoronto.ca June 9, 2006

Point-of-Gaze Estimation: Theory and Applications

Jeff Kang, Elias Guestrin, Moshe Eizenman, Erez Eizenman

[email protected]

June 9, 2006

Page 2: Point-of-Gaze Estimation: Theory and Applications Jeff Kang, Elias Guestrin, Moshe Eizenman, Erez Eizenman jeff.kang@utoronto.ca June 9, 2006

Point-of-Gaze Estimation

Point-of-gaze: • point in space imaged on the centre of the highest

visual acuity region of the retina

• “Where we are looking” Motivation:

• Psychology/neurology: gaze follow shifts in attentional focus—gain insight into human cognitive processes

• Ophthalmology: objective measure of what is seen—measure the visual acuity of infants

• Human-machine interfaces: gaze-based pointing devices

Page 3: Point-of-Gaze Estimation: Theory and Applications Jeff Kang, Elias Guestrin, Moshe Eizenman, Erez Eizenman jeff.kang@utoronto.ca June 9, 2006

Theoretical Foundation

Measure position of eye features extracted from video images: pupil centre, corneal reflections

Page 4: Point-of-Gaze Estimation: Theory and Applications Jeff Kang, Elias Guestrin, Moshe Eizenman, Erez Eizenman jeff.kang@utoronto.ca June 9, 2006

System Implementations

Head-mounted Systems

Remote Head-free Systems

Page 5: Point-of-Gaze Estimation: Theory and Applications Jeff Kang, Elias Guestrin, Moshe Eizenman, Erez Eizenman jeff.kang@utoronto.ca June 9, 2006

Selected Applications

Air Force Pilot Training

Consumer Research

Page 6: Point-of-Gaze Estimation: Theory and Applications Jeff Kang, Elias Guestrin, Moshe Eizenman, Erez Eizenman jeff.kang@utoronto.ca June 9, 2006

Quantification of Mood Disorders

Page 7: Point-of-Gaze Estimation: Theory and Applications Jeff Kang, Elias Guestrin, Moshe Eizenman, Erez Eizenman jeff.kang@utoronto.ca June 9, 2006

Quantification of Mood Disorders

Page 8: Point-of-Gaze Estimation: Theory and Applications Jeff Kang, Elias Guestrin, Moshe Eizenman, Erez Eizenman jeff.kang@utoronto.ca June 9, 2006

Reading Behaviour

Page 9: Point-of-Gaze Estimation: Theory and Applications Jeff Kang, Elias Guestrin, Moshe Eizenman, Erez Eizenman jeff.kang@utoronto.ca June 9, 2006

Reading Behaviour

Page 10: Point-of-Gaze Estimation: Theory and Applications Jeff Kang, Elias Guestrin, Moshe Eizenman, Erez Eizenman jeff.kang@utoronto.ca June 9, 2006

Research Directions

Image Processing• Adaptive algorithms

• Neural networks Current Projects

• Study of vision and reading disorders caused by brain lesions (Toronto Western Hospital)

• Development of vision tests for pre-verbal infants (Toronto Hospital for Sick Children)

• Development of reading aids for Age-related Macular Generation patients (University of Waterloo, School of Optometry)

Page 11: Point-of-Gaze Estimation: Theory and Applications Jeff Kang, Elias Guestrin, Moshe Eizenman, Erez Eizenman jeff.kang@utoronto.ca June 9, 2006

Questions

Contact:

Jeff Kang ([email protected])