View
1
Download
0
Category
Preview:
Citation preview
GazeDetec)onandTrackingKyleSchulz•CSCI512•Spring2013
VisionExten)on
GazeDetec)onandTrackingKyleSchulz•CSCI512•Spring2013
Goals
1. Enhanceuser’sexperience• Extendvisionbeyondrestric@ons• Createseamlessintegra@on
2. Enhanceviewer’sexperience• Createillusionofreality• Mimicfinernuances
GazeDetec)onandTrackingKyleSchulz•CSCI512•Spring2013
Process
1. Buildcapturemechanism2. Captureuser’seye3. Locateeyesinreal@me4. Determinegaze5. Projectontoexternalcameras6. Compositexternals
CurrentProgress
GazeDetec)onandTrackingKyleSchulz•CSCI512•Spring2013
BuildingtheCaptureMechanism
CheapWebcam
IRFilter
CameraFilm
GazeDetec)onandTrackingKyleSchulz•CSCI512•Spring2013
BuildingtheCaptureMechanism
Lens
USBPower
IRLEDs
GazeDetec)onandTrackingKyleSchulz•CSCI512•Spring2013
CaptureUser’sEye
• OpenCV• C++• Grabsimagefromvideo
stream• Issomewhatclunkywith
mul@plecameras• IRallowsforsemi‐stable
imagecondi@ons
GazeDetec)onandTrackingKyleSchulz•CSCI512•Spring2013
LocateEyesinReal)me
• Converttograyscale• Dialateanderodetoremove
LEDglareandnoise• Erodeanddialatetoremove
damagedCCDpixelsanddust
• Playwithhistogramstoenhancecontrast
GazeDetec)onandTrackingKyleSchulz•CSCI512•Spring2013
LocateEyesinReal)me
• DynamicThresholding• Storesaminandmax
successfulthreshold• Checksmin,maxand
averagewhenlost• Returnsanareasimilartoan
elipse• LessaccurateinIRsitua@ons
GazeDetec)onandTrackingKyleSchulz•CSCI512•Spring2013
LocateEyesinReal)me
• Applygausianblur• Usecannyeedgedetector• Findthe“blobs”,compute
theirarea• Findboundingrectangle• Compareareawithbounding
rectangle’sellipsearea• Returnbestcandidate
GazeDetec)onandTrackingKyleSchulz•CSCI512•Spring2013
LocateEyesinReal)me
• Useeitherorbothsolu@onstobestdeterminepupilloca@on
• Persistance,smoothing
GazeDetec)onandTrackingKyleSchulz•CSCI512•Spring2013
DetermineGaze
PossibleSolu)ons
• Usewidthofirisandloca@onofcamera
• Calibratewithextentsofvision
• Detecteyeasawhole
Recommended