GESTURE PHONESAuthors

Krishna Kumar. S & Sai Venkata Vinay. C

1Dept of Electronics & Communication Engg

SONA COLLEGE OF TECHNOLOGY, SALEM

2

What is a Gesture Phone? Different tracking methods

◦ Optical tracking Stereoscopic vision technology Triangulation

◦ Inertial tracking Cases of gesture recognition technology Future innovations

TABLE OF CONTENTS

Dept of Electronics & Communication Engg

3

Phones which recognize our gestures and movements either using touch or touch free technology

WHAT IS A GESTURE PHONE?

http://www.pointgrab.com/276/gesture-mobile/http://www.fastcompany.com/1570274/how-use-androids-gesture-search-and-leave-your-phones-keyboard-behind

Dept of Electronics & Communication Engg

4

Optical tracking Inertial tracking

DIFFERENT TRACKING METHODS

www.ti.com/lit/wp/spry199/spry199.pdf

Dept of Electronics & Communication Engg

5

Optical tracking:◦ Two different cameras ◦ Triangulation method

Inertial tracking :◦ Single camera◦ Rolling shutters

DIFFERENT TRACKING METHODS

http://www.ti.com/lit/wp/spry199/spry199.pdf

Dept of Electronics & Communication Engg

Source :Real-time Motion Tracking on a Cellphone using Inertial Sensing and a Rolling-Shutter Camera.

The common technologies used are◦ Stereoscopic vision◦ Structured light pattern◦ Time of flight(TOF)

Optical tracking

Dept of Electronics & Communication Engg6

Source:www2.maths.lth.se

Two images shot Image processed using triangulation Calculates the depth of the image

STEREOSCOPIC VISION TECHNOLOGY

http://www.ti.com/lit/wp/spry199/spry199.pdf

Dept of Electronics & Communication Engg7

TRIANGULATION

Dept of Electronics & Communication Engg8

Source:www2.maths.lth.se

Independent of external structure Pixels are captured row by row

INERTIAL TRACKING

Dept of Electronics & Communication Engg9

Source :Real-time Motion Tracking on a Cell phone using Inertial Sensing and a Rolling-Shutter Camera.

Dept of Electronics & Communication Engg10

Source: Real-time Motion Tracking on a Cell phone using Inertial Sensing and a Rolling-Shutter Camera.

11

Answer call Operate other devices Browse web pages and scroll e-books Switch off mobile

CASES OF GESTURE RECOGNITION TECHNOLOGY

Dept of Electronics & Communication Engg

www.thorntech.com Source: EFY June 2013

Point grab’s solution Air swiper Hovering controls Blow to unlock

ANDROIDS AND WINDOWS PHONES

12

Source: androios-tveaks.blogspot.com

Source: androios-tveaks.blogspot.com

Flexible programming environment User friendly Multitasking Easy optimizing and paralyzing data portable

BENEFITS OF GESTURE TECHNOLOGY

13Dept of Electronics & Communication Engg

Depends on compiler’s performance Power consumption High clock cycle High standard processor required Requires lighting Gorilla arm

CHALLENGES

14Dept of Electronics & Communication Engg

Ultrasonic on phone for industries Infrared waves can be used for smaller application Burglar alarm Background smudging Pausing of signal transmission

INNOVATIONS

15Dept of Electronics & Communication Engg

16

1. BongWhan Choe, Jun-Ki Min, and Sung-Bae Cho; Online Gesture Recognition for User Interface.

2. Mingyang Li, Byung Hyung Kim and Anastasios I. Mourikis; Real-time Motion Tracking on a Cellphone using Inertial Sensing and a Rolling-Shutter Camera.

3. Mingyu Chen, Ghassan AlRegib, Senior Member, IEEE, and Biing-Hwang Juang, Fellow, IEEE; Feature Processing and Modeling for 6D Motion Gesture Recognition.

4. Dong-ik ko, Lead engineer, gesture recognition and depth –sensing gaurav agarwal, Manager, Gesture recognition and depth-sensing; Gesture recognition: Enabling natural interactions with electronics.

REFERENCES

Dept of Electronics & Communication Engg