GESTURE RECOGNITION TECHNOLOGY

CONTENTS• What are gestures and types of gestures.• What is gesture recognition? And its example• Basic working of gesture recognition system• Hand gesture recognition• Facial gesture recognition• Sign language recognition• Gesture sensing technology• Technology behind it• Algorithms• Uses of gesture recognition• Gesture recognition challenges

What are gestures?

• A gesture is a form of non-verbal communication.

• Visible bodily actions communicate particular messages.

• Gestures include movement of the hands, face, or other parts of the body.

Types of gestures

• Iconic gestures• Pointing gestures• Metaphoric gestures• Beat gestures

What is gesture recognition?

EXAMPLE

A smart TV recognizing the hand movement to control the channels or to select a option from the menu.

Basic working of gesture recognition technology

User interface User interface displaydisplay

Standard web Standard web cameracamera

useruserUpdating

object

Image capture

Image inputImage input

Hand movement

Hand gesture recognition

Hand gesture recognition technology allows operations of complex machines using only a series of fingers and hand movements ,

eliminating the need of physical contact between operator and machine

Facial gesture recognitionFacial Gesture Recognition

creates an effective non-contact interface between user and their

machines

The goal of facial Gesture Recognition is to make

machine effectively understand human emotions.

Even most cameras detects your smile to automatically click a

picture

Sign language recognitionCertain types of gesture recognition software can transcribe the symbols represented through sign language

into text

Effective sign language recognition can help the deaf people to communicate with

both other people as well as the machine

Gesture sensing technologyElectric Field sensing technology

Proximity of a human body or body part can be measured by

sensing electric fields .

These measurements can be used to measure the distance

of a human hand or other body part from an object; this

facilitates a vast range of applications for a wide range

of industries.

Device sensing technology

Device-based techniques use a glove or other position tracker, whose movements send signals that the

system uses to identify the gesture.

The glove is equipped with a variety of sensors to provide information about hand position, orientation, and flex of

fingers.

Technology behind it...Wired gloves

These can provide input to the computer about the position and

rotation of the hands using magnetic devices.

The first commercially available hand-tracking glove-type device was the Data Glove , a glove-type device which could

detect hand position, movement and finger bending.

This uses fiber optic cables running down the back of the hand. Light pulses are created and when the fingers are bent, light leaks through small cracks and the loss is registered, giving

an approximation of the hand pose.

Stereo cameras

A Stereo camera is a camera that has two lenses about the same distance apart as your eyes and takes two pictures at the

same time. This simulates the way we actually see and therefore creates the 3D

effect when viewed.

Using two cameras whose relations to one another are known, a 3D

representation can be approximated by the output of the

cameras.

Depth-aware cameras

Using specialized cameras such as structured light or time-of-

flight cameras, one can generate a depth map of what is being seen

through the camera at a short range, and use this data to

approximate a 3d representation of what is being seen.

These can be effective for detection of hand gestures due to their short range

capabilities.

Thermal cameras

An infrared camera is a device that detects infrared radiation(temperature) from the

target object and converts it into an electronic signal to generate a thermal

picture on a monitor or to make temperature calculations on it.

Algorithms

3-D model based

Skeletal based algorithm

Appearance based

Use of gesture recognition technology

Just as speech recognition can transcribe speech to text, certain types of gesture recognition software can transcribe the

symbols represented through sign language into text.

Sign language recognition

For systems where the act of finding or acquiring a physical controller could require too much time, gestures can be used as an alternative control mechanism. Controlling secondary devices in a car, or controlling a television set are examples of such usage.

Through the use of gesture recognition, remote control with the wave of a hand of various devices is

possible.

Virtual controllers

Remote control

Machine wheel chairs are coming with gesture based system. The

movement of the hand will act as a controller of speed as well as

direction

In video game consoles such as Microsoft X-box with kinect sensors, often the user is the

controller and has to perform all physical movements that they desire

the character in the game to do.

Aid to physically challenged

Immersive gaming technology

challenges

Different users make gestures differently, causing difficulty in identifying motions

Many gesture recognition systems do not read motions accurately or optimally due

to factors like insufficient background light, high background noise etc

Lack of gesture language

Robustness

Made by:- JINaL THaKRaR(57)