26
• gesture recognition https://store.theartofservice.com/the-gesture-recognition- toolkit.html

Gesture recognition

Embed Size (px)

Citation preview

Page 1: Gesture recognition

• gesture recognition

https://store.theartofservice.com/the-gesture-recognition-toolkit.html

Page 2: Gesture recognition

Gesture recognition

1 However, the identification and recognition of posture, gait, proxemics, and human behaviors

is also the subject of gesture recognition techniques.Matthias Rehm, Nikolaus Bee,

Elisabeth André, [http://mm-werkstatt.informatik.uni-augsburg.de/files/publications/199/wave_like_an_egyptian_final.pdf Wave Like an Egyptian - Accelerometer Based

Gesture Recognition for Culture Specific Interactions], British Computer Society, 2007

https://store.theartofservice.com/the-gesture-recognition-toolkit.html

Page 3: Gesture recognition

Gesture recognition

1 Gesture recognition can be seen as a way for computers to begin to

understand human body language, thus building a richer bridge between machines and humans than primitive

text user interfaces or even GUIs (graphical user interfaces), which still

limit the majority of input to keyboard and mouse.

https://store.theartofservice.com/the-gesture-recognition-toolkit.html

Page 4: Gesture recognition

Gesture recognition

1 Gesture recognition enables humans to communicate with the machine (User interface|

HMI) and interact naturally without any mechanical devices. Using the concept of

gesture recognition, it is possible to point a finger at the computer screen so that the Cursor (computers)|cursor will move accordingly. This

could potentially make conventional input devices such as mouse (computing)|mouse,

computer keyboard|keyboards and even touch screen|touch-screens redundant.

https://store.theartofservice.com/the-gesture-recognition-toolkit.html

Page 5: Gesture recognition

Gesture recognition

1 Gesture recognition can be conducted with techniques from computer vision and image

processing.

https://store.theartofservice.com/the-gesture-recognition-toolkit.html

Page 6: Gesture recognition

Gesture recognition

1 [http://reference.kfupm.edu.sa/content/v/i/

vision_based_gesture_recognition__a_revi_291732.pdf Vision-Based Gesture

Recognition: A Review], In: Gesture-Based Communication in Human-Computer Interaction, Volume 1739 of Springer

Lecture Notes in Computer Science, pages 103-115, 1999, ISBN 978-3-540-66935-7,

Alejandro Jaimesa and Nicu Sebe,

https://store.theartofservice.com/the-gesture-recognition-toolkit.html

Page 7: Gesture recognition

Gesture recognition

1 This is computer interaction through the drawing of symbols with a pointing device cursor.Dopertchouk, Oleg;

[http://www.gamedev.net/page/resources/_/technical/game-programming/recognition-of-handwritten-gestures-r2039

Recognition of Handwriting Gestures], gamedev.net, January 9, 2004Chen, Shijie;

[http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=5693514tag=1 Gesture Recognition Techniques

in Handwriting Recognition Application], Frontiers in Handwriting Recognition p 142-147 November 2010Balaji,

R; Deepu, V; Madhvanath, Sriganesh; Prabhakaran, Jayasree [http://www.hpl.hp.com/india/documents/papers/GKB_IWFHR10_Final.pdf Handwritten Gesture Recognition for Gesture

Keyboard], Hewlett-Packard Laboratories (see Pen computing)

https://store.theartofservice.com/the-gesture-recognition-toolkit.html

Page 8: Gesture recognition

Gesture recognition - Uses

1 Gesture recognition is useful for processing information from humans that is not conveyed through speech or type. There are also various types of gestures that can be identified by

computers.

https://store.theartofservice.com/the-gesture-recognition-toolkit.html

Page 9: Gesture recognition

Gesture recognition - Uses

1 *'Sign language recognition'. Just as speech recognition can transcribe speech to text,

certain types of gesture recognition software can transcribe the symbols represented through

sign language into text.Thad Starner, Alex Pentland,

[http://citeseer.comp.nus.edu.sg/cache/papers/cs/405/ftp:zSzzSzwhitechapel.media.mit.eduzSzp

ubzSztech-reportszSzTR-306.ps.gz/starner95visual.ps.gz Visual Recognition of

American Sign Language Using Hidden Markov Models], Massachusetts Institute of Technology

https://store.theartofservice.com/the-gesture-recognition-toolkit.html

Page 10: Gesture recognition

Gesture recognition - Uses

1 *'Directional indication through pointing'. Pointing has a very specific purpose in our society, to reference an object or location based on its position relative to ourselves.

The use of gesture recognition to determine where a person is pointing is

useful for identifying the context of statements or instructions. This application

is of particular interest in the field of robotics.Kai Nickel, Rainer Stiefelhagen,

https://store.theartofservice.com/the-gesture-recognition-toolkit.html

Page 11: Gesture recognition

Gesture recognition - Uses

1 *'Control through facial gestures'. Controlling a computer through facial

gestures is a useful application of gesture recognition for users who

may not physically be able to use a mouse or keyboard. Eye tracking in

particular may be of use for controlling cursor motion or focusing

on elements of a display.

https://store.theartofservice.com/the-gesture-recognition-toolkit.html

Page 12: Gesture recognition

Gesture recognition - Uses

1 Foregoing the traditional keyboard and mouse setup to interact with a

computer, strong gesture recognition could allow users to accomplish frequent or common tasks using

hand or face gestures to a camera.Lars Bretzner and Tony

Lindeberg [http://www.csc.kth.se/cvap/abstracts/brelin-eccv98.html Use Your Hand as

a 3-D Mouse ...], Prochttps://store.theartofservice.com/the-gesture-recognition-toolkit.html

Page 13: Gesture recognition

Gesture recognition - Uses

1 *'Affective computing'. In affective computing, gesture recognition is used in the process of identifying

emotional expression through computer systems.

https://store.theartofservice.com/the-gesture-recognition-toolkit.html

Page 14: Gesture recognition

Gesture recognition - Uses

1 Through the use of gesture recognition, remote control with the wave of a hand of various devices is

possible

https://store.theartofservice.com/the-gesture-recognition-toolkit.html

Page 15: Gesture recognition

Gesture recognition - Input devices

1 The ability to track a person's movements and determine what

gestures they may be performing can be achieved through various tools. Although there is a large amount of research done in image/video based gesture recognition, there is some

variation within the tools and environments used between

implementations.https://store.theartofservice.com/the-gesture-recognition-toolkit.html

Page 16: Gesture recognition

Gesture recognition - Input devices

1 These can be effective for detection of hand gestures due to their short

range capabilities.Yang Liu, Yunde Jia, A Robust Hand Tracking and Gesture

Recognition Method for Wearable Visual Interfaces and Its Applications, Proceedings of the Third International Conference on Image and Graphics

(ICIG’04), 2004

https://store.theartofservice.com/the-gesture-recognition-toolkit.html

Page 17: Gesture recognition

Gesture recognition - Input devices

1 Mouse gestures are one such example, where the motion of the mouse is correlated to a symbol being drawn by a person's hand, as

is the Wii Remote, which can study changes in acceleration over time to represent gestures.Per Malmestig, Sofie Sundberg,

[http://www.tricomsolutions.com/academic_reports.html SignWiiver - implementation of sign language technology]Thomas Schlomer,

Benjamin Poppinga, Niels Henze, Susanne Boll, [http://www.wiigee.com/download_files/gesture_recognition_with_a_

wii_controller-schloemer_poppinga_henze_boll.pdf Gesture Recognition with a Wii Controller], Proceedings of the 2nd

international Conference on Tangible and Embedded interaction, 2008AiLive Inc.,

[http://www.ailive.net/papers/LiveMoveWhitePaper_en.pdf LiveMove White Paper], 2006 Devices such as the LG Electronics Magic Wand, the Loop and the Scoop use Hillcrest Labs' Freespace technology,

which uses MEMS accelerometers, gyroscopes and other sensors to translate gestures into cursor movement

https://store.theartofservice.com/the-gesture-recognition-toolkit.html

Page 18: Gesture recognition

Gesture recognition - Input devices

1 Software-based gesture recognition technology using a standard 2D

camera that can detect robust hand gestures, hand signs, as well as track hands or fingertip at high accuracy

has already been embedded in Lenovo’s Yoga ultrabooks , Pantech’s

Vega LTE smartphones, Hisense’s Smart TV models, among other

devices.https://store.theartofservice.com/the-gesture-recognition-toolkit.html

Page 19: Gesture recognition

Gesture recognition - Algorithms

1 Some literature differentiates 2 different approaches in gesture

recognition: a 3D model based and an appearance-based.Vladimir I

https://store.theartofservice.com/the-gesture-recognition-toolkit.html

Page 20: Gesture recognition

Gesture recognition - Challenges

1 There are many challenges associated with the accuracy and usefulness of gesture recognition

software. For image-based gesture recognition there are limitations on

the equipment used and image noise. Images or video may not be under consistent lighting, or in the

same location. Items in the background or distinct features of the users may make recognition

more difficult.

https://store.theartofservice.com/the-gesture-recognition-toolkit.html

Page 21: Gesture recognition

Gesture recognition - Challenges

1 The variety of implementations for image-based gesture recognition may also cause issue for

viability of the technology to general usage. For example, an algorithm calibrated for one

camera may not work for a different camera. The amount of background noise also causes

tracking and recognition difficulties, especially when occlusions (partial and full) occur.

Furthermore, the distance from the camera, and the camera's resolution and quality, also cause

variations in recognition accuracy.

https://store.theartofservice.com/the-gesture-recognition-toolkit.html

Page 22: Gesture recognition

Gesture recognition - Challenges

1 ISBN 978-3-540-42317-1, Lars Bretzner, Ivan Laptev, Tony Lindeberg

[http://www.csc.kth.se/cvap/abstracts/BreLapLin-FG02.html Hand gesture recognition

using multi-scale colour features, hierarchical models and particle filtering], Proceedings of the Fifth IEEE International

Conference on Automatic Face and Gesture Recognition, Washington, DC, USA, 21–21 May 2002, pages 423-428

https://store.theartofservice.com/the-gesture-recognition-toolkit.html

Page 23: Gesture recognition

Gesture recognition - Challenges

1 Proceedings Computer Vision and Pattern Recognition Workshop, May 27-June 2, 2004, Xia Liu Fujimura, K., Hand gesture recognition using

depth data, Proceedings of the Sixth IEEE International Conference on

Automatic Face and Gesture Recognition, May 17–19, 2004

https://store.theartofservice.com/the-gesture-recognition-toolkit.html

Page 24: Gesture recognition

Handheld projectors - Hand gesture recognition

1 A modified laser projector has been used to perform gesture recognition and finger tracking using laser-based

active tracking techniques at the University of Tokyo

([http://www.k2.t.u-tokyo.ac.jp/perception/SmartLaserTracking/index-e.html Smart Laser Scanner] and

[http://www.k2.t.u-tokyo.ac.jp/perception/SLP/index-e.html Laser Sensing

Display]).https://store.theartofservice.com/the-gesture-recognition-toolkit.html

Page 25: Gesture recognition

Pen computing - Gesture recognition

1 The PenPoint OS was a special Operating System which

incorporated gesture recognition and handwriting input at all levels of the

Operating System. Prior systems which employed gesture recognition

only did so within special applications, such as CAD/CAM applications or text processing.

https://store.theartofservice.com/the-gesture-recognition-toolkit.html