3 Dimensional Gestures Documented at Embedded Interaction Lab (EILab)
3D Gesture Documentation is an attempt to provide an overview of possible 3D gestures, which can be implemented in gestural user interfaces for variety of purposes. It highlights possible functionality associated with it. The functionalities given in this document are general purpose, it may vary with the context and its users It is gathered from existing literature and initial research activity (ongoing) on identi!cation of appropriate gestures for social acceptance in collaboration with IBM Research (India). This documentation is the !rst draft, which will further be updated at various stages and intimated
The document is divided into three major sections: • Upper body gestures Gestures that involve upper body (above waist) • Lower body gestures Gestures that involve lower body (below waist) • Full body gestures Gestures that involve full body
These three categories are further sub divided into static gestures and dynmaic gestures. Static Gesture Static gestures are postures that does not take movements into account. For example, stop gesture can be performed to stop ongoing video. Posture of “palm facing” is detected to activate stop action, but the movement of hand is not considered.
These three categories are further sub divided into static gestures and dynmaic gestures. Dynamic Gesture Dynamic gestures are movements. Dynamics in a gesture provide a meaning, which are taken into consideration to activate an action. For example, in drag gesture, initial and last position of hand movement is interpreted to activate appropriate action
Upper body gestures Gestures that involve upper body (above waist)
Upper Body 3 Dimensional Gestures Static Gestures
Stare Narrowed eyes
Wink Wink with tilted neck (left/right)
Delete a choice; unlike a choice or provide alternative choices
Zoom-in a choice; maximize a choice; increase brightness of a system
Favourite a choice; select or con!rm a choice
Favourite choice on extreme side (right/left); select or con!rm a choice on extreme side (right/left)
Huh I Ponh (left)
Ponh (right) Tongue out
Remove favourite tag of a choice; provide alternative choice
Select or con!rm a choice on left side
Select or con!rm a choice on right side
Remove favourite tag of a choice; delete a choice; provide alternative choice
Upper Body 3 Dimensional Gestures Static Gestures
Head up Head down
Head sideways (left) Head sideways (right)
Scroll up; increase properties of a choice (e.g. Increase volume of a selected song)
Scroll down; decrease properties of a choice (e.g. Decrease volume of selected song)
Scroll left side Scroll right side
Upper Body 3 Dimensional Gestures Static Gestures
Head scratching Binocular
Call me Hands covering lips
Help required; provide clues for appropriate actions
Zoom-in a choice; increase resolution of screen
Call or connect to selected choice
Mute; decrease volume
Upper Body 3 Dimensional Gestures Static Gestures
Elbow bend Victory
Fist Thumbs up
Pause an ongoing activity
Select or con!rm a choice; favourite a choice
Grab and select or con!rm a choice
Increase properties of a function; favourite a choice
Upper Body 3 Dimensional Gestures Static Gestures
Thumbs down Salute
Hold Sshhh!!
Decrease properties of a function; remove favourite tag of a choice
Select or con!rm a choice; upgrade a choice to most priority contents
Select multiple choices together
Mute; decrease volume
Upper Body 3 Dimensional Gestures Static Gestures
Surprise Eat
Hands folded Stop
Help required; activate favorite choice
Select or con!rm food related choice
Pause; start a system Stop ongoing activity
Upper Body 3 Dimensional Gestures Static Gestures
Slap (fear) Perfect
Delete a choice; hide a choice
Select or con!rm a choice; favourite a choice
Palm upwards Palm downwards
Increase properties of a function; scroll up
Decrease properties of a function; scroll down
Upper Body 3 Dimensional Gestures Static Gestures
Shoot Think
Select or con!rm a choice; !re bullets in action games
Help required
Hook Hands behind ears
Select or con!rm a choice; tag a choice
Increase sound/volume of a selected choice
Upper Body 3 Dimensional Gestures Static Gestures
Yawn
Deselect a choice; provide alternative choice
Upper Body 3 Dimensional Gestures Static Gestures
Pinch in & Pinch out
Increase/decrease properties of a choice; majorly used in zoom in/out an image
Pak pakkapak
Dislike a choice; provide alternative choice
Upper Body 3 Dimensional Gestures Dynamic Gestures
Snapping
Select or con!rm a choice; !re bullets in action games
Driving
Controlling of car in car games
Upper Body 3 Dimensional Gestures Dynamic Gestures
In-air tap
Select or con!rm a choice;
Both hands open & close (horizontal)
Increase/decrease properties of selected choice (e.g. Increase/decrease of a volume of selected song)
Upper Body 3 Dimensional Gestures Dynamic Gestures
Both hands open & close (vertical)
Increase/decrease properties of selected choice (e.g. Increase/decrease of a volume of selected song)
Forward hand push
Select or con!rm a choice
Upper Body 3 Dimensional Gestures Dynamic Gestures
Grab and drag
Grab a choice and drag it to desired place
Wave
Start the system; go back to main menu of a system
Upper Body 3 Dimensional Gestures Dynamic Gestures
Swipe (left to right)
Horizontal scrolling of contents in left to right direction
Swipe (right to left)
Horizontal scrolling of contents in right to left direction
Upper Body 3 Dimensional Gestures Dynamic Gestures
Punch
Delete a choice; in some cases, select a choice (e.g. punch to blast away your calories)
Yesss!!
Select or con!rm a choice; favourite a choice
Upper Body 3 Dimensional Gestures Dynamic Gestures
Arey..suno
Pause ongoing activity
Swimming
Provide details of selected contents; zoom-in a choice
Upper Body 3 Dimensional Gestures Dynamic Gestures
Cut-throat
Delete a choice; deselect a choice
Fist opening
Select or con!rm a choice to activate it
Upper Body 3 Dimensional Gestures Dynamic Gestures
Swipe right hand (sideways)
Horizontal scrolling from left-right direction
Swipe left hand (sideways)
Horizontal scrolling from right to left direction
Upper Body 3 Dimensional Gestures Dynamic Gestures
Grab and drag
Grab and drag a choice and move to drop
Upper Body 3 Dimensional Gestures Dynamic Gestures
Spit
Delete a choice; dislike a choice; deselect a choice
Upper body movement (both sides)
Horizontal scrolling from left-to-right direction and vice versa
Upper Body 3 Dimensional Gestures Dynamic Gestures
Head butt
Delete a choice
Head movement (only one time) like “Yes”
Select or con!rm a choice
Upper Body 3 Dimensional Gestures Dynamic Gestures
Head movement (only one time) like “No”
Deselect a choice; delete a choice; remove choice from favourite tag
Upper Body 3 Dimensional Gestures Dynamic Gestures
Lower body gestures Gestures that involve lower body (below waist) movements
Lower Body 3 Dimensional Gestures Static Gestures
Right leg upwards Left leg upwards
Left leg forward kick Right leg forward kick
Select or con!rm a choice on right side; horizontal scrolling from right side
Select or con!rm a choice on left side; horizontal scrolling from left side
Delete a choice; kick a choice; Select or con!rm a choice on lower left side; increase properties of a choice
Delete a choice; kick a choice; Select or con!rm a choice on lower right side; increase properties of a choice
Left leg backward Right leg backward
Jump Crossed legs
Select or con!rm a choice on left side; horizontal scrolling from left side; decrease properties of a choice
Select or con!rm a choice on right side; horizontal scrolling from right side; decrease properties of a choice
Select or con!rm your choice; increase properties of a choice
Pause ongoing activity
Lower Body 3 Dimensional Gestures Static Gestures
Bent ankle Toes upward
Right toe forward Right toe backward
Increase properties of a choice; select or con!rm a choice on left side; left forward scrolling; pause or stop ongoing activity
Pause ongoing activity; increase properties of a choice
Increase properties of a choice; select or con!rm a choice on right side; right forward scrolling
Decrease properties of a choice; select or con!rm a choice on right side; right backward scrolling
Lower Body 3 Dimensional Gestures Static Gestures
Sitting Crossed legs (right) - I
Crossed legs (left) - I Crossed legs (right) - II
Start a system Pause ongoing activity; activate favourite choices
Pause ongoing activity; activate favorite choices
Pause ongoing activity
Lower Body 3 Dimensional Gestures Static Gestures
Full body gestures Gestures that involve full body movement
Full Body 3 Dimensional Gestures Static Gestures
Stand – hands on waist Stand – hands on hips
Tired Huh
Pause ongoing activity; start a system; activate serious applications; return to default
Pause ongoing activity; stop ongoing activity
Dislike a choice; provide alternative choice
Dislike a choice; provide alternative choice; delete a choice; remove choice from favourite
Hands open & bend left/right
Hit
A step towards left/right
Bend forward
Obstruct moving objects
Delete a choice; stop ongoing activity; hit an object with a racket (e.g. Hitting a tennis ball)
View previous/next set of contents
Activate a choice; fast forward; move a choice forward
Full Body 3 Dimensional Gestures Static Gestures
Bend left Bend right
Fly (left) Fly (right)
Select or con!rm a choice on left side; horizontal scroll on left
Select or con!rm a choice on right side; horizontal scroll on right
Select or con!rm a choice on left side; horizontal scroll on left
Select or con!rm a choice on right side; horizontal scroll on right
Full Body 3 Dimensional Gestures Static Gestures
Squat Sitting on toes
Activate a choice; activate favourite choices
Start a system; activate favourite choices
Namaste
Start a system; activate a choice
Full Body 3 Dimensional Gestures Static Gestures
Embedded Interaction Lab (EILab) Team Denny George, Mannu Amrit, Minal Jain and Keyur Sorathia A special thanks to Shreya Raina. Special mention: Moupiya Ukil and Amlan Abhinav