32
Cultural awareness and personal customization of gestural commands using a shamanic interface Leonel Morgado [email protected] INESC TEC (formerly INESC Porto) Universidade Aberta (Portuguese Open University)

Cultural awareness and personal customization of gestural commands using a shamanic interface

Embed Size (px)

DESCRIPTION

Presentation given at 5th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-exclusion (DSAI 2013) in Vigo. Abstract: Gesture-based interfaces to control systems using full body or upper torso motions are becoming more common, particularly in the entertainment industry but increasingly in other domains. These interfaces may represent significant hurdles for individuals with motion or balance impairments. Even for non-impaired users, commands which are not readily represented by body mimicry require users to learn new non-intuitive gestures for adding layers of complexity in commands. In this paper, a reflection and clarification of these challenges is presented, based on some sample usage cases. Then a possibly solution path is presented, resorting to an idea originating in a science fiction novel, the shamanic interface imagined by Daniel Suarez. A reflection on its feasibility and on possible paths towards its creation is presented, as well as the possible impacts to render gesture-based interfaces more accessible to all and potentially easier to learn due to enhanced cultural awareness. The basic idea presented in this reflection paper is that the creation of a concern-separation layer between the gestures being executed by the users and their interpretation by computing systems can contribute both to the access by users with special needs and to all users in general, by enabling customized approaches to gesture-based control..

Citation preview

Page 1: Cultural awareness and personal customization of gestural commands using a shamanic interface

Cultural awarenessand personal customization

of gestural commandsusing a shamanic interface

Leonel [email protected]

INESC TEC (formerly INESC Porto)

Universidade Aberta(Portuguese Open University)

Portugal

Page 2: Cultural awareness and personal customization of gestural commands using a shamanic interface
Page 3: Cultural awareness and personal customization of gestural commands using a shamanic interface
Page 4: Cultural awareness and personal customization of gestural commands using a shamanic interface
Page 5: Cultural awareness and personal customization of gestural commands using a shamanic interface

Low cost motion-capturing devices

Page 6: Cultural awareness and personal customization of gestural commands using a shamanic interface

Libraries/Frameworks for gestures in applications

Page 7: Cultural awareness and personal customization of gestural commands using a shamanic interface

Pipeline

http://neurogami.com/presentations/KinectForArtists/

Depth Data

http://i.imgur.com/OdxJm.png

Skeleton Data

Page 8: Cultural awareness and personal customization of gestural commands using a shamanic interface
Page 9: Cultural awareness and personal customization of gestural commands using a shamanic interface

Limitations

1 2 3

Page 10: Cultural awareness and personal customization of gestural commands using a shamanic interface

http://www.youtube.com/watch?v=vuiRUV5LWuk

Precision and synchronicity1

Page 11: Cultural awareness and personal customization of gestural commands using a shamanic interface

Unnatural motion2

http://www.flickr.com/photos/kikas_babenco/9119057052/sizes/o/in/photostream/

http://blog.case.edu/lev.gonick/2007/03/19/exp_flying.jpg

Page 12: Cultural awareness and personal customization of gestural commands using a shamanic interface

Non-kinestesic concepts3

Wave to Kinect(“start”)

Guide(“stop”)

Page 13: Cultural awareness and personal customization of gestural commands using a shamanic interface
Page 14: Cultural awareness and personal customization of gestural commands using a shamanic interface
Page 15: Cultural awareness and personal customization of gestural commands using a shamanic interface

Which gestures?

Page 16: Cultural awareness and personal customization of gestural commands using a shamanic interface

http://www.travelinsurance.org/gestures/

Page 17: Cultural awareness and personal customization of gestural commands using a shamanic interface

Non-kinestesic concepts3

Wave to Kinect(“start”)

Guide(“stop”)

Page 18: Cultural awareness and personal customization of gestural commands using a shamanic interface

Non-kinestesic concepts3Holding “window pane” to pan and zoom

http://www.youtube.com/watch?v=ehTvtkybubM

Page 19: Cultural awareness and personal customization of gestural commands using a shamanic interface

Non-kinestesic concepts3

http://www.keiichimatsuda.com/augmented.php“Augmented (hyper)Reality: Domestic Robocop”

Page 20: Cultural awareness and personal customization of gestural commands using a shamanic interface

Non-kinestesic concepts3“Augmented (hyper)Reality: Domestic Robocop”

http://www.keiichimatsuda.com/augmented.php

Page 21: Cultural awareness and personal customization of gestural commands using a shamanic interface

& Culture

Page 22: Cultural awareness and personal customization of gestural commands using a shamanic interface
Page 23: Cultural awareness and personal customization of gestural commands using a shamanic interface

Shamanic interface

Page 24: Cultural awareness and personal customization of gestural commands using a shamanic interface
Page 25: Cultural awareness and personal customization of gestural commands using a shamanic interface

One interface for all cultural backgrounds is utopian……but connecting gestural metaphors to cultural background in order to overcome technological

literacy and support learning may be viable.

Page 26: Cultural awareness and personal customization of gestural commands using a shamanic interface
Page 27: Cultural awareness and personal customization of gestural commands using a shamanic interface

…particularly to provide end-users with better access to advanced behaviours.

Page 28: Cultural awareness and personal customization of gestural commands using a shamanic interface

Aveiro, Portugal: Saint Gonçalinho celebration

Page 29: Cultural awareness and personal customization of gestural commands using a shamanic interface
Page 30: Cultural awareness and personal customization of gestural commands using a shamanic interface

Cuna people, Panama: inna suid, rite of cutting a girl’s hair

Page 31: Cultural awareness and personal customization of gestural commands using a shamanic interface
Page 32: Cultural awareness and personal customization of gestural commands using a shamanic interface

Want to cooperate? Get in touch!

[email protected]