Embed Size (px)
Citation preview
A Nose Gesture Interface Device: Extending Virtual Realities
2
Saved the most important for last
“A Nose Gesture Interface Device: Extending Virtual Realities”
Tyson R. Henry, Scott E. Hudson, Andrey K. Yeatts, Brad A. Myers, and Steven Feiner, Proceedings of UIST ‘91, November 11 - 13, 1991, Hilton Head, NC, pp. 65-68
http://www.acm.org/pubs/citations/proceedings/uist/120782/p65-henry/
3
Some of the most important VR work ever published Had its own special session at
UIST ‘91 Reprinted in Presence (the main
VR journal), April 1992.
Will recreate the presentation here
A Nose Gesture Interface Device: Extending Virtual RealitiesTyson Henry* University of New MexicoScott Hudson* Carnegie MellonAndrey Yeatts University of ArizonaBrad Myers Carnegie MellonSteven Feiner Columbia University
*at the University of Arizona in 1991
5
Motivation
Current virtual reality systems are just too limited
Goal: improved sense of presenceExtensions to other
sensesFull body interaction
6
Rhino-Virtual Realities
The potential of the nose has been sorely neglected in previous systems
To remedy this we have developed ...
7
The DATANOSE™
8
Offers Support for True Multi-Modal Interaction
Works with conventional graphical interfaces...
9
10
A New Suction Based Dragging Technique: “Hoovering”
11
Also works with older (text based) interface styles...
12
13
Hardware Design
The Early Prototypes…
14
First Prototype
Fully functional– Exceeded all specs
But unexpectedly did not gain user acceptance
15
Design iteration
Next prototypes miniaturized the olfactory output system and explored new commercially appealing packaging...
16
Rabbit Nose Platform
Worked better, but whiskers interfered with interaction
17
Next Iteration
Didn’t work very well...
18
Pig Nose Platform
Issues with users squealing
19
Dog Nose Platform
Drooling problems...
20
This one didn’t work at all
Subjects had an inexplicable urge to tell bad puns
21
After a few small modifications it worked better
But pun problem persisted
22
The final prototype...
23
Groucho Marx Nose Platform
24
DATANOSE™ Features
Full featured miniature olfactory I/O system
Fully mobile operation
25
Works in the lab...
26
Down the hall...
27
To places mobile computing has never gone before...
28
Advanced Interaction Techniques
3D Rotation Task– True User-Centered Rotation
29
30
31
32
33
34
Interacting with Multiple Devices
The DATANOSE™ works smoothly with conventional I/O devices...
35
Keyboard
36
Mouse
37
Valuators (Knobs)
38
Also has great potential in computer supported cooperative work applications...
39
40
Finally, can support fluid interaction with large data sets...
41
42
Applications:An Example Virtual World
Searched for an appropriate application domain...
43
Applications:An Example Virtual World
Implemented: Dog’s World–A user’s view
44
45
46
47
CSCW Extensions:
The Collaborative Dog’s World...
48
49
A New Toolkit
To avoid the high cost of developing rhino-interfaces, a new toolkit was developed
SYSTEM– An acronym standing for...
50
A New Toolkit
To avoid the high cost of developing rhino-interfaces, a new toolkit was developed
SYSTEM– a System that reallY doeS creaTE
user interfaces that have really nice featuMs
51
Uses The Seeheim Model
A major advance in itself
52
More Important ...
We have been able to answer the most important research question about the model...
53
Uses The Seeheim Model
What is that little box at the bottom!?!
54
Important Discovery
The Seeheim model works much better if you put everything in the little box
An improved model...
55
Improved Model
56
The Final SMELL-HEIM Model
57
Another Major Advance
A completely new approach to dialog management– Did an extensive literature search
Never been done before– Will revolutionize UI software work
58
Another Major Advance
A completely new approach to dialog management– Did an extensive literature search
Never been done before– Will revolutionize UI software work
Finite State Machine Controllers!
59
SYSTEM supports easy to use graphical editor for FSM controllers
60
SYSTEM supports easy to use graphical editor for FSM controllers
61
Usability Testing
Significant new testing after the paper was submitted
62
User Testing Results
Really Really Liked ItReally Liked ItSort of Liked It
Hated ItSubject #1 Subject #2
63
User Testing Results
Both users really really liked it!
Really Really Liked ItReally Liked ItSort of Liked It
Hated ItSubject #1 Subject #2
64
Future Work
Extending to other body parts
– DATA ARM™
– DATA EYEBALLS™
65
66
Future Work (cont.)
Extending to other body parts
– DATA FOOT™– DATA MOUTH™
Warning: Our research shows that these devices should not be used together!
67
Conclusion
Overall a dramatic breakthrough in virtual
research
Questions?
69
