Embed Size (px)
DESCRIPTION
Slides from my presentation at Nordichi 2012 on our development of a new type of interface, Tangible 3D Tabletops, which combines tangible tabletops with 3D projection on physical objects.
Citation preview
TANGIBLE 3D TABLETOPS:COMBINING TANGIBLE TABLETOP INTERACTION WITH 3D PROJECTION
Peter Dalsgaard & Kim Halskov
Center for Advanced Visualisation and Interaction (CAVI)
Participatory Information Technology Centre (PIT)
Aarhus University
AGENDA
Related work
The setup
Basic principles
Design considerations
Next steps
RELATED WORK: TANGIBLE TABLETOPS, E.G. REACTABLEBencina, R., Kaltenbrunner, M. and Jordà, S. 2005. Improved Topological Fiducial Tracking in the reacTIVision System
RELATED WORK: 3D PROJECTION ON PHYSICAL OBJECTSDalsgaard, P. and Halskov, K. 2011. 3D Projection on Physical Objects: Design Insights from Five Real Life Cases
FURTHER RELATED WORK
Buxton, W. 1997. Living in Augmented Reality: Ubiquitous Media and Reactive
Environments. Video Mediated Communication, K. Finn, A. Sellen and S. Wilber (Eds.).
Erlbaum, Hillsdale, NJ, USA, 363-384.
Merrill, D., Kalanithi, J. and Maes, P. 2007. Siftables: towards sensor network user
interfaces. Proc. of TEI 2007, ACM Press, 75-78.
Patten, J., Ishii, H., Hines, J. and Pangaro, G. 2001. Sensetable: A wireless object
tracking platform for tangible user interfaces. CHI ‘01: Proc. SIGCHI Conference on
Human Factors in Computing Systems. , 253-260.
Hancock, M. Nacenta, M., Gutwin, C., and Carpendale, S. 2009. The effects of
changing projection geometry on the interpretation of 3D orientation on
tabletops. Proc. Of ITS '09, ACM Press, 157-164.
Marquardt, N., Jota, R., Greenberg, S., and Jorge, J.A. 2011.The Continuous Interaction
Space: Interaction Techniques Unifying Touch and Gesture on and above a Digital
Surface. Proc. Interact 2011, 461-476.
Williams, C., Yang, X. D., Partridge, G., Millar-Usiskin, J., Major, A. and Irani, P. 2011.
TZee: exploiting the lighting properties of multi-touch tabletops for tangible 3d
interactions. Proc. of CHI '11. ACM Press 1363-1372.
Baudisch, P. Becker, T. and Frederik Rudeck. 2010. Lumino: tangible building blocks
based on glass fiber bundles. Proc. of SIGGRAPH '10, ACM Press.
Spindler, M., Martsch, M. & Dachselt, R. 2012. Going beyond the surface: studying
multi-layer interaction above the tabletop. CHI 2012. ACM, New York, NY, USA,
1277-1286.
THE SETUP
BASIC PRINCIPLES: COMBINING
TANGIBLES AND TABLETOP SURFACE
Projection on 3D object that stands out from surface
Projection on 3D object that matches surface
Projection on flat object that stands out from surface
Projection on flat object that matches surface
COMBINING 2D AND 3D CONTENT ON TANGIBLES AND TABLETOP
TECHNICAL ISSUES
RESOLUTION OCCLUSION LAG
DESIGN CONSIDERATIONS
1. How to combine and connect content and functions of
tangibles and tabletop surface
2. How to develop dynamic content on tangibles that are
simultaneously displays and input devices
3. How to take advantage of visual effects and the
combination of 2D and 3D on tangibles and tabletop
surface
1. COMBINING AND CONNECTING CONTENT AND FUNCTIONS OF TANGIBLES AND TABLETOP SURFACE
2. DYNAMIC CONTENT ON TANGIBLES THAT ARE BOTH DISPLAYS AND INPUT DEVICES
3. VISUAL EFFECTS AND THE COMBINATION OF 2D AND 3D ON TANGIBLES AND TABLETOP
NEXT STEPS
Finding good use cases in order to learn if and how this
interface is particularly suited for certain situations
Higher resolution (table and tangibles) and more projectors
Exploring more complex and dynamic content on tangibles
Exploring more complex and dynamic content on tabletop
Developing a typology of interface components and
principles
Augmented tabletop Symbiotic interfaces Augmented tangiblesAmorphous shapes
SUMMARY: TANGIBLE 3D TABLETOPS
Tangible 3D Tabletops combine 3D projection and tangible tabletops
A new form of interface in which 2D and 3D content can be combined and connected in various ways
Tangibles can serve as simultaneous input and output devices
Existing visual effects can be employed in new ways, and new effects can be developed for this particular medium
We are just beginning to explore the potentials and challenges of this type of interface
TANGIBLE 3D TABLETOPS:COMBINING TANGIBLE TABLETOP INTERACTION WITH 3D PROJECTION
Peter Dalsgaard ([email protected]) & Kim Halskov ([email protected])
Center for Advanced Visualisation and Interaction (CAVI)
Participatory Information Technology Centre (PIT)
Aarhus University
QUESTIONS?
![Multi-State Device Tracking for Tangible Tabletops...these devices has been proposed in related projects [GSK06] [SJG 06] [WWJ 06], we consider the tracking method pre-sented next](https://img.pdfslide.us/doc/110x75/5f5650e9aa57e40c7e4087c9/multi-state-device-tracking-for-tangible-tabletops-these-devices-has-been-proposed.jpg){kind=tracking}
![Flyables: Exploring the 3D Interaction Space for ... · Gomes et al. [7] proposed BitDrones, a toolbox to model 3D tangible interaction leveraging quadcopters. This theoretical concept](https://img.pdfslide.us/doc/110x75/6027a95d24c39f6fc87ad843/flyables-exploring-the-3d-interaction-space-for-gomes-et-al-7-proposed-bitdrones.jpg)
