Embed Size (px)
DESCRIPTION
AudioCubes is a novel tangible user interface allowing any person interested by sound design such as sound creators, and music trainers to intuitively explore and create dynamically changing sound. A new sound is created by manipulating distributed cube tangible user interface that can be coupled wirelessly by locating them in the interaction range of each other on a table. At any time, a sound processing network combines operational properties of AudioCubes, such as location on a plane or in space, movement, arrangement with other cubes, and layout. Sound algorithm parameters and the configuration of the sound processing network can be changed simultaneously, allowing a fast and convenient exploration of sound creation space that creates a new interaction technique for creating sounds.
Citation preview
Bonn, 18-21 February 2008 © 2008 Percussa & UCL 1
AudioCubes: a Distributed Cube Tangible Interface based on Interaction Range for Sound DesignBert Schiettecatte1,2, Jean Vanderdonckt2
1Percussa Inc., Mere (Belgium), [email protected]
2Belgian Lab. of Computer-Human Interaction (BCHI), Université catholique de Louvain (UCL), Louvain-la-Neuve (Belgium) [email protected]
© 2008 Percussa & UCL 2Bonn, 18-21 February 2008
Outline Motivations What are AudioCubes? Ways to use AudioCubes Example Configurations Interaction range of AudioCubes Related Work
AudioCubes Design Process AudioCubes Evaluation Conclusion AudioCubes Users AudioCubes Availability
AudioCubes
© 2008 Percussa & UCL 3Bonn, 18-21 February 2008
MotivationsAccessability of professional music and sound tools today
U-Control 33e Malstrom synthesizer in Propellerheads Reason
Laptop artist Kim Cascone performing
Focus on technology and control instead of music or sound ...
Personal experience with ...
© 2008 Percussa & UCL 4Bonn, 18-21 February 2008
What are AudioCubes?Small, wireless, battery powered portable computers which : Detect each other's location and orientation Sense other real-world objects Work with each other and without infrastructure Generate and process sound
Each cube has : USB connector for data exchange
and battery charging 4 faces with IR sensors and
emitters Full colour light source
© 2008 Percussa & UCL 5Bonn, 18-21 February 2008
Ways to use AudioCubes
Each cube generates sound and sends out to other cubes nearby One or more cubes connected to speaker make sound audible Computer needed to set behaviour of cubes initially
Without a computer (i.e. Sound generator)
Cubes detect each other and nearby objects, send info to computer Information from detection is used to interact with software Computer needed to set behaviour of cubes initially
With a computer (i.e. Human Computer Interface)
© 2008 Percussa & UCL 6Bonn, 18-21 February 2008
Example configurations One vs many inputs, one vs. many outputs
Cubes used as sound generator – location and orientation changes parameters AND global behaviour
© 2008 Percussa & UCL 7Bonn, 18-21 February 2008
Interaction range of AudioCubes Regulated by angle (φ), minimum range (rmin=0.5
cm), and maximum range (rmax=50 cm)
Coupling two AudioCubes
s1 s2
φ1 φ2
r1minr1max
r2minr2max
© 2008 Percussa & UCL 8Bonn, 18-21 February 2008
Related work
Audiopad by Patten & Recht (MIT Media Lab) Blockjam by Newton-Dunn et al (Sony CSL IL)
AudioCubes is different from related work in that : The system is self contained and intelligent No infrastructure necessary
© 2008 Percussa & UCL 9Bonn, 18-21 February 2008
AudioCubes Design Process
Techniques used
Paper prototyping
Hand soldering, glueing
Various rapid prototyping techniques, laser cutting
AudioCube second rev.Mechanical design
Paper prototype
AudioCube first platform with external signal processing
AudioCube second platform with built in DSP
AudioCube third platform wtih built in DSP
© 2008 Percussa & UCL 10Bonn, 18-21 February 2008
AudioCubes Evaluation
User observation camera and cube tablewith amplification at the MUHKA museum
Audiocubes connect to table amplifierthrough audio cables
camera
amplifier inputs
1 2 3 4
5
6
Micro-phoneinput
Audio Outputjack
Table and camera setup diagram
Standard cube configuration for the art installation Cubes generate sound and send to each other, 2 cubes connected to speakers
Let's put the cubes in a museum and let people make sound with them, without computers ...
© 2008 Percussa & UCL 11Bonn, 18-21 February 2008
AudioCubes Evaluation4 hours of observation video
Among the goals :
•Observe human-machine interaction not anticipated•Determine if visitors could understand and learn system•Is our system more accessible than other classic technology for making electronic music and sound?
© 2008 Percussa & UCL 12Bonn, 18-21 February 2008
ConclusionAudioCubes used as sound generator :
Parameters and behaviour change at the same time
AudioCubes used as computer interface : Cube sense each other's location and orientation
but also distance to other objects Cubes can be easily configured in many ways for
different applications
Lets people explore and be creative with technology, without imposing “control” too much
Gives room to “happy accidents”
In both cases :
© 2008 Percussa & UCL 13Bonn, 18-21 February 2008
AudioCubes users in Education•Berklee College of Music (USA)•KnowledgeXtensions, Inc (USA)•Watch That Sound (Netherlands)•Pantalone (Belgium)
AudioCubes users in ResearchSaint Mary's University (Canada)Aristotle University of Thessaloniki (Greece)Université catholique de Louvain (Belgium)University of Southern Denmark (Denmark)University of Western Sydney (Australia)V2 (Netherlands)
Past AudioCube workshopsV2, RotterdamVancouver New Music & Video In/Out, VancouverVooruit, Ghent
© 2008 Percussa & UCL 14Bonn, 18-21 February 2008
Thank you very much for your attention!
http://www.percussa.com/ PERCUSSA
http://www.isys.ucl.ac.be/bchi Belgian Lab. of Computer-Human Interaction
http://www.similar.ccEuropean excellence network on Multimodal User Interfaces
