A Toolkit for Explorations in Sonic Interaction Design

Stefano Delle Monache - Università IUAV di Venezia

FKL 2013 - Per chi suona il paesaggio sonoro, 13 aprile 2013 - SUC, Firenze

is about enhancing the qualities of objects in use through sound.Sound can make the qualities of interaction manifest, sharable and social.

> shape the sonic appearance of products

> support new functions or display possibilities for products

> improve the performance in interaction processes

> design informative and pleasant sonic environments

EU COST IC0601 Action on Sonic Interaction Design - 2007 / 2011 http://www.sid.soundobject.org/

SONIC INTERACTION DESIGN

FKL 2013 - Per chi suona il paesaggio sonoro, 13 aprile 2013 - SUC, Firenze

‣ Understanding and interpreting non-visual sketches and prototypes is a core issue when designing for movement-based interaction.

Research through design practices

creationmanipulation

interpretation

performance

understanding

SONIC INTERACTION DESIGN

FKL 2013 - Per chi suona il paesaggio sonoro, 13 aprile 2013 - SUC, Firenze

‣ Sonic interaction designers expect an effective set of methods, practices and tools.

Product Sound Design Summer School, Aalto University, Espoo, Finland 23th-26th August 2010

SONIC INTERACTION DESIGN

FKL 2013 - Per chi suona il paesaggio sonoro, 13 aprile 2013 - SUC, Firenze

‣ The SDT is a front-end application in Max/MSP and Pure Data, providing a palette of virtual lutheries and foley pits for Sonic Interaction Design sketching and prototyping.

SOUND DESIGN TOOLKIT

http://www.soundobject.org/SDT/

FKL 2013 - Per chi suona il paesaggio sonoro, 13 aprile 2013 - SUC, Firenze

‣ Set of interactively controllable physics-based sound models‣ natural behaviour (natural mapping)‣ continuous sound feedback‣ potentially an embodied experience

‣ Procedural approach to sound design

‣ Resonator and interactor description by their physical-geometric properties

Impact

Friction

SOUND DESIGN TOOLKIT

FKL 2013 - Per chi suona il paesaggio sonoro, 13 aprile 2013 - SUC, Firenze

FRACTURE

model

Simulation

examples

Derived

processes

Basic events

And textures

Low-level

modelsIMPACT

model

FRICTION

model

FLUID FLOW

model

BUBBLE

model

TURBULENCE

model

EXPLOSION

model

SOLIDS LIQUIDS GASSES

fracturing

crumpling hitting rolling

rubbing braking

walking

crushing

bouncing

dropping

breaking

sliding

squeaking

footsteps

on gravel

can

crushing

falling

coin

rolling /

braking

wheel

squeaking

door

paper

crumpling

hammered

string

struck

bar

glass

cleaning

bowed

string

rubbed

glass

burbling dripping flowing

splashing filling pouring

whooshing burning

sucking

exploding popping

Vacuum cleaner (turning

on/off, corking tube)

SDT is based on an everyday sound taxonomy.

from and Gaver (1993)

SOUND DESIGN TOOLKIT

FKL 2013 - Per chi suona il paesaggio sonoro, 13 aprile 2013 - SUC, Firenze

‣ Iterative process of development and evaluation of the system in workshop settings towards a tool that could:

1. grow away from a musical metaphor

2. respond to the requirements of design thinking

3. be sufficiently immediate and easy to use

4. represent a valuable platform in SID education and research

SOUND DESIGN TOOLKIT

FKL 2013 - Per chi suona il paesaggio sonoro, 13 aprile 2013 - SUC, Firenze

SOUND DESIGN TOOLKIT

FKL 2013 - Per chi suona il paesaggio sonoro, 13 aprile 2013 - SUC, Firenze

‣ interactive installation: Gamelunch, a sonic dining table ‣ investigation of surprise and contradiction in sonic interaction (Polotti et al., 2008)

EMBODYING THE SDT

FKL 2013 - Per chi suona il paesaggio sonoro, 13 aprile 2013 - SUC, Firenze

‣ research: designing continuous sonic interaction‣ continuous sound feedback for mechanical connections‣ supportive and expressive feedback for cyclic continuous actions (Rocchesso et al., 2009)

EMBODYING THE SDT

FKL 2013 - Per chi suona il paesaggio sonoro, 13 aprile 2013 - SUC, Firenze

‣ workshop on paper-driven sonic narrative - paper mechanisms for sonic interaction at Conservatorio di Musica Statale C. Pollini of Padova - 2011. (Delle Monache et al., 2012)

EMBODYING THE SDT

FKL 2013 - Per chi suona il paesaggio sonoro, 13 aprile 2013 - SUC, Firenze

‣ S. Delle Monache, P. Polotti, and D. Rocchesso, “Sonic InteractionDesign”, Disegno Industriale – Industrial Design, n. 46-47, pp. 130-139, Gangemi Editore, Roma 2011.(http://rice.iuav.it/163/1/soundesign.pdf)

‣ D. Rocchesso, P. Polotti and S. Delle Monache, “DesigningContinuous Sonic Interaction”. International Journal of Design, 3(3),2009. (http://www.ijdesign.org/ojs/index.php/IJDesign/article/view/620/271)

‣ S. Delle Monache, P. Polotti, and D. Rocchesso, “A Toolkit forExplorations in Sonic Interaction Design”, In the 5th Audio MostlyConference: A Conference on Interaction with Sound (AM '10),Pitea, Sweden. September 15 – 17, 2010. ACM, New York, NY,USA.(http://rice.iuav.it/170/1/SDT_atoolkitforSID.pdf)

‣ S. Delle Monache, D. Rocchesso, J. Qi, L. Buechley, A. De Gotzen,D. Cestaro, “Paper mechanisms for sonic interaction”. In Proc.TEI2012 - 8th Conference on Tangible, Embedded and EmbodiedInteraction. Kingston, Canada, 2012.(http://soundingpopables.wordpress.com/)

REFERENCES

FKL 2013 - Per chi suona il paesaggio sonoro, 13 aprile 2013 - SUC, Firenze