27
Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop King’s College, London 10-11 March 2010

Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop

Embed Size (px)

Citation preview

Page 1: Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop

Sculpting musical sound

David N LeePerception-Movement-Action Research Centre

University of Edinburgh

Talk given atShaping Music in Performance Workshop

King’s College, London10-11 March 2010

Page 2: Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop

Summary of talk

A theory of action controland

applications to understandingmoving

andmaking music

Page 3: Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop

Action-gaps

• Acting requires controlling action-gaps between current state and goal state

• Controlling action-gaps requires prospective sensory and intrinsic information

Page 4: Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop
Page 5: Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop

Multiple action gaps

• Acting generally requires controlling several action-gaps contemporaneously

Page 6: Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop
Page 7: Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop

τ• The principal informational variable for

controlling action-gaps is τ• τ is the time-to-closure (or the time-from-

closure) of an action-gap at the current rate of closing (or opening)

• τ of action-gap, X, equals X / &X

Page 8: Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop

Properties of τ

• Action-time variable• Prospective informational variable• Universal variable• Directly perceptible

Page 9: Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop
Page 10: Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop

τ-coupling

• Foundation for controlling action gaps

• Means the ratio of the τ s of two gaps is constant

Page 11: Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop

τ can be directly sensed through τ-coupling

Page 12: Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop

Intrinsic guiding gaps

• Should be simple and sufficient• Should be rooted in ecological physics

Page 13: Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop

(a)

Page 14: Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop
Page 15: Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop

How a gap changes undertauG - guidance

Page 16: Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop

TauG-guidance parameters

K = ‘oomph’ A = amplitudeT = duration

Page 17: Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop

tauG ‘kinetic melodies’ in the nervous system

Page 18: Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop

Examples of tauG guidance

Page 19: Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop

m-g

m-g

Page 20: Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop

TauG-guidance of sucking in neonates

Page 21: Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop
Page 22: Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop

-10

-8

-6

-4

-2

0

-5 -4 -3 -2 -1 0

TauG

TauA

60

65

70

75

80

-10

0

10

20

30

40

50

60

13.4 13.6 13.8 14 14.2 14.4

wrist position (longitudinal axis; cm)

velocity of wrist (cm/s)

wrist position (longitudinal axis; cm)

velocity of wrist (cm/s)

time (s)

start

end

One day old infant gesture

Page 23: Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop

TauG-guidance of pitch-glide singing

Va---ne

1 s

pitch (Hz)

Page 24: Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop
Page 25: Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop

TauG-guidance of attacking intensity- glide when bowing

Page 26: Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop

Future directions

We have shown how, at the few hundred millisecond level, the shape of a musical sound (pitch and intensity glides) mirrors the shape of the movement that produces it. Both follow the same tauG mathematical formula. We are now moving in two new directions: to the sub-millisecond level to explore how sound waves are sculpted to generate the timbre or quality of sound, and to the supra-second level to explore how the shapes of musical phrases are sculpted. Preliminary results suggest that tauG also features at these two levels.

Page 27: Sculpting musical sound David N Lee Perception-Movement-Action Research Centre University of Edinburgh Talk given at Shaping Music in Performance Workshop

References

Schogler, B., Pepping, G-J. & Lee, D. N. (2008). TauG-guidance of transients in expressive musical performance. Experimental Brain Research, 198, 361-372.

Lee, D. N., & Schogler, B. (2009). Tau in musical expression. In S. Malloch & C. Trevarthen (Eds.), Communicative Musicality: Exploring the basis of human companionship. Oxford: Oxford U. P.

Lee, D. N. (2009). General Tau Theory: evolution to date. Special Issue: Landmarks in Perception. Perception, 38, 837-858.