13
Lori Landay Professor of Cultural Studies Berklee College of Music SCMS13

Sound, Embodiment, and the Experience of Interactivity in Video Games & Virtual Environments

Embed Size (px)

Citation preview

Page 1: Sound, Embodiment, and the Experience of Interactivity in Video Games & Virtual Environments

Lori Landay

Professor of Cultural Studies

Berklee College of Music

SCMS13

Page 2: Sound, Embodiment, and the Experience of Interactivity in Video Games & Virtual Environments

Innovative sound can bridge the gaps between the physical body, represented body, and imagined body in video games.

Page 3: Sound, Embodiment, and the Experience of Interactivity in Video Games & Virtual Environments

Grand Theft Auto IV: The Battle of Gay TonyRockstar North, 2009

Do you feel the wind? Where? Why?

Page 4: Sound, Embodiment, and the Experience of Interactivity in Video Games & Virtual Environments

Flower, thatgamecompany, 2009

Do you feel the wind? Where? Why?

Page 5: Sound, Embodiment, and the Experience of Interactivity in Video Games & Virtual Environments

Walter Murch’s aural spectrum

http://transom.org/?page_id=7006

Page 6: Sound, Embodiment, and the Experience of Interactivity in Video Games & Virtual Environments

Char Davies, Osmose (1994-96)

unified sound, image, action in a virtual environment

Page 7: Sound, Embodiment, and the Experience of Interactivity in Video Games & Virtual Environments

LIMBO, Playdead, 2010

Page 8: Sound, Embodiment, and the Experience of Interactivity in Video Games & Virtual Environments

GAPS BETWEENthe physical body of the player,

the screen body represented on the screen, perhaps by an avatar, and

the imagined body comprised of the mental image and nonconscious sensory-motor processes of the physical body and also the virtual body

Sound has the potential to bridge the points of disconnection among these embodiment perspectives in a way that image and action cannot.

Page 9: Sound, Embodiment, and the Experience of Interactivity in Video Games & Virtual Environments

Sound effects & music in Portal 2

Dan Bruno http://cruiseelroy.net/2011/06/portal-2-music/

sound of soaring through the air after bouncing on “Aerial Faith Plate,” a sound effect that can be better understood as a musical event than a diegetic sound

Page 10: Sound, Embodiment, and the Experience of Interactivity in Video Games & Virtual Environments

Speech as sound effects in Portal 2

Page 11: Sound, Embodiment, and the Experience of Interactivity in Video Games & Virtual Environments

Portal 2, Valve, 2011

Page 12: Sound, Embodiment, and the Experience of Interactivity in Video Games & Virtual Environments

“Technology mirrors our desires; interactive technologies, in particular, reflect our desire to feel engaged.”

David Rokeby, “Transforming Mirrors: Subjectivity and Control in Interactive Media,” 1996

Page 13: Sound, Embodiment, and the Experience of Interactivity in Video Games & Virtual Environments