64
Chapter 12: Auditory Localization and Organization

Chapter 12: Auditory Localization and Organization

Embed Size (px)

DESCRIPTION

Chapter 12: Auditory Localization and Organization. Figure 12-1 p290. Auditory Localization. Auditory space - surrounds an observer and exists wherever there is sound Researchers study how sounds are localized in space by using: Azimuth coordinates - position left to right - PowerPoint PPT Presentation

Citation preview

Page 1: Chapter 12:  Auditory Localization and Organization

Chapter 12: Auditory Localization and

Organization

Page 2: Chapter 12:  Auditory Localization and Organization

Figure 12-1 p290

Page 3: Chapter 12:  Auditory Localization and Organization

Auditory Localization

• Auditory space - surrounds an observer and exists wherever there is sound

• Researchers study how sounds are localized in space by using:

– Azimuth coordinates - position left to right

– Elevation coordinates - position up and down

– Distance coordinates - position from observer

Page 4: Chapter 12:  Auditory Localization and Organization

Figure 12-3 p291

Page 5: Chapter 12:  Auditory Localization and Organization

Auditory Localization - continued

• On average, people can localize sounds

– Directly in front of them most accurately

– To the sides and behind their heads least accurately.

• Location cues are not contained in the receptor cells like on the retina in vision; thus, location for sounds must be calculated.

Page 6: Chapter 12:  Auditory Localization and Organization

Figure 12-2 p291

Page 7: Chapter 12:  Auditory Localization and Organization

Binaural Cues for Sound Localization

• Binaural cues - location cues based on the comparison of the signals received by the left and right ears

– Interaural time difference (ITD)- difference between the times sounds reach the two ears

• When distance to each ear is the same, there are no differences in time.

• When the source is to the side of the observer, the times will differ.

Page 8: Chapter 12:  Auditory Localization and Organization

Figure 12-4 p292

Page 9: Chapter 12:  Auditory Localization and Organization

Binaural Cues for Sound Localization - continued

• Interaural level difference (ILD) - difference in sound pressure level reaching the two ear

– Reduction in intensity occurs for high frequency sounds for the far ear

• The head casts an acoustic shadow.

• This effect doesn’t occur for low frequency sounds.

• Cone of Confusion

Page 10: Chapter 12:  Auditory Localization and Organization

Figure 12-5 p292

Page 11: Chapter 12:  Auditory Localization and Organization

Figure 12-6 p293

Page 12: Chapter 12:  Auditory Localization and Organization

Figure 12-7 p294

Page 13: Chapter 12:  Auditory Localization and Organization

Monaural Cue for Sound Location

• Monaural cue – uses information from one ear

• The pinna and head affect the intensities of frequencies.

• Measurements have been performed by placing small microphones in ears and comparing the intensities of frequencies with those at the sound source.

– This is a spectral cue since the information for location comes from the spectrum of frequencies.

Page 14: Chapter 12:  Auditory Localization and Organization

Figure 12-8 p294

Page 15: Chapter 12:  Auditory Localization and Organization

Monaural Cue for Sound Location - continued

• ILD and ITD are not effective for judgments on elevation since in many locations they may be zero.

• Experiment investigating spectral cues

– Listeners were measured for performance locating sounds differing in elevation.

– They were then fitted with a mold that changed the shape of their pinnae.

Page 16: Chapter 12:  Auditory Localization and Organization

Monaural Cue for Sound Location - continued

– Right after the molds were inserted, performance was poor for elevation but was unaffected for azimuth.

– After 19 days, performance for elevation was close to original performance.

– Once the molds were removed, performance stayed high.

– This suggests that there might be two different sets of neurons—one for each set of cues.

Page 17: Chapter 12:  Auditory Localization and Organization

Figure 12-9 p295

Page 18: Chapter 12:  Auditory Localization and Organization

The Physiological Auditory Location

• Auditory nerve fibers synapse in a series of subcortical structures– Cochlear nucleus– Superior olivary nucleus (in the brain

stem)– Inferior colliculus (in the midbrain)– Medial geniculate nucleus (in the

thalamus)– Auditory receiving area (A1 in the

temporal lobe)

Page 19: Chapter 12:  Auditory Localization and Organization

Figure 12-10 p296

Page 20: Chapter 12:  Auditory Localization and Organization

The Physiological Auditory Location - continued

• Hierarchical processing occurs in the cortex

– Neural signals travel through the core, then belt, followed by the parabelt area.

– Simple sounds cause activation in the core area.

– Belt and parabelt areas are activated in response to more complex stimuli made up of many frequencies.

Page 21: Chapter 12:  Auditory Localization and Organization

Figure 12-11 p297

Page 22: Chapter 12:  Auditory Localization and Organization

The Physiological Representation of Auditory Space - continued

• Jeffress Model for narrowly tuned ITD neurons

– These neurons receive signals from both ears.

– Coincidence detectors fire only when signals arrive from both ears simultaneously.

– Other neurons in the circuit fire to locations corresponding to other ITDs.

Page 23: Chapter 12:  Auditory Localization and Organization

Figure 12-12 p297

Page 24: Chapter 12:  Auditory Localization and Organization

Figure 12-13 p297

Page 25: Chapter 12:  Auditory Localization and Organization

Broad ITD Tuning Curves in Mammals

• Broadly-tuned ITD neurons

– Research on gerbils indicates that neurons in the left hemisphere respond best to sound from the right, and vice versa.

– Location of sound is indicated by the ratio of responding for two types of neurons.

– This is a distributed coding system.

Page 26: Chapter 12:  Auditory Localization and Organization

Figure 12-14 p298

Page 27: Chapter 12:  Auditory Localization and Organization

Figure 12-15 p298

Page 28: Chapter 12:  Auditory Localization and Organization

Figure 12-16 p299

Page 29: Chapter 12:  Auditory Localization and Organization

Localization in Area A1 and the Auditory Belt Area

• Broadly-tuned ITD neurons

– Malhorta and Lomber (2007)

– Cooling and lesioning

Page 30: Chapter 12:  Auditory Localization and Organization

Auditory Where (and What) Pathways

• What, or ventral stream, starts in the anterior portion of the core and belt and extends to the prefrontal cortex.– It is responsible for identifying sounds.

• Where, or dorsal stream, starts in the posterior core and belt and extends to the parietal and prefrontal cortices.– It is responsible for locating sounds.

• Evidence from neural recordings, brain damage, and brain scanning support these findings.

Page 31: Chapter 12:  Auditory Localization and Organization

Figure 12-17 p300

Page 32: Chapter 12:  Auditory Localization and Organization

Figure 12-18 p300

Page 33: Chapter 12:  Auditory Localization and Organization

Figure 12-19 p301

Page 34: Chapter 12:  Auditory Localization and Organization

Hearing Inside Rooms

• Direct sound - sound that reaches the listener’s ears straight from the source

• Indirect sound - sound that is reflected off of environmental surfaces and then to the listener

• When a listener is outside, most sound is direct; however inside a building, there is direct and indirect sound.

Page 35: Chapter 12:  Auditory Localization and Organization

Figure 12-20 p301

Page 36: Chapter 12:  Auditory Localization and Organization

Perceiving Two Sounds That Reach the Ears at Different Times

• Experiment by Litovsky et al.– Listeners sat between two speakers: a lead

speaker and a lag speaker.

– When sound comes from the lead speaker followed by the lag speaker with a long delay, listeners hear two sounds.

– When the delay is decreased to 5 - 20 msec, listeners hear the sound as only coming from the lead speaker - the precedence effect.

Page 37: Chapter 12:  Auditory Localization and Organization

Figure 12-21 p302

Page 38: Chapter 12:  Auditory Localization and Organization

Architectural Acoustics

• The study of how sounds are reflected in rooms.

• Factors that affect perception in concert halls.

– Reverberation time - the time is takes sound to decrease by 1/1000th of its original pressure

• If it is too long, sounds are “muddled.”• If it is too short, sounds are “dead.”• Ideal times are around two seconds.

Page 39: Chapter 12:  Auditory Localization and Organization

Architectural Acoustics - continued

• Factors that Affect Perception in Concert Halls – Intimacy time - time between when sound

leaves its source and when the first reflection arrives

• Best time is around 20 ms.

– Bass ratio - ratio of low to middle frequencies reflected from surfaces

• High bass ratios are best.

– Spaciousness factor - fraction of all the sound received by listener that is indirect

• High spaciousness factors are best.

Page 40: Chapter 12:  Auditory Localization and Organization

Acoustics in Classrooms - continued

• Ideal reverberation time in classrooms is

– .4 to .6 second for small classrooms.

– 1.0 to 1.5 seconds for auditoriums.

– These maximize ability to hear voices.

– Most classrooms have times of one second or more.

• Background noise is also problematic.

– Signal to noise ratio should be +10 to +15 dB or more.

Page 41: Chapter 12:  Auditory Localization and Organization

Figure 12-22 p304

Page 42: Chapter 12:  Auditory Localization and Organization

Auditory Organization: Scene Analysis

• Auditory Scene - the array of all sound sources in the environment

• Auditory Scene Analysis - process by which sound sources in the auditory scene are separated into individual perceptions

• This does not happen at the cochlea since simultaneous sounds are together in the pattern of vibration of the basilar membrane.

Page 43: Chapter 12:  Auditory Localization and Organization

Auditory Organization: Scene Analysis - continued

• Heuristics that help to perceptually organize stimuli

– Onset time - sounds that start at different times are likely to come from different sources

– Location - a single sound source tends to come from one location and to move continuously

– Similarity of timbre and pitch - similar sounds are grouped together

Page 44: Chapter 12:  Auditory Localization and Organization

Separating the Sources

• Compound melodic line in music is an example of auditory stream segregation.

• Experiment by Bregman and Campbell

– Stimuli were alternating high and low tones

– When stimuli played slowly, the perception is hearing high and low tones alternating.

– When the stimuli are played quickly, the listener hears two streams; one high and one low.

Page 45: Chapter 12:  Auditory Localization and Organization

Figure 12-23 p305

Page 46: Chapter 12:  Auditory Localization and Organization

Figure 12-24 p305

Page 47: Chapter 12:  Auditory Localization and Organization

Figure 12-25 p306

Page 48: Chapter 12:  Auditory Localization and Organization

Separating the Sources - continued

• Experiment by Deutsch - the scale illusion or melodic channeling

– Stimuli were two sequences alternating between the right and left ears.

– Listeners perceive two smooth sequences by grouping the sounds by similarity in pitch.

– This demonstrates the perceptual heuristic that sounds with the same frequency come from the same source, which is usually true in the environment.

Page 49: Chapter 12:  Auditory Localization and Organization

Figure 12-26 p306

Page 50: Chapter 12:  Auditory Localization and Organization

Separating the Sources - continued

• Proximity in time - sounds that occur in rapid succession usually come from the same source

– This principle was illustrated in auditory streaming.

• Auditory continuity - sounds that stay constant or change smoothly are usually from the same source

Page 51: Chapter 12:  Auditory Localization and Organization

Separating the Sources - continued

• Experiment by Warren et al.

– Tones were presented interrupted by gaps of silence or by noise.

– In the silence condition, listeners perceived that the sound stopped during the gaps.

– In the noise condition, the perception was that the sound continued behind the noise.

Page 52: Chapter 12:  Auditory Localization and Organization

Figure 12-27 p307

Page 53: Chapter 12:  Auditory Localization and Organization

Separating the Sources - continued

• Effect of past experience

– Experiment by Dowling

• Melody “Three Blind Mice” is played with notes alternating between octaves

• Listeners find it difficult to identify the song

• But after they hear the normal melody, they can then hear it in the modified version using melody schema

Page 54: Chapter 12:  Auditory Localization and Organization

Figure 12-28 p307

Page 55: Chapter 12:  Auditory Localization and Organization

Auditory Organization: Perceiving Meter

• Rhythmic pattern is a series of changes across time.

• Metrical structure is the underlying beat of music.

Page 56: Chapter 12:  Auditory Localization and Organization

Figure 12-29 p308

Page 57: Chapter 12:  Auditory Localization and Organization

Figure 12-30 p310

Page 58: Chapter 12:  Auditory Localization and Organization

Connections Between Hearing and Vision

• Visual capture or the ventriloquist effect - an observer perceives the sound as coming from the visual location rather than the source for the sound

• Experiment by Sekuler et al.

– Balls moving without sound appeared to move past each other.

– Balls with an added “click” appeared to collide.

Page 59: Chapter 12:  Auditory Localization and Organization

Figure 12-31 p311

Page 60: Chapter 12:  Auditory Localization and Organization

Figure 12-32 p311

Page 61: Chapter 12:  Auditory Localization and Organization

Hearing and Vision: Physiology

• The interaction between vision and hearing is multisensory in nature.

• Thaler et al (2011) – Used expert blind echolocators to create clicking sounds and observed these signals activated the bran.

Page 62: Chapter 12:  Auditory Localization and Organization

Figure 12-33 p312

Page 63: Chapter 12:  Auditory Localization and Organization

Figure 12-34 p312

Page 64: Chapter 12:  Auditory Localization and Organization

Figure 12-35 p313