57
(The Human Ear) Peripheral Auditory System Place Theory of Hearing Amplitude Response of the Ear Logarithms and Sound Intensity Scales Periodicity Pitch and Fundamental Tracking Aural Harmonics and Combination Tones Ohm’s Law of Hearing Masking Binaural Effects Hearing Loss

(The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Embed Size (px)

Citation preview

Page 1: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

(The Human Ear)1. Peripheral Auditory System2. Place Theory of Hearing3. Amplitude Response of the Ear4. Logarithms and Sound Intensity Scales5. Periodicity Pitch and Fundamental Tracking6. Aural Harmonics and Combination Tones7. Ohm’s Law of Hearing8. Masking9. Binaural Effects10. Hearing Loss

Page 2: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

(The Human Voice)

11. Anatomy of the Vocal Tract12. Vocal Formants13. Analysis of Vocal Sounds

Page 3: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

“Dynamic Range” of ear

Frequency range: 20 Hz – 20 kHz

(factor of 1000)

Range of eye ~ 0.400- 0.700 microns

(factor of 2)

Intensity range: 1 to 1012

Range of eye ~ 1-1,000,000 (106)

Page 4: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Peripheral Auditory System

Page 5: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Cross section of the Cochlea

Page 6: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Guinea Pig “Hair Cells”

Similar in humans, chinchillas, cats and guinea pigs

Page 7: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

The “Place Theory” of Hearing

From: Juan G. Roederer, The Physics and Psychophysics of Music

Page 8: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Features of the “Place Theory”1. Correlation of frequency with position of

maximum response (higher frequencies closer to oval window at base of cochlea)

2. 20-5000 Hz frequency range >2/3 of membrane length

3. Remaining frequencies (5,000-20,000 Hz

squeezed into remaining <1/3

4. Equal frequency ratios occupy the same distance along membrane

Page 9: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Experimental basisfor the Place theory

1. The Critical Band

2. The Frequency JND

3. The Limit of Frequency Discrimination

and its analog experiment

4. Sharpening

Page 10: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

The Critical Band

~15% in frequency, greater at lower frequencies

From: Juan G. Roederer, The Physics and Psychophysics of Music

Page 11: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

The Just Noticeable Difference

~0.6% in frequency, greater at lower frequencies

From: Juan G. Roederer, The Physics and Psychophysics of Music

Page 12: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Limit of frequency discrimination

(two tones)

~7% for low frequencies, ~15% for higher frequencies

Page 13: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Analog experimentusing the arm

as basilar membrane

Page 14: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Effect of“Sharpening”

The JND is less for complex waves

Page 15: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Experiment Summary

From: Juan G. Roederer, The Physics and Psychophysics of Music

Page 16: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Escher: Waterfall

Page 17: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Escher: Staircase

Page 18: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Shepard’s Tones

Roger N. Shepard: Circularity in Judgements of Relative Pitch; Journal of the Acoustical Society of America, 1964

Page 19: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

A Pair ofParadoxes

Page 20: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Shepard’s tones in musicVoice of the ComputerJean-Claude Risset:

Computer Suite from “Little Boy”

I. Flight and Count-down

II. Fall (uses downward glissando Shepard’s tones to represent the fall of the atomic bomb on Hiroshima

III. Contra-Apotheosis

Page 21: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Fletcher-Munson (Equal Loudness) Curves

Page 22: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Sound Intensity Level Scale(SIL)

Units of bels or decibels

1. “Physics” scale2. Equal intensity ratios mean

equal steps of loudness3. Intensity JND

Page 23: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Loudness Level scale“Phons”

1. “Subjective” scale2. Accounts for variation

of loudness with frequency3. More useful in describing

hearing

Page 24: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

The decibel scale

SIL = SIL0 + 10 log (I/Io)

log 1 = 0.0log 2 = 0.3log 3 = 0.5log 4 = 0.6log 5 = 0.7

log 6 = 0.8log 7 = 0.85log 8 = 0.9log 9 = 0.95log 10 = 1.0

Page 25: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Examples using decibels1. Adding two equal signals2. Multiplying a signal by 33. Multiplying a signal by 104. Multiplying a signal by 1.255. Demonstration H5-21 Three Decibels6. Question of the Week #1497. Question of the Week #1508. Consultation as expert acoustic witness

Page 26: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Periodicity Pitchand

Fundamental TrackingPsychological phenomenon

Page 27: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Aural Harmonicsand

Combination Tones

Sum Tone: f+ = nf1 + mf2

Difference Tone: f- = | nf1 - mf2 |

Created by non-linearities primarilyin the bone chain of the middle ear

Physical phenomenon

Page 28: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Aural Harmonics

Page 29: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Combination Tone Experimentn m sum: f+ difference: f-

1 1 1200 Hz 200 Hz

1 2 1900 Hz 900 Hz2 1 1700 Hz 300 Hz2 2 2400 Hz 400 Hz

f1 = 500 Hz f2 = 700 Hz

Page 30: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Ohm’s Law of Hearing(excellent approximation)

Second order (quality) beats(counterexample to Ohm’s Law)

Masking(complication of Critical Band)

Page 31: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Quality Beats (Second-order beats)

Fundamental with mis-tuned 2nd harmonic

Page 32: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Source of Masking

From: Thomas Rossing, The Science of Sound

Page 33: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Masking Curves

From: Donald Hall: Musical Acoustics, Second Edition

a. Threshold of hearing for pure toneb. Masking by 365 Hz to 455 Hz 80 dB noise bandc. Masking by 400 Hz 80 dB tone

Page 34: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Steady-state tone quality

1. Number and amplitude of overtones2. Inharmonicities3. Periodicity pitch and

fundamental tracking 4. Difference tones (enhance fundamental)5. Critical Band and Masking (formants)

Page 35: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Musical Effects of theCritical Band and Masking

1. Open chords sound more clear than closed chords, especially using bass notes

2. Close notes sound sound homophonic – chords predominate

3. Spread out notes sound polyphonic – individual lines are more easily identified

4. Eg: Use of low chord in piano music affected by historical development of the piano

Page 36: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Binaural Effects

1. Binaural beats and diplacusis 2. Localization of sounds

(low f = 500-800Hz, high f > 1000Hz)3. Click illusions

(monaural and binaural)4. Precedence effect

Page 37: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Hearing Loss1. Temporary threshold shifts

Exposure to noiseReaction to drugs

2. Permanent hearing lossNoise or drug exposureNatural aging (presbycusis)Rubella during pregnancy

3. Tinnitus or ringing in ear (permanent or temporary)Noise or drugs

Page 38: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Treatment of Hearing Loss

1. Diagnosis using audiogram2. Surgery for outer and middle ear3. No correction for central

auditory system problems4. Hearing aid corrects threshold

problems5. Cochlear Implants

Page 39: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Cochlear Implant - Overview

Source: Prof. Graeme Clark, The Bionic Ear Institute

Page 40: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Cochlear Implant - Detail

Source: Prof. Leslie M. Collins, Duke University

Page 41: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Cochlear Implant ReferencesCochlear Implant Association, Inc.

http://www.cici.org/

The Bionic Ear InstituteThe University of Melbourne

http://www.bionicear.org/bei/index2.html

Advanced Bionicshttp://www.advancedbionics.com/

Page 42: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

TheHumanVocalTract

Page 43: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Closed tube system(formation of vowel sounds)

Shorter lengthRaises frequency

Moving center nodetoward closed endraises frequency byshortening wavelength

Page 44: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Vocal Formant spectra

“OO”

“AH”

“EE”

Page 45: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Vocal Spectrogram of Formants

Page 46: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Formants for vowel sounds

Page 47: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Constancy of formant frequencyas

Singing frequency changes

Page 48: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

TheSingersFormant

Averaged spectral energy distribution:Light: ordinary speechDark: orchestral accompanimentBrown: Good singer with orchestra

Johan Sundberg: The Acoustics of the Singing Voice; Sci. Amer., March 1977

Page 49: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Formation of Sibilants

Unvoiced:“sss”

Page 50: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Formation of Sibilants

Voiced:“zzz”

Page 51: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Audio Spectrograms

Page 52: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Voice and Synthesizer “wow”

Page 53: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Computerized Speech Laboratory

Page 54: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Matching vocal spectrograms

Page 55: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

1. Helium Voiceand Sulfur Hexafluoride Voice

2. Tibetan Monks and the

Tantric Rituals

3. The Harmonic Choir

4. Kronos String Quartetwith Tuvan Throat Singers

5. Falsetto singing andcountertenor singers

Page 56: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

Spectrograms of Bird Calls

What birds are they?

Page 57: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity

The End