45
an Detection and Localizat of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington, DC 4 May, 2010

Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Embed Size (px)

Citation preview

Page 1: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Human Detection and Localization of Sounds

in Complex EnvironmentsW.M. Hartmann

Physics - AstronomyMichigan State University

QRTV, UN/ECE/WP-29Washington, DC4 May, 2010

Page 2: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Goals: GRB-51-18, QRTV

• Phases II-IV. Determine human and technical factors relevant to improving the safety of pedestrians in the presence of quiet road vehicles.

e.g.:

• Detection

• LocalizationThese are psychoacoustical topics

Page 3: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Psychoacoustics Goals

• Mathematical models of hearing processes.

• Consistent with animal physiology.

• Consistent with human imaging and encephalography.

• Explain data from listening experiments in which listeners respond to sounds.

Page 4: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

People from off the street

Irreproducible results

Experiment

Page 5: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Psychoacoustical Methods

• Controlled environment

• Focused attention

• Trained listeners

• Long

experiments

• Specialized

protocol.

Page 6: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Experimental protocol

Two-interval forced choice

One of these intervals has a signal in it.

The listener knows that in advance.

Interval 1 Interval 2

Page 7: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Experimental Goals Met

• Reproducible data• Find the best possible performance for the

human organism. • Successfully test models.

• Relevant to the blind pedestrian on the street corner?

But

Page 8: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Single interval/ No interval

• Maybe there’s a signal…. Maybe not.

Signal present: HIT MISS

No signal: FALSE CORRECT ALARM REJECTION

YES NO

Page 9: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Hit Rate + Miss Rate =100 False Alarm+Correct Rejection=100

Page 10: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Slope about 1.0

Listener in unbiassed experiment

Page 11: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Miss rate about 0.

Pedestrian

Page 12: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Is psychoacoustics of any use at all in this context?

• P, “It cannot be heard.”

• Conclusion: It can’t be heard.

• P, “It’s easily heard.”

• Conclusion: Maybe it can be heard.

• There’s more:

Page 13: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Active cochlea

Page 14: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

0

20

40

60

80

Cal

Test

Page 15: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Detection

• In typical environments, background noise means that detection thresholds are masked thresholds.

• Masking is frequency specific.

• Tonotopic organization starts with the cochlea.

Page 16: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,
Page 17: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,
Page 18: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Buick Lucerne, 1 meter, idle

60 dBA15 dB beeps

Page 19: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

100 dBA

Page 20: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Buick Lucerne, 1 meter, 2000-1500 RPM

72 dBA

Page 21: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,
Page 22: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

DC9, next to the intake

30 dB

hp

Page 23: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Sound Localization

• Azimuth -90 degrees to 90 deges

• Elevation – including front back 0 to 360 degees

• Distance

Page 24: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

ITD = Interaural time differenceILD = Interaural level difference

xLxR

t t

Azimuth

Page 25: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

714 Hz

1428 Hz

=41 deg => 500 us

=> ITD < 1200 Hz

ITD

Page 26: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Right ear

Left ear

Bright

spot

ILD

Arago-Poisson, 1818

Headshadow

>1300 Hz

Page 27: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

ILD

Page 28: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Listener Responses

Page 29: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Amplitude modulation• fc=1500 Hz, fm = 100 Hz

• 100% modulation

2/3 ms 10 ms

Page 30: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

AMfm=100 Hz100%

Listener N

Listener Responses

Page 31: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Direct sound retains coherenceMax cross-correlation = 1.

xLxR

t t

Page 32: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Room reflections destroy coherence

xLxR

t t

Page 33: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Coherence

ITD

o

BW (-o)

Page 34: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Need high coherenceto use envelope cues.

Page 35: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

PRECEDENCE EFFECT

• Competition between Sound 1 & Sound 2

• Sound 1: Localization cues, ITD, ILD, etc.

• Sound 2: Localization cues, ITD, ILD, etc.

time1 2

Sound 1 takes precedence.

Page 36: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

• Sound 1: Localization cues, ITD, ILD, etc.

• Sound 2: Localization cues, ITD, ILD, etc.

time1 2

Sound 1 takes precedence.

Fused image near location of Sound 1.

Page 37: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

1 2

Yvor Winters, 1900-1968

Page 38: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

1 2closer

Page 39: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Elevation and front/back

• Anatomical filtering – cues at high frequencies > 8 kHz or > 2 kHz.

• Problem for elderly listeners.

• Front/back– Turn the head. Otherwise lost.

Page 40: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Distance

• Intensity of known sounds

• Air absorption attenuates high frequencies

• Direct-to-reverberant ratio

• Low-frequency ILD (< 1 meter).

Page 41: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Buick Lucerne, at grille, idle

66 dBA

Page 42: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Conclusions

• To be detectable, signals should have frequencies different from masking. Practically, this means mid to high.

• To be localizable (AZ), signals should have low frequencies. Both ITD and ILD work for the widest range of azimuths. Signals should be impulsive to elicit precedence.

• To disambiguate front/back signals should have high frequencies too.

Page 43: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

The End

Thanks to the NIDCD

Page 44: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

ILD + Responses

Listener does notuse ear signals independently.

Page 45: Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

IPD + Responses

1500 Hz is too fast for ongoingITD or IPD.