Speech Perception DAY 18 – Oct 9, 2013

SPEECH PERCEPTIONDAY 18 – OCT 9, 2013

Brain & LanguageLING 4110-4890-5110-7960NSCI 4110-4891-6110Harry HowardTulane University

Course organization• The syllabus, these slides and my recordings are

available at http://www.tulane.edu/~howard/LING4110/.• If you want to learn more about EEG and neurolinguistics,

you are welcome to participate in my lab. This is also a good way to get started on an honor's thesis.

• The grades are posted to Blackboard.

10/07/13 Brain & Language, Harry Howard, Tulane University

REVIEW

10/07/13 Brain & Language, Harry Howard, Tulane University 3

Linguistic model, Fig. 2.1 p. 37

Discourse model

SyntaxSentence prosody

MorphologyWord prosody

Segmental phonologyperception

Acoustic phonetics Feature extraction

Segmental phonologyproduction

Articulatory phonetics Speech motor control

SEMANTICS

Sentence level

Word level

SPEECH PERCEPTIONIngram §6

A baby’s linguistic experience• Are babies sensitive to phonological distinctions in their

mothers’ speech?• Yes. • How can this be?

• They must be able to hear in the womb.

• In their first few months, babies prefer …• their caretaker’s voice;• phonological distinctions in their linguistic environment;• speech rhythms in their linguistic environment.

• Summary: before children utter their first words, their perceptual system is being attuned to their linguistic environment.

Head turning• Baby attends to toy and ignores repetitions of a stimulus until it changes:

• a – a – a – i

Perceptual magnet effectsPrototype /i/ (P) and

non-prototype (NP) vowelsResult: reduced discrimination near

prototype

Discussion of PME• Animals can’t do this. Hooray!• It depends on exposure to a language – it emerges only

after 6 months.

THE SPEECH RECOGNITION LEXICONIngram §7

Linguistic model, Fig. 2.1 p. 37

Discourse model

SyntaxSentence prosody

MorphologyWord prosody

Segmental phonologyperception

Acoustic phonetics Feature extraction

Segmental phonologyproduction

Articulatory phonetics Speech motor control

SEMANTICS

Sentence level

Word level

Storing on a hard disk• How does a computer store files on its hard drive?• By writing them in

sequence or where ever there is space.

Retrieving from a hard disk• How does a computer find files on its hard drive (say, when you search for one by its name)?• It searches for it in

sequence or randomly.• How long does it take?

How would this work for lexical retrieval?

• Ingram’s example• The phoneme detector department detects /k/.• A comparator starts looking for all the files that begin with /k/,

perhaps ordered in terms of frequency.• The phoneme detector department detects /æ/.• The comparator rejects the files that don’t begin with /kæ/ and starts

searching the remaining files, perhaps ordered in terms of frequency.• “It is an open bet whether the word cat would be retrieved before or

after the detection of /t/.” (p. 143)• Problems

• Other factors influence speed of retrieval, such as whether the target word has been seen recently.

• Adding such factors to a serial search model tends to make it slow down!

An alternative: the TRACE II model

Observations• TRACE implements parallel computation, rather than serial

or sequential computation.• It is both bottom-up (driven by data) and top-down (driven

by expectations).• Bottom up

• The successive winnowing of a set of cohorts is modeled by decaying activation of competitors as more information is gathered.

• Top down• Word frequency is modeled by lowering the threshold of activation of more

frequent word units, so they need less activation.• The phoneme restoration effect is modeled by the word units supplying the

missing activation of a phoneme unit.• [kæØ] can be heard as ‘cat’.

• The Ganong effect is modeled in the same way.• [kæ<sʃ>] can be heard as ‘Cass’ or ‘cash’ in the proper context.

Simple recurrent networks• Read what Ingram says to get the general idea of what it

is supposed to do.

Modeling variability• We will go over it on Monday.

NEXT TIMEFinish Ingram §7.

☞ Go over questions at end of chapter.

Speech Perception DAY 18 – Oct 9, 2013

Documents

Linking speech perception and neurophysiology: speech ...odedghitza.github.io/downloads/peer-reviewed articles/Ghitza_11.pdf · Linking speech perception and neurophysiology: speech

Speech Analysis Synthesis and Perception

Speech Perception The Speech Chain - UCSB speech...– speech coding – speech recognition • try to understand speech perception by looking at the physiological models of hearing

The two different parts of speech Speech Production Speech Perception

NEUROBIOLOGY OF SPEECH PERCEPTION

Speech & Music Perception

Bringing back the voice: on the auditory objects of speech ... · Keywords Speech perception · Voice perception · Auditory objects 1 Introduction Speech perception is one of the

Speech perception 2 Perceptual organization of speech

Music and Speech Perception - San Jose State University · speech perception in terms of general ways that hearing and perception work. •Example: Perception of coarticulated speech

Speech Perception [ ] recognize speech wreck a nice beach ?

Speech Generation and Perception

Speech perception 2

How visual cues to speech rate influence speech perception

Speech Perception with Cochlear Implants

Psycholinguistics 04 Perception of Language. Structure of Speech Perception of Isolated Speech Segments Perception of Continuous Speech Perception of

SPEECH PERCEPTION IN VIRTUAL ENVIRONMENTS

Investigating Speech Perception in Evolutionary

Speech Perception The Speech Chain

Left premotor cortex and allophonic speech perception in ... · Left premotor cortex and allophonic speech perception in dyslexia: a PET study. Premotor cortex and speech perception

Speech Perception and Comprehension