8
Supplementary online information for Modelling Motor Pattern Generation in the Development of Infant Speech Paper for the eighth International Seminar on Speech Production (ISSP'08) Strasbourg, France, 8th to the 12th of December, 2008 Ian Spencer 1 Howard & Piers Messum 2 1 Biological & Machine Learning Lab, Department of Engineering, University of Cambridge, Trumpington Street, Cambridge CB2 1PZ, England, 2 Centre for Human Communication, University College London, UK E-mail: [email protected], [email protected]

Supplementary online information for Modelling Motor Pattern Generation in the Development of Infant Speech Paper for the eighth International Seminar

Embed Size (px)

Citation preview

Page 1: Supplementary online information for Modelling Motor Pattern Generation in the Development of Infant Speech Paper for the eighth International Seminar

Supplementary online information for

Modelling Motor Pattern Generation in the Development of Infant Speech

Paper for the eighth International Seminar on Speech Production (ISSP'08) Strasbourg, France, 8th to the 12th of December, 2008

Ian Spencer1 Howard & Piers Messum2

 1Biological & Machine Learning Lab,

Department of Engineering, University of Cambridge, Trumpington Street, Cambridge CB2 1PZ, England,

2Centre for Human Communication, University College London, UK

E-mail: [email protected], [email protected]

Page 2: Supplementary online information for Modelling Motor Pattern Generation in the Development of Infant Speech Paper for the eighth International Seminar

Important signal flow paths flow

Sensory Input

Motor ActionOutput

A) Proprioception

B) External sensory consequences

Action/Reaction

from Mother

C) Communicationpaths D) Reformulations

Explore Reward

Infant model

Page 3: Supplementary online information for Modelling Motor Pattern Generation in the Development of Infant Speech Paper for the eighth International Seminar

Reward and effort

Play Sound

Page 4: Supplementary online information for Modelling Motor Pattern Generation in the Development of Infant Speech Paper for the eighth International Seminar

Well synchronized breathing

Play Sound

Page 5: Supplementary online information for Modelling Motor Pattern Generation in the Development of Infant Speech Paper for the eighth International Seminar

Poorly synchronized breathing

Play Sound

Page 6: Supplementary online information for Modelling Motor Pattern Generation in the Development of Infant Speech Paper for the eighth International Seminar

More examplesPlay SoundPlay Sound

Page 7: Supplementary online information for Modelling Motor Pattern Generation in the Development of Infant Speech Paper for the eighth International Seminar

Segmentation using acoustic powerPlay Sound

Page 8: Supplementary online information for Modelling Motor Pattern Generation in the Development of Infant Speech Paper for the eighth International Seminar

Learning multi-syllable words

Caregiveroutput

As recognizedby infant

Best pronunciationby infant

bar bar

a b

b oo

Utterance

• The caregiver produces several 2-syllable sounds• These are then segmented and recognized by the infant model • The infant then pronounces them in his voice• The caregiver selects his best productions