1
Coding of behavioral and contextual constituents in free interaction vocal/verbal - orthographic transcription; controlled vocabulary (CV) for children until age 0;9 - symbols for specifics: repetitions; adult-directed speech; ingressive speech; formulaic speech; distorted speech; whispering; ungrammatical/unsemantic speech gaze - CV: look at parent/child/researcher; object; other; out of frame gesture - CV for children until age 0;6; semi strict from age 0;9; semi strict for parents touch - semi strict for both child and parent facial expression - parent, CV mood - child, CV until age 1;0 activity - CV: picture book, “dollplay”, rhymes, etc context - CV: instructions, conversing child/adult, etc distance - CV: within reach, body contact, out of reach Annotation in ELAN About 10 student research assistants employed - all have studied linguistics for at least one year Detailed annotation instructions (updated when needed) Weekly meetings on annotation issues, e-mail contact whenever questions arise Summarizing data as principal factors Four factors summarizing durations in interaction variables for one parent- child dyad. Interaction variables are sorted based on loadings in the first factor (dark blue). Factors are top principal components with varimax rotation. One factor, showing gaze at researcher, is omitted. Completed and upcoming studies Completed: - Pagmar, D. (2015). Noun Phrase Anaphora and Referential Behaviour in Child-Directed Speech During the Child’s First Year - Rask, L. (2015). Prosodic Features in Child-directed Speech during the Child's First Year - Andersson, S. (2015). Repetitions in Child-Directed Speech during the Child’s First Year (in Swedish) - Gustavsson, A. (2014). Touch in interaction between parents and their children (in Swedish) Upcoming: - A Multimodal Account for Implicatures in Parent-Toddler Interaction - Repetitions in child-directed speech; focusing on semantics A session in the lab Free interaction (appr. 10-15 min) Target objects: Mo, Na and Li A few toys (car, clothes to Mo, Na and Li, cups, cow family) ”Book” (drawings of airplane, bucket, umbrella, etc) Suggestions for rhymes and gestures (up to age 0;9) Test leader plays with child (appr. 5-10 min, from age 1;0) Set-up 1, ages 1;0-1;9: non-prompted imitation of block building; jumping with blocks; put blocks in box; find block; age 2;0: prompted imitation Set-up 2, ages 2;0-2;6: non-prompted role play including parent, test leader and dolls Set-up 3, ages 2;9-3;0: prompted role play Goals and aims The goal is to reach a better understanding of the role played by different modalities in the language acquisition process, and to further understand the relation between modalities in parent-child interactions. To build a multimodal database for Swedish children in the ages 0;3-3;0. To use the knowledge gained to model the language acquisition process. Research questions What roles do different modalities play - in interaction between child and parent? - in production within child/parent? What are the differences and commonalities within the group of children/parents as for e.g., interactional style; pace of development; relation between language and external values (non-verbal cognition; SECDI; SES; background; etc); relations within language (semantics; pragmatics; syntactic development; etc)? Project design Subjects and data Subjects 83 subjects (Nov 2013) -> 73 subjects (Nov 2015) 41 boys & 32 girls; 2 twin couples; about 15 bi- or multilingual Non-probability sample (interested parents among 2000 randomly selected) Data collection Child and parent in focus Longitudinal: ages 0;3-3;0, every third month Background data Family situation (martial status; income; educational level; siblings; child care situation; etc) Health situation (otitis; hearing; motoric development; other issues) Language (languages in the family; dyslexia in the family; etc) Behavioral Data Vocal, verbal, gesture, gaze, touch, activity, etc Semi-structured test of joint attention, turn-taking, non- prompted and prompted imitation Additional Data Swedish CDI (ages 0;9-3;0, every third month; online survey) Parents’ understanding of communicative aspects (online survey) Poster presented at WEIRCLE, Workshop on Extensive and Intensive Recordings of Children's Language Environment 2015, Ecole Normale Supérieure, Paris, December 7-8, 2015. We would like to thank all participating families for their contribution to the project. We also gratefully acknowledge the Marcus and Amalia Wallenberg Foundation for the funding of this project (MAW 2011.007; MAW 2013.0056). www.su.se Summary The MINT project is a longitudinal study of verbal and nonverbal interaction between 73 Swedish children and their parents, recorded in lab environment from 3 months to 3 years of age. The overall goal of the project is to deepen our understanding of how language acquisition takes place in a multimodal and interactional framework. The Swedish MINT Project – modelling infant language acquisition from parent-child interaction Tove Gerholm, Lisa Gustavsson, Iris-Corinna Schwarz, Ulrika Marklund, Gláucia Lais Salomão, Petter Kallioinen, Stina Andersson, Freya Eriksson, David Pagmar, Johanna Schelhaas, Sofia Tahbaz Department of Linguistics

The Swedish MINT Project – modelling infant language ...su.diva-portal.org/smash/get/diva2:893444/ATTACHMENT01.pdf · - CV: picture book, “dollplay”, rhymes, etc € context

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: The Swedish MINT Project – modelling infant language ...su.diva-portal.org/smash/get/diva2:893444/ATTACHMENT01.pdf · - CV: picture book, “dollplay”, rhymes, etc € context

Coding of behavioral and contextualconstituents in free interaction 

vocal/verbal- orthographic transcription; controlled vocabulary (CV) forchildren until age 0;9- symbols for specifics: repetitions; adult-directed speech;ingressive speech; formulaic speech; distorted speech;whispering; ungrammatical/unsemantic speech 

gaze- CV: look at parent/child/researcher; object; other; out of frame 

gesture- CV for children until age 0;6; semi strict from age 0;9; semistrict for parents 

touch- semi strict for both child and parent 

facial expression- parent, CV 

mood- child, CV until age 1;0 

activity- CV: picture book, “dollplay”, rhymes, etc 

context- CV: instructions, conversing child/adult, etc 

distance- CV: within reach, body contact, out of reach

Annotation in ELAN 

• About 10 student research assistants employed - all havestudied linguistics for at least one year

• Detailed annotation instructions (updated when needed)• Weekly meetings on annotation issues, e-mail contact

whenever questions arise

Summarizing data as principal factors

Four factors summarizing durations in interaction variables for one parent-        child dyad. Interaction variables are sorted based on loadings in the first factor  (dark blue). Factors are top principal components with varimax rotation. One    factor, showing gaze at researcher, is omitted.                                                                

                                                                                           

Completed and upcoming studies 

Completed:- Pagmar, D. (2015). Noun Phrase Anaphora andReferential Behaviour in Child-Directed Speech During theChild’s First Year- Rask, L. (2015). Prosodic Features in Child-directedSpeech during the Child's First Year- Andersson, S. (2015). Repetitions in Child-DirectedSpeech during the Child’s First Year (in Swedish)- Gustavsson, A. (2014). Touch in interaction betweenparents and their children (in Swedish) 

Upcoming:- A Multimodal Account for Implicatures in Parent-ToddlerInteraction- Repetitions in child-directed speech; focusing on semantics

A session in the lab 

Free interaction (appr. 10-15 min)• Target objects: Mo, Na and Li• A few toys (car, clothes to Mo, Na and Li, cups, cow

family)• ”Book” (drawings of airplane, bucket, umbrella, etc)• Suggestions for rhymes and gestures (up to age 0;9) 

Test leader plays with child (appr. 5-10 min, from age 1;0)• Set-up 1, ages 1;0-1;9: non-prompted imitation of block

building; jumping with blocks; put blocks in box; findblock; age 2;0: prompted imitation

• Set-up 2, ages 2;0-2;6: non-prompted role play includingparent, test leader and dolls

• Set-up 3, ages 2;9-3;0: prompted role play

Goals and aims 

• The goal is to reach a better understanding of the role playedby different modalities in the language acquisition process,and to further understand the relation between modalities inparent-child interactions.

• To build a multimodal database for Swedish children in theages 0;3-3;0.

• To use the knowledge gained to model the languageacquisition process.

Research questions 

• What roles do different modalities play- in interaction between child and parent?- in production within child/parent?• What are the differences and commonalities within the group

of children/parents as for e.g., interactional style; pace ofdevelopment; relation between language and external values(non-verbal cognition; SECDI; SES; background; etc);relations within language (semantics; pragmatics; syntacticdevelopment; etc)?

Project design

Subjects and data 

Subjects• 83 subjects (Nov 2013) -> 73 subjects (Nov 2015)• 41 boys & 32 girls; 2 twin couples; about 15 bi- or

multilingual• Non-probability sample (interested parents among 2000

randomly selected) 

Data collection• Child and parent in focus• Longitudinal: ages 0;3-3;0, every third month 

Background data• Family situation (martial status; income; educational

level; siblings; child care situation; etc)• Health situation (otitis; hearing; motoric development;

other issues)• Language (languages in the family; dyslexia in the family;

etc) 

Behavioral Data• Vocal, verbal, gesture, gaze, touch, activity, etc• Semi-structured test of joint attention, turn-taking, non-

prompted and prompted imitation 

Additional Data• Swedish CDI (ages 0;9-3;0, every third month; online

survey)• Parents’ understanding of communicative aspects (online

survey)

Poster presented at WEIRCLE, Workshop on Extensive and Intensive Recordings of Children's Language Environment 2015, Ecole Normale Supérieure, Paris, December 7-8, 2015. We would like to thank all participating families for their contribution to the project. We also gratefully acknowledge the Marcus and Amalia Wallenberg Foundation for the funding ofthis project (MAW 2011.007; MAW 2013.0056).www.su.se

Summary 

The MINT project is a longitudinal study of verbal andnonverbal interaction between 73 Swedish children andtheir parents, recorded in lab environment from 3 monthsto 3 years of age. The overall goal of the project is todeepen our understanding of how language acquisitiontakes place in a multimodal and interactional framework.

The Swedish MINT Project  – modelling infant language acquisitionfrom parent-child interactionTove Gerholm, Lisa Gustavsson, Iris-Corinna Schwarz, Ulrika Marklund, Gláucia Lais Salomão, Petter Kallioinen,Stina Andersson, Freya Eriksson, David Pagmar, Johanna Schelhaas, Sofia Tahbaz

Department of Linguistics