29
1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

Embed Size (px)

Citation preview

Page 1: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

1

PSYC 3290Psycholinguistics

Alternative Language Processing (Bilingualism and Sign Language)

March 31, 2008

Page 2: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

2

Outline• Research paper (due Apr 3 – last lecture)

include abstract. But it won’t be evaluated• Last lecture • Final Exam: Apr 11 (Friday) 9-12 a.m. VH-B• Bilingualism• Sign language• Bimodal bilingualism (speech + sign)

Page 3: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

3

Nature of Bilingualism• Are you a bilingual?• Affected by environmental factors:

education system, immigration, social pressure, political environment…etc.

• Bilingualism is not categorical.

Monolingual Bilingual

Page 4: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

4

Types of Bilinguals• Romaine (1995)

Type 1: one person, one language

Type 2: nondominant home language/one language, one environment

Type 3: nondominant home language without community support

Type 4: double nondominant home language without community support

Type 5: nonnative parents

Type 6: mixed languages

Romaine, S. (1995). Bilingualism. (2nd ed. ). Oxford: Blackwell.

Page 5: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

5

End Product of these SubtypesBilingual children growing up in different linguistic

and social environment would differ in:• (Relative) usage of language

– Overcoming the urge to speak the stronger language– Finding a matching item in the weaker semantic

network

• Proficiency of each language– Formal structures of language produced– Levels of comprehension in different contexts, e.g.,

speaking to grandparents on the phone vs. watching the news

Page 6: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

6

Nature of Bilingualism

ProficiencyU

se

Analysis

Co

ntro

l

Page 7: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

7

Linguistic Consequences of Bilingualism

• Delay in acquisition of speech sounds to word learning: Effect of two phonetic representations

• Concepts of print: Effect of two references to the same referent

• Limited transfer between languages: Effect of writing system

• Lower receptive vocabulary: Effect of two semantic network

• Lower performance in lexical retrieval: Effect of two semantic network

Page 8: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

8

Speech Perception and Word Learning

• Fennell, Byers-Heinlein & Werker (2007)

• Habituated to one syllable with an object• Switch to a different syllable with that same object• Monolingual infants showed dishabituation at 17 months,

bilingual infants delayed to 20 months.• Results replicated in heterogeneous bilinguals and

homogeneous bilinguals (Chinese-English & French-English)

bih dih

Fennell, C. T., Byers-Heinlein, K. & Werker, J. F. (2007). Using speech sound to guide word learning: The case of bilingual infants. Child Development, 78, 1510-1525.

Page 9: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

9

Concepts of Print: Moving word task (Apperly, Williams & Williams, 2004; Bialystok & Martin, 2003; Bialystok & Senman, 2004; Bialystok, Shenfield & Codd, 2000; Bialystok & Luk, 2007;

Collins & Robinson, 2005)

dogdog dogdog

Page 10: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

10

Limited Transfer between Languages• Depends on writing system written

representations of language• Phonological awareness Writing system

effect is weaker (Luk & Bialystok, in press)• Nonword decoding writing system effect is

greatest (Bialystok, Luk & Kwan, 2005)

Page 11: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

11

Receptive Vocabulary(Bialystok, 2007; Oller, Pearson & Cobo-Lewis,

2007)

• Canadian context (N = 963)

40

50

60

70

80

90

100

110

120

5 6 7 8 9

Age group

Standardized score

Mono

Biling

Page 12: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

12

Word Retrieval• Verbal fluency is an important screening

measure for degenerative disease.

Letter fluency: B = M

Category fluency: B < M

But we will come back to this findings later…

Page 13: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

13

Cognitive Consequences of Bilingualism

• Cognitive flexibility

• Inhibitory control

• Selective attention

Executive Functions

Page 14: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

14

Cognitive Flexibility(Bialystok & Martin, 2004)

• Dimensional change card-sorting task (DCCS)

Colour game

Shape game

Page 15: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

15

Inhibitory Control(Bialystok & Senman, 2004; Bialystok & Sheparo, 2005)

Ambiguous Figures

Appearance-reality

Page 16: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

16

Simon Task(Bialystok, et al., 2004; Martin-Rhee & Bialystok, 2008)

Control

Congruent Incongruent

Page 17: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

17

Simon Task across Lifespan

Red LeftGreen Right

Children (Martin-Rhee & Bialystok, 2007)

700

900

1100

1300

1500

1700

Congruent Incongruent

Mean RT ms

Monolingual

Bilingual

Middle-aged (Bialystok et al, 2004)

0

200

400

600

800

1000

Congruent Incongruent

Mean RT ms

Monolingual

Bilingual

Older adults (Bialystok et al., 2004)

700

900

1100

1300

1500

1700

Congruent Incongruent

Mean RT ms

Monolingual

Bilingual

Page 18: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

18

Bilingual mind

Page 19: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

19

Handling two languages….

L2L2

L2

L2

L2L2

L1L1L1

L1L1

L1L1

L1

L1

Weaker representationStronger

control

Page 20: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

20

The verbal fluency task requires both executive functions and proficiency, we know:

(1) bilinguals are better at EF(2) bilinguals are worse in proficiency

Page 21: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

21

Is in VF really due to bilingualism?

• Young adults (119 bilinguals, 41 monolinguals)

20

25

30

35

40

45

Letter Category

Mono Biling

20

25

30

35

40

45

Letter Category

Mono HP Biling LP Biling

Partial results: Bialystok, Craik & Luk, in press

Page 22: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

22

Bilingualism and the Brain (Michelli et al., 2004)

• Grey matter density in inferior parietal lobe (BA 40) significantly correlate with proficiency in L2

• Italian-English bilinguals of all levels of proficiency

• Experience changes the anatomical brain structures

Page 23: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

23

Summary for Bilingualism• Bilingualism is a multidimensional construct that

includes functional usage (how much) and proficiency (how well).

• The cognitive consequences of bilingualism is positive, but limited to nonverbal tasks.

• The linguistic consequences of bilingualism is mixed. Results can be influenced by:– Writing system– Phonetic representation– Semantic network

• Bilingualism also affects brain structure.

Page 24: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

24

Sign Language• Natural human language• Different modalities compare to speech:

Speech: auditory in, verbal outSign: visual in, manual out

• Similarity: – Linguistic structures (“phonology”, syntax, word)– Diversity in languages (ASL, BSL, MSL, SSL…)

• Difference: – Sound meaning vs. movement meaning– Speech organ vs. bodily parts (arm, hand, facial

expression, gesture)– No tense marker

Page 25: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

25

Nicaraguan Sign Language Project

• Children began to sign to each other regardless of the oral approach in education.

• They were kept at own homes prior to the educational reform.

• Birth of a sign language purely based on usage.

• Language does not arise from one person or two people… you need a community.

• Home signs converge to give birth to a language system

Page 26: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

26

Nicaraguan Sign Language Project

• First vs. Second generation of NSLFluency: 2nd > 1st Efficiency: 2nd > 1st Complexity: 2nd > 1st

• Development of NSL was driven by younger individuals than older ones Critical period

• Process is similar to cerolization (how pidgin language evolves to a native-like language) in spoken language (the Hawaiian example)

Page 28: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

28

Sign Language and the Brain(Neville et al., 1998; Newman et al., 2002)

Page 29: 1 PSYC 3290 Psycholinguistics Alternative Language Processing (Bilingualism and Sign Language) March 31, 2008

29

Bimodal Bilingualism

• Bimodal (speech-sign) bilinguals do not have the modality constraint as unimodal (speech-speech) bilinguals.

• Would the positive cognitive consequences of unimodal bilingualism extends to bimodal bilingualism?