How does bilingualism affect language and attention ? UPF Albert Costa November 2009 UIB Francisco Barceló Cristina Baus (PhD student) Francesca Branzi

How does bilingualism affect language and attention ?

UPF

Albert Costa

November 2009

UIB

Francisco Barceló

Cristina Baus (PhD student)Francesca Branzi (PhD student)

Marco Calabria (Post-doc)Xavier Garcus (Research assistant)

Mireia Hernández (PhD student)Alexandra Ibañez (Master student)

Iva Ivanova (PhD student)

Paula Marne (Research assistant)Clara Martin (Post-doc)Violeta Pina (PhD student)Sara Rodriguez (PhD student)Elin Runnquist (PhD student)Jasmin Sadat (PhD student)Kristof Strijkers (PhD student)

UJI

César Ávila

http://www.upf.edu/

General introduction

Does bilingualism affect language processing in a general manner?

Does it affect the native and dominant language (L1) ?

Does bilingualism affect non-linguistic cognitive processes ?

Does it also affect attention, memory, task-switching… ?


Does bilingualism affect the native and dominant language (L1) ?

New evidence that L1 might be influenced by L2: Adult bilingual listeners

experience more difficulty processing L1 in noise as L2 proficiency increases (von

Hapsburg et al., 2009)

Does bilingualism also affect attention, memory, task-switching… ?

Recent evidence that monitoring processes are affected by bilingualism

(Costa et al., 2009; Hernández et al., in press)


production

comprehension

Memory

impairment

Language

Marco Calabria

Paula Marne

Mireia Hernández

Nuria Sebastian Galles

Marco Calabria

Mireia Hernández

Paula Marne

Clara Martin

Cristina Baus

Iva Ivanova

Elin Runnquist

Jasmin Sadat

Kristof Strijkers

Iva Ivanova

Clara Martin

Sara Rodriguez

César Ávila

Francisco Barceló

Francesca Branzi Mireia Hernández

Alexandra Ibañez

Clara Martin

Violeta Pina

Attention


production

comprehension

Memory

impairment

Language

Marco Calabria

Paula Marne

Mireia Hernández

Cristina Baus

Iva Ivanova

Elin Runnquist

Jasmin Sadat

Kristof Strijkers

Iva Ivanova

Clara Martin

Sara Rodriguez

César Ávila

Francisco Barceló


Alexandra Ibañez

Clara Martin

Violeta Pina


Marco Calabria

Mireia Hernández

Paula Marne

Clara Martin

Attention

L1 production influenced by bilingualism (bilingualism cost)

Task-switching influenced by bilingualism (bilingualism advantage)

Bilingualism effects on Naming latencies

Monolinguals

Bilinguals in L1

Naming latencies larger in highly-proficient bilinguals compared to monolinguals, even when speaking in L1

Ivanova, I. & Costa, A. (2008) Acta Psychologica

Repetitions

Na

min

g la

ten

cie

s (m

s)

540

560

580

600

620

640

660

680

700

1 2 3 4 5

Bilinguals in L2Bare naming Noun-phrase production

1 2 3 4

Repetitions

650

700

750

800

850

900

Na

min

g la

ten

cie

s (m

s)Sadat-Schaffai, J., Alario, F-X.,

Costa, A., in preparation

“car” “the red car”

Monolinguals

Bilinguals in L1

Bilinguals in L2Bare naming Noun-phrase production

Sadat-Schaffai, J., Alario, F-X., Costa, A., in preparation

“car” “the red car”

Bilingualism effects on Articulatory durations

Articulatory durations larger in highly-proficient bilinguals compared to monolinguals, even when speaking in L1

1 2 3 4

Repetitions

750

800

850

900

Art

icul

ator

y du

ratio

ns (

ms)

390

410

430

450

1 2 3 4

Repetitions

Art

icul

ator

y du

ratio

ns (

ms)

Time-course of the bilingualism effect on picture naming

Divergence between picture naming in L1 and L2 200ms after the picture onset

To be compared to monolinguals’ data…

Strijkers, K., Runnquist, E., Costa, A. in preparation

Strijkers, K., Costa, A., Thierry, G. (2009) Cerebral Cortex

Costa, A., Strijkers, K., Martin, C., Thierry, G. (2009) PNAS

Decline in L1 naming latencies after 4 months of immersion in a foreign country

Effect of immersion on naming latencies

Baus, C., Costa, A., Carreiras, M. in preparation

ArrivalArrival DepartureDeparture

Monolinguals Bilinguals immersed (L1)

760

780

800

820

840

860

880

Nam

ing

late

ncie

s (m

s)

Bilingualism effects on speech production

Bilingualism affects language processing in a general manner ?

… meaning that it has an influence on L1 production ?

YES: bilinguals slower than monolinguals in L1 production

Early bilinguals slower than monolinguals in L1 bare naming and noun-phrase production

Late bilinguals slower than monolinguals in L1 bare naming after 4 months of immersion

Language impairment in Alzheimer disease

Picture Naming

L1 L2

40

50

60

70

80

90

100

% C

orre

ct R

espo

nses

Mild Cognitive Impairment

Mild Alzheimer Disease

Moderate Alzheimer Disease

- Same task 6 months later

Memory of L1 and L2 words differentially affected in Alzheimer disease ?

- Same task with monolingual patients

Memory of L1 words differentially affected in monolinguals and bilinguals ?

Calabria, M., Hernández, M., Marne, P., Costa, A.

In collaboration with the “Hospital Universitari de Bellvitge”the “Hospital de la Santa Creu i Sant Pau”

the “Hospital de Dia Sant Jordi de Granollers”

Bilinguals differ from monolinguals in speech production

even when using their first and dominant language

cognitive processes (beyond “purely” linguistic

processing) affected by bilingualism ?

Investigation of non-linguistic processes in bilingualism

From linguistic to non-linguistic tasks

Why investigating non-linguistic task-switching in bilingualism ?

- To observe effects of bilingualism beyond linguistic processing

- Because task-switching might be influenced by bilingualism…

… as bilinguals use to switch from one language to another

Switching from one language to the other makes

bilinguals better at switching from one task to another

even in the non-linguistic domain ?

Bilingualism effects on task-switching

Hernández, M., Martin, C., Barceló, F., Costa, A.

REPEAT SWITCH

Cues

Experimental design (Task-switching)

LOCAL COST: Larger RTs for the first trial after a switch versus repeat

= Task-set reconfiguration.

RESTART COST: Larger RTs for the first trial after a cue versus second trial

= Task-set retrieval

Repeat series

Rp4Rp3Rp2Rp1REPEAT

……

Switch series

Sw4Sw3Sw2Sw1SWITCH

……

Restart and Local costs

Ma

gn

itud

e o

f th

e C

ost

s (m

s)

Local Cost

(Sw1 – Rp1)

Restart Cost

(Rp1 – Rp2)

Repeat series

Switch series

Rp4Rp3Rp2Rp1REPEAT

…

Sw4Sw3Sw2Sw1SWITCH

…

…

…

Restart and Local costs

0

100

200

300

400

500

600

Bilinguals

Monolinguals

*

Hernandez, M., Martin, C., Barcelo, F., Costa, A.,

submitted in Cognition

-4

-2

0

2

-6

-8

-4

-2

0

2

-6

-84000 200 600 8004000 200 600 800

N2

Restart cost

Local cost

Bilingualism effects on task-switching - ERPs

Repeat – Trial 1

Repeat – Trial 2

Switch – Trial 1

In monolinguals, we expect:

- Similar effect on the Local cost

- Larger effect on the Restart cost

Martin, C., Hernandez, M., Barcelo, F., Costa, A., in preparation

Rp2Rp1REPEAT

Sw2Sw1SWITCH

“Neural basis of language and set-shifting in bilinguals“

Ávila, C., Hernandez, M., Costa, A. et al. submitted

Bilingualism effects on task-switching - fMRI

Bilinguals are better than monolinguals in Task-set retrieval but not in Task-set reconfiguration

Bilingualism effects on task-switching

Bilingualism seems to affect task-switching

The specific process affected by bilingualism is the RESTART COST

We did not observe any bilingualism effect on the SWITCH COST

Abutalebi, J., Costa, A., et al. submitted

Branzi, F., Abutalebi, J., Costa, A.Pina, V., Fuentes, L., Costa, A.

MONOLINGUALS engaged more extensively areas related to cognitive

control such as the ACC

Incongruent vs. Congruent trials

BilingualsMonolinguals

Monolinguals vs. Bilinguals

Bilingualism effects on conflict resolution

+ +

Incongruent Congruentvs.

= CONFLICT EFFECT

Costa, A., et al. (2008) CognitionCosta, A., et al. (2009) CognitionHernandez, M. et al. (in press) Bilingualism: Lang & Cogn

Bilinguals differ from Monolinguals in non-linguistic processes (task-switching, conflict resolution…)

Bilingualism and Executive control

Bilinguals differ from Monolinguals in L1 production and comprehension

The link between bilingualism effects in linguistic and non-linguistic

tasks might be that bilingualism affects executive control

Convergence between different projects on language,

attention and memory

production

comprehension

Memory

impairment

Language

Marco Calabria

Paula Marne

Mireia Hernández

Cristina Baus

Elin Runnquist

Jasmin Sadat

Kristof Strijkers


Marco Calabria

Mireia Hernández

Paula Marne

Clara Martin

Attention

New projects on bilingualism at the interface between language, attention and memory

Iva Ivanova

Clara Martin

Sara Rodriguez

César Ávila

Francisco Barceló


Alexandra Ibañez

Clara Martin

Violeta Pina

Bilingualism and Executive control

Cristina Baus Francesca Branzi Marco Calabria

Mireia Hernandez Iva Ivanova Paula Marne Clara Martin

Violeta Pina

Alexandra Ibañez

Sara Rodriguez Elin Runnquist Jasmin Sadat Kristof Strijkers

Albert Costa

SWITCH COST: slower performance in switch relative to non-switch trials, reflecting the resources needed for task-set reconfiguration.

If RED or CIRCLE, press 1

If BLUE or SQUARE, press 2

• Non-Switch: the current trial requires the same set as the previous one.

2 sets: COLOR and SHAPE (forma)

• Switch: the current trial requires a different set from the previous one.

Avila, Hernandez, Costa et al. (submitted….and rejected)


Bilingualism effects on speech production – 2

370 380 390 400 410 420

780 800 820 840 860 880

Bar

e N

amin

gN

oun

Phr

ase

Articulatory durations (ms)

Naming latencies and articulatory durations larger in highly-proficient bilinguals compared to monolinguals in Noun-phrase production

600

640

680

720

760

800

Bare Naming Noun Phrase

Nam

ing

late

ncie

s (m

s)

Monolinguals

Bilinguals in L1

Sadat-Schaffai, J., Alario, F-X., Costa, A., in preparation

675

775

875

975

1075

1175

1275

1375

1475

1 2 3 4 5 6 7

Bil- SWITCH

Mon- SWITCH

Bil- REPEAT

Mon- REPEAT

RT

s

POSITION OF TRIAL AFTER CUE

Repeat series

Switch series

Rp4Rp3Rp2Rp1REPEAT

…

Sw4Sw3Sw2Sw1SWITCH

…

…

…

Reaction times

Switch vs. non switch trials:

•BILINGUALS:Increased activity in the left IFG

• MONOLINGUALS: Increased activity in the left AAC and right IFG


Avila, C., Hernandez, M., Costa, A. et al. submitted

• Increased activation in the right IFG in monolinguals vs. bilinguals (red cluster)

Between Group comparison

Which areas are more involved in Task-switching for one group compared to the other ?

• Increased activation in the

left IFG in bilinguals vs. monolinguals (blue cluster)

Avila, C., Hernandez, M., Costa, A. et al. submitted


Bilingualism effects on linguistic and non-linguistic task switching

Non-linguistic task switching = classification of cards depending on Color and Form

Linguistic task switching = production of picture’s name versus production of verbs associated to the pictures

Francesca Branzi, Albert Costa, Jubin Abutalebi

Bilinguals outperform Monolinguals in linguistic and non-linguistic task switching ?

Linguistic and non-linguistic switching involve similar/different networks ?


Costa, A., Hernández, M., Costa-Faidella, J., Sebastián-Gallés, N. (2009) Cognition

No effect of bilingualism on the LOW-Monitoring contexts

Bilingualism effects on conflict resolution

8% Con 50% Con 75% Con 92% Con

510

560

610

660

710

760

Con Incon Con Incon Con Incon Con Incon

RT

s (m

s)

Bilinguals

Monolinguals

Effect of bilingualism on the HIGH-Monitoring contexts

Bilingualism effects on task-switching and conflict resolution

Bilingualism, task-switching and conflict resolution

Violeta Pina, Albert Costa, Carlos Funtes

Bilingualism advantage in Task-switching (Hernandez et al., sub. in Cognition)

… but advantage only on the restart cost

Bilingualism advantage in Conflict resolution (Costa et al., 2008; 2009)

… but advantage only in high monitoring context

Ma

gn

itud

e o

f th

e C

ost

s (m

s)

Local Cost Restart Cost0

100

200

300

400

500

600

Bilinguals

Monolinguals

*

8% Con 50% Con 75% Con 92% Con

510

560

610

660

710

760

Con Incon ConIncon ConIncon Con Incon

RT

s (m

s)Bilinguals

Monolinguals

Bilingualism, task-switching and conflict resolution

Violeta Pina, Albert Costa, Luis Funtes

- Task including task-switching and conflict resolution

If bilingualism advantage = monitoring process

(cf. Costa et al., 2009; Hernández et al., in press)

We should observe a larger bilingualism advantage in this task with higher monitoring process demands

Bilingualism effects on task-switching and conflict resolution

Bilingualism effects on executive control

“Neural basis of language and set-shifting in bilinguals“

Bilingualism and Task-switching – fMRI

Ávila, C., Hernandez, M., Costa, A. et al. submitted

Bilingualism and Conflict resolution – fMRI

Branzi, F., Abutalebi, J., Costa, A.

Bilingualism, Task-switching and Conflict resolution

Pina, V., Fuentes, L., Costa, A.

Bilingualism, memory and language

Project on implicit and explicit learning in young adults

Implicit learning of dot pattern influenced by bilingualism ?

Explicit learning of a new language influenced by bilingualism ?

Bilingualism, memory and language

Project on memory of language in bilinguals

Investigation of memory of words in different languages and different colors in bilingual speakers

Memory of words is language-dependant in bilinguals ?

Documents

How does bilingualism affect language and attention ? UPF Albert Costa November 2009 UIB Francisco Barceló Cristina Baus (PhD student) Francesca Branzi