59
fMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

  • View
    219

  • Download
    0

Embed Size (px)

Citation preview

Page 1: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

fMRI and Reading

Einar Mencl, Haskins Laboratories, New Haven, CT USA

Page 2: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Koby finishes 49 in 12 minutes;Einar finishes 61 in…?

Page 3: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Collaborators

• Haskins Laboratories: Ken Pugh, Rebecca Sandak, Stephen Frost, Dina Moore, Stephanie Mason, Leonard Katz, Jay Rueckl, Donald Shankweiler, Annette Jenner, Jun Ren Lee, Carol Fowler, Ram Frost

• Yale Center for the Study of Learning and Attention: Bennett Shaywitz, Sally Shaywitz, Karen Marchione, John, Holahan, Jack Fletcher

• Yale University/Diagnostic Radiology: John Gore, Todd Constable, Robert Fulbright, Pawel Skudlarski, Cheryl Lacadie

Page 4: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Haskins - 270 Crown Street, New Haven CT

Page 5: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Haskins - 300 George Street, New Haven CT

Page 6: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Haskins - 300 George Street, New Haven CT

Page 7: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Haskins Folks (1)

Page 8: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Haskins Folks (2)

Page 9: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Behavioral Background

1) motor theory of speech perception; phonology 2) Evidence from fast priming: (Turvey, Lueketela, & Frost) a) toad - frog b) tode - frog c) towed - frog

Page 10: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Behavioral Background

1) motor theory of speech perception; phonology 2) Evidence from fast priming: (Turvey, Lueketela, & Frost) a) toad - frog b) tode - frog c) towed - frog

3) What is the best prime for a word? 1) fort - fort (identity)

Page 11: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Behavioral Background

1) motor theory of speech perception; phonology 2) Evidence from fast priming: a) toad - frog b) tode - frog c) towed - frog

3) What is the best prime for a word? 1) fort - fort 2) bowl - bowl?

Page 12: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Behavioral Background

1) motor theory of speech perception; phonology 2) Evidence from fast priming: a) toad - frog b) tode - frog c) towed - frog

3) What is the best prime for a word? 1) fort - fort 2) bowl - bowl? >>> boll - bowl (!) alternate pronounciations: howl, scowl

Page 13: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Slice Locations

Page 14: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Auditory versus Visual Sentence Task

Constable, Pugh et al., (NeuroImage 2004)

common print(red) speech(blue)

R - L

Page 15: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

An Initial Neurobiological Reading Model

ANTERIORAreas:

inferior frontal gyrus (including Broca’s area)

One Hypothesized Function:Articulatory recoding

OCCIPITOTEMPORAL (VENTRAL)

Areas: occipitotemporal juncture, middle and inferior temporal gyriHypothesized Function: Linguistically structured memory- based fast word identification system (posterior aspect = “word-form” area)

TEMPOROPARIETAL(DORSAL)

Areas:supramarginal, angular, superior temporal (Wernicke’s) gyri

Hypothesized Function:Mapping of orthographic to phonological and semantic representations

(Pugh et al. 2000)

Page 16: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Auditory versus Visual Sentence Task

Constable, Pugh et al., (NeuroImage 2004)

common print(red) speech(blue)

R - L

temporoparietal

occipitotemporal

anterior

Page 17: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Case MixingExp. (design)

Subjects get 10 scan runs, each 5:40 long

Each run, they see 5 blocks of baseline trials:

//*\ or /\\/

and 4 blocks of lexical decision trials:1 high frequency unmixed case2 low frequency unmixed case3 high frequency mixed case4 low frequency unmixed case

charm or cHaRm

Page 18: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Case Mixing Exp. (design)

1 baseline /\*/2 HF unmixed case3 LF unmixed case4 HF mIxEd CaSe5 LF mIxEd CaSe

Page 19: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Case MixingExp. (1)

single-subjectwords - lines

1 baseline /\*/2 HF unmixed case3 LF unmixed case4 HF mIxEd CaSe5 LF mIxEd CaSe

Page 20: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Case MixingExp. (2)

single subjectmixed - unmixed

1 baseline /\*/2 HF unmixed case3 LF unmixed case4 HF mIxEd CaSe5 LF mIxEd CaSe

Page 21: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Case MixingExp. (12)

across subjecthigh frequency wordsmixed - unmixed

1 baseline /\*/2 HF unmixed case3 LF unmixed case4 HF mIxEd CaSe5 LF mIxEd CaSe

Page 22: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Case MixingExp. (13)

across subjectlow frequency wordsmixed - unmixed

1 baseline /\*/2 HF unmixed case3 LF unmixed case4 HF mIxEd CaSe5 LF mIxEd CaSe

Page 23: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Case Mixing (14): Time effects in IFG

Page 24: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Case Mixing (15): Time effects in OT

Page 25: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Event-Related Designs, Two Analyses

1) Using a priori predicted response functions a) long intertrial interval designs b) Reference waveform regression2) Estimating the actual response a) simple averaging b) delta function regression (FIR, finite impulse response)3) Some examples

Page 26: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Simulated Hemodynamic Response (1)

mean = 5000sd = 100effect size 0-1%, 0-50 pointsGamma function tau=1.08; n=3; delay=3

Page 27: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Simulated Hemodynamic Response (2)

Noise SD = 0

Noise SD = 10

Noise SD = 100

Page 28: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Event-Related Designs, Two Analyses

1) Using a priori predicted response functions a) long intertrial interval designs b) Reference waveform regression2) Estimating the actual response a) simple averaging b) Delta Function Regression3) Some examples

Page 29: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Long Intertrial Intervals, Single Conditioncf. Ni et al., (2000)

Event Regressor

Simulated Data

Page 30: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Long Intertrial Intervals, Multiple Conditions

Cond 1Cond 2

Cond 1Cond 2

Event Regressors

Simulated Data

Page 31: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Multiple Regression (3):Reference Waveform Regression

Friston et al. 1994 int C1 C2

Cond 1Cond 2

Page 32: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Variability of the HRFAguirre et al., 1998

Page 33: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Event-Related Designs, Two Analyses

1) Using a priori predicted response functions a) long intertrial interval designs b) reference waveform regression2) Estimating the actual response a) simple averaging b) delta function regression3) Some examples

Page 34: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Estimating the Response (1):Simple Averaging, No Overlap

Cond 1Cond 2

Page 35: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Estimating the Response (2):Simple Averaging, With Overlap

Cond 1Cond 2

Page 36: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Estimating the Response (3):Simple Subtraction with Overlap

Dale & Buckner, 1997

Page 37: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Delta Function Regression (1)

Meizin et al., 2000

Page 38: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Delta Function Regression (2)Cond 1Cond 2

EventRegressorsFor Cond 1

EventRegressorsFor Cond 2

-1 0

+1+2+3

.

.

.+15P

eris

timul

us

Tim

e

Page 39: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Delta Function Regression (3)

Cond 1 Cond 2___

Cond 1

Cond 2

Page 40: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Delta Function Regression (4):Evoked Responses

Estimated Response

Peristimulus Time

Imag

e In

tens

ity

Imag

e In

tens

ity

Page 41: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Delta Function Regression (5): Overlapping Responses

Cond 1Cond 2

Cond 1 Cond 2___

Page 42: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Estimated Response & Gamma Fits

Delta Function Regression (6):Gamma Fitting

Peristimulus Time

Imag

e In

tens

ity

Imag

e In

tens

ity

Page 43: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Estimated Response

Peristimulus Time

Imag

e In

tens

ity

Imag

e In

tens

ity

Baseline Timepoints[-1 to 0]

Activation Timepoints[+3 to +8]

Delta Function Regression (4):“Blocklet” Analysis

Page 44: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Compare & Contrast...

Reference Waveform Regression 1) most designs are analyzable 2) stronger power 3) biased when reference <> actual

Delta Function Regression 1) some designs not analyzable 2) weaker power 3) unbiased measure of temporal response

Page 45: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Primed Lexical Decision Experiment (intro)

5 trialtypes: orthographic phonological

prime target relationship relationship

1 O+P+ bribe TRIBE similar similar2 O+P- couch TOUCH similar dissimilar3 NWO+ bliss TRISS similar similar4 NW brick THILM dissimilar dissimilar5 UNRE lunch TRUNK dissimilar dissimilar

Page 46: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

LD/Prime Exp. (intro)

1 bribe - TRIBE2 couch - TOUCH3 bliss - TRISS4 brick - THILM5 lunch - TRUNK

Page 47: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

LD/PrimeExp. (1)

single subjectunrelated primelunch - TRUNK

1 bribe - TRIBE2 couch - TOUCH3 bliss - TRISS4 brick - THILM5 lunch - TRUNK

Page 48: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

LD/PrimeExp. (2)

raw time course

1 bribe - TRIBE2 couch - TOUCH3 bliss - TRISS4 brick - THILM5 lunch - TRUNK

Page 49: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

LD/PrimeExp. (4)

across subjects

bribe - TRIBE

1 bribe - TRIBE2 couch - TOUCH3 bliss - TRISS4 brick - THILM5 lunch - TRUNK

Page 50: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

LD/PrimeExp. (5)

across subjects

couch - TOUCH

1 bribe - TRIBE2 couch - TOUCH3 bliss - TRISS4 brick - THILM5 lunch - TRUNK

Page 51: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

LD/PrimeExp. (6)

across subjects

couch - TOUCH vsbribe - TRIBE

1 bribe - TRIBE2 couch - TOUCH3 bliss - TRISS4 brick - THILM5 lunch - TRUNK

Page 52: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

LD/PrimeExp. (6)

across subjects

couch - TOUCH vsbribe - TRIBE

1 bribe - TRIBE2 couch - TOUCH3 bliss - TRISS4 brick - THILM5 lunch - TRUNK

Page 53: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

LD/PrimeExp. (1)

across subjectregion timecourses

1 bribe - TRIBE2 couch - TOUCH3 bliss - TRISS4 brick - THILM5 lunch - TRUNK

Page 54: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

titration of stimulus duration

+

house

&&&&&

1000 msec

500/1500 msec

25/50/100 msec

1000 msec

Page 55: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

titration of stimulus duration (2)

Page 56: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Interactivity: Phonology and Semantics

(Strain et al. 1999)

• RT faster for hi-imageability words

• Imageability modulates Cons x Freq

• Triangle model exhibits same pattern

• Does the brain…?

Page 57: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Design

Go/no-go naming in a block fMRI session

Stimuli:• Words (Consistency x Imageability x Frequency)• Pseudowords

Page 58: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

IFG = Consistency

MTG =Imageability

Region of interest analysis

(Main effect)

(Main effect)

Frost, et al., 2005, Neuroreport

Page 59: FMRI and Reading Einar Mencl, Haskins Laboratories, New Haven, CT USA

Cross-Linguistic Effects - Word Frequency

…and implications for developmental dyslexia…