27
Can we recover meaningful spatial informa- tion from multivariate pattern analysis? Ga¨ el Varoquaux INRIA/Parietal Alexandre Gramfort Bertrand Thirion

Can we recover meaning full spatial information from multivariate pattern analysis

Embed Size (px)

DESCRIPTION

Slides of the HBM 2012 symposium on recovery of spatial information using machine learning and multivariate pattern analysis from fMRI brain images.

Citation preview

Page 1: Can we recover meaning full spatial information from multivariate pattern analysis

Can we recover meaningful spatial informa-tion from multivariate pattern analysis?

Gael Varoquaux INRIA/Parietal

AlexandreGramfort

BertrandThirion

Page 2: Can we recover meaning full spatial information from multivariate pattern analysis

Can we recover meaningful spatial informa-tion from multivariate pattern analysis?

Gael Varoquaux INRIA/Parietal

AlexandreGramfort

BertrandThirionYes we can!

Page 3: Can we recover meaning full spatial information from multivariate pattern analysis

Can we recover meaningful spatial informa-tion from multivariate pattern analysis?

Gael Varoquaux INRIA/Parietal

AlexandreGramfort

BertrandThirion

Page 4: Can we recover meaning full spatial information from multivariate pattern analysis

1 Prediction versus recovery

2 Random parcellations and sparsity

G Varoquaux 2

Page 5: Can we recover meaning full spatial information from multivariate pattern analysis

?

1 Prediction versus recovery

G Varoquaux 3

Page 6: Can we recover meaning full spatial information from multivariate pattern analysis

1 Standard analysis and MVPA

Standard analysisTest whether the voxel isrecruited by the taskMany voxels ⇒ problemof multiple comparisons

MVPAOverall predictive model

Many voxels ⇒ curse ofdimensionality

F-test SearchlightAnalyzes of regional-average activation and multi-voxel pattern information tell complementary stories,K. Jimura, R.A. Poldrack, Neuropsychologia 2011

G Varoquaux 4

Page 7: Can we recover meaning full spatial information from multivariate pattern analysis

1 Standard analysis and MVPA

Standard analysisTest whether the voxel isrecruited by the taskMany voxels ⇒ problemof multiple comparisons

MVPAOverall predictive model

Many voxels ⇒ curse ofdimensionality

F-test SearchlightAnalyzes of regional-average activation and multi-voxel pattern information tell complementary stories,K. Jimura, R.A. Poldrack, Neuropsychologia 2011

G Varoquaux 4

Page 8: Can we recover meaning full spatial information from multivariate pattern analysis

1 Good prediction 6=6=6= good recovery

Simple simulations: y = w X + eX: observed fMRI images: spatially smoothe: noisew: coefficients (brain regions)

Ground truth

G Varoquaux 5

Page 9: Can we recover meaning full spatial information from multivariate pattern analysis

1 Good prediction 6=6=6= good recovery

Sparse models (lasso):Prediction: 0.78 explained variance

Amplitude of the weights:

0

max

G Varoquaux 5

Page 10: Can we recover meaning full spatial information from multivariate pattern analysis

1 Good prediction 6=6=6= good recovery

SVM:Prediction: 0.71 explained variance

Amplitude of the weights:

0

max

G Varoquaux 5

Page 11: Can we recover meaning full spatial information from multivariate pattern analysis

1 Good prediction 6=6=6= good recovery

Standard univariate analysis (ANOVA):

F-score:

0

max

G Varoquaux 5

Page 12: Can we recover meaning full spatial information from multivariate pattern analysis

1 Good prediction 6=6=6= good recovery

LassoPrediction: 0.77Recovery: 0.461

SVMPrediction: 0.71Recovery: 0.464

F-scorePrediction:Recovery: 0.963

G Varoquaux 6

Page 13: Can we recover meaning full spatial information from multivariate pattern analysis

1 Multivariate analysis for recovery?

Considering each voxel separately issuboptimal: they share information

Most often, we know that we are looking fora small fraction of the cortex

A voxel is more likely to be activatedif its neighbor is

G Varoquaux 7

Page 14: Can we recover meaning full spatial information from multivariate pattern analysis

1 Multivariate analysis for recovery?

Considering each voxel separately issuboptimal: they share information

Most often, we know that we are looking fora small fraction of the cortex

Sparse models

A voxel is more likely to be activatedif its neighbor is

Spatial models

G Varoquaux 7

Page 15: Can we recover meaning full spatial information from multivariate pattern analysis

1 Sparse models

Compressive sensing:detection of k signals out of p (voxels)with only n observations ∝ k

IterpretableSelects random subsets in correlated signals

Face vs housediscriminationData from [Haxby 2001]

Stability selection:Apply random perturbations to the dataKeep voxels that are selected often

[Meinhausen 2010]

G Varoquaux 8

Page 16: Can we recover meaning full spatial information from multivariate pattern analysis

1 Sparse models

Compressive sensing:detection of k signals out of p (voxels)with only n observations ∝ k

IterpretableSelects random subsets in correlated signals

Face vs housediscriminationData from [Haxby 2001]

Stability selection:Apply random perturbations to the dataKeep voxels that are selected often

[Meinhausen 2010]

G Varoquaux 8

Page 17: Can we recover meaning full spatial information from multivariate pattern analysis

1 Spatial models

Brain parcellations:Ward clustering to reduce voxel numbers

Supervised clustering [Michel 2011]

... ... ...

... ...

Clustering blind to experimental conditions

G Varoquaux 9

Page 18: Can we recover meaning full spatial information from multivariate pattern analysis

2 Random parcellations andsparsity

Combining

Clustering

Sparsity

G Varoquaux 10

Page 19: Can we recover meaning full spatial information from multivariate pattern analysis

2 Random parcellations andsparsity

+

Randomization

Stability scores

G Varoquaux 10

Page 20: Can we recover meaning full spatial information from multivariate pattern analysis

2 Algorithm

1 loop: perturb randomly data

2 Ward agglomeration to form n features

3 sparse linear model on reduced features

4 accumulate non-zero features

5 threshold map of apparition counts

G Varoquaux 11

Page 21: Can we recover meaning full spatial information from multivariate pattern analysis

2 Recovery performanceRandomizedClusteredLasso:

Selection scores

0

max

G Varoquaux 12

Page 22: Can we recover meaning full spatial information from multivariate pattern analysis

2 What is the best method for feature recovery?For small brain regions: elastic netFor large brain regions: randomized-clustered sparsityLarge regions and very smooth images: F-tests

[Varoquaux 2012] ICMLG Varoquaux 13

Page 23: Can we recover meaning full spatial information from multivariate pattern analysis

2 fMRI: face vs house discrimination [Haxby 2001]

F-scores

L R

y=-31 x=17

L R

z=-17

G Varoquaux 14

Page 24: Can we recover meaning full spatial information from multivariate pattern analysis

2 fMRI: face vs house discrimination [Haxby 2001]

Randomized Clustered Sparsity

L R

y=-31 x=17

L R

z=-17

Less background noise(source of false positive)

G Varoquaux 14

Page 25: Can we recover meaning full spatial information from multivariate pattern analysis

2 Predictive power of selected voxelsObject recognition [Haxby 2001]

Using recovered voxels improves predictionG Varoquaux 15

Page 26: Can we recover meaning full spatial information from multivariate pattern analysis

Can we recover meaningful spatial informationfrom multivariate pattern analysis?

SVM and sparse models less powerful then F-scoreSparsity + clustering + randomization:

excellent recovery⇒ Multivariate brain mapping

Simultaneous prediction and recovery

Predictionaccuracy:93%

G Varoquaux 16

Page 27: Can we recover meaning full spatial information from multivariate pattern analysis

For more detailsG. Varoquaux, A. Gramfort, and B. Thirion, Small-samplebrain mapping: sparse recovery on spatially correlated de-signs with randomization and clustering, ICML 2012

Acknowledgments, for sharing data:J. Haxby R. Poldrack K. Jimura

Softwarescikit-learn: machine learning in Python

G Varoquaux 17