19
PSI 2014 Conference The Tower Hotel, Tower Bridge, London Risk Calculation in Screening with Biomarkers Nick Cowans Statistical Programmer Veramed Limited 1

PSI 2014 Conference The Tower Hotel, Tower Bridge, London Risk Calculation in Screening with Biomarkers Nick Cowans Statistical Programmer Veramed Limited

Embed Size (px)

Citation preview

Page 1: PSI 2014 Conference The Tower Hotel, Tower Bridge, London Risk Calculation in Screening with Biomarkers Nick Cowans Statistical Programmer Veramed Limited

1

PSI 2014 ConferenceThe Tower Hotel, Tower Bridge, London

Risk Calculation in Screeningwith Biomarkers

Nick CowansStatistical Programmer

Veramed Limited

Page 2: PSI 2014 Conference The Tower Hotel, Tower Bridge, London Risk Calculation in Screening with Biomarkers Nick Cowans Statistical Programmer Veramed Limited

2

Biomarkers

Something we measure in order to predict risk of a disease/syndrome in a subject

Cholesterol: coronary/vascular diseaseCA-125: ovarian cancer PAPP-A, Free hCGβ: Carrying a Trisomy 21 fetus

Page 3: PSI 2014 Conference The Tower Hotel, Tower Bridge, London Risk Calculation in Screening with Biomarkers Nick Cowans Statistical Programmer Veramed Limited

3

Characteristic of BiomarkersConcentrations bound at zeroNo upper limit

0 “”

Log transform

Page 4: PSI 2014 Conference The Tower Hotel, Tower Bridge, London Risk Calculation in Screening with Biomarkers Nick Cowans Statistical Programmer Veramed Limited

4

Mean()

Variance(2)

= [ , 2 ]

Page 5: PSI 2014 Conference The Tower Hotel, Tower Bridge, London Risk Calculation in Screening with Biomarkers Nick Cowans Statistical Programmer Veramed Limited

5

Unaffected PopulationN(U, 2

U)Affected Population

N(A, 2A)

AU

Page 6: PSI 2014 Conference The Tower Hotel, Tower Bridge, London Risk Calculation in Screening with Biomarkers Nick Cowans Statistical Programmer Veramed Limited

6

Calculating RiskLikelihood affected: 2l

Likelihood unaffected: l

X = x U/l

Likelihood ratio = 2

TWICE as likely to be

from affected population

Page 7: PSI 2014 Conference The Tower Hotel, Tower Bridge, London Risk Calculation in Screening with Biomarkers Nick Cowans Statistical Programmer Veramed Limited

7

Estimating parameters,

We cannot know , population parametersA conventional method :

Collect some data in each population, ZUse Maximum Likelihood Estimation to estimate , call it Ignore uncertaintyUse in risk calculation

Page 8: PSI 2014 Conference The Tower Hotel, Tower Bridge, London Risk Calculation in Screening with Biomarkers Nick Cowans Statistical Programmer Veramed Limited

8

Making predictions

p(X=x| A)

p(X=x| U)new data

parameter estimates

Your prediction is conditional on your parameter estimates, which are

uncertain

LikelihoodRatio

=

Page 9: PSI 2014 Conference The Tower Hotel, Tower Bridge, London Risk Calculation in Screening with Biomarkers Nick Cowans Statistical Programmer Veramed Limited

9

Estimating parameters

Not a problem when sample size is largeIf sample size is small, repeating experiments can result in very different estimates:

10 samples (or experiments)

True mean = 10n = 10,000:

n = 10:more uncertainty

Page 10: PSI 2014 Conference The Tower Hotel, Tower Bridge, London Risk Calculation in Screening with Biomarkers Nick Cowans Statistical Programmer Veramed Limited

10

Predictive approach

Rather than predict conditional on uncertain estimated parameters as in the estimative approachObtain predictive density functionBayesian concept; parameters given own distributions

parameter estimates from data Zp(X|)estimative approach:

^

Just data Zpredictive density function: p(X|Z)

Page 11: PSI 2014 Conference The Tower Hotel, Tower Bridge, London Risk Calculation in Screening with Biomarkers Nick Cowans Statistical Programmer Veramed Limited

11

Predictive approach

With Normally distributed data, the predictive density function becomes a scaled and shifted central t-distributionNumber of samples in original data, Z, is no longer ignored, and is incorporated via degrees of freedom

Page 12: PSI 2014 Conference The Tower Hotel, Tower Bridge, London Risk Calculation in Screening with Biomarkers Nick Cowans Statistical Programmer Veramed Limited

12

Predictive approach

Estimative Method

2l

l

Page 13: PSI 2014 Conference The Tower Hotel, Tower Bridge, London Risk Calculation in Screening with Biomarkers Nick Cowans Statistical Programmer Veramed Limited

13

Predictive approach

Estimative Method

Predictive Method

2l

l

l

1.6l

Page 14: PSI 2014 Conference The Tower Hotel, Tower Bridge, London Risk Calculation in Screening with Biomarkers Nick Cowans Statistical Programmer Veramed Limited

14

Case study

Screening for trisomy 21In trisomy 21 pregnancies:

PAPP-A decreasedFree hCGβ increased

Bivariate Normal distributionRisk calculated based upon maternal age, biochemistry and nuchal fold thickness

Page 15: PSI 2014 Conference The Tower Hotel, Tower Bridge, London Risk Calculation in Screening with Biomarkers Nick Cowans Statistical Programmer Veramed Limited

15

Marker distribution

Page 16: PSI 2014 Conference The Tower Hotel, Tower Bridge, London Risk Calculation in Screening with Biomarkers Nick Cowans Statistical Programmer Veramed Limited

16

Results

Risk ROC Curves

Page 17: PSI 2014 Conference The Tower Hotel, Tower Bridge, London Risk Calculation in Screening with Biomarkers Nick Cowans Statistical Programmer Veramed Limited

17

Summary

Fallacy of estimative approach: takes no account of sampling variability of the estimatorPredictive approach weighs possible distributions of new data according to the various plausible values for More likely to see differences in risks with small sample sizes

Page 18: PSI 2014 Conference The Tower Hotel, Tower Bridge, London Risk Calculation in Screening with Biomarkers Nick Cowans Statistical Programmer Veramed Limited

18

Acknowledgments

Professor Kevin Spencer (Barking Havering and Redbridge University NHS Trust)Professor David Wright (University of Plymouth)Dr Kevin Walters (University of Sheffield)

Page 19: PSI 2014 Conference The Tower Hotel, Tower Bridge, London Risk Calculation in Screening with Biomarkers Nick Cowans Statistical Programmer Veramed Limited

19

Thank you