40
Technology Transition Workshop| Paul Chamberlain Probability Software and Fingerprint Comparison Technology Fingerprint Comparison Technology Transition Workshop

Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology [email protected] Transition Workshop Probability Software and

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

Technology Transition Workshop| Paul Chamberlain

Probability Software and Fingerprint Comparison

Technology

Fingerprint Comparison

TechnologyTransition Workshop

Page 2: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

IntroductionIntroduction

• We’ve introduced some ideas of how probability can help in forensic science

• How can any of this be applied to fingerprints?

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 2Probability Software & Fingerprint Comparison Lecture

Page 3: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

Fingerprint Examination – The ObjectiveFingerprint Examination  The Objective

• In a fingerprint examination we are trying to establish if the latent print and the known print came from the same individual

• We are comparing a partial and distorted area of friction ridge detail with an area taken under controlled conditions

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 3Probability Software & Fingerprint Comparison Lecture

Page 4: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

AnalysisAnalysis

• First, let’s consider how we arrive at our conclusions now

• In the analysis phase we select individual features and configurations of features to use in our comparison

• Why do we select those features?

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 4Probability Software & Fingerprint Comparison Lecture

Page 5: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

AnalysisAnalysis

• We select on the basis of the knowledge we have that these features are− Consistently reproducible

− Have a high degree of specificity

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 5Probability Software & Fingerprint Comparison Lecture

Page 6: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

AnalysisAnalysis

• Specificity− You shouldn’t expect the particular features and their configuration to appear in another random fingerprint

• If you could show that they don’t appear in any other fingerprint at all then you could call this uniqueness

Y l h i b id i ll

Technology

− You can only show uniqueness by considering all fingerprints

TechnologyTransition Workshop

Probability Software and Fingerprint Comparison 6Probability Software & Fingerprint Comparison Lecture

Page 7: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

EvaluationEvaluation

• We can say that in our evaluation we are calculating the likelihood that the features and configurations appearing in the latent and print have the same source

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 7Probability Software & Fingerprint Comparison Lecture

Page 8: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

EvaluationEvaluation

• We are talking about a single event

• You will recall that to consider the probability ofYou will recall that to consider the probability of a single event we can use the concept of subjective probability

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 8Probability Software & Fingerprint Comparison Lecture

Page 9: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

EvaluationEvaluation

• You will also recall that we need to be careful with that word subjective− Does not imply that our observations are unfounded

• They are based on empirical observations and belief

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 9Probability Software & Fingerprint Comparison Lecture

Page 10: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

EvaluationEvaluation

• In fingerprints, we call this experience

• Our current approach to fingerprints does have aOur current approach to fingerprints does have a logical basis− Provided that the features and configurations we select truly have a high level of specificity

− The basis has some scientific validity

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 10Probability Software & Fingerprint Comparison Lecture

Page 11: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

EvaluationEvaluation

• We identified issues− Consistencyy

− Transparency

− Reproducibility

− Etcetera

• What constitutes sufficient experience?

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 11Probability Software & Fingerprint Comparison Lecture

Page 12: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

HowWill Probability Help?How Will Probability Help?

• We can use ideas from probability to develop an understanding of how we currently reach our conclusions

• We can do more than this

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 12Probability Software & Fingerprint Comparison Lecture

Page 13: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

HowWill Probability Help?How Will Probability Help?

• We can model features in a fingerprint and produce data to assist

• This data is:− Consistent to the input

− Transparent: the underlying theories, databases, etc. can be demonstrated

R d ibl

Technology

− Reproducible

• We can say it is more “objective”Technology

Transition Workshop

Probability Software and Fingerprint Comparison 13Probability Software & Fingerprint Comparison Lecture

Page 14: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

Introducing Probability SoftwareIntroducing Probability Software 

• This is the aim of software such as FSS Fingerprint Dactsys™

• It generates an output based on the minutiae configuration

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 14Probability Software & Fingerprint Comparison Lecture

Page 15: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

Introducing Probability SoftwareIntroducing Probability Software

• Why only minutiae?− They are the universally accepted featuresy y p

− Used in almost all comparisons

− Start simple

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 15Probability Software & Fingerprint Comparison Lecture

Page 16: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

Introducing Probability SoftwareIntroducing Probability Software

• The output of Dactsys™ is a Likelihood Ratio (LR)

• What we are providing is a measure of theWhat we are providing is a measure of the weight of evidence of a corresponding configuration of minutiae

• How is this achieved?

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 16Probability Software & Fingerprint Comparison Lecture

Page 17: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

Introducing Probability SoftwareIntroducing Probability Software

Number of concordances

Explainable discrepancies Variability in deposition of same finger

)Pr()Pr(

p

HEHE

RatioLikelihood )Pr( dHE

S ifi it f L l f i il it b t

Technology

Specificity of configuration of minutiae

Level of similarity between different fingers

TechnologyTransition Workshop

Probability Software and Fingerprint Comparison 17Probability Software & Fingerprint Comparison Lecture

Page 18: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

Introducing Probability SoftwareIntroducing Probability Software

• Specificity of the configuration of minutia − Minutiae type, direction and relative spatial relationships

TechnologyTechnologyTransition WorkshopImage courtesy of Paul Chamberlain

Probability Software and Fingerprint Comparison 18Probability Software & Fingerprint Comparison Lecture

Page 19: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

Introducing Probability SoftwareIntroducing Probability Software

• The model takes an objective, data‐driven approach

• It provides a calculation based on the actual latent print and known match− It is case specific

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 19Probability Software & Fingerprint Comparison Lecture

Page 20: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

Introducing Probability SoftwareIntroducing Probability Software

• There are other factors that need to be considered− Database needs to be representative

• Relevant population

• Size

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 20Probability Software & Fingerprint Comparison Lecture

Page 21: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

Introducing Probability SoftwareIntroducing Probability Software

• Different areas of fingers and thumbs− Differing distributions of minutiaeg

• Research on palms and phalanges

• Distortion during depositiong p− Probabilistic distortion model

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 21Probability Software & Fingerprint Comparison Lecture

Page 22: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

Elements of ValidationElements of Validation

• Addressing these and other aspects of the model and the software constitutes validation− Differences in deposition of same finger

− Measurement of errors

− Accuracy

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 22Probability Software & Fingerprint Comparison Lecture

Page 23: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

Validation and AdoptionValidation and Adoption

• We will not discuss validation further here and assume for the purpose of this discussion that the model and software are validated

• FSS sets the highest standards of validation• Until both a validation and any adoption criteria are met, this software cannot be used

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 23Probability Software & Fingerprint Comparison Lecture

Page 24: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

First Generation SoftwareFirst Generation Software

• Of course, minutiae form only part of the examination

• Does software with such a limitation have value?

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 24Probability Software & Fingerprint Comparison Lecture

Page 25: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

First Generation SoftwareFirst Generation Software

• Let’s look at those criteria from the first session− Scientific validity y

− Sufficiency 

− Consistency

− Transparency

− Reproducibility

i i

Technology

− Training

TechnologyTransition Workshop

Probability Software and Fingerprint Comparison 25Probability Software & Fingerprint Comparison Lecture

Page 26: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

First Generation SoftwareFirst Generation Software

• Scientific validity − Contributes to the basis of fingerprint examinationg p

• Sufficiency − Can provide a guide to defining sufficiency

• Consistency− Same output from same observations

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 26Probability Software & Fingerprint Comparison Lecture

Page 27: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

First Generation SoftwareFirst Generation Software

• Transparency− Helps show how some of the observations were pevaluated

• Reproducibility− Same output regardless of time

• Training

Technology

− “Captures” experience of examiners

TechnologyTransition Workshop

Probability Software and Fingerprint Comparison 27Probability Software & Fingerprint Comparison Lecture

Page 28: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

First Generation SoftwareFirst Generation Software

• We can identify some value in using this type of software to support our current process

• Does this software challenge the ability to individualise?

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 28Probability Software & Fingerprint Comparison Lecture

Page 29: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

Probability and IndividualisationProbability and Individualisation

• What do we mean by individualisation?− “Conclusive match”

• Exclude any likelihood of another source

• Such certainty cannot be supported from a y ppscientific / mathematical viewpoint

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 29Probability Software & Fingerprint Comparison Lecture

Page 30: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

Probability and IndividualisationProbability and Individualisation

• It is now becoming more accepted that it is unnecessary to attempt to exclude all other sources

• We need to think only about relevant populations

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 30Probability Software & Fingerprint Comparison Lecture

Page 31: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

Probability and IndividualisationProbability and Individualisation

• Let’s consider another definition:− The findings of the examination are such that the likelihood of another person in the relevant population being the source of the latent is so diminishingly small that it can be discounted

− This is an expert opinion

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 31Probability Software & Fingerprint Comparison Lecture

Page 32: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

Probability and IndividualisationProbability and Individualisation

• What is the fundamental objective of a latent print comparison?− To associate an individual with a latent recovered from a scene or item

• The probative value of that association is dependent on the case circumstances

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 32Probability Software & Fingerprint Comparison Lecture

Page 33: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

Probability and IndividualisationProbability and Individualisation

• The expert opinion based on the definition provided here has the same evidential value as we are currently expressing

• What about those matches for which we are unable to make this opinion?− We will consider this situation later in the workshop

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 33Probability Software & Fingerprint Comparison Lecture

Page 34: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

Scope of First Generation SoftwareScope of First Generation Software

• The Dactsys™ software you will use today only calculates LR for configurations of 12 minutiae or less

• Research has shown that LR for higher numbers of corresponding minutiae are extremely high

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 34Probability Software & Fingerprint Comparison Lecture

Page 35: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

Scope of First Generation SoftwareScope of First Generation Software

• The specificity of minutiae configurations above 12 is such that the likelihood of another source can be assumed to be diminishingly small

• The opinion of individualisation is therefore supported

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 35Probability Software & Fingerprint Comparison Lecture

Page 36: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

Scope of First Generation SoftwareScope of First Generation Software

• This finding is of interest to our colleagues involved in the biometric uses of fingerprints

• Does this finding indicate a return to a point standard?

• The simple answer is no, but we will return to this topic later

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 36Probability Software & Fingerprint Comparison Lecture

Page 37: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

Scope of First Generation SoftwareScope of First Generation Software

• Below 12 minutiae, the software may be considered as providing a sort of baseline measure

• Individualisation would therefore be based on the examiner’s calculation of the specificity of the other features observed, etc.

Technology

• To do this we will develop an Evaluative Framework

TechnologyTransition Workshop

Probability Software and Fingerprint Comparison 37Probability Software & Fingerprint Comparison Lecture

Page 38: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

Scope of First Generation SoftwareScope of First Generation Software

• We will now introduce you to a demonstration version of FSS Fingerprint Dactsys™

• We will investigate how the software performs and explore its use

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 38Probability Software & Fingerprint Comparison Lecture

Page 39: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

Questions?Questions?

TechnologyTechnologyTransition Workshop

Probability Software and Fingerprint Comparison 39Probability Software & Fingerprint Comparison Lecture

Page 40: Probability Software and FingerprintComparison · Forensic Science Service lh b li@f li k Technology Paul.Chamberlain@fss.pnn.police.uk Transition Workshop Probability Software and

Contact InformationContact Information

Sarah WestSarah West

Mississippi Department of Public Safety

swest@mcl state ms [email protected]

P l Ch b l iPaul Chamberlain

Forensic Science Service

l h b l i @f li k

Technology

[email protected]

TechnologyTransition Workshop

Probability Software and Fingerprint Comparison 40Probability Software & Fingerprint Comparison Lecture