Quality in Forensic Service Accuracy & Reliability Are Present, Just Like on CSI, Right?...

Quality in Quality in Forensic ServiceForensic ServiceAccuracy & Reliability Are Accuracy & Reliability Are Present, Just Like on CSI, Present, Just Like on CSI,

Right?Right?

Massachusetts State Police Crime LaboratorySudbury, Massachusetts

Carl M. Selavka, Ph.D., D-Carl M. Selavka, Ph.D., D-ABCABC

DirectorDirector

And Now,And Now,

A Word A Word

From My From My

Sponsor:Sponsor:

DisclaimersDisclaimersThe opinions The opinions expressed in this expressed in this presentation are presentation are those of the author those of the author and do not necessarily and do not necessarily represent the official represent the official positions of the:positions of the:

Disclaimed Disclaimed AgenciesAgencies

Commonwealth of Commonwealth of

MassachusettsMassachusetts

Executive Office of Public Executive Office of Public

SafetySafety

Department of State PoliceDepartment of State Police

Crime Laboratory SystemCrime Laboratory System

Disclaimed Disclaimed AgenciesAgencies

NIJNIJ AAFSAAFSDHHSDHHS ASCLDASCLDABCABC NEAFS NEAFS FEPACFEPAC ACSACS

Disclaimed Disclaimed AgenciesAgencies

NCST&NCST&

LL(Participants, Attendees, Those Actually (Participants, Attendees, Those Actually

Awake)Awake)

ThatThat

TitleTitle

• The Real Forensic The Real Forensic

World World • Quality is Easy, Quality is Easy,

Right?Right?• Structure from ChaosStructure from Chaos• Legal SynergyLegal Synergy• This is GOOD!This is GOOD!

Presentation Presentation SummarySummary

• From Crime Commission to From Crime Commission to

DiscoveryDiscovery

• On-Site First-Responders & On-Site First-Responders &

InvestigatorsInvestigators

• Evidence Recognition, Presentation Evidence Recognition, Presentation

to Key to Key Responders, Documentation, Responders, Documentation,

Collection Collection & Transport Integrity& Transport Integrity

• Triage to Avoid Exhaustive Triage to Avoid Exhaustive

ExaminationsExaminations

• The Examinations Themselves….The Examinations Themselves….

The Real Forensic The Real Forensic WorldWorld

• Interpretations of Elicited & Missing Interpretations of Elicited & Missing

DataData

• Contextual Elements Insure Contextual Elements Insure

“Probative” “Probative” Forensic ReportsForensic Reports

• Iterative Evidentiary Management Iterative Evidentiary Management

Yields Yields “Non-Advocacy” Credibility“Non-Advocacy” Credibility

• Presentation in Court Provides Presentation in Court Provides

Forensic Forensic DefensibilityDefensibility

The Real Forensic The Real Forensic WorldWorld

Quality AssuranceQuality Assurance

• QualityQuality (Webster’s II – 1984)(Webster’s II – 1984)

Essential CharacterEssential Character An Inherent AttributeAn Inherent Attribute Degree of ExcellenceDegree of Excellence

• AssuranceAssurance A Statement Intended to A Statement Intended to

Inspire Inspire ConfidenceConfidence

Quality in Forensic Quality in Forensic ScienceScience

Ideal Lab ManagementIdeal Lab Management

• Is Our QA Program Is Our QA Program

Proper?Proper?• Is the Personnel Is the Personnel

System OK?System OK?• Do We Use Good Do We Use Good

Science?Science?• Do We Report Do We Report

Correctly?Correctly?• Are We Defensible?Are We Defensible?

InfrastructureInfrastructure

Accred

itati

Accred

itati

onon

Cert

ifica

ti

Cert

ifica

ti

onon

StandardizatiStandardizationon

Quality Quality ControlControl

QualityQualityAssuranceAssurance

NationalNationalStandardsStandards

InfrastructureInfrastructure

Accred

itati

Accred

itati

onon

Quality AssuranceQuality Assurance

ASCLD/LAASCLD/LA

BB

ASCLD / LABASCLD / LABAmerican Society American Society

of Crime of Crime Laboratory Laboratory Directors / Directors / Laboratory Laboratory

Accreditation Accreditation BoardBoard

Other AccreditationsOther Accreditations

• ISO 17025 (Guide ISO 17025 (Guide 25)25)• NAME – NAME – Death Death InvestigationInvestigation

• IAI – FingerprintsIAI – Fingerprints• AFTE – Firearms, AFTE – Firearms, TMsTMs• ABFT – ToxicologyABFT – Toxicology

Other AccreditationsOther Accreditations

• NATA, SCC, NATA, SCC, NAMASNAMAS• See the URL for See the URL for More:More:

www.ascld-lab.org Click On “Resources”Click On “Resources” Click “Forensic Links” Click “Forensic Links” and and you’ll get 36 you’ll get 36 Recognized Sites!!Recognized Sites!!

Why ASCLD / LAB?Why ASCLD / LAB?

• Objective ProcessObjective Process• Impartial ReviewImpartial Review• Consensus Consensus StandardsStandards• Peer-BasedPeer-Based

InfrastructureInfrastructure

Accred

itati

Accred

itati

onon

Cert

ifica

ti

Cert

ifica

ti

onon

Is the Personnel System OK?Is the Personnel System OK?

ABC ABC ((www.criminalistics.com)

ABFT ABFT ((www.abft.org

)

IAI IAI ((www.theiai.org)

Certification is Certification is

NOT an End Unto NOT an End Unto

ItselfItself

Certification is a Certification is a

passageway - a passageway - a

commitment to commitment to

continued professional continued professional

developmentdevelopment

Proficiency Tests (PTs)Proficiency Tests (PTs)

RecognizeRecognize

PossiblyPossibly

DeviantDeviant

ResultsResults

• Differentiate Anecdotal Differentiate Anecdotal Issues Issues From Systemic From Systemic Performance Performance Improvement Improvement OpportunitiesOpportunities• Document Corrective Document Corrective ActionsActions• Reestablish CompetencyReestablish Competency

DocumentationDocumentation

That QA That QA Guarantee…Guarantee…

Change theChange the

Examiner’sExaminer’s

JobJob

Why Is This a Good Approach Why Is This a Good Approach to Certification?to Certification?

• Objective ProcessObjective Process• Impartial ReviewImpartial Review• Consensus Consensus StandardsStandards• Peer-BasedPeer-Based

• AccreditationAccreditation – ASCLD/LAB & – ASCLD/LAB &

OthersOthers

• CertificationCertificationAAFS Forensic Specialties AAFS Forensic Specialties

Accreditation BoardAccreditation Board

2004 NIJ Guide 2004 NIJ Guide – Appendix – Appendix

C C 9 FSAB-Recognized Programs9 FSAB-Recognized Programs 14 Organizations Listed14 Organizations Listed

Quality in Forensic Quality in Forensic ScienceScience

InfrastructureInfrastructure

Accred

itati

Accred

itati

onon

Cert

ifica

ti

Cert

ifica

ti

onon

StandardizatiStandardizationon

Do We Use Good Science?Do We Use Good Science?

Do We Report Correctly?Do We Report Correctly?

T/SWG - T/SWG -

______

ASTMASTM

T / SWGT / SWG

Technical Technical oror Scientific Working Scientific Working

GroupGroupfor / on _____ for / on _____ (18 Total)(18 Total)

Technical WG = NIJTechnical WG = NIJ• TWG-BSITWG-BSI

Bombing Scene Bombing Scene InvestigationInvestigation

• TWG-CSITWG-CSICrime Scene Crime Scene

InvestigationInvestigation• TWG-DITWG-DI

Death InvesigationDeath Invesigation

• TWG-DETWG-DEDigital EvidenceDigital Evidence

• TWG-EYEETWG-EYEEEyewitness Eyewitness

EvidenceEvidence• TWG-FASITWG-FASI

Fire/Arson Scene Fire/Arson Scene InvestigationInvestigation

• TWG-MFFITWG-MFFIMass Fatality Forensic IDMass Fatality Forensic ID

Scientific WG = FBIScientific WG = FBI• SWG-STAINSWG-STAIN

Bloodstain Pattern Bloodstain Pattern AnalysisAnalysis

• SWG-DESWG-DEDigital EvidenceDigital Evidence

• SWG-DAMSWG-DAMDNA Analysis MethodsDNA Analysis Methods

• SWG-GUNSWG-GUNFirearms and ToolmarksFirearms and Toolmarks

• SWG-FASTSWG-FASTFriction Ridge Friction Ridge

Analysis, Analysis, Study and Study and TechnologyTechnology• SWG-ITSWG-IT

Imaging TechnologiesImaging Technologies

• SWG-MATSWG-MATMaterials AnalysisMaterials Analysis

• SWG-MGFSWG-MGFMicrobial Genetics & Microbial Genetics &

ForensicsForensics

• SWG-DOCSWG-DOCForensic Document Forensic Document

ExamExam

Scientific WG = DEAScientific WG = DEA

• SWG-DRUGSWG-DRUGfor thefor the Analysis of Seized Analysis of Seized

DrugsDrugs

• TWG-FEXTWG-FEXFire & Explosions Fire & Explosions

InvestigationsInvestigations

Technical WG = NCFSTechnical WG = NCFS

ASTMASTMAmerican Society American Society

for Testing & for Testing & Materials – Materials –

Committee E30 on Committee E30 on Forensic SciencesForensic Sciences

(Now ASTM International)(Now ASTM International)

ASTM InternationalASTM International

• 9 E30 Technical 9 E30 Technical GroupsGroups

• 6 E30 Specialty 6 E30 Specialty GroupsGroups

• 25 E30.01 25 E30.01 Criminalistics Criminalistics StandardsStandards

• Objective ProcessObjective Process• Impartial ReviewImpartial Review• Consensus Consensus StandardsStandards• Peer-BasedPeer-Based

Why Is This a Good Approach Why Is This a Good Approach to Standardization?to Standardization?

• AccreditationAccreditation – ASCLD/LAB & Others– ASCLD/LAB & Others

• Certification Certification – AAFS FSAB & Others– AAFS FSAB & Others

• Standardization Standardization ASTM Committee E30 on Forensic ASTM Committee E30 on Forensic

SciencesSciences

NIJ, FBI, DEA and NCFS SponsorsNIJ, FBI, DEA and NCFS Sponsors2004 NIJ Guide 2004 NIJ Guide – Appendix D– Appendix D

19 Standardization Groups19 Standardization Groups

Quality in Forensic Quality in Forensic ScienceScience

InfrastructureInfrastructure

Accred

itati

Accred

itati

onon

Cert

ifica

ti

Cert

ifica

ti

onon

StandardizatiStandardizationon

QualityQuality

ForensicForensic

ServicesServices

• National Agencies?National Agencies?• State Agencies?State Agencies?

NY, OK, TX NY, OK, TX Crime Crime

LaboratoriesLaboratories Exempt Categories PlentifulExempt Categories Plentiful Examiners = NOExaminers = NO

• Municipal Agencies?Municipal Agencies?• Local Governments?Local Governments?

RequiredRequired Quality Quality AssuranceAssurance

NO!NO!

What You What You

Should Should

Expect Expect

From From

Forensic Forensic

PractitionerPractitioner

ss

Practical Practical

Quality Quality

GuaranteesGuarantees

We ProvideWe Provide

FEPACFEPACForensic Forensic Science Science

Education Education Programs Programs

Accreditation Accreditation CommissionCommission

InfrastructureInfrastructureA

ccre

dita

tiA

ccre

dita

tion

on

Cert

ificati

Cert

ificati

on

on

StandardizatiStandardizationon

QualityQuality

ForensicForensic

ServicesServices

Educational Educational HarmonizationHarmonization

• Accuracy is NOT EnsuredAccuracy is NOT Ensured• Reliability is NOT Reliability is NOT EnsuredEnsured• In Our Advocacy In Our Advocacy Process, Process, Accuracy & Accuracy & Reliability Rest Reliability Rest in the Eye in the Eye of the Beholderof the Beholder

QA Take-Away:QA Take-Away:

Can You All Now Run Can You All Now Run With the Big Dogs?With the Big Dogs?

Yes, You Can.Yes, You Can.

AcknowledgementAcknowledgementssNCST&L Organizing NCST&L Organizing Committees & Leadership Committees & Leadership TeamTeam - - Professor Carol HendersonProfessor Carol Henderson

Massachusetts State Massachusetts State PolicePolice -- Colonel Robbins & Command StaffColonel Robbins & Command Staff -- MSP Crime Lab SystemMSP Crime Lab System