28
1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

Embed Size (px)

Citation preview

Page 1: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

1 of 28

Closing Remarks

Presenter: Sebastian Tindall

(10 minutes)

Day 2 DQO Training CourseModule 8

Page 2: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

2 of 28

Module 8Closing Remarks & Final Exam

Objectives:

To summarize key points made today To answer the “How many samples” question “Final Exam” Questions/feedback from the audience

Page 3: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

3 of 28

The DQO Process“A systematic planning process based on the scientific method for the unambiguous defining of

Environmental decision criteria

Data requirements

Error tolerances

and the documentation / preservation of these details in a consistent, standardized format providing a defensible record of the decision”

Merrick “Rick” BlancqUS Army Corps of Engineers Portland District

[email protected]

Page 4: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

4 of 28

Systematic Planning Doesn’t Just “Happen”

Haphazard approaches yield haphazard results

Decision makers must provide input early & often

Need an implementation process Successful implementation model evolved as

the DQO Process was used

Page 5: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

5 of 28

Tools Make the Job Easier

Scoping Checklist DQO e-Workbook (electronic template)

– Standardized DQO Report format DQO Web Site

– DQO tools and materials– Latest version of all of today’s slides

Visual Sample Plan (VSP)– Download free software

Data Quality Assessment tools (coming!)

Page 6: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

6 of 28

Managing Uncertainty We are forced to make environmental decisions

based on estimates Estimates always involve errors Errors in estimates are not mistakes If unmanaged, errors in estimates CAN lead to

Decision Errors which ARE MISTAKES Decision Errors must be managed

– Identify– Quantify

Severe consequences of decision errors mandate a statistical basis

Page 7: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

7 of 28

Defensibility

S ampling and A nalys is P lan

Sc oping

Data QualityA ssessment

Dec is ion

Sampling&

A nalys is

Data Quality Objec tives

(DQO)

L aboratory Data Verific ation /

Validation

F ie l d S a mpl ingP l a n(F S P )

Qua l it y A s sura nc e P ro je c t P l a n

(Q A P j P )

H e a lt h a ndSa fe t y P l a n

(H S P )

Comes from doing good science

Requires documentation– “If it isn’t written down, it

didn’t happen” Use a standardized format We must employ the

scientific method to make defensible decisions

Page 8: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

8 of 28

How Many Samples do I Need?

REMEMBER:

HETEROGENEITY

IS THE RULE!

Page 9: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

9 of 28

How many samples do I need?

Begin With the End in Mind

Optimal Sampling Design

Alternative Sample Designs

, , , Correct Equation for n (Statistical Method)

Population Frequency Distribution

Contaminant Concentrations in the Spatial Distribution of the Population

The end

DATA

Page 10: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

10 of 28

Logic to Assess Distribution and Calculate Number of Samples

SkewedCalculate the number of

samples based on skeweddistributions (e.g.,

nonparametric tests suchas WSR or WRS)

Is frequencydistribution fromeach populationsymmetrical orapproximatelysymmetrical?

YesSymmetrical

Use equations based onsymmetrical distribution.

No

Option 1 Option 2

Badly SkewedBadly skewed or for any

distribution, use computersimulations

(e.g.,Monte Carlo) to performcalculations to estimate the

number of samples

Page 11: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

11 of 28

A Visual Decision Strategy

S ta rt G e tD a ta

C h e ckD a ta

Fit D a ta

PD F D oH yp oth es is

Te s t

C le a nD irty

Ne e dM o reD a ta

S to pD a ta

G e tS a m ple

S ize

G e tS am pl i n gLocati on s

V ES A

n

V S P

x , y

V is u a l D Q A V is u a l F it V is u a l Te s t

Page 12: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

12 of 28

Project Planning Documents

Work Plan

Must contain a clear presentation of (and the reasoning behind):

DQO Report FSP Quality Assurance Project Plan HSP

Page 13: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

13 of 28

Project Planning Documents

• General project decision goals

• More detailed, technical project goals/decision rules (DQOs), that will guide project decision-making

• Goals for data quality (MQOs)

• How sampling representativeness will be ensured, and how sampling uncertainty will be controlled

• List of analytical technologies and methods

• QC protocols and criteria to demonstrate that data of known quality will be generated

• Description how data will be assessed and interpreted according to the decision rules

Page 14: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

14 of 28

Analytical +

Sub-sampling +

Natural heterogeneity of the site=

Total Uncertainty

Uncertainty is Additive!Remember the uncertainty is additive for

all steps in sampling and analysis

Page 15: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

15 of 28

Keys to success– Sound technical basis– Complete and thorough documentation

Do it!Do it!(Get the job done - right)

Prove it!Prove it!(Document what/why/how)

SiteClosed

Page 16: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

16 of 28

TRIAD: Systematic PlanningManaging Uncertainty for Environmental Decision Making

Systematic Planning in Environmental Decision Making

http://www.doe.hanford.gov/dqo

Sebastian TindallBechtel Hanford Inc. 3350 George Washington WayRichland, WA 99352(509) [email protected]

Page 17: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

17 of 28

TRIAD: Dynamic Work PlansA Guideline

for

Dynamic Workplans and Field Analytics:

The Keys to Cost-Effective Site Characterization and Cleanup

http://cluin.org/char1_edu.cfm#dyna_work

Albert Robbat, Jr.

Tufts University, Chemistry Department

Center for Field Analytical Studies and Technology

Medford, Massachusetts, 02155

tel: 617-627-3474 and fax: 617-627-3443

Page 18: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

18 of 28

TRIAD: On-Site AnalysisApplying the Concept of Effective Data to Environmental

Analyses for Contaminated Sites

http://cluin.org/

Deana M. Crumbling, M.S.

Technology Innovation Office

U.S Environmental Protection Agency

401 M Street, SW, Mail Code 5102G

Washington, DC 20460

(703) 603-0643

[email protected]

Page 19: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

19 of 28

Sampling for

Environmental ActivitiesChuck Ramsey

EnviroStat, Inc.PO Box 636

Fort Collins, CO 80522970-689-5700

970-229-9977 fax

[email protected]

www.envirostat.org

Page 20: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

20 of 28

On-Site Environmental Sampling & Analyses

J. Edward Tillman,

Columbia Technologies1450 So Rolling Rd

Baltimore, MD 21227

410-536-9911

410-536-0222 (Fax)

[email protected]

Page 21: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

21 of 28

DQO Consultants:Preparation & Facilitation

Mitzi Miller

Environmental Quality Management (EQM)1777 Terminal Drive

Richland, WA 99352

(509) 946-4985; Fax: (509) 946-4595

[email protected]

Page 22: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

22 of 28

DQO Consultants: Environmental Statistics

Jim Davidson

Davidson and Davidson, Inc.8390 Gage Blvd., Suite 205

Kennewick, WA 99336

(509) 374-4498;

[email protected]

Page 23: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

23 of 28

DOE EM-3 Sponsored Web Pages

http:/www.hanford.gov/dqo/

http://dqo.pnl.gov/

http://www.em.doe.gov/safetyhealth/3d/

Page 24: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

24 of 28

Program POCsElizabeth M. Bowers

Department of Energy

Richland Operations Office825 Jadwin Avenue

Richland, WA 99352(509) 373-9276

[email protected]

Dave BottrellDepartment of Energy

EM-319901 Germantown Road

Cloverleaf BuildingRoom 1078

Germantown, MD 20874-1290(301) 903-7251

[email protected]

Sebastian TindallDQO Program Manager

Bechtel Hanford Inc. 3350 George Washington Way

Richland, WA 99352(509) 372-9195

[email protected]

Brent PulsipherVSP Program Manager

Pacific Northwest National Laboratories.

2400 Stevens DriveRichland, WA 99352

(509) 375-3989 [email protected]

Page 25: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

25 of 28

Day 2 Training Credits

• Susan Blackburn, SAIC, Richland, WA• Dave Blumenkranz, SAIC, Richland, WA• Mitzi Miller, EQM, Richland, WA & Knoxville, TN• Kelly Black, Neptune and Associates, Denver, CO• Candy Hawk, Blue Sky Software, Richland, WA• Mike Schwab, Bechtel Hanford, RL, WA• Surajit Amrit, Bechtel Hanford, RL, WA• Al Robinson, EQM, Richland, WA

Page 26: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

26 of 28

FINAL EXAM

• What is the Question?

What is the DQO Process in a Nutshell?

• What is the Population?

• What is the Confidence required?

Page 27: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

27 of 28

How Many Samples do I Need?

REMEMBER:

HETEROGENEITY

IS THE RULE!

Page 28: 1 of 28 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

28 of 28

End of Day 2 Course

Please take a few minutes to fill out and turn in all the course evaluation forms.

Thank you for your attention today.

Questions? Feedback?