Closing Remarks

1 of 28

Closing Remarks

Presenter: Sebastian Tindall

(10 minutes)

Day 2 DQO Training CourseModule 8

2 of 28

Module 8Closing Remarks & Final Exam

Objectives:

To summarize key points made today To answer the “How many samples” question “Final Exam” Questions/feedback from the audience

3 of 28

The DQO Process“A systematic planning process based on the scientific method for the unambiguous defining of

Environmental decision criteria

Data requirements

Error tolerances

and the documentation / preservation of these details in a consistent, standardized format providing a defensible record of the decision”

Merrick “Rick” BlancqUS Army Corps of Engineers Portland District

[email protected]

4 of 28

Systematic Planning Doesn’t Just “Happen”

Haphazard approaches yield haphazard results

Decision makers must provide input early & often

Need an implementation process Successful implementation model evolved as

the DQO Process was used

5 of 28

Tools Make the Job Easier

Scoping Checklist DQO e-Workbook (electronic template)

– Standardized DQO Report format DQO Web Site

– DQO tools and materials– Latest version of all of today’s slides

Visual Sample Plan (VSP)– Download free software

Data Quality Assessment tools (coming!)

6 of 28

Managing Uncertainty We are forced to make environmental decisions

based on estimates Estimates always involve errors Errors in estimates are not mistakes If unmanaged, errors in estimates CAN lead to

Decision Errors which ARE MISTAKES Decision Errors must be managed

– Identify– Quantify

Severe consequences of decision errors mandate a statistical basis

7 of 28

Defensibility

S ampling and A nalys is P lan

Sc oping

Data QualityA ssessment

Dec is ion

Sampling&

A nalys is

Data Quality Objec tives

(DQO)

L aboratory Data Verific ation /

Validation

F ie l d S a mpl ingP l a n(F S P )

Qua l it y A s sura nc e P ro je c t P l a n

(Q A P j P )

H e a lt h a ndSa fe t y P l a n

(H S P )

Comes from doing good science

Requires documentation– “If it isn’t written down, it

didn’t happen” Use a standardized format We must employ the

scientific method to make defensible decisions

8 of 28

How Many Samples do I Need?

REMEMBER:

HETEROGENEITY

IS THE RULE!

9 of 28

How many samples do I need?

Begin With the End in Mind

Optimal Sampling Design

Alternative Sample Designs

, , , Correct Equation for n (Statistical Method)

Population Frequency Distribution

Contaminant Concentrations in the Spatial Distribution of the Population

The end

DATA

10 of 28

Logic to Assess Distribution and Calculate Number of Samples

SkewedCalculate the number of

samples based on skeweddistributions (e.g.,

nonparametric tests suchas WSR or WRS)

Is frequencydistribution fromeach populationsymmetrical orapproximatelysymmetrical?

YesSymmetrical

Use equations based onsymmetrical distribution.

No

Option 1 Option 2

Badly SkewedBadly skewed or for any

distribution, use computersimulations

(e.g.,Monte Carlo) to performcalculations to estimate the

number of samples

11 of 28

A Visual Decision Strategy

S ta rt G e tD a ta

C h e ckD a ta

Fit D a ta

PD F D oH yp oth es is

Te s t

C le a nD irty

Ne e dM o reD a ta

S to pD a ta

G e tS a m ple

S ize

G e tS am pl i n gLocati on s

V ES A

n

V S P

x , y

V is u a l D Q A V is u a l F it V is u a l Te s t

12 of 28

Project Planning Documents

Work Plan

Must contain a clear presentation of (and the reasoning behind):

DQO Report FSP Quality Assurance Project Plan HSP

13 of 28

Project Planning Documents

• General project decision goals

• More detailed, technical project goals/decision rules (DQOs), that will guide project decision-making

• Goals for data quality (MQOs)

• How sampling representativeness will be ensured, and how sampling uncertainty will be controlled

• List of analytical technologies and methods

• QC protocols and criteria to demonstrate that data of known quality will be generated

• Description how data will be assessed and interpreted according to the decision rules

14 of 28

Analytical +

Sub-sampling +

Natural heterogeneity of the site=

Total Uncertainty

Uncertainty is Additive!Remember the uncertainty is additive for

all steps in sampling and analysis

15 of 28

Keys to success– Sound technical basis– Complete and thorough documentation

Do it!Do it!(Get the job done - right)

Prove it!Prove it!(Document what/why/how)

SiteClosed

16 of 28

TRIAD: Systematic PlanningManaging Uncertainty for Environmental Decision Making

Systematic Planning in Environmental Decision Making

http://www.doe.hanford.gov/dqo

Sebastian TindallBechtel Hanford Inc. 3350 George Washington WayRichland, WA 99352(509) [email protected]

17 of 28

TRIAD: Dynamic Work PlansA Guideline

for

Dynamic Workplans and Field Analytics:

The Keys to Cost-Effective Site Characterization and Cleanup

http://cluin.org/char1_edu.cfm#dyna_work

Albert Robbat, Jr.

Tufts University, Chemistry Department

Center for Field Analytical Studies and Technology

Medford, Massachusetts, 02155

tel: 617-627-3474 and fax: 617-627-3443

18 of 28

TRIAD: On-Site AnalysisApplying the Concept of Effective Data to Environmental

Analyses for Contaminated Sites

http://cluin.org/

Deana M. Crumbling, M.S.

Technology Innovation Office

U.S Environmental Protection Agency

401 M Street, SW, Mail Code 5102G

Washington, DC 20460

(703) 603-0643

[email protected]

19 of 28

Sampling for

Environmental ActivitiesChuck Ramsey

EnviroStat, Inc.PO Box 636

Fort Collins, CO 80522970-689-5700

970-229-9977 fax

[email protected]

www.envirostat.org

20 of 28

On-Site Environmental Sampling & Analyses

J. Edward Tillman,

Columbia Technologies1450 So Rolling Rd

Baltimore, MD 21227

410-536-9911

410-536-0222 (Fax)

[email protected]

21 of 28

DQO Consultants:Preparation & Facilitation

Mitzi Miller

Environmental Quality Management (EQM)1777 Terminal Drive

Richland, WA 99352

(509) 946-4985; Fax: (509) 946-4595

[email protected]

22 of 28

DQO Consultants: Environmental Statistics

Jim Davidson

Davidson and Davidson, Inc.8390 Gage Blvd., Suite 205

Kennewick, WA 99336

(509) 374-4498;

[email protected]

23 of 28

DOE EM-3 Sponsored Web Pages

http:/www.hanford.gov/dqo/

http://dqo.pnl.gov/

http://www.em.doe.gov/safetyhealth/3d/

24 of 28

Program POCsElizabeth M. Bowers

Department of Energy

Richland Operations Office825 Jadwin Avenue

Richland, WA 99352(509) 373-9276

[email protected]

Dave BottrellDepartment of Energy

EM-319901 Germantown Road

Cloverleaf BuildingRoom 1078

Germantown, MD 20874-1290(301) 903-7251

[email protected]

Sebastian TindallDQO Program Manager

Bechtel Hanford Inc. 3350 George Washington Way

Richland, WA 99352(509) 372-9195

[email protected]

Brent PulsipherVSP Program Manager

Pacific Northwest National Laboratories.

2400 Stevens DriveRichland, WA 99352

(509) 375-3989 [email protected]

25 of 28

Day 2 Training Credits

• Susan Blackburn, SAIC, Richland, WA• Dave Blumenkranz, SAIC, Richland, WA• Mitzi Miller, EQM, Richland, WA & Knoxville, TN• Kelly Black, Neptune and Associates, Denver, CO• Candy Hawk, Blue Sky Software, Richland, WA• Mike Schwab, Bechtel Hanford, RL, WA• Surajit Amrit, Bechtel Hanford, RL, WA• Al Robinson, EQM, Richland, WA

26 of 28

FINAL EXAM

• What is the Question?

What is the DQO Process in a Nutshell?

• What is the Population?

• What is the Confidence required?

27 of 28

How Many Samples do I Need?

REMEMBER:

HETEROGENEITY

IS THE RULE!

28 of 28

End of Day 2 Course

Please take a few minutes to fill out and turn in all the course evaluation forms.

Thank you for your attention today.

Questions? Feedback?