CALA PT ForumJune 9 2011

AGENDA

1. Changes to the PT Program since 2004.

2. Open discussion on effectiveness of these changes.

3. Planned future changes.

4. Open discussion on these proposals.

5. Open discussion on any other PT issues.

2

CHANGES SINCE 2004

Two PT workshops held in 2004, Vancouver and Toronto.

Several recommendations came out of workshops.

3

WORKSHOP RECOMMENDATIONS

1. Give clearer message on rounding, correction, etc.

4

Action: None. The PT standard clearly requires labs to treat samples as routine, including how results are reported.

2. Change from evaluation using assigned points to a continuous system.

Action: Evaluation procedure was changed as per recommendation from workshop.

WORKSHOP RECOMMENDATIONS

3. Account for detection limit in evaluation.

5

Action: Evaluation procedure was changed as per recommendation from workshop.

4. Establish fixed limits so they do not get tighter.

Action: Changed to the use of regression equations to set a lower limit to acceptance limits.

WORKSHOP RECOMMENDATIONS

5. Establish limits that are based on end-use of data.

6

Action: Investigated but could not find consistent acceptable limits. pH limits were changed to be + 0.2.

6. Examine possibility of evaluating by method, not as a whole.

Action: Concluded that we wanted to retain PT as a comparison amongst peers. Where there are differences, labs have been exempted.

WORKSHOP RECOMMENDATIONS

7. Remove the PT registration fee.

7

Action: Removed.

8. Don’t charge full price if lab can perform more than one method from same sample.

Action: No longer charge full price for this.

9. Spread concentrations throughout published range.

Action: Efforts have been made to do this.

WORKSHOP RECOMMENDATIONS

10.Force labs to treat samples as routine.

8

Action: If a lab isn’t accredited, this is difficult to do. For accredited labs, a PT sample is now examined during every assessment.

11.Provide electronic reports that can be uploaded to LIMS.

Action: Electronic reports are now provided.

WORKSHOP RECOMMENDATIONS12.Private sector is under-represented on Program Committee.

9

Action: Added additional private sector members to Program Committee.

13.Combine C23 and C06.

Action: Done.

WORKSHOP RECOMMENDATIONS

14.Foil lined lids on pesticide samples leak.

10

Action: Now use teflon-lined lids.

OTHER CHANGES

1. Added reports on method specific summary statistics.

11

2. Added reports containing method specific histograms.

OTHER CHANGES

12

3. Moved generic reports from password protected area to public area.

4. Removed mandatory participation in CALA PT.

5. Modified concentration ranges for several test groups.

6. Added several new test groups.

7. Reduced PT fees by ~25%.

DISCUSSION ON CHANGES

13

FUTURE CHANGES

14

1. Introduction of Blind “Challenge” Samples.

• May be a difficult matrix.

• May be presence of interference.

• May be a non-conformance of the sample.

• Challenge sample will not be used as part of evaluation

• A summary report of the challenge will be provided after the study.

• Will not cause instrument problems.

ON-LINE APPLICATION POSSIBILITIES

Ordering Samples For New Clients.

15

ON-LINE APPLICATION POSSIBILITIES

Ordering Samples For Existing Clients.

16

ON-LINE APPLICATION POSSIBILITIES

Retrieving Historic Reports and Trends.

17

Sample CODE App ANALYTE METHOD N UNITS ASSIGNED U REPORTED s z-Score PT Score BIAS SUMMARYC01A-1 PT-007777 1 Alkalinity (pH 4.5) TITRIMETRIC 113 mg/L 88.6 0.3 90.5 2.8 0.674C01A-2 PT-007777 1 Alkalinity (pH 4.5) TITRIMETRIC 113 mg/L 240.1 0.7 240.5 6.1 0.065C01A-3 PT-007777 1 Alkalinity (pH 4.5) TITRIMETRIC 113 mg/L 120.2 0.3 121.7 3.5 0.427C01A-4 PT-007777 1 Alkalinity (pH 4.5) TITRIMETRIC 111 mg/L 76.9 0.3 77 2.5 0.04 95 AcceptableC01A-1 PT-007778 10 Calcium ICP 124 mg/L 34.69 0.2 35.1 1.63 0.251C01A-2 PT-007778 10 Calcium ICP 124 mg/L 73.92 0.3 76.1 3.31 0.658C01A-3 PT-007778 10 Calcium ICP 124 mg/L 28.53 0.1 29.72 1.37 0.868C01A-4 PT-007778 10 Calcium ICP 124 mg/L 26.5 0.1 26.87 1.28 0.289 92 AcceptableC01A-1 PT-031114 11 Calcium ICP 124 mg/L 34.69 0.2 36.46 1.63 1.086C01A-2 PT-031114 11 Calcium ICP 124 mg/L 73.92 0.3 76.9 3.31 0.9C01A-3 PT-031114 11 Calcium ICP 124 mg/L 28.53 0.1 30.32 1.37 1.306C01A-4 PT-031114 11 Calcium ICP 124 mg/L 26.5 0.1 27.43 1.28 0.727 85 H AcceptableC01A-1 PT-007781 17 ChlorideION CHROMATOGRAPHY 121 mg/L 25.5 0.1 25.4 1.3 -0.077C01A-2 PT-007781 17 ChlorideION CHROMATOGRAPHY 123 mg/L 24.3 0.1 24.1 1.3 -0.154C01A-3 PT-007781 17 ChlorideION CHROMATOGRAPHY 123 mg/L 11.3 0.07 11.3 0.7 0C01A-4 PT-007781 17 ChlorideION CHROMATOGRAPHY 121 mg/L 17 0.09 16.9 0.9 -0.111 99 AcceptableC01A-1 PT-007782 3 Conductivity (25˚C)CONDUCTIVITY METER 140 µs/cm 383 0.8 378 11 -0.449C01A-2 PT-007782 3 Conductivity (25˚C)CONDUCTIVITY METER 142 µs/cm 892 2 891 25 -0.04C01A-3 PT-007782 3 Conductivity (25˚C)CONDUCTIVITY METER 140 µs/cm 355 0.8 351 11 -0.36C01A-4 PT-007782 3 Conductivity (25˚C)CONDUCTIVITY METER 141 µs/cm 249 0.6 247 8 -0.245 96 Acceptable