35
Quality Assurance Quality Assurance The Rest of the Story The Rest of the Story Dennis Dvorak FHWA Resource Center Olympia Fields, IL North Central Asphalt User Producer Group Meeting January 10-11, 2007

Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

  • Upload
    vodien

  • View
    215

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

Quality AssuranceQuality Assurance““The Rest of the StoryThe Rest of the Story””

Dennis DvorakFHWA Resource Center

Olympia Fields, IL

North Central Asphalt User Producer Group MeetingJanuary 10-11, 2007

Page 2: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

AASHTO Road Test

Page 3: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

Payment Plan with 5% Incentive

Estimated PWL

PF=0.5PWL + 55Pay

Fact

or (%

)

Page 4: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

Payment Plan with Incentive

Pay Incentive

Pay Disincentive

AQL=90

10095 105

9080 100

Pay factors

Estimated PWL

Page 5: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

Payment Plan without Incentive

Estimated PWL

PF=0.5PWL + 55Pay

Fact

or (%

)

PF=100

Page 6: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

Payment Plan without Incentive

Pay Disincentive

AQL=90

9080 100

10095 105Pay factors

NoIncentive

Estimated PWL

Page 7: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

Payment Plan without Incentive

Pay Disincentive

AQL=90

9080 100

10095 105Pay factors

98

Estimated PWL

Page 8: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

8

OverviewBackgroundWhere we have been …Where we are now …Current ResourcesWhere we are going …

Short termLong term

Page 9: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

9

Background

Why is Quality Assurance Important?

Approximately 50% of construction costs are spent on the PURCHASE of materials.

Page 10: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

10

Acceptance proceduresOnce material is in place … it stays in placeOnly industry paying for marginally acceptable material

Background

Page 11: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

11

Where We Have Been …Method type specs1956-1960 AASHO Test Road

Recognition of Material variability1960s Blatnik Investigations

Federal regulation on sampling and testing1970’s Experimentation with QA specifications1980’s Implementation of QA specifications1990’s Use of contractor test results for acceptance

Page 12: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

12

Quality Assurance SpecificationsPercent Within Limits Specifications

Design BuildShort Term Warranty/Guarantee

Where We Are Now …

Page 13: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

13

Where We Are Now …POLICY (23CFR 637.205(a)) – “Each SHA shall develop a quality assurance program …The program must meet the criteria in 637.207 and be approved by the FHWA.”

Page 14: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

14

Quality Assurance ProgramAcceptance Program

State’s Verification TestingInspectionMay use Contractor test resultsDispute resolution

Qualified TechniciansAccredited / Qualified LabsIndependent Assurance ProgramMaterials Certification

Page 15: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the
Page 16: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the
Page 17: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

Scope

InterviewsInterviewsDOT Headquarters, Region/District, DOT Headquarters, Region/District,

and Project Field Officesand Project Field OfficesReviewReview

DOT implementation strategies, DOT implementation strategies, policy and procedures, and office policy and procedures, and office recordsrecords

VisitVisitConstruction projects to assess field Construction projects to assess field

procedures and practicesprocedures and practices

Page 18: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

18

Not enough State personnelNot enough State Verification TestingReluctance to spend money on construction engineering – not even for consultantsIncreasing volume of projects/workloadNo electronic materials testing data

Where We Are Now …

Page 19: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

19

Ineffective validation proceduresno independent samplesno independent samplesno statistical comparisonno statistical comparisonnumber of samples for comparisonnumber of samples for comparisoncontrol of Contractor supplied datacontrol of Contractor supplied datasecurity of samplessecurity of samplesControl of random sampling locationControl of random sampling locationRetest provisionsRetest provisions

Where We Are Now …

Page 20: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

20

Common Types of OIG Fraud Cases

Bid rigging & collusionMaterials overchargingTime overchargingProduct substitutionMinority-owned business fraudQuality-control testing fraudKickbacksBribery

Page 21: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

21

Common Types of OIG Fraud Cases

Bid rigging & collusionMaterials overchargingTime overchargingProduct substitutionMinority-owned business fraudQuality-control testing fraudKickbacksBribery

Page 22: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

DefinitionContractor misrepresents how much construction material was used on the job and then charges for more material than was used to increase job profit.

Materials Overcharging

Page 23: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

23

Plant production report shows 1,380 tons more asphalt shipped than produced on this dayPlant production report shows 1,380 tons more asphalt shipped than produced on this day

Asphalt Production ReportAsphalt Production Report

Asphalt Shipped

Private Jobs

Asphalt Produced

The Paper TrailThe Paper Trail

Page 24: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

Quality-Control Testing Fraud

DefinitionContractorContractor misrepresentsmisrepresents QC test results to falsely earn QC test results to falsely earn contract incentives or avoid contract disincentives, or to avoidcontract incentives or avoid contract disincentives, or to avoidproduction shutdown or required removal of deficient material production shutdown or required removal of deficient material in order to in order to limit costslimit costs oror increase profits.increase profits.

ExampleAfter distracting the state inspector, an asphaltAfter distracting the state inspector, an asphalt--paving crew paving crew foreman discarded road cores from random QC locations foreman discarded road cores from random QC locations designated by the inspector and replaced them with designated by the inspector and replaced them with ““test corestest cores””known to qualify for densityknown to qualify for density--incentive payments under the incentive payments under the contract.contract.

Page 25: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

Quality-Control Testing FraudSample Indicators

Contractor employees regularly contrive to take or label QC samples away from inspector oversight

Contractor insists on transporting QC samples from the construction site to the lab

Contractor does not maintain QC samples for later Quality-Assurance (QA) testing

Contractor challenges results, or attempts to intimidate Contractor challenges results, or attempts to intimidate Quality Assurance inspectors obtaining conflicting resultsQuality Assurance inspectors obtaining conflicting results

Page 26: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

26

ResourcesNHI Course 134042: Materials Control NHI Course 134042: Materials Control and Acceptance and Acceptance -- Quality Assurance Quality Assurance FHWA Basic PWL WorkshopFHWA Basic PWL Workshop2003-2005 Summary Report for QA Stewardship Reviewwww.fhwa.dot.gov/pavement/materials/stewardreview2006.cfm

Page 27: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

27

Where We Are Going …Short Term

Reduce RisksLots not restricted to a single dayMore State Verification Testing as compared to Contractor TestingStatistically Proper Validation Procedures

SPECRISK and PWL-Pay ProgramsSpecification Development CourseDatabase Workshop

Page 28: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

28

Why Electronic Databases

Need information to develop and modify specificationsMaterials inputs into M-E Pavement Design GuideTie to Pavement Management System

Page 29: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

29

Examples of Paper Documents

Page 30: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

30

Examples of Electronic Files

Page 31: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

31

Evolution…QA Specs

Performance Specs

Design Build Warrant Maintain

Page 32: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

32

Advanced Quality Systems (AQS) Implementation Team

Headquarters OfficesResource CenterDivision Offices

Page 33: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

33

Where We Are Going …Long Term

Domestic Scan of other industriesMove toward Quality Management Systems by all contractors and suppliers

Beyond ISO 9000 – sector specific requirement• Aerospace – AS9100• Automotive – ISO/TS16949

Quality Based Selection and ProcurementDesign Build Warrant Maintain

Page 34: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

34

Design Build Warrant Maintain - The Final QA?

Long Term WarrantyPerformance based contractGuarantees product integrityContractor responsible for repair of defects or replacement

Warranty PeriodPre specified for repair defects

Page 35: Quality Assurance “The Rest of the Story”ncaupg/Activities/2007... · Quality Assurance “The Rest of the Story ... transporting QC samples from the construction site to the

35

… and beyond!

Cannot continue on same path of regulate and enforceCannot continue to police contractors trying to catch them in the act

System needed to match contractor’s priorities in-line with agency’sQuality and long term performance