AHRQ Quality IndicatorsAHRQ Quality IndicatorsValidation and the Validation and the

National Quality Forum National Quality Forum

AHRQ 2007 Annual MeetingAHRQ 2007 Annual Meeting

Bethesda, MDBethesda, MD

September 27, 2007September 27, 2007

NQF ProcessNQF Process

NQF Hospital Care Additional Priorities, 2007NQF Hospital Care Additional Priorities, 2007 Other consensus development processes for Other consensus development processes for

DVT or PE, healthcare acquired infections, DVT or PE, healthcare acquired infections, ambulatory careambulatory care

Review by five technical advisory panelsReview by five technical advisory panels– Patient safetyPatient safety– PediatricPediatric– Surgical and anesthesiaSurgical and anesthesia– CompositeComposite– Reporting templateReporting template

Documentation of evidenceDocumentation of evidence– Literature reviewsLiterature reviews

– NQF evaluation criteriaNQF evaluation criteria importance, scientific soundness, feasibility, and usabilityimportance, scientific soundness, feasibility, and usability

Development of evidenceDevelopment of evidence– Data analysisData analysis

– Clinical panel reviewsClinical panel reviews

– Medical record abstractionMedical record abstraction

– Validation pilotValidation pilot

AHRQ QI ValidationAHRQ QI Validation

Validation PilotValidation Pilot

Goals of the validation pilotGoals of the validation pilot– Gather evidence on the scientific Gather evidence on the scientific

acceptability of the patient safety indicatorsacceptability of the patient safety indicators

– Consolidate the evidence base Consolidate the evidence base

– Improve guidance on the interpretation and Improve guidance on the interpretation and use of the datause of the data

– Evaluate potential refinements to the Evaluate potential refinements to the specificationsspecifications

Validation PilotValidation Pilot

Develop medical record abstraction toolsDevelop medical record abstraction tools Structured review of potentially preventable Structured review of potentially preventable

adverse eventsadverse events Guided process for identifying potential Guided process for identifying potential

opportunities for improvementopportunities for improvement

Develop mechanisms for conducting Develop mechanisms for conducting validation studies on a routine basisvalidation studies on a routine basis collaborating with other organizationscollaborating with other organizations data collection and analysisdata collection and analysis ongoing evaluation and refinementongoing evaluation and refinement

Validation PilotValidation Pilot

Become a participant in the validation pilotBecome a participant in the validation pilot– Select a sample of cases using your administrative Select a sample of cases using your administrative

data (e.g. 30-100 cases)data (e.g. 30-100 cases)– Available abstractors to use the data collection Available abstractors to use the data collection

tools to review casestools to review cases– Participate in a collaborative with other Participate in a collaborative with other

organizations around the countryorganizations around the country Types of organizationsTypes of organizations

– Facilitating organizationsFacilitating organizations collaborating with one or more individual hospitalcollaborating with one or more individual hospital

– Hospital systemsHospital systems representing more than one individual hospital representing more than one individual hospital

– Individual hospitals Individual hospitals