Contextualizing the Evaluand: Contextual Influences and Constraints

on Communicating Findings

Kristi Pettibone, PhD

The MayaTech Corporation, With CDC’s National Center for Injury Prevention and Control

American Evaluation AssociationNovember 13, 2009

The findings of this presentation are the responsibility of the authors and do not necessarily represent the official views of the Centers for Disease Control and Prevention

Review of Key Stakeholders

• CDC leadership

• NCIPC program staff

• ICRC program evaluation workgroup

• ICRC directors

• External peer review panel

• Evaluation contractors

• Board of Scientific Counselors

Purpose of Evaluation & Report

• Intended for internal use only, though some parts may be shared

• Identify research gaps and areas for program improvement

• Required by CDC policy to conduct program and portfolio reviews for research and scientific programs every 5 years

Potential Uses of Findings

• Demonstrate accountability

• Program improvement

• Future FOA requirements

• Documentation of program history

Potential Uses of Findings (continued)

• Talking points with Congress and state legislatures

• Success stories

• Sharing through general publications and/or Extramural Research Program Office website

Implications for Sharing Findings with Stakeholders

• Only few stakeholders will receive the full report

• Some stakeholders might receive only key findings

• When possible, findings reported in format that prevents comparisons between centers

Contextual Influences/Constraints

ICRC Directors

• Wanted to promote their programs

• Concerned about comparisons among centers

• Half of the centers reapplied for funding under the 2009 Funding Opportunity Announcement

• Asked for additional funding for program

Contextual Influences/Constraints

ICRC Portfolio Evaluation Workgroup• Comprised of

– ICRC Directors– CDC Evaluators– NCIPC Leadership and Researchers

• Designed to ensure that members had– Experience with other programs/centers– History with ICRCs– Representation from ICRCs

Contextual Influences/Constraints

NCIPC

• Showcased benefits of program

• Identified areas for program improvement

Evaluation contractor

• Guided by previous portfolio reviews

• Financial constraints

Managing Competing Contexts

• Discuss dissemination of findings early• Crosswalk data collection and analysis

activities with dissemination plans• Ensure budget supports dissemination

activities• Clarify and manage expectations with all

stakeholders in advance• Revisit these expectations throughout

evaluation to address possible changes

Contact Information

Kristi Pettibone

The MayaTech Corporation

kpettibone@mayatech.com