NIKOLE LOBB DOUGHERTY, MA JESSI LAROSE, MPH OCTOBER 2011 H&AC Promising Strategies: Evaluation...

NIKOLE LOBB DOUGHERTY, MAJESSI LAROSE, MPH

OCTOBER 2011

H&AC Promising Strategies: Evaluation & Technical

Assistance

Presentation Overview

Overview of H&AC Evaluation Team and Goals

The H&AC Initiative Evaluation

Evaluation Technical Assistance

The H&AC Evaluation Team

Washington UniversityGeorge Warren Brown School of

Social Work

Saint Louis University

School of Public Health Doug Luke, PhD Nikole Lobb

Dougherty, MA Chris Robichaux, MS Tanya Montgomery,

MPH

Cheryl Kelly, PhD Darcy Scharff, PhD Jessi LaRose, MPH Trina Ragain, MPH

Evaluation Team Goals

1. Conduct a modest multi-site evaluation of the H&AC Initiative Develop evaluation plan and logic model Implement evaluation plan

2. Increase grantees’ evaluation capacity through intensive technical assistance and training Work with grantees to develop individual evaluation

plans Work with grantees to implement evaluation plans

The H&AC Initiative Evaluation

Definition of Internal Program Evaluation and the H&AC Evaluation

Internal Program Evaluation:Evaluation conducted by each individual grantee for their own program

H&AC Evaluation: Evaluation of the entire H&AC initiative (i.e., across all grantees) conducted by the evaluation team at Washington University and Saint Louis University

H&AC Evaluation Focus

Capacity of programsReach of programsPartnershipsPolicy ChangeBuilt Environment OpportunitiesPromising PracticesSustainabilityBehavior Change

How will we collect data?

Healthy & Active Programs and Policies Evaluation (HAPPE) System Quantitative data collection Monthly and quarterly data submission throughout all three

years of funding Focuses on your activities (what, when, where and who),

capacity, & partnershipsOne-on-one interviews with program staff

Qualitative data collection Conducted in the 1st and 3rd years of the project Focuses on lesson’s learned, capacity, collaborations

Sustainability Assessment Survey Online survey Focuses on structures and processes related to likelihood of

sustaining project elements

The HAPPE System

Benefits of the Evaluation

H&AC Evaluation:Have a greater understanding of the impact of the

H&AC Initiative on MissouriIdentification and dissemination of promising

practices to guide future obesity prevention efforts

Individual Program:Easy and organized access to your own data Ability to generate your own reports of your data

Preview of H&AC Evaluation Activities

November 2011 – January 2012Training on the HAPPE System/Logic Model

Development

Spring 2012Qualitative interviews with project

representatives

Evaluation Technical Assistance

Technical Assistance Goals

To increase internal evaluation capacity

To address evaluation needs of grantees

To provide evaluation resources and networking opportunities to grantees

What We Can Help With

Evaluation plans (e.g., logic models, evaluation questions)

Quantitative and qualitative instrumentsData management and analysisDatabase developmentReports and presentationsEvaluation resources Networking opportunities with other

evaluatorsInterim reports/contract reporting tool

Preview of TA activities

Evaluation capacity online needs assessment November 2011 (a follow-up needs assessment will be

conducted in the fall of 2014)Site visits

November 2011-January 2012Individualized technical assistance plans and

program logic model Based on needs assessment and first site visit

Regular communication to assist with needs Conference calls, visits, emails

Contact Information

Technical Assistance Contacts

Initiative Evaluation Contacts