Communicating Program Impact-Using Research Outcomes to Promote Community Buy-in

Locally

Presented by : Sebrina Doyle and Stephanie Bradley

EPISCenter

April 24th, 2012

One size fits all messages don’t always work…

Figuring out the Who, What, Where,

and How of Communication

WHO do you need to communicate with?

A note on stakeholders…

A person, group, or organization that has direct or

indirect stake in an organization because it can affect or

be affected by the organization's actions, objectives,

and policies.

Source: http://www.businessdictionary.com/definition/stakeholder.html

Who are the stakeholders for your program/organization?

6

Source: http://www.memoireonline.com/07/06/196/m_stakeholders-football-club-strategy4.html

What do you need to communicate?

Numbers are Powerful!

∗ Academic (attendance, grades)

∗ Social (bullying, peer relationships)

∗ Behavioral (antisocial behavior, risky behavior)

∗ ATOD use/abuse (timing of onset, use, risk for abuse)

∗ Family Relationships (parent-child, sibling)

∗ Mental health

Program Outcomes:

∗ Time-

∗ Initial investment of time in training

∗ # of hours spent implementing program

∗ Money-

∗ Amount of funds required for start-up

∗ Amount of funds required for maintenance

∗ Cost/Benefit-

∗ Amount of time/money saved by running the program

Other metrics that can be used for measurement:

Where do you get the information?

Data Toolkit

Program Logic Model

WSIPP Economic Research

National Program Results

External Local and State Data Sources

(EpiQMS, PAYS)

External National Data Sources (CDC,

Kids Count)

Agency/Local Data

∗ What is it?

∗ Describes how and why the program produces changes in the targeted outcomes

∗ Why is it important?

∗ Provides theoretical backbone

∗ Guides quality implementation

∗ Guides quality evaluation

Logic Model Basics

Lessons

Group Activities

Role-Playing

Self-reflection

Homework

Projects

Skill Practice

Individual Therapy

Group Therapy

Program Components, Activities, Features

Increased knowledgeIncreased skillsImproved attitudes

Better communicationIncreased norms knowledgeRecognizing emotionsIncreased belief in self

Short Term Outcomes

Increased school successBetter relationshipsDecreased substance useBetter mental health

Long Term Outcomes

Risk Factors:Poor family relationshipsAcademic disengagementLack of study skillsPoor social skillsIsolation

Protective Factors:Attachment to schoolProsocial activitiesPositive relationshipsEmotion regulationNorms knowledge

Targets

Essential Features of a Logic Model – A General Example

How…? What…?

After an eighteen month period, BBBSA youth:

∗ were 46% less likely than control youth to initiate drug use.

∗ were 27% less likely to initiate alcohol use than control youth.

∗ were almost one-third less likely than control youth to hit someone.

∗ were better than control youth in academic behavior, attitudes, and performance.

∗ were more likely to have higher quality relationships with their parents or guardians than control youth.

∗ were more likely to have higher quality relationships with their peers at the end of the study period than did control youth.

Program Outcomes for BBBSA* From the Blueprints for Violence Prevention Website

Program youth compared to control group youth:

∗ Spent 60% fewer days incarcerated at 12 month follow-up;

∗ Had significantly fewer subsequent arrests;

∗ Ran away from their programs, on average, three time less often;

∗ Had significantly less hard drug use in the follow-up period;

∗ Had quicker community placement from more restrictive settings (e.g., hospital, detention); and

∗ Had better school attendance and homework completion at 24 months follow-up.

Program Outcomes for MTFC* From the Blueprints for Violence Prevention Website

Cost/Benefit Ratios

The Economic Return on PCCD’s Investment in Research-based Programs: A cost-benefit assessment of delinquency prevention in Pennsylvania. 2008, p.5.

From the PA Epidemiological Report

Construct ALCOHOL TOBACCO ILLICIT DRUGS

Mortality

Alcoholic Liver Disease Death Rate

Percent Fatal Motor Vehicle Crashes Involving Alcohol

Fatal Motor Vehicle Death Rate Involving Alcohol

Percent Drinking Drivers of Total Drivers in Fatal Crashes

Lung Cancer Death Rate

Emphysema Death Rate

Drug Death Rate Percent Persons 12+

Meeting DSM-IV Criteria for Illicit Drug Abuse/Dependence

Crime

DUI Arrest Rate Self-reported DUI (youth only) Public Drunkenness Conviction

Rate Underage Purchase of

Alcohol/Tobacco Conviction rate DUI Conviction Rate

Drug Possession Conviction Rate

Illegal Alcohol/Drug Sales Conviction Rate

Other Consequences

Percent Persons 12+ Meeting DSM-IV Criteria for Alcohol

Abuse/Dependence Treatment Admissions (%) for

Alcohol Use

Treatment Admissions (%) for Illicit Drug Use

Consumption

Current Use (youth only) Binge Drinking

Lifetime Use (youth only) Heavy Drinking (adults only)

Alcohol Sales

Current Use Lifetime Use (youth

only) Daily Smokers (adults

only) Smoking During

Pregnancy

Current Use Lifetime Use (youth

only)

Two examples:

EpiQMShttp://www.portal.state.pa.us/portal/server.pt?open=514&objID=596553&mode=2

PAYShttp://www.pays.state.pa.us

Map Example from EPIQMS

Table Example from EPIQMS

Binge Alcohol Use in Past Month by Persons aged 12-20 by PA Substate Region

SAMHSA, Office of Applied Studies, National Survey on Drug Use and Health, 2006, 2007, and 2008.

A Few Bridges

Funding agency Cost-benefit

Potential Volunteers

Community

Time Commitment/ program effects

EpiQMS, PAYS

Who: What: Where:

WSIPP Economic Report

Program Developer Website

Risk & protective factors

HOW do you communicate the

information?

Hands on time

Report out &

brainstorm for others