� � When Making Your Program Selection

�  Don’t Wait for a Funding Opportunity to Select Programs!

�  Program Selection Planning Team o  Do you have the right people on your team to most effectively select a program? o  Does each member of the team understand the priorities established in the community

strategic plan? o  Is there a diverse selection of members with a wide variety of skills represented on the

team? •  Budget writing •  Program selection •  Data/outcomes

�  Agency Participation o  Who will be the best agency to take the lead on applying for and implementing program?

�  Develop a Timeline o  Start from deadline date and work backwards o  Program selection takes time o  Have team work on other sections as program selection is being made

KEY

Inside circle—programs that most directly impact the risk factor Outside circle—programs that have the capability to impact the risk factor. Triangles—Activities that are not research or evidenced-based, but have the potential to make an impact on the risk factor

�  www.episcenter.psu.edu

�  www.blueprintsprograms.com

�  www.crimesolutions.gov

�  www.nrepp.samhsa.gov

�  www.ojjdp.gov/mpg

�  www.findyouthinfo.gov

How well does the program fit into local efforts and is it feasible to implement?

How confident are you that the program will affect population-level change?

How well does the program address the priorities found in our local prevention strategic plan?

�  Program Match

�  Organizational Resources

�  Program Quality

�  Program Fit o  Does the program specifically address the risk and protective factors, developmental stage,

domains of influence, and the population targeted, as well as the culture and values of the community?

�  Program Efficacy o  Based on the program’s record of evaluation results, how much confidence can the

community have that the program will result in improved outcomes?

�  Program Feasibility o  Do the community, implementers, and implementing organization have the necessary

capacity to deliver the program with sufficient quality, sustain it, and assess its delivery and impact?

� Critical Program Components •  Risk and protective factors addressed by the program •  How and with whom the program was conducted

•  Target population

•  Program evaluation •  Results

� Appropriateness of the Program •  Implementation costs •  Resources, skills and time issues

•  Social and political issues

� Implementation Costs •  Staff •  Training

•  Supplies & Materials

•  Equipment & Facilities •  Administration

� Resources, Skills, and Time Available •  Resources – how will they affect selected programs? •  Skills – what credentials & experience is required? (Can we afford it?)

•  Timing – when will implementation steps take place?

•  Outside Training & Technical Assistance •  Substitutes or Staff Replacements

•  Transportation

•  Costs Over Time

  Fit & Feasibility (F&F)  

Poor ------------------------------------------------> Good  

Evid

ence

 

Stro

ng <

------

------

-- W

eak   Untested or Ineffective

& Poor F&F  Untested or Ineffective & some challenges to F&F  

Untested or Ineffective but good F&F  

Promising Effectiveness but Poor

F&F  

Promising Effectiveness but some challenges to F&F  

Promising Effectiveness & good F&F  

Evidence-based but Poor F&F  

Evidence-based but some challenges to F&F  

Evidence-based & good F&F  

�  Best Practices �  Promising Approaches �  Research-Based

�  Science-Based �  Evidence-Based �  Model Programs

�  Blueprints Programs

What’s it all mean???

� Best Practices (Lowest level of confidence) “We’ve done it and we like it”

� Promising Approaches “We really think that this will work…but we need time to prove it”

� Research-Based “The intervention is based on a sound theoretical foundation”

� Evidenced-Based (Highest level of confidence)

“This intervention has been tested and shown to work”

Not Sure

Best Practices Think It Might

Promising Approaches

Science Says It Will

Research-Based

High Confidence

Evidence-Based

�  Relevance of the conceptual model (Theory of Change) �  Quantity and quality of evidence �  Generalizability of evidence

�  Economic feasibility �  Local “fit” �  Breadth of impact

�  TA and training infrastructure �  Peer network opportunities �  Sustainability

�  Do we need the program? �  What are other options? �  How strong is the evidence?

�  Does the evidence apply to our population? �  Is it worth the investment and can we afford it? �  Can we assemble necessary resources & stakeholders?

�  Will our community find it acceptable? �  How broad might the impact be? �  Can the developer support out site?

�  Do we know others who have used it? �  What will it take to sustain it?

�  Program Selection: Is the Program You Selected a Good Fit for the Community?

v  Does the program address your community’s prioritized RPF? v  Is the program appropriate for the population/demographic you plan to target? v  Are the outcomes desired for your community the same as those indicated in the research?

�  Implementation Planning Steps: Are the Systems/Resources Needed for Implementation Available?

v  Is there a single organization that will coordinate and oversee program quality? v  Is the organization respected in the community, fiscally responsible, and effectively organized?

�  Implementation Steps: Can the Expectations for Quality & Model Adherence Be Met? v  Does the capacity exist to ensure key program elements are implemented?

�  Steps for Assessing Program Impact: Does the Capacity for Reporting Outcomes and Fidelity Data Exist?

v  Can the population that the program was designed to target be recruited?

�  Steps for Sustainability: How Will Program Resources Be Identified to Sustain Beyond Start-Up?

v  Can the lead organization identify skilled individuals to participate in any required trainings? v  Can funds/resources be identified to sustain key implementation elements of the program

beyond the initial seed funding?

�  Addressing Challenges During Implementation v  Are there practical or biological barriers within the lead organization that could inhibit adoption? v  How will lead organization administrators address staff and facilitators who are struggling with

implementation? v  What resources will be made available to them to address these issues?