NASC 2012 ANNUAL CONFERENCENASC 2012 ANNUAL CONFERENCEAUGUST 6, 2012AUGUST 6, 2012

Why Evidence Based Practices MatterWhy Evidence Based Practices Matter

If we want to see results, we have to use approaches that If we want to see results, we have to use approaches that workwork

Principles of Effective InterventionPrinciples of Effective Intervention

Risk PrincipleRisk Principle—focus on offenders at high risk for future criminal offending

Need PrincipleNeed Principle—target criminogenic needs

Treatment PrincipleTreatment Principle—use behavioral approaches

Program FidelityProgram Fidelity—ensure quality delivery

Why These Principles MatterWhy These Principles Matter

Better OutcomesBetter Outcomes

Andrews, Bonta & Hogue, 1990; Andrews & Bonta, 2006

Importance of Importance of Program FidelityProgram Fidelity

Why Program Quality MattersWhy Program Quality Matters

Source: Washington State Institute of Public Policy 2011

Savings in

Juvenile Progra

ms

Why Program Quality MattersWhy Program Quality Matters

Source: Washington State Institute of Public Policy 2011

Savings in Adult Progra

ms

Importance of Program FidelityImportance of Program Fidelity

Barnoski & Aos, (2004) Outcome Evaluation of WashingtonState’s Research-Based Programs for Juvenile Offenders. WISP.

Fidelity to the Fidelity to the

model and model and

program program

delivery affect delivery affect

offender offender

recidivism recidivism

rates. rates.

Importance of Program FidelityImportance of Program Fidelity

“What seems to most strongly characterize characterize effective CBT programs effective CBT programs is high quality implementation as represented by low proportions of treatment dropouts, close monitoring of the quality and fidelitymonitoring of the quality and fidelity of the treatment implementation, and adequate CBT training for the providers.”

Landenberger,& Lipsey, (2005). “The Positive Effects of Cognitive-Behavioral Programs for Offenders: A Meta-Analysis of Factors Associated with Effective Treatment.” Journal of Experimental Criminology.

Importance of Program FidelityImportance of Program Fidelity

Barnoski & Aos, (2004) Outcome Evaluation of WashingtonState’s Research-Based Programs for Juvenile Offenders. WISP.

Fidelity to the Fidelity to the

model and model and

program program

delivery affect delivery affect

the bottom line. the bottom line.

Ensuring Program Ensuring Program FidelityFidelity

Assessment of ProgramsAssessment of Programs

We use a risk assessment to make sure we aren’t mixing offenders aren’t mixing offenders or focusing on low risk offenders

We use case planning to make sure we are targeting criminogenic needs targeting criminogenic needs and matching offenders to the most appropriate programs

But how do we know if the programs we send But how do we know if the programs we send offenders to are doing any good?offenders to are doing any good?

Identifying Effective ProgramsIdentifying Effective Programs

Focuses on higher risk offender

Targets criminogenic needsTargets criminogenic needs

Use s evidence-based interventions

Bases program design on proven Bases program design on proven theoretical modeltheoretical model

Matches offender to treatment type

Ensure s quality delivery of programEnsure s quality delivery of program

Uses appropriate rewards and punishers

How do I How do I

know if a know if a

program is program is

effective for effective for

treating treating

offenders?offenders?

How do I How do I

know if a know if a

program is program is

effective for effective for

treating treating

offenders?offenders?

Impact of the Numbers of Favorable Impact of the Numbers of Favorable Features on RecidivismFeatures on Recidivism

Source: Adapted from Lipsey, 1997, 2005, cover 509 juvenile justice studies

Average Practice

Qualities of Good Programs Qualities of Good Programs Ask These QuestionsAsk These Questions

Is there stablestable leadership leadership?

What trainingtraining does staff receive?

What is there knowledge of EBPknowledge of EBP ?

Is there ongoing monitoring ongoing monitoring of program – quality assurance process

Is there a manualmanual of operation? – Program must be researched based

What risk factors risk factors do they focus on ?

Do they use cognitive behavioral cognitive behavioral approaches – practice skills?

What is the dosagedosage?

Do they focus on medium and high risk high risk offenders?

What are their dropout ratesdropout rates?

Assessment Process OverviewAssessment Process Overview

Use a Use a Validated Validated

Risk Risk AssessmentAssessment

Develop Case Develop Case Plan Based Plan Based

on Risk on Risk Assessment Assessment

Match Offender Match Offender to Effective to Effective

ServicesServices

What Utah is Doing to Ensure What Utah is Doing to Ensure Fidelity in ProgramsFidelity in Programs

Assessing programs using a research-basedresearch-based program assessment toolassessment tool

Each item on the assessment tool is related to Each item on the assessment tool is related to reductions in recidivismreductions in recidivism

The tool examines whether programs are implementing EBP models The tool examines whether programs are implementing EBP models with with fidelityfidelity

Programs are provided with Programs are provided with feedbackfeedback on their progress and ongoing on their progress and ongoing assistance to improveassistance to improve

RecidivismRecidivism is measured and linked to program assessment results and is measured and linked to program assessment results and provided to probation management and programsprovided to probation management and programs

Pre/Post tests Pre/Post tests measuring changes in offender attitudes and behaviors measuring changes in offender attitudes and behaviors

What Utah is Doing to Ensure Fidelity in What Utah is Doing to Ensure Fidelity in Programs Across the SystemPrograms Across the System

Validated risk instrument

Case Planning modelCase Planning model

Correctional Program Checklist – program improvement

Certification of probation staffCertification of probation staff

Training, training , training

A vision statement that included EBPA vision statement that included EBP

Report Cards/Rich information system

Judicial/Legislative supportJudicial/Legislative support

Contact InformationContact Information

Ray Wahl Ray Wahl – Deputy State Court Administrator

rayw@utcourts.gov801-578-3805