September 21, 2012Tennessee Office of Criminal Justice Programs1 JOHNSON CITY! Mar 1, 2013 – Feb 28, 2016 Strategic Project Design: Session #1 Evidence-based

September 21, 2012Tennessee Office of Criminal Justice Programs1

JOHNSON CITY!JOHNSON CITY!Mar 1, 2013 – Feb 28, 2016Mar 1, 2013 – Feb 28, 2016

Strategic Project Strategic Project Design: Session #1Design: Session #1

Evidence-based Strategies:Evidence-based Strategies: TCCR Projects to Reduce Violent TCCR Projects to Reduce Violent and Drug-Related Crimeand Drug-Related Crime

2

TRAINING GOALSTRAINING GOALS

• Explain requirements and schedule.

• Orient key concepts and action steps.

• Help grant application team with:– Crime data analyses & opinion baselines, – Resources inventory, – Plans for collaborative partnerships, and – Searches for evidence-based models.

Tennessee Office of Criminal Justice Programs with Performance Vistas, Inc.

September 21, 2012

3

LEARNING OBJECTIVESLEARNING OBJECTIVES• Recognize requirements of this grant;

• Discuss “evidence-based,” “data-driven” and “collaborative” project design;

• Know major tasks and deadlines;

• Recognize steps for preparing the problem statement:– Analyzing crime & population data; – Analyzing other data on nature of crime; and– Collecting opinions of residents & potential partners.


September 21, 2012

4

• Take some lessons from existing TCCR project teams;

• Recognize steps for inventorying resources & building partnerships;

• Know where to begin searching for evidence-based models; and

• Plan the data analysis, collaboration efforts, and application writing responsibilities.

LEARNING OBJECTIVESLEARNING OBJECTIVES


September 21, 2012

5

SESSION AGENDASESSION AGENDA

• What’s Expected of an Applicant What’s Expected of an Applicant

• Project Planning Calendar of EventsProject Planning Calendar of Events

• Evidence-Based & Data-Driven Projects Evidence-Based & Data-Driven Projects

• Lessons from TCCRP ProjectsLessons from TCCRP Projects

• Problem Statement WorksheetProblem Statement Worksheet

• Johnson City DataJohnson City Data

• Working Session: Project DesignWorking Session: Project DesignTennessee Office of Criminal Justice Programs

with Performance Vistas, Inc.September 21, 2012

6

PURPOSE of the TCCRPPURPOSE of the TCCRP To To demonstratedemonstrate with with actionable dataactionable data how how

effective effective community collaborationcommunity collaboration can be can be for for preventingpreventing violent and drug-related violent and drug-related crime, crime, revitalizingrevitalizing crime ridden areas, crime ridden areas, enforcingenforcing community standards community standards on such on such crimes, and crimes, and preventingpreventing re-arrests and re-arrests and probation violationsprobation violations among offenders in among offenders in selected areasselected areas of the community.of the community.


September 21, 2012

7

MAJOR EventsMAJOR Events (HO #2)(HO #2)• Training: Training: 09/21, 09/21, 10/15, 11/1510/15, 11/15

• Crime data analyses & targets:Crime data analyses & targets: 10/15/1210/15/12

• Strategies, LM ideas, partners:Strategies, LM ideas, partners: 11/15/12 11/15/12

• 11stst working session (LM): working session (LM): 11/15/1211/15/12

• Draft Logic Model & Measures: Draft Logic Model & Measures: 12/15/1212/15/12

• 22ndnd working session & TA: working session & TA: Dec 2012 Dec 2012

• Final Application submission:Final Application submission: 01/31/1301/31/13

• Awards & Initiation: Awards & Initiation: 02/28/13 02/28/13 Tennessee Office of Criminal Justice Programs


8

Characteristics of a Strategic Characteristics of a Strategic Project Design (HO #3)Project Design (HO #3)

1.1. It follows a 10-Step Process. (HO #4)It follows a 10-Step Process. (HO #4)• A Logical Flow…• Analyze problems & inventory resources• Identify strategies & select to fit

2.2. It is a It is a collaborativecollaborative process. process.

3.3. It is It is data drivendata driven..

4.4. It identifies and selects It identifies and selects evidence-evidence-based strategiesbased strategies. .


September 21, 2012

9

……a a collaborativecollaborative process process • Communication:Communication:

Information exchangeInformation exchange. .

• Coordination:Coordination:

Coordination is about efficiencyCoordination is about efficiency. .

• Collaboration:Collaboration:

““The process of shared creationThe process of shared creation…”…”

Note the differences (HO #5) Note the differences (HO #5)


September 21, 2012

10

““Data-Driven?”Data-Driven?” • Crime Data:Crime Data: crime incidents in a specific crime incidents in a specific

location, with recent trends and socio-location, with recent trends and socio-demographic information demographic information

• Other data:Other data: supplement crime data supplement crime data

• Crime data mapping:Crime data mapping: Plot the patterns Plot the patterns

• Community resources mapping:Community resources mapping: Plot the Plot the available assets available assets

• Mapping ResourcesMapping Resources and Image Sources and Image Sources Tennessee Office of Criminal Justice Programs


11

Evidence-Based? 3 DegreesEvidence-Based? 3 Degrees• Evidence-Evidence-

BasedBased

• Evidence-Evidence-

InformedInformed

• Unproven:Unproven:

Research evaluation Research evaluation (experimental design w/ (experimental design w/ control group); control group); provesproves its its ability to prevent violent ability to prevent violent crime. Model pgm. crime. Model pgm.

Similar, but Similar, but demonstratesdemonstrates best practice for reducing best practice for reducing risks or increasing risks or increasing protective factors. protective factors. Promising pgm.Promising pgm.

Evaluated, but no outcome Evaluated, but no outcome findings, or not evaluated.findings, or not evaluated.


September 21, 2012

12

Evidence-Based ConceptsEvidence-Based Concepts 1.1. Performance measurement (e.g., Performance measurement (e.g.,

outcomes) does NOT = EVALUATION: outcomes) does NOT = EVALUATION: Does not show causality; shows if Does not show causality; shows if objectives were met. objectives were met.

““Performance measurement is necessary Performance measurement is necessary but not sufficient for evaluation.”but not sufficient for evaluation.”


September 21, 2012

13

Evidence-Based ConceptsEvidence-Based Concepts 2. You’re searching for projects that are:2. You’re searching for projects that are:

a.a. Exemplary and model Exemplary and model – – clear evidence of clear evidence of effectiveness using multiple, rigorous effectiveness using multiple, rigorous evaluation research.evaluation research.

b.b. PromisingPromising – – some evidence of effectiveness some evidence of effectiveness (outcomes data), but many questions (outcomes data), but many questions remain.remain.

c.c. InnovativeInnovative – – derived from evidence-based derived from evidence-based projects but not yet supported by multiple, projects but not yet supported by multiple, rigorous evaluation research.rigorous evaluation research.


September 21, 2012

14

Evidence-Based ConceptsEvidence-Based Concepts 3. You’re 3. You’re NOTNOT searching for projects that: searching for projects that:

a. Have clearly been proven NOT to be effective.

b. Have no evidence of being effective.

http://gemini.gmu.edu/cebcp/matrix.htmlhttp://gemini.gmu.edu/cebcp/matrix.html

See HO #6 See HO #6


September 21, 2012

15

Evaluation PlanEvaluation Plan • Process Evaluation and Outcome Process Evaluation and Outcome

Measurement: Measurement: – Make sure we DO what we said we would do. Make sure we DO what we said we would do.

Descriptive.Descriptive.– Gather data on results (CHANGES).Gather data on results (CHANGES).

• Internal (local) and External Evaluators.Internal (local) and External Evaluators.• Five process evaluation activities: Five process evaluation activities:

Developmental approach, learn as we go.Developmental approach, learn as we go.• More rigorous study later. (HO #7)More rigorous study later. (HO #7)


September 21, 2012

16

Four Types of StrategiesFour Types of Strategies • Pre-enforcement Prevention:Pre-enforcement Prevention: Activity in Activity in

the community by coalition partners the community by coalition partners intended to PREVENT first-time arrests. intended to PREVENT first-time arrests.

• Neighborhood Revitalization: Neighborhood Revitalization: Blight Blight removal, physical improvements, resident removal, physical improvements, resident ownership. ownership.


September 21, 2012

17

Four Types of StrategiesFour Types of Strategies • Enforcement:Enforcement: Activity performed by law Activity performed by law

enforcement & partners to prevent first-enforcement & partners to prevent first-time offenses and apprehend offenders.time offenses and apprehend offenders.

• Offender Intervention:Offender Intervention: Activity performed Activity performed by coalition partners to prevent known by coalition partners to prevent known offenders from offending again, or to offenders from offending again, or to prevent their re-arrest or probation prevent their re-arrest or probation violation. violation.


September 21, 2012

18

Typical ActivitiesTypical Activities• Pre-enforcement Prevention: Pre-enforcement Prevention: in-school in-school

education, behavior change, parent-child education, behavior change, parent-child relations, community mentoring, etc.relations, community mentoring, etc.

• Neighborhood Revitalization:Neighborhood Revitalization: environmental improvements (e.g., environmental improvements (e.g., motion detection or lighting), motion detection or lighting), Neighborhood Watch programsNeighborhood Watch programs . .

See HO #8See HO #8


September 21, 2012

19

Typical ActivitiesTypical Activities• Enforcement: Enforcement: neighborhood patrolling, neighborhood patrolling,

security cameras, arrest and detentionsecurity cameras, arrest and detention..

• Offender Intervention: Offender Intervention: social & other social & other skills-building, monitoring, reward and skills-building, monitoring, reward and discipline, parental involvementdiscipline, parental involvement. .

See HO #8See HO #8


September 21, 2012

20

Two Training & Two WorkingTwo Training & Two Working• Training Sep ‘12: Requirements & basics Training Sep ‘12: Requirements & basics

– Crime data, Census, surveys, EBS, brief Crime data, Census, surveys, EBS, brief leaders and formulate major strategy ideas.leaders and formulate major strategy ideas.

• Training Oct ‘12: Major strategies, goals Training Oct ‘12: Major strategies, goals and recruiting primary partnersand recruiting primary partners– Crime mapping, zones & target pops, goals, Crime mapping, zones & target pops, goals,

objectives, half of application worksheet.objectives, half of application worksheet.

• Working Nov ‘12: Fine tune strategiesWorking Nov ‘12: Fine tune strategies– finish the Logic Model (project design)finish the Logic Model (project design)

• Working Dec ‘12: Finish the application Working Dec ‘12: Finish the application Tennessee Office of Criminal Justice Programs


21

8 Steps for Designing 8 Steps for Designing Johnson City’s ApproachJohnson City’s Approach

1. FIRST TRAINING: Basic training.

2. HOMEWORK! • Collect crime data, Census data, do opinion surveys. • Do EBS search, starting with reviewing “What Works in

Prevention” Nation, Crusto, etal, American Psychologist and the Evidence-Based Policing Matrix by George Mason University.

• Preview the grant application formats.• Identify the major findings for a briefing of community leaders.• Prepare city leaders, prosecutors, judges, defense, LE, housing

authority, schools, local and State Corrections, evaluator: Obtain approval for major directions of the design .

• Set major strategic directions of the project.Tennessee Office of Criminal Justice Programs


22

3. SECOND TRAINING: Oct 15. Bring your homework! Your core team will review the Problem Statement draft and will identify goals for the major strategies. We will use the grant application formats, and we will discuss how to recruit your primary strategy partners.

4. THEN… HOMEWORK in October and November! • Team prepares crime maps, reviews root causes and EBS.• Team refines major strategies, converts goals to objectives.• Team identifies COLLABORATORS (key partners). • Brief potential partners and invite them to November session.


September 21, 2012


23

5. WORKING SESSION: November 15. • The new COLLABORATIVE analyzes the community’s crime &

needs data, the major strategy directions and goals.• Collaborators assess the community’s resources for delivering

the services required for the major strategies of the crime reduction program.

•Collaborators conduct logic modeling for strategies, making decisions about funded and unfunded partners and their contributions. •We will plan for follow-up TA before the next working session.


September 21, 2012


24

6. HOMEWORK: Collaborators prepare in draft remaining Worksheets for the grant application. TA as needed.

7. SECOND WORKING SESSION: Group brings in partners: • victim services, treatment and other service providers, • academia, youth workers, and community businesses

and residents. • Review the draft application and logic model goals,

objectives, intended outputs and outcomes, measures of success and reporting protocols.

8. FINALIZE GRANT APPLICATION: Due January 31, 2013!Tennessee Office of Criminal Justice Programs



25

Lessons from 6 TCCRP cities:Lessons from 6 TCCRP cities: 1.1. Community-oriented policing requires Community-oriented policing requires

sharing that’s seldom comfortable to LE.sharing that’s seldom comfortable to LE.2.2. Clearing up key definitions (e.g., “crimes,” Clearing up key definitions (e.g., “crimes,”

“implementation,” incidents,” “offenses,”)“implementation,” incidents,” “offenses,”)3.3. Outputs are NOT Outcomes!Outputs are NOT Outcomes!4.4. Short-term versus long-term outcomes:Short-term versus long-term outcomes:

• Behavior change vs crime rate reductions.Behavior change vs crime rate reductions.• Perceptions of change vs re-arrest rates.Perceptions of change vs re-arrest rates.• Pgm graduation/completion vs knowledge, Pgm graduation/completion vs knowledge,

skills, conditions improved (i.e., CHANGE).skills, conditions improved (i.e., CHANGE).Tennessee Office of Criminal Justice Programs


26

Lessons from 6 TCCRP cities:Lessons from 6 TCCRP cities: 5.5. Bringing in partners before the design is Bringing in partners before the design is

clear (or not having OI partners early).clear (or not having OI partners early).6.6. Not having full knowledge & commitment Not having full knowledge & commitment

from community leaders.from community leaders.7.7. Not having a full-time project director: Not having a full-time project director:

partner meetings, tracking progress, partner meetings, tracking progress, commitments, data capture and delivery. commitments, data capture and delivery. OWNERSHIP!OWNERSHIP!

8.8. Not having clarity about baseline crime Not having clarity about baseline crime incidence and arrest data (value of a incidence and arrest data (value of a crime data analyst).crime data analyst).


September 21, 2012

27

Lessons from 6 cities Lessons from 6 cities (cont’d)(cont’d):: 9.9. Not having evaluator on board to help early:Not having evaluator on board to help early:

- EBS research & strategy selection;- EBS research & strategy selection;- Output and outcome measures & data tools;- Output and outcome measures & data tools;- Facilitating reporting protocols.- Facilitating reporting protocols.

10. Not understanding developmental or formative 10. Not understanding developmental or formative evaluation; process analysis. Descriptive.evaluation; process analysis. Descriptive.

11. Delays in implementation: Producing activities, 11. Delays in implementation: Producing activities, not just MOUs. A slow start will hurt you...not just MOUs. A slow start will hurt you...

12. Under-estimating requirements. NOT typical! 12. Under-estimating requirements. NOT typical! - demanding design process & application;- demanding design process & application;- broad-based partnerships;- broad-based partnerships;- heavy on data & reporting; - heavy on data & reporting; - outcome measurement.- outcome measurement.


September 21, 2012

28

Thanks! Thanks! Questions, DiscussionQuestions, Discussion

Please be sure to complete a session Please be sure to complete a session evaluation form! HO #9evaluation form! HO #9


September 21, 2012

Documents

September 21, 2012Tennessee Office of Criminal Justice Programs1 JOHNSON CITY! Mar 1, 2013 – Feb 28, 2016 Strategic Project Design: Session #1 Evidence-based