Embed Size (px)
Citation preview
PROGRAM EVALUATION & IMPROVEMENT FOR VICTIM
SERVICESThursday, July 31, 2014
TODAY’S PRESENTERS
Nicole Geller Director, Justice Initiatives
Social Solutions Global
Susan HowleyDirector of Public PolicyThe National Center for Victims of Crime
Melissa Caine-HuckabayDirector of Training and TechnologyWest Contra Costa Family Justice Center
Fundraising/appropriations
• Compelling stories
• A few statistics
• Personal relationship
Previously Today
Compelling stories A few statistics Personal relationship
Proving our value
Fundraising/Appropriations
All funders
CongressState legislature
OMB
State grant administrators
Private foundations
Individual donors
All want to know:
How are you using this money?
Is it making a difference?
Vision 21: Building Organizational Capacity
High-capacity Results-oriented
DATA
Collect
Analyze
Use
Too many organizations…
Don’t know Where they are spending their time and money How many victims they’re serving, what services, and what
level of effort Whether their activities are making a difference
HOPE
New technologies to capture
What we’re doing
What we’re achieving
Feedback loop
2014Melissa Caine-HuckabayDirector of Training & Technology
FAMILY JUSTICE CENTER OVERVIEW
What is the Family Justice Center?
13WCCFJC 2014
Safety Planning
Q: What happens when a victim seeks services for domestic violence, sexual assault, child abuse, elder abuse, or human trafficking?
A: The victim often gets referred to many different resources in many different places.
Victim
Peer Counseling
Restraining Order
Assistance
Victims of Crime
Compensation Program Family Law
Assistance
Court Support
Law Enforcement Assistance
Access to Counseling and Mental
Health Services
Emotional Support
Advocacy
Assistance With
EmergencyShelter
14WCCFJC 2014
Victim
Peer Counseling
Emotional Support
Access to Counseling
and Mental Health
Services
Court Support
Safety Planning
Law Enforcement Assistance
Assistance With
EmergencyShelter
Advocacy
Family Law Assistance
Victims of Crime
Compensation Program
Restraining Order
Assistance
15WCCFJC 2014
WCCFJC’s Vision:Through a single door, the West Contra Costa Family Justice Center brings together our entire community to support the healing of family violence survivors. Our diverse partners work hand-in-hand, responding directly to survivor needs. Working together, we create new violence free futures for families, communities, and our county.
Through a single door,
Working together,
16WCCFJC 2014
Data shows:
• During the pilot phase, there were over 1,500 total visits to FJC and Partners
• Over 643 new families accessed services during this same time
It’s working…
• 84% of FJC clients have children under the age of 18, and over half of these children are in common with the client’s abuser
• More than 1/3 of clients require services in languages other than English (most frequently Spanish, but also Tagalog, Vietnamese, and other)
…thanks to the community:• Clients have come to the FJC from over 56 different
referral sources (10% are friends and family referrals)over 56 different
referral sources 17WCCFJC 2014
How do survivors receive support from the Family Justice Center?Two Projects:
• Project Serve (Navigation & WINGS)• Project Connect (Community Building)
18WCCFJC 2014
Project Serve• Focuses on the context-specific needs and healing of
each survivor and family• Five areas:
• Domestic Violence• Sexual Assault• Child Abuse• Elder Abuse• Human Trafficking
19WCCFJC 2014
STEP 3 Getting Connected
STEP 4 Check Out and Exit
STEP 5Stay Connected
STEP 2 Navigator
A Navigator (*) will review the types of services available to you from a variety of agencies and help connect you with those who can address your needs. When talking to a Navigator you will determine some of the connections.
STEP 1Welcome to the Family
Justice Center
Tell us about you!
Before checking out make sure you have talked to the Client Navigator and had all of your questions answered and needs assessed. Schedule follow-up appointments.
Counseling and Family Therapy (*) Mental Health Counseling, Children’s Counseling, Parenting Support, Child Care
Advocates (*) Assistance with immediate crisis intervention, court accompaniment, restraining orders and many other resources.
Criminal Justice System (*) The Center partners with law enforcement entities in every city throughout West Contra Costa County.
District Attorney’s Office (*) Information about criminal cases, court outcomes and specialized programs design to help victims of violence.
Faith Based Support (*) Spiritual counseling and support for a variety of faith traditions.
Employment and Finances Address immediate financial crisis, get you back on your feet, and build financially secure futures.
Legal Services Information about legal processes, family court, legal representation and immigration services.
Health Care Receive patient financial counseling for health coverage.
Basic Needs Address food and clothing needs.Call us if you have any questions or want to schedule another visit. We are here for you.20WCCFJC 2014
21
Early Outcomes • It took time to make sense of the early data• The model was working• Our County’s first snapshot of multi-system
coordination• Celebrating the victories• Finding the gaps• Who’s missing?• Re-evaluating roles• Sustainability focused
WCCFJC 2014
Groundbreaking Celebration 11/1/2013
Project Connect Programming• Added in phase II of the pilot• Reach all members of the West County community• Stay connected longer with our clients• Support survivors on a deeper level, after the point
of crisis
22WCCFJC 2014
Project Connect Gatherings
• Survivors, community members, service providers
• Networking and information sharing
• Rotating topics • Moving the
conversation forward
23WCCFJC 2014
WINGS• Women INspired to
Grow and Succeed• 7-week workshop
series• Self-sufficiency for
survivors• Partnership with
local DV shelter program & culturally specific services
24WCCFJC 2014
Cooking Matters• Offered in
partnership with 18 Reasons
• 6-week workshop series
• Healthy, affordable family cooking and eating
• Survivors, community members
25WCCFJC 2014
What do we mean by “Collective Impact”?
• Evolving role within County collaborative • Shared vision for change• Shared measurement systems • Mutually reinforcing activities• Continuous communication• Backbone support organization
26WCCFJC 2014
Family Justice Center Backbone Functions:
• Guide vision and strategy• Support aligned activities• Establish shared measurement practices• Build public will• Advance policy• Mobilize funding
27WCCFJC 2014
WCCFJC 2014 28
New projects, new challenges
• County’s High Risk Team pilot
• Law Enforcement Training Project
29
Program Evaluation
• Early, unsophisticated data led to lots of questions• What are we measuring?• Are we aligned? If yes, in which areas?• How do we know what we are doing is effective?• How do we tell our story?• How do we include survivor voices?• How do we measure and communicate risk?
WCCFJC 2014
30
On The Horizon
On-going process, but has yielded big changes• Long-term needs assessment • Self-sufficiency and financial literacy• A focus on resilience and risk factors• Understanding poly-victimization and co-occurrence• Continue to evaluate how to best measure
effectiveness
WCCFJC 2014
What Works
EVIDENCE-BASED PRACTICE MODELS
ANALYTIC REPORTING
OUTCOMES CASE MANAGEMENT
PERFORMANCE MANAGEMENT
COLLABORATIVE & COLLECTIVE IMPACT
SOCIAL ROI
$
o
6
F
7
CASE MANAGEMENT IS A SCIENCE…WHICH CAN BE APPLIED BY ALL
WHAT WE KNOWlocal effort = individual, community & statewide outcomes
National & Statewide Data Sets
The research will reveal…
Benchmark Local Needs
Targeted Areas For
Improvement
Identify Programs and
EBPMMonitor Models
Delivered with Fidelity
Client-Level Impact
Community Level Impact
State Level Impact
WHERE IS THE SECTOR MOVING?
PUBLIC FUNDING IS FLOWING TO INNOVATIVE PRACTICE MODELS
THE RIGHT DATA REVEALS TRAJECTORY
TargetPopulation
E
E
EE
EE
Trajectory
Baseline
Effort = Cost = InvestmentFrequencyDuration
Type Impa
ct =
Ben
efit
= R
etur
n
Period of Service
THE RIGHT DATA CAN REVEALAPPROPRIATE INTERVENTIONS
TargetPopulation
Posi
tive
Impa
ct
Period of Service
E EE
E
EE
E
THE ART OF COLLABORATIONTHE MISSION: TO IMPROVE SERVICE ACROSS
ORGANIZATIONS
LEADAGENCY
R7
MODEL
DATA
pp
p
pp
p
p
p
p
COLLABORATION BEGINS:LOCALLY
7EVALUATION
k
6BENCH-
MARKING
eMONITOR-
ING
Partners work to achieve similar results,but struggle to learn critical lessons from their peers.
THE POWER OF DATA WITHIN EVALUATION
7EVALUATION
k
6BENCH-
MARKING
eMONITOR-
ING
Tools should be scalable and improve cross-agency data sharing and benchmarking
AS THE INTELLIGENCE GROWS:CITY-WIDE
7EVALUATION
k
6BENCH-
MARKING
eMONITOR-
ING
Building a community of practice improves agency performance and community-wide outcomes
THE SHARING EXPANDSSTATE
7EVALUATION
k
6BENCH-
MARKING
eMONITOR-
ING
Partners work to achieve similar results,but struggle to learn critical lessons from their peers.
THE KNOWLEDGE WE SHARE AFFECTS CHANGE
7EVALUATION
k
6BENCH-
MARKING
eMONITOR-
ING
Data collection tools must be scalable and improve cross-agency data sharing and benchmarking
WITH INFORMATION AND EVALUATION BEST PRACTICE CAN REPLICATE
7EVALUATION
k
6BENCH-
MARKING
eMONITOR-
ING
Building a community of practice improves agency performance and state-wide outcomes
LET’S GO NATIONWIDE WITH WHAT IS EFFECTIVE!
7EVALUATION
k
6BENCH-
MARKING
eMONITOR-
ING
Partners work to achieve similar results,but struggle to learn critical lessons from their peers.
WORKING TOWARD A NATIONAL BODY OF WORK
7EVALUATION
k
6BENCH-
MARKING
eMONITOR-
ING
A continual process is what makes this effort scalable, and improves cross-agency data sharing and benchmarking
WHAT STARTS LOCALLY INFORMS US NATIONALLY
7ANALYTICS
ETO
k
6BENCH-
MARKING
eMONITOR-
ING
ETO
ETO
ETO
ETO
ETO ETO
ETO
ETO
ETO
ETO
ETO
ETO
ETO
ETO
ETO
ETO
ETO
Community of practice improves agency performance and drives nation-wide outcomes
Confidential - Copyright, 2014 Social Solutions Global All Rights Reserved
“BUT YOU CAN’T MEASURE…”…the difference between counting how many and
assessing how well• Changes in attitude and behavior • Changes in perception• Changes in receptiveness to service or help• Incremental progress towards goals • Changes in condition
…yes you can!
“Data” and “Technology”can be scary words
No matter how advanced your technology becomes, it is still human beings helping human beings.
• Good technology and good data is an invaluable asset in service to victims – we don’t know what we don’t know
• The technology available today can reveal behavioral patterns and predictors, making us less reliant on anecdote but rather supported by evidence
• Applying a practice with fidelity
Different Victims Have Different Needsand different indicators of success
• Domestic Violence• Child Abuse• Poly Victimization• Financial Fraud• Elder Abuse• Human Trafficking – Minors • Human Trafficking – Adults
The More Precise We GetThe More Likely Our Model Can Predict Results
Agency
Services
Children
Victims
Offender/Ex Offender
Teens
Trajectory: Incremental Progress & Correlation
Agency
Services
Children
Offender
TeensVictims
Trajectory: The Calculus of Impact
Trajectory
Baseline
FrequencyDuration
Type
TargetPopulation
Impa
ct =
Ben
efit
= R
etur
n
Period of Service
Incremental Tracking Reveals Actual Trajectory
TargetPopulation
Posi
tive
Impa
ct
Period of Service
Stages of Change Model
Know where you are starting to get to where you need to be
0
10
20
30
40
50
60
Precontemplation Contemplation Preparation Action Maintenance
At Departure
0
10
20
30
40
50
60
Precontemplation Contemplation Preparation Action Maintenance
At Intake
The Power of Timing
DA Filed Charges
46%
No Charges Filed54%
Before
DA Filed Charges
65%
No Charges Filed35%
After Training
“Do the best you can until you know better. Then when you know
better, do better.”
Maya Angelou
Presenter InformationSusan Howley – Director of Public Policy
The National Center for Victims of Crime
202.467.8700
Melissa Caine-Huckabay - Director of Training and Technology
West Contra Costa Family Justice Center
510.965.4949
Nicole Geller – Director, Justice Initiatives
Social Solutions Global
317.409.7069
QUESTIONS&
ANSWERS
R Go ahead. Ask away.
