Embed Size (px)
Citation preview
SFFThrivingNonprofitSectorSeries2017May2017
LEARNINGFORIMPACTUsingDatatoImprovePerformance
Welcome!
3
Today’sspeakers
§ Presenter:
StevenLaFrance,FounderandCEO,LearningforAction
§ PanelSpeaker:
EliseCutini,CEOSiliconValleyChildren’sFund
Join the ConversationHave your cell phone ready to answer our poll questions throughout the presentation.
Text SOBRATOFDN to 22333 to join the conversation. You will receive text confirmation that you’ve joined the session
and can then respond to multiple polling questions.
You may also reply via web at PollEv.com/sobratofdn
Join us on twitter at #LearningforImpact
Today’sAgenda
9
ToolsandConceptsforEvaluationandLearning
CaseStudy:SiliconValleyChildren’sFund
IntroductiontoTheSobratoImpactLab
Closing,Lunch,&Networking
Objectives
10
Understandbasicconcepts
Becomeinspiredtotakeaction
Gainaccesstonewtoolsandresources
GetexcitedabouttheSobratoImpactLab
11
ToolsandConceptsforEvaluationand
Learning
WhyshouldIcare?
Todemonstrateeffectiveness
Todemonstrate
“socialreturnon
investment”
Todemonstrateandreplicatewhatworks
ToPROVE
Evaluationforaccountability,fundraising andpolicydevelopment
13
Toimproveprogramdesign
Toimprovepractice
Toinformstrategicplanning
anddecision-making
ToIMPROVE
Evaluationforlearning andcontinuousimprovement
14
Mostimportantly…
ToEMPOWERAndtakechargeofyour:
15
Whatneedstobeinplaceforevaluationand
learning?
The3C’sofEvaluationandLearning
18
*Values*CommunicationProcesses
*Relationships
*Time*Systems*Resources
Culture
ContinuousImprovement
*ProgramModel*TheoryofChange
*Data
WhatisaTheoryofChange?
19
Whatyoudo,why
Withwhom
Howyoudo
it
Towhatend
TheoryofChange:WritingDowntheRecipe
20
ComponentsofaTheoryofChange
21
2.ProgramModel
1.NeedThe“why”
a.TargetPopulationThe“who”
b.Components&ActivitiesThe“what”
c.OutcomesThe“Towhatend”
3.HypothesisThestakeintheground
YourDataRoadmap
22
TargetPopulation
Components&Activities Outcomes
Collectdataoneachpartofthemodel
Numbersserved,characteristics Participation Change
Questions?
24
CaseStudy:SiliconValleyChildren’sFund
EliseCutini,CEO
25
Silicon Valley Children’s Fund
MISSIONImproving education and life outcomes for foster youth.Foster youth in Silicon Valley are self-reliant.① Youth-advised innovation② Cost-effective social solutions③ Cross sector collaboration
VISION
VALUES
① Identify gaps in services② Convene partners to develop strategies③ Create, test, and scale innovative solutions
STRATEGY
N=All Target for Santa Clara County (~600 between the ages of 14-21)
2016
2017
2018
2019
► Served 384 youth
► Serving 400 youth
► Target 445 youth
► Target 518 youth
3% FY National College Graduation Rate
SVCF Scholars graduate college at 10x the National Rate
A 10-year commitment to self-reliance for foster youth.
The Evolution to becoming a stronger learning organization
Data in ExcelSet metrics and targets
Program year-end reports, challenging our outcomes
Employee performance tied to outcome and output objectives
All-staff annual continuous improvement retreat to set objectives
Developed Program Model and Theory of Change, implemented new data system
Utilizing real-time data on program quality, engagement and progress
►2009 ►2012 ►2013 ►2015 ►2016 ►2017
Proving
Improving without a point of reference
Improving with data against theory of change
28
Why should we do this data collection & evaluation?
►Leads to good questions and important conversations►Creates curiosity, allowing for creativity►Builds strong storytelling about why you are doing this and
how it is having an impact►Moves you away from a “one-size-fits-all” approach►Keeps employees engaged, builds ownership
►Builds innovation into your culture…we all love to create!
29
Ways to get started at any level
Reward Curiosity
Get comfortable with “bad” information
Inject culture with continuous improvement
Gather constituent voice
Start measuring what you can
Keep it simple and have fun with it
Internal reflection, not external selling
30
Start at the end and work your way backwards
Why you do what you do How you do it What you
claim to do
What your constituents
say / think you do
►What can you measure in each of these areas?
Opportunities for learning and improving areembedded in each of these!
LearningfromtheData:SiliconValleyChildren’sFund
“Step Up” Program Recruiting Pipeline
KeyTakeaways:§ Only8youthmetthe
originaltargetpopulationcriteriaasdefinedinourTheoryofChange.
§ WeexpandedeligibilitybyusingabroaderGPArangeandloweredtheminimumnumberofunitsaccumulated.
70
61
8
0
10
20
30
40
50
60
70
80
#of12thGradersinFosterCarein
SCC
RecordsReviewed
MetCriteria
Step Up Program:Student Engagement by Activity
16
13
1110
98
4
7
4
109
12
0
2
4
6
8
10
12
14
16
18
20
SUCommitmentLetterSigned
Receivedanytutoring
Referredfortutoring
CompletedYESApplication
Atleast1CCPlacementTestPrepSession
Orientation
StudentEngagement
Yes No
KeyTakeaways:§ Student
engagementinprogramactivitiesvaries.
§ Wewanttoincreasethenumberofstudentsreceivingtutoring.
OnTrack85%
NotOnTrack15%
Step Up Student Progress:On Track To Graduate
Ourontrackgraduationgoalwas80%.Weareexceedingthisgoal!
N=20OnTracktoGraduate
GradPlan55%
NoGradPlan,45%
N=20
MetwithCoachandAcademicCounselorforGraduationPlan
PairShare:
WhatisonethingthatyouwilltakeawayANDDO basedonthepresentationandcasestudy?
36
PurposeoftheImpactLab
Expandandaccelerateeffortstoevaluateandlearnfrom
theimpactofyourwork
ProgramDetails
1. FullGroupInstructionalSessionsØ Twofull-daysessionsperyearwith2-3participantsperorganizationusinginstruction,breakoutsessionsandpeerlearning
2. CoachingØ 8hourspermonthperorganizationoftailoredone-on-onecoachingwithaseasonedconsultant
3. ReflectionandLearningØ Ongoingassessmentofwhat’sworkingandwhatcouldbeimproved
Timeline
Sept‘17
Feb‘18
LearningSession1LayingtheFoundation
withTheoryofChange
LearningSession2DevelopingMetricsandMeasurement
Tools
Sept‘18
Feb‘19
LearningSession3
AnalyzingandReportingonDatafor
ReflectionandLearning
LearningSession4
SustainablyEmbeddingData-DrivenLearning
withintheOrganization
Phase1 Phase2
Mar‘19
InitiativeCompletion
Event
Questions?
41
Thankyou!
