LEARNING FOR IMPACT - The Sobrato Organization · LEARNING FOR IMPACT Using Data to Improve...

SFFThrivingNonprofitSectorSeries2017May2017

LEARNINGFORIMPACTUsingDatatoImprovePerformance

Welcome!

3

Today’sspeakers

§ Presenter:

StevenLaFrance,FounderandCEO,LearningforAction

§ PanelSpeaker:

EliseCutini,CEOSiliconValleyChildren’sFund

Join the ConversationHave your cell phone ready to answer our poll questions throughout the presentation.

Text SOBRATOFDN to 22333 to join the conversation. You will receive text confirmation that you’ve joined the session

and can then respond to multiple polling questions.

You may also reply via web at PollEv.com/sobratofdn

Join us on twitter at #LearningforImpact

Today’sAgenda

9

ToolsandConceptsforEvaluationandLearning

CaseStudy:SiliconValleyChildren’sFund

IntroductiontoTheSobratoImpactLab

Closing,Lunch,&Networking

Objectives

10

Understandbasicconcepts

Becomeinspiredtotakeaction

Gainaccesstonewtoolsandresources

GetexcitedabouttheSobratoImpactLab

11

ToolsandConceptsforEvaluationand

Learning

WhyshouldIcare?

Todemonstrateeffectiveness

Todemonstrate

“socialreturnon

investment”

Todemonstrateandreplicatewhatworks

ToPROVE

Evaluationforaccountability,fundraising andpolicydevelopment

13

Toimproveprogramdesign

Toimprovepractice

Toinformstrategicplanning

anddecision-making

ToIMPROVE

Evaluationforlearning andcontinuousimprovement

14

Mostimportantly…

ToEMPOWERAndtakechargeofyour:

15

Whatneedstobeinplaceforevaluationand

learning?

The3C’sofEvaluationandLearning

18

*Values*CommunicationProcesses

*Relationships

*Time*Systems*Resources

Culture

ContinuousImprovement

*ProgramModel*TheoryofChange

*Data

WhatisaTheoryofChange?

19

Whatyoudo,why

Withwhom

Howyoudo

it

Towhatend

TheoryofChange:WritingDowntheRecipe

20

ComponentsofaTheoryofChange

21

2.ProgramModel

1.NeedThe“why”

a.TargetPopulationThe“who”

b.Components&ActivitiesThe“what”

c.OutcomesThe“Towhatend”

3.HypothesisThestakeintheground

YourDataRoadmap

22

TargetPopulation

Components&Activities Outcomes

Collectdataoneachpartofthemodel

Numbersserved,characteristics Participation Change

Questions?

24

CaseStudy:SiliconValleyChildren’sFund

EliseCutini,CEO

25

Silicon Valley Children’s Fund

MISSIONImproving education and life outcomes for foster youth.Foster youth in Silicon Valley are self-reliant.① Youth-advised innovation② Cost-effective social solutions③ Cross sector collaboration

VISION

VALUES

① Identify gaps in services② Convene partners to develop strategies③ Create, test, and scale innovative solutions

STRATEGY

N=All Target for Santa Clara County (~600 between the ages of 14-21)

2016

2017

2018

2019

► Served 384 youth

► Serving 400 youth

► Target 445 youth

► Target 518 youth

3% FY National College Graduation Rate

SVCF Scholars graduate college at 10x the National Rate

A 10-year commitment to self-reliance for foster youth.

The Evolution to becoming a stronger learning organization

Data in ExcelSet metrics and targets

Program year-end reports, challenging our outcomes

Employee performance tied to outcome and output objectives

All-staff annual continuous improvement retreat to set objectives

Developed Program Model and Theory of Change, implemented new data system

Utilizing real-time data on program quality, engagement and progress

►2009 ►2012 ►2013 ►2015 ►2016 ►2017

Proving

Improving without a point of reference

Improving with data against theory of change

28

Why should we do this data collection & evaluation?

►Leads to good questions and important conversations►Creates curiosity, allowing for creativity►Builds strong storytelling about why you are doing this and

how it is having an impact►Moves you away from a “one-size-fits-all” approach►Keeps employees engaged, builds ownership

►Builds innovation into your culture…we all love to create!

29

Ways to get started at any level

Reward Curiosity

Get comfortable with “bad” information

Inject culture with continuous improvement

Gather constituent voice

Start measuring what you can

Keep it simple and have fun with it

Internal reflection, not external selling

30

Start at the end and work your way backwards

Why you do what you do How you do it What you

claim to do

What your constituents

say / think you do

►What can you measure in each of these areas?

Opportunities for learning and improving areembedded in each of these!

LearningfromtheData:SiliconValleyChildren’sFund

“Step Up” Program Recruiting Pipeline

KeyTakeaways:§ Only8youthmetthe

originaltargetpopulationcriteriaasdefinedinourTheoryofChange.

§ WeexpandedeligibilitybyusingabroaderGPArangeandloweredtheminimumnumberofunitsaccumulated.

70

61

8

0

10

20

30

40

50

60

70

80

#of12thGradersinFosterCarein

SCC

RecordsReviewed

MetCriteria

Step Up Program:Student Engagement by Activity

16

13

1110

98

4

7

4

109

12

0

2

4

6

8

10

12

14

16

18

20

SUCommitmentLetterSigned

Receivedanytutoring

Referredfortutoring

CompletedYESApplication

Atleast1CCPlacementTestPrepSession

Orientation

StudentEngagement

Yes No

KeyTakeaways:§ Student

engagementinprogramactivitiesvaries.

§ Wewanttoincreasethenumberofstudentsreceivingtutoring.

OnTrack85%

NotOnTrack15%

Step Up Student Progress:On Track To Graduate

Ourontrackgraduationgoalwas80%.Weareexceedingthisgoal!

N=20OnTracktoGraduate

GradPlan55%

NoGradPlan,45%

N=20

MetwithCoachandAcademicCounselorforGraduationPlan

PairShare:

WhatisonethingthatyouwilltakeawayANDDO basedonthepresentationandcasestudy?

36

PurposeoftheImpactLab

Expandandaccelerateeffortstoevaluateandlearnfrom

theimpactofyourwork

ProgramDetails

1. FullGroupInstructionalSessionsØ Twofull-daysessionsperyearwith2-3participantsperorganizationusinginstruction,breakoutsessionsandpeerlearning

2. CoachingØ 8hourspermonthperorganizationoftailoredone-on-onecoachingwithaseasonedconsultant

3. ReflectionandLearningØ Ongoingassessmentofwhat’sworkingandwhatcouldbeimproved

Timeline

Sept‘17

Feb‘18

LearningSession1LayingtheFoundation

withTheoryofChange

LearningSession2DevelopingMetricsandMeasurement

Tools

Sept‘18

Feb‘19

LearningSession3

AnalyzingandReportingonDatafor

ReflectionandLearning

LearningSession4

SustainablyEmbeddingData-DrivenLearning

withintheOrganization

Phase1 Phase2

Mar‘19

InitiativeCompletion

Event

Questions?

41

Thankyou!