View
0
Download
0
Category
Preview:
Citation preview
BEYOND VOLUNTEERING: MEASURING THE SOCIAL IMPACT
CASE STUDY -‐ VOLUNTEERING MATTERS
March 2018
Thaddaeus Douglas, Impact and Evalua<on Manager at Volunteering Ma?ers
Aims and objecBves
Aim: provide an overview of our impact and evalua<on framework
Objec<ves:
Volunteering Ma?ers
The steps taken to develop our framework
Making the case for evalua<on and impact
Statement of purpose
Introduc<on to the framework: data collec<on across three levels
Preliminary results
What next?
1.
2.
3.
4.
5.
1
6.
7.
Volunteering MaQers
2
Volunteering MaQers is a naBonal charity leading UK volunteering in policy and pracBce.
Vision: a society in which everyone can par<cipate in their community through volunteering.
Mission: to invest in people’s ability to volunteer, thereby reducing inequali<es and isola<on, improving health and wellbeing and building a stronger and more inclusive society.
Our values: Honest and transparent Collabora<ve Ambi<ous Innova<ve Inclusive
Volunteering MaQers
3
Volunteering MaQers
Strategic priori<es:
To increase our reach and impact
To provide the best possible experience for volunteers and ensure their voices are heard
To provide leadership on effec<ve volunteering, influencing public policy and public service design
4
The steps taken to develop our framework
5
Source: NPC – Four Pillars Approach
Strategic vision Leadership
Case for impact measurement
Map your theory of change
PrioriBse what you measure
Choose the level
of evidence
Select your source
and tools
EffecBve measurement framework developed Step 1 – Map your theory of
change
Step 2 – Priori<se what you measure
Step 3 – Choose your level of evidence
Step 4 – Select your sources and tools
THE RESOURCES
VOLUNTEER TIME
STAFF TIME AND SALARY
ADVERTISING AND RECRUITMENT MATERIALS
INDUCTION AND TRAINING MATERIALS
VOLUNTEER EXPENSES
THE THINGS YOU DO WITH RESOURCES
VOLUNTEER INDUCTION AND TRAINING
HOME VISITS
THE PRODUCTS OR SERVICES THAT A PROGRAMME DELIVERS
NUMBER OF VOLUNTEER SESSIONS
NUMBER OF FAMILIES VISITED
THE INTEMEDIARY CHANGES, BENEFITS AND OTHER RESULTS THAT A PROGRAMME BRINGS ABOUT
INCREASE IN SOCIAL CONTACT FOR PARENTS
INCREASED ACCESS TO LOCAL ACTIVITIES / SERVICES FOR FAMILIES
INCREASED CONFIDENCE AND SELF ESTEEM
THE BROAD LONG-‐TERM EFFECTS OF THE PROGRAMME OR PROJECT
REDUCED ISOLATION OF FAMILIES
IMPROVED LIFE CHANCES OF CHILDREN
GREATER AWARENESS OF VOLUNTEERING
INPUTS ACTIVITIES OUTPUTS OUTCOMES IMPACT
Source: Volunteer Impact Assessment Toolkit
The steps taken to develop our framework
6
Source: Volunteer Impact Assessment Toolkit
Human capital
People’s knowledge, skills and health
Economic capital
Benefits or costs with financial value
Social capital
More coopera:ve rela:onships between people
Cultural capital
A sense of one’s own iden:ty and understanding of others iden:ty
Volunteers • Increased personal development, such as growth in confidence and self esteem • Increased skills such as digital • Improved health
• Increased access to training • Increased employment prospects • Increased earning power
• New friendships, contacts and networks • Greater involvement in ac<vi<es • Enhanced sense of trust in others
• Be?er understanding of own’s own iden<ty • Greater apprecia<on of other people’s cultures
OrganisaBons • Increased personal development of staff • Increased levels of skills for the organisa<on
• Increase in financial value / increased costs to organisa<on for involving volunteers • Greater income for the organisa<on
• More volunteers and staff a?racted to the organisa<on • Greater connec<on to community • Enhanced reputa<on
• Services are more reflec<ve of cultural diversity • Greater diversity of organisa<on
Beneficiaries • Increase personal development • Increased skills • Improved physical or mental health • Greater sense of wellbeing among beneficiaries
• Increase access to services that they would otherwise have to buy • Increased employability • Improved financial situa<on for beneficiaries through services and signpost provided
• New friendships • Enhanced trust in others • Greater involvement in local ac<vi<es
• Greater sense of belonging to a group and taking part in culture and expressing values • Increased understanding of other people’s cultures
Community • Greater health and wellbeing of ci<zens • Improved skills – produc<ve workforce
• Enhanced value for money in public services • Increased employment • Reduced an<-‐social behaviour
• Increase social networks • Enhanced trust and par<cipa<on • More organisa<ons working together
• Richer cultural life • Greater tolerance of others
7
Source: NPC – A journey to greater impact – NPC approach to developing an impact measurement framework for an organisa<on
Get backing Develop systems Use data Review
1. Find senior champs
2. Make the case
for measure
3. Get external support
4. Designate an impact
lead
5. Develop a tailored system
6. Train frontline staff
7. Use results to improve
8. Publicise your results
9. Review and
improve your system
The steps taken to develop our framework
8
Making the case for data collecBon
To demonstrate our value
To showcase our achievements
To learn and improve
To facilitate income generaBon
opportuniBes
To show we are high performing
To screen and demonstrate need
To raise our profile in the sector
To increase effecBveness and beQer results
To ask difficult quesBons of ourselves
To make reliable assessment about expansion and scale
To understand what works and what
doesn’t
InformaBon readily available
To inform and influence policy
To assess progress towards targets
Useful informaBon to aid decision-‐
making
To allocate resources
To beQer allocate resources
To get the best results for
beneficiaries
To understand unintended benefits
and limitaBons
To determine success factors
To inform future prioriBes
To refine or make clear your mission
and purpose
Creates accountability and
transparency
To help funders make the right
decisions
9
We collect informaBon across three levels…
Level 1 – Universal StaBc demographic data and key outcomes for all volunteers and beneficiaries
Level 2 – Pillar specific Key outcomes we measure of our work in four strategic pillars (young people, disabled people, families and older people) meaning we are consistent with measures between groups.
Level 3 – Programme specific
Key outcomes we measure within a specific programme.
10
LEVEL 1 UNIVERSAL – 5 CORE ‘ASKS’ FOR ALL PROGRAMMES – WHAT WE EXPECT TO COLLECT FROM ALL VOLUNTEERS AND BENEFICIARIES
Gender Date of Birth (Age) Postcode Ethnicity Disability
Religion English as a second language Place of birth / na<onality Sexuality Economic ac<vity
LEVEL 1 UNIVERSAL – 2 CORE OUTCOMES FOR ALL PROGRAMMES – BASELINE AND FOLLOW-‐UP (BEFORE AND AFTER) – WHAT WE EXPECT TO COLLECT FROM ALL VOLUNTEERS AND BENEFICIARIES
Ci<zenship and involvement in the community
Wellbeing
Level 1 Universal
11
LEVEL 2 PILLAR SPECIFIC – WE EXPECT ALL PROGRAMMES TO MEASURE AT LEAST TWO OF THEM (NOT ALL OF THEM)
YOUNG PEOPLE ARE BETTER PREPARED FOR ADULTLIFE
DISABLED PEOPLE FULFILL THEIR POTENTIAL
FAMILIES ARE LESS ISOLATED AND BETTER SOCIALLY ENGAGED
OLDER PEOPLE HAVE IMPROVED HEALTH AND WELLBEING
(1) Access to educa<on, employment and training / keeping in educa<on, employment or training / economic ac<vity
(2) Be?er life and employability skills
(3) Increased confidence and self esteem
(1) Improved mental wellbeing
(2) Be?er par<cipa<on and inclusion / greater involvement
(3) Increased independence and independent living skills
(1) Improved family mental health / family func<oning
(2) Improved parental skills
(3) Reduc<on in the number of children who come off a CPP / CiN plan reduced risk of being on a Child Protec<on Plan or moving into care
(1) Reduced isola<on and loneliness
(2) Increased sense of purpose
(3) Maintained health
Level 2 Pillar Specific
12
LEVEL 3 PROGRAMME SPECIFIC – THE KEY OUTCOMES WE MEASURE WITHIN A SPECIFIC PROJECT
YOUNG PEOPLE ARE BETTER PREPARED FOR ADULTLIFE
DISABLED PEOPLE FULFILL THEIR POTENTIAL
FAMILIES ARE LESS ISOLATED AND BETTER SOCIALLY ENGAGED
OLDER PEOPLE HAVE IMPROVED HEALTH AND WELLBEING
Examples… (1) Gain qualifica<ons
and accredita<on (2) Be?er aspira<ons (3) Be?er knowledge
about healthy rela<onships
Examples… (1) Reduced reliance on
state services (2) Less isolated (3) Improved aitudes
or percep<ons towards disabled people
Examples… (1) Economic ac<vity (2) Health ea<ng –
reducing child obesity
(3) Reducing domes<c violence
Examples… (1) Improved physical
health and mobility (2) Improved
independence (3) Be?er quality of
life / ageing be?er
Level 3 Programme Specific
13
Preliminary results – Level 1 Gender
Age
Ethnicity
Male Female Totals
Grandmentors A 82 (50%) 83 (50%) 166
Local authority A 210 (60%) 140 (40%) 355
Grandmentors B 48 (60%) 32 (40%) 80
Local authority B 160 (58%) 120 (42%) 280
Grantmentors Totals 130 (53%) 115 (47%) 245
England 39,670 (56%) 30,780 (44%) 70,440
London 5,830 (59%) 4,030 (41%) 9,860
1%
5%
28%
57%
9%
1%
8%
35%
56%
0%
0%
0%
16%
59%
25%
26 and over
23 to 25
20 to 22
17 to 19
14 to 16
Asian or Asian Bri<sh 25%
Black or Black Bri<sh 25%
Mixed 4%
Other 3%
Other ethnic group 7%
White 36%
Asian or Asian Bri<sh
Black or Black Bri<sh
Mixed
Other
Other ethnic group
White
Area by Index of MulBple DeprivaBon % of LSOAa by Decile 1 = most deprived, 10= least deprived
1.49%
1.49%
1.49%
1.49%
1.49%
10.45%
10.45%
17.91%
40.30%
13.43%
10
9
8
7
6
5
4
3
2
1
14
Preliminary results – Level 2
Grandmentors Total Local authority A NaBonal rate*
Local authority A rate*
In educa<on employment and training / volunteering (EET)
95% 96% 49% 59%
Not in educa<on employment and training / volunteering (NEET)
5% 4% 40% 36%
Remained in educa<on, employment, training / volunteering**
50% 38% -‐ -‐
Moved from not in educa<on, employment or training / volunteering to educa<on, employment or training / volunteering (NEET to EET)
43% 58% -‐ -‐
Remained NEET 5% 4% -‐ -‐
Analysis based on the most recent 40 cases where follow-‐up data is available shows that 43% moved from being NEET to EET.
Data shows that Grandmentors have supported half (50%) of the mentees to remain in educaBon, employment or training.
As illustrated in the table above, the naBonal rate at which care leavers aged 19, 20 and 21 are in educaBon, employment or training is at 49% Compared to 95% of care leavers supported by Grandmentors.
*Source: HM Government & Office of Na<onal Sta<s<cs – ‘Children looked aoer in England including adop<on: 2015 to 2016, published Feb 2017
15
VOLUNTEERING MATTERS MODEL OF INTERVENTION – SPORTING CHANCE THEORY OF CHANGE (LEVEL 3 & 4)
Needs Ac<vi<es Intermediate Outcomes Impact & long term goals
Increased par<cipa<on, building strong and inclusive communi<es
Older men are less isolated and
lonely Older men engage in more physical, social and health ac<vi<es
Older men eat more healthily
Male life expectancy is
less than female
Health inequali<es and
health challenges
Older men are at risk of isola<on and loneliness
Older men have an increased sense of purpose
Older men have increased
connec<on to the community
Older men are more likely to maintain and improve social
networks
Older men aged 50 and over design and
deliver a range of inclusive physical ac<vi<es from walking football to armchair
exercise for the benefit of other
older me
Older men engage in social ac<vi<es such as reminiscence
sessions
Older men engage in informa<on sessions and
health promo<on
ac<vi<es in non-‐tradi<onal healthcare seings
All male environments are cri<cal to engaging
older men
Informal physical, social or health
related a ac<vi<es are best delivered
away from tradi<onal
‘healthcare’ or ‘sports / fitness’
facili<es
Ac<vi<es delivered at different <mes
of the day, par<cularly in the evening are best suited for older
men
Outcomes of the induc<on, training and support mean volunteers have sufficient skills, knowledge AND
confidence enabling them to
deliver the ac<vi<es
Older men feel reassured
Older men feel more valued
Older men feel more engaged
Older men more likely to engage with services early on
Assump<ons
KEY
Ac<vi<es
Assump<ons
Intermediate outcomes
Ul<mate goal
Evidence from Spor<ng Chance Sheffield in 2017
Older men have improved health and wellbeing
Older men are more physically
ac<ve
Older men feel empowered
Outcomes for the volunteers and beneficiaries
Older men make new friendships
Accountability line
Older men feel more confident
83% feel empowered to take control of their own lives
96 ac<vity sessions delivered in 2017, exceeding the target of 30
100% made new friends
67% are ea<ng a healthier diet
83% are more confident
100% agree that SporBng Chance has given them a new lease of life
100% said that SporBng Chance has helped them connect with the local community, with 83% agreeing a lot
Two thirds (67%) said that SporBng Chance has helped them to beQer manage their health condiBon
Wellbeing life saBsfacBon score increased from an average of 5.9 at the start to 6.6 arer six months; feeling worthwhile score increased from 6.3 to 7.3 and happiness score increased from 6.0 to 6.3
33% smoke less, 17% reduced their medicaBon, 50% drink less alcohol, 67% have been to the doctor less
83% can move more easily
On a scale range from 5 to 25 (where higher scores indicate higher levels of loneliness), SporBng Chance parBcipants average a score of 9.9 at the beginning, reducing to 6.8 arer six months.
At the beginning, 71% felt strong belonging to their immediate neighbourhood, rising to 83% arer. The average for people aged 75 and over is 85%. The average for people aged 50 and over is around 79%
16
What next?
17
Further informaBon
Thaddaeus Douglas – Impact and Evalua<on Manager at Volunteering Ma?ers thaddaeus.douglas@volunteeringma?ers.org.uk
18
Recommended