Embed Size (px)
Citation preview
Programme Design
for Impact
14 July 2016
What I’ll cover…
Why we’re interested in measuring behaviour change
Some of the challenges
How we design behaviour change interventions so we can measure them
Some tips and ideas for how to
do it better
Why we’re interested in measuring behaviour change
We have been trying to change behaviour for over 60 years… but can we evidence whether or not our work is successful in achieving the changes in behaviour we want to see?
Why we’re interested in measuring behaviour change
We know that we can no longer talk about how we think or feel our work changes behaviour… we have to be able to collect evidence which enables us to talk confidently about how our work changes behaviour.
What are the challenges?
• Finding funding to monitor and evaluate
• Balancing the cost of evaluation against the cost of the intervention
• Having the appropriate expertise in-house
• What if it doesn’t work? Managing risk of failure
• It is difficult!
Centre for Social Innovation
• Launched in 2015 after two years of development
• Provides expertise and capacity within our busy organisation
• Utilises experience and intelligence from staff, volunteers, clients and networks
• Enables us to take risks and to fail
• Successful interventions are scaled out through our networks
How do we do it – Our Approach
1. Define the problem/behaviour
2. Design interventions
3. Test interventions in the field
4. Scale
• What do we know about the problem/behaviour?
• What is happening? Where is it happening? Who is doing it? When are they doing it? Why are they doing it?
• What are the gaps in our knowledge about the problem/behaviour? How can we address these?
• What is the change we want to see? Set environmental, social and /or economic objectives
1. Define the problem/behaviour
2. Design interventions
• What research, insights or trials are out there that we can use to help us?
• How can we manipulate cues and norms?
• Can we use tools like EAST Framework and Values and Frames?
• How could it be replicated by others at scale? How?
Case Studies
3. Testing interventions
1. Has the intervention been successful in delivering the change I wanted to see?
2. Have their been any unintended impacts, good or bad?
3. What would improve the intervention?
4. Should we look to scale the intervention or is further testing needed?
3. Testing interventions
• Who will we work with?
• Where will we test our intervention?
• When will we test it?
• How are we planning to monitor success?
- What data will identify the effectiveness?
- How will we collect that data?
- Do we need a baseline/control condition?
- Have we included sufficient measures?
4. Scale
- Refine and improve
- Think about what it was that made the change and ensure that is retained in any version for scaling
• Work in partnership with others from the start• Set clear roles and responsibilities for partners involved in
delivery• Keep monitoring simple • Think about whether the time right• Conduct site visits • Do some qualitative research • Communicate about what you’re doing to the right people
at the right time • Keep going back to your aim and objectives • Keep questioning your rationale for monitoring something
in a certain way
Some practical tips
Visit the CharityComms website
to view slides from past events,
see what events we have
coming up and to check out
what else we do:
www.charitycomms.org.uk
14 July 2016
London
#CCbehaviourchange
Developing
behaviour change
campaignsSponsored by
WiFi: CCTVenues_Canary_Wharf_SQ
Password: CCTV3nu3s
