Introduction to Impact Assessment This introduction uses the Weavers Triangle, designed by Jane...

Introduction to Impact AssessmentThis introduction uses the Weaver’s Triangle, designed by Jane

Weaver it has been developed by the Charities Evaluation Service

(CES) as part of their monitoring and evaluation model.

helps you identify the aims and objectives, so you can put in place methods for monitoring and evaluating the work you are carrying out using performance indicators such as:Impact or outcome and Output measures

The Weaver’s triangle

Self evaluation cycle

Needs assessment

OVERALL AIM

Statements about different aspects of your main purpose

SPECIFIC AIMS

What you are hoping to achieve

Identify what you will do

OBJECTIVES

Taken from Practical monitoring and evaluation – Charities evaluation services

The Weaver’s Planning Triangle

SPECIFIC AIMSThe changes or differences we want to make

OBJECTIVESWhat we do to make those changes

Ada

pted

from

CE

S P

lann

ing

Tria

ngle

dev

elop

ed b

y Ja

ne W

eave

r

1:1 tutorials promote independent learning skills

- learners able to manage their own work- timely support for learners at risk - late hand-ins and drop out reduced - Increased learner confidence - tutors use the learning conversation effectively

▪ 1 year pilot managed by the Senior Tutor▪ Learning Conversation training for Advanced Practitioners (APs)▪ APs train programme teams ▪ Learner assessment for baselines ▪ Mentor support for tutors▪ Monitoring and evaluation of pilot

AIMLonger

term effect

The Triangle in context

Aims relate to outcomes & impact

Aims = the benefits or changes you are trying to achieve

The overall aim should relate to the impact you are trying to achieve

The specific aims should be linked to the outcomes

start with words that indicate a change, for example: to increase, to enable, to develop, to improve etc.

Objectives = the methods or the activities by which you achieve your aims

The objectives should link to the products or outputs from your activities (eg events held, leaflets distributed, observations made)

start with words that indicate activity, for example: to organise, to produce, to set up etc.

Objectives relate to products or outputs

OVERALL AIM

OUTCOMES

WHY we do it

Purposes

WHAT we do

Activities

SPECIFIC AIMS

IMPACT

OUTPUTSOBJECTIVES

Taken from Practical monitoring and evaluation – Charities evaluation services

The Weaver’s Planning Triangle

OUTCOMESThe changes or differences we want to make

OUTPUTS/ACTIVITIESWhat we do to make those changes

What outcome measures will we use?

How will we monitor the outputs?

Ada

pted

from

CE

S P

lann

ing

Tria

ngle

dev

elop

ed b

y Ja

ne W

eave

r

1:1 tutorials promote independent learning skills

- learners able to manage their own work- timely support for learners at risk - late hand-ins and drop out reduced - Increased learner confidence - tutors use the learning conversation effectively

▪ 1 year pilot managed by the Senior Tutor▪ Learning Conversation training for Advanced Practitioners (APs)▪ APs train programme teams ▪ Learner assessment for baselines ▪ Mentor support for tutors▪ Monitoring and evaluation of pilot

AIMLonger

term effect

The Triangle in context

What are outputs?

Outputs are linked to the project objectives

Outputs are all the detailed activities, services and products connected to the project. Eg training events, materials, leaflets, visits, observations etc

Objective: Set up ‘surgeries’ to discuss the new-build

Outputs:•Drop in sessions for staff and the public to meet the

senior executive and estates manager in the organisation

•Targeted consultation and advice sessions

Eg with learners with particular needs and their carers.

Output example

Output Indicators

The indicators are what you can use to assess whether you have achieved your outputs

They assess progress towards meeting your project objectives

They are a type of performance indicator

Output

•Drop in sessions for staff and the public to meet the senior executive and estates manager in the organisation

Output indicators:

•Number of drop in sessions

•Number of people attending

•Types of drop in sessions

•Profile of people attending

Output indicators, example

What are outcomes?

Outcomes are linked to the specific aims

Outcomes are the changes, benefits, learning or other effects that actually occur as a result of your activities. They can be expected or unexpected, positive or negative.

•are how you assess whether an expected outcome is occurring and assess progress towards meeting an aim

•Impact and outcome measurement is basically about the same thing, a change that results from the improvement actions taken

•Outcome indicators are a performance indicator and can be qualitative or quantitative

Outcome indicators or measures

Specific aim: To improve the cascading of information regarding the new-build across the organisation and in the local community

Outcomes:• Increased knowledge of the new-build programme

• Increased marketing of the organisation

• Increased confidence and reputation

What indicators or measures could you use?

Outcome example

Use the indicators for monitoring

•Collate information on your output indicators to show outputs have been delivered and to show progress towards meeting targets.

•Collect information on your outcome indicators to demonstrate that outcomes are achieved.

Collect baseline information before you start, in order to measure the impact of your improvement actions

Monitoring outputs and outcomes