GEAR projectGEAR project

Process Evaluation

Overview of GEAR Evaluation ComponentsOverview of GEAR Evaluation Components

Outcomes Multi-component internal evaluation

External evaluator: Prof. Carol Hagemann-White, University of Osnabrück, DE

External Evaluation

InternalEvaluation

EFFECTIVENESS EVALUATION

Teachers’ Seminar

Teachers’ Seminar

pre- and post- training questionnaires test the teachers’ training effectiveness

post- training questionnaires assess seminar’s procedures and identify potential

facilitators/barriers for future implementation

pre- post- and follow-up questionnaires (intervention & control group)

test the effectiveness of GEAR Workshops in classes

pre- post- and follow-up questionnaires (teachers implementing workshops)

test the impact of GEAR Workshops in classes

post- training questionnaires (students & teachers) assess workshops’ procedures and identify potential

facilitators/barriers for future implementation

PROCESS EVALUATION

EVALUATION OF MASTER GEAR PACKAGE

TEACHER’S MANUAL & STUDENTS’ HANDOUTS EVALUATION

OutlineOutline

Overview

Aim & Objectives

Method

Schedule of Process Monitoring Reporting

Monitoring Tools

OverviewOverview

Monitoring data collection:Baseline data: activities to be implemented at specific times, available budget per activityData Source documents: agreed work plan and contractual budgetPerformance targets: implementation of all planned activities, on time, within the provisioned budgetTool for data collection: process monitoring checklistsFrequency of data collection: every 3 or 6 months respectivelyInvolved parties: External Evaluator, Coordinator & Partners

Data flow

Data synthesis & reporting Coordinator will undertake synthesis of data provided by all partners, as follows:

Monitoring of activities: every 3 monthsMonitoring of expenditures: every 6 monthsMonitoring of dissemination activities: every 6 months

Final reporting: External Evaluator

Template 1

Template …

Template 8

Coordinator to Partners

1st Process Evaluation Form

… Process Evaluation Form

8th Process Evaluation Form

Partners to Coordinator

1st Process Evaluation Report

… Process Evaluation Report

8th Process Evaluation Report

Coordinator to External Evaluator

Final Report

based on the 8

Process Reports

Coordinator All Partners Coordinator ExternalEvaluator

AIM & ObjectivesAIM & Objectives

AimMonitoring & tracking of the implementation progress Timely identification of potential deviations/ problems Decision making & undertaking corrective actions Smooth implementation

Secondary ObjectivesSystematic, consistent and reliable information on project progressFacilitation of the project’s reporting

MethodMethod

Method Measure actual results against expected results

Continuous comparison among actual performance

AND

work plan scheduled activities execution time table timely execution of the activities budget implementation according provisions expected quality quality of final deliverables

Schedule of Process Monitoring ReportingSchedule of Process Monitoring Reporting

DurationThroughout the project

8 Process evaluation reportsEvery 3-month period

No Sent template

Progress report

Content of Progress report

1st 5.2.2010 26.2.2010 Implementation progress + Financial report

2n

d30.4.2010 31.5.2010 Implementation progress + Dissemination

report

3rd 31.7.2010 31.8.2010 Implementation progress + Financial report

4th 31.10.2010 30.11.2010 Implementation progress + Dissemination report

5th 31.1.2011 28.2.2011 Implementation progress + Financial report

6th 30.4.2011 31.5.2011 Implementation progress + Dissemination report

7th 30.7.2011 31.8.2011 Implementation progress + Financial report

8th 30.9.2011 30.11.2011 Implementation progress + Dissemination report

Feb 10 May

10Aug 10

Nov 10

Feb 11 May 11

Aug 11

Nov 11

G E A R A G A I N S T I P V - I M P L E M E N T A T I O N

Dec 09Grant

Agreement

Dec 11Final

Report

Oct 10Final

Report

Monitoring ToolsMonitoring Tools

8 Process Monitoring Checklists

Structure: 3 distinct sessions / checklist:

“GENERAL EVALUATION” its items will be unchanged throughout the project

“DETAILED EVALUATION: EXPECTED RESULTS PER INDIVIDUAL ACTIVITY BY YOUR ORGANIZATION“

its items will be modified according to the work plan

“DETAILED EVALUATION: EXPECTED RESULTS PER INDIVIDUAL ACTIVITY BY THE COORDINATOR“

its items will be modified according to the work plan