© GEO Secretariat

5.2 Monitoring and Evaluation

John AdamecCo-Chair, M&E Working Group GEO-XI Plenary13-14 November 2014Geneva, Switzerland

Overview• Fifth Evaluation of GEOSS Implementation

(Weather, Water, Climate) and Executive Committee Response (Plenary Document 10) (for approval)

• Progress on the sixth (final) Evaluation of GEOSS Implementation

• Progress in the Implementation of Recommendations of GEOSS Evaluations (Plenary Document 11) (for approval)

Fifth Evaluation of GEOSS Implementation (Weather, Water, Climate) and Executive Committee Response (Plenary Document 10) (for approval)

5th Evaluation Team

Norway Lars Ingolf Eide Co-Chair

United States Michael Tanner Co-Chair

Iran Ali Didevarasl

Greece Evangelos Gerasopoulos

Germany Guido Halbig

Australia Agnes Lane

Canada Jean Leclerc

United States Meagan Singer

Japan Ryutaro Tateishi

5th Evaluation Process• Fifth GEOSS evaluation of

Water, Weather and Climate SBAs commenced in late October 2013

• Data collection and analysis from November 2013 to April 2014

• Draft report submitted to GEO Secretariat for factual review April 9, 2014

• Revised draft submitted to M&E WG May 9, 2014

• Final Report to GEO Executive Committee June, 2014

• Presentation to GEO Executive Committee July, 2014

5th Evaluation: Key Messages• Evaluation of progress was facilitated by

improvements to reporting in GEO, in particular, the reports prepared by the Implementation Boards for Plenary.

• Current strategic targets are viewed by GEO participants as deeply ambiguous– Better targets would be:

• specific, measurable, and firmly achievable under the scope of GEO

• Organized around the users and societal sectors served, instead of the data provider communities

5th Evaluation: Key Messages• Need to consistently and clearly articulate a

unique role and mission for GEO, especially with respect to other international organizations

• Opportunity to advocate support for in situ observation networks

• Challenge of securing appropriate forms and levels of support over the necessary time frames to achieve desired outcomes– Projects, as well as: communication, capacity

building, administration, and evaluation functions

© GEO Secretariat

5th Evaluation: Proposed Responses• From 15 findings, the ET made 13 recommendations• ExCom has proposed the following responses

– 7 of 13 were already addressed in the IPWG report • 1- cross SBA interaction, • 3- clarifying role of GEOSS, • 5- promoting in situ observations globally with developing countries

emphasized, • 6- concise and measureable targets for activities, • 8- improving outreach and user engagement, • 12- organizing around user domains, • 13- using GEOSS as a platform to address observational gaps)

5th Evaluation: Proposed Responses• From 15 findings, the ET made 13 recommendations• ExCom has proposed the following responses

– 6 of 13 request other actions• 2- periodic confirmation of listed task contacts by Secretariat, and

determine if this is necessary for all or only a subset of activities in the future,

• 4- requests capacity building activities adopt suitable impact assessment practices as part of the activity,

• 7- apply reasonable user experience monitoring to the GEO Portal, • 9- renew effort to identify a component coordinator for the Cold

Regions activities, • 10- achieved in responding to recommendation 7, • 11- review status of, and identify opportunities for GEO to advocate

for, sustainability of the TIGGE archive.

Progress on the sixth (final) Evaluation of GEOSS Implementation

Unique Concepts from 6th Evaluation Framework

Evaluation Scope: Entire period of the first 10-Year Implementation Plan and full range of SBAs and Transverse Areas

Strategy: Build on prior evaluations through synthesis of previous findings to guide further data collection and new analysis.

Desired Outcome: Forward-looking recommendations applicable to the next implementation plan rather than advice specific to the current (2005-2015) documents.

Final Evaluation TeamCroatia Bojan Lipovscak

Japan Yukio Haruyama

United States Matthew Druckenmiller

Co-Chair

Germany Guido Halbig

Greece Evangelos Gerasopoulos

Norway Lars Ingolf Eide Co-Chair

Canada Rima Ammouri

European Commission

Gilles Ollier

Final Evaluation TimelineInitial meeting of the Evaluation Team with the M&E WG

15-16 July 2014

Data collection July 2014 - February 2015

Interim Report on initial findings for IPWG*

End January 2015

Completed draft report provided to M&E WG and Secretariat for factual review

End April 2015

Transmittal of the final evaluation report to M&E WG

End May 2015

Presentation of final evaluation report to ExCom

July 2015*If resources allow.

The M&E WG and ET request you to:

• Please respond if contacted to provide input to the evaluation

• Please take part in the public evaluation survey

• Please share the survey and encourage others to participate too

Visit: http://earthobservations.org/evaluation.php

for further information or to contact the team.

Progress in the Implementation of Recommendations of GEOSS Evaluations (Plenary Document 11) (for approval)

Progress in the Implementation of Recommendations

Context• GEO-IX Plenary in November 2012 approved a process to track

the implementation of recommendations from the series of evaluations.

• Progress was assessed by the M&E WG.• Information collected via Secretariat experts.

Structure

Progress in the Implementation of Recommendations

Results