Learning Metrics Task Force

Overview and Results of First In-Person Meeting

October 2012

Project Overview

Contents• Learning Metrics Task Force Overview:

o Purpose and Objectiveso Structure and Roleso Process and Timeline

• New York City Meeting Results:o Meeting Objectiveso Consultation Process, Participants, and Resultso Revised Frameworko Key Decisionso Topics of Discussiono Next Steps

Why focus on learning?Despite commitments and progress in improving access to education at the global level (i.e., EFA Goals and MDG 2), learning levels are still low.

It’s estimated that 171 million people could be lifted out of poverty if all students in low-income countries left school with just basic reading skills. (Education First, UNSG, 2012)

Why now?A confluence of global policy events has created a unique window of opportunity for the education sector to raise the profile of international education goals and ensure that learning becomes a central component of the global development agenda.

To do this, the global education community must work collectively to define global ambition on improving learning and practical actions to deliver and measure progress.

What do we aim to accomplish?

The overarching goal of the Learning Metrics Task Force is to catalyze a shift in the global conversation on education from a focus on access to access plus learning.

To achieve this goal the task force will develop recommendations to help countries and international organizations measure and improve learning outcomes for children and youth.

Why shift the focus from just access to access plus learning?• At least 250 million primary school age children

around the world are not able to read, write or count well, even for those who have spent at least four years in school. (EFA GMR 2012)

• We must get better at measuring outcomes in addition to inputs. So in addition to enrollment and completion data, we must also measure and improve learning.

Core QuestionsTo achieve its objectives, the Learning Metrics Task Force will address three main questions over the course of its deliberations:

1. What learning is important from early childhood through post-primary?

2. How should learning be measured?

3. How can national, regional, and global organizations work together to implement these measures to improve learning opportunities and outcomes for children and youth?

Project Structure and RolesTask Force:

• Led by three Co-Chairs and representing UN agencies, civil society, bilateral donors, government, and private organizations

• High-level representatives who can serve as decision-makers and strong advocates for the project recommendations

Working Groups:

• Technical experts who work collaboratively to develop recommendations for consideration by the task force

• Based on the three guiding questions of the task force, the working groups will cover three topics in succession: standards/competencies, measures and methods, implementation

Consultation Process:

• Engages a broad spectrum of education actors both online and in person

• Takes into account adaptability and applicability to specific contexts and collects input and feedback on working group recommendations

The Consultation Process

Any effort to develop a shared vision for global learning goals and targets must be open, inclusive, and transparent.

The task force seeks input from a wide variety of stakeholders through a global consultation process to be conducted both online and in person.

The objectives of the consultation process are to:

• Engage a diverse group of actors at the political and technical levels to achieve maximum efficacy and impact.

• Compile feedback and input on appropriate competencies for measuring learning in various contexts to inform the final recommendations presented to the task force.

Project Process and Deliverables

Project Timeline

JUL AUG SEP OCT NOV DEC JAN FEB MAR APR MAY JUN

= TASK FORCE MEETINGS

JUL AUG SEP OCT

2012 2013

LAUNCH

STANDARDS WORKING GROUP

MEASURES WORKING GROUP

IMPLEMENTATION WORKING GROUP

= CONSULTATION PERIODS

New York CitySept. 27-28, 2012

Dubai, UAEFeb. 20-21, 2013

Bellagio, ItalyJuly 16-18, 2013

CallJuly 2012

MontrealTBD

NYC Meeting Results

Meeting OverviewDate: 27-28 September 2012

Location: New York City

Host: UNESCO

Keynote: Dr. Qian Tang, Assistant Director-General for Education, UNESCO

Attendees:

• 3 Task Force Co-Chairs

• 25 Task Force Member Representatives

• 2 Working Group Chairs

• 9 Secretariat Representatives

• 5 Observers

Meeting Objectives• Review the results of the consultation process • Discuss and make final decisions on the

recommendations of the Standards Working Group• Discuss a plan of action and identify additional

opportunities for informing the post-2015 agenda• Discuss a plan of action for engaging national-level

stakeholders• Evaluate the LMTF process to date and identify

improvements if necessary

Consultation Process• A preliminary draft of competencies was distributed for

public consultation from 2 August through 3 September

2012• The purpose was to spark discussion and elicit feedback

from a broad spectrum of education stakeholders• The draft was available in Arabic, French, English, and

Spanish• A “consultation toolkit” with guidance on facilitation and

sample discussion questions was also distributed

Consultation ParticipantsDuring the consultation period, more than 400 individuals from 57 countries participated in online or in-person consultations.

Consultation ResultsSeveral broad themes emerged from the consultation feedback:

• Alignment• Specificity• Number of competencies• Level at which standards are set• How to measure/implement

Based on this feedback, the Standards Working Group significantly revised its proposed framework for presentation to the task force.

Revised Framework*

Note: This draft framework is intended for the purposes of the Learning Metrics Task Force to identify domains for measurable learning outcomes. It is not intended at this time to be used as a framework for policymaking, curriculum or instruction. Recommended domains and sub-domains in the areas of early childhood, primary, and post-primary are listed in the meeting summary document.

Key Decisions Over the 2-day meeting, the task force came to the following decisions:

• Seven learning domains (see previous slide) will be submitted to the Measures and Methods Working Group for recommendations on measurement.

• Sub-domains within each of the seven domains (see meeting summary document) will be offered to the Measures and Methods Working Group as guidance for areas of measurement.

• Not all of the seven domains are feasible for a potential global learning goal; accordingly, the task force recommends exploring a hybrid approach to measuring learning at the global and national levels. The Measures and Methods Working Group is charged with proposing options for a hybrid approach.

Key Decisions (continued)• The recommendations of the task force will encompass

comprehensive basic education, from early childhood to lower secondary (ISCED 2).

• The recommendations will seek to encompass children who are in school and those who are out of school, but the task force acknowledges that measuring learning of children in school may be more feasible.

Topics of Discussion

• How comprehensive should the framework be?• Should the task force recommend global or national metrics?• Will the task force make recommendations for all children or only

those who are in school?• Should learning be measured by age cohort or grade level?• How far into the education lifespan will the task force’s

recommendations extend?• Will the task force make recommendations for how assessments can

be used to improve learning?• What is the timeline for proposed learning goals?

While the task force broadly accepted the working group’s revised framework, attendees engaged in lively discussion and debate on specific domains and sub-domains, as well as larger questions about the project vision and scope.

The following questions were major topics of discussion over the 2-day meeting. (See the full meeting summary document for details on each.)

Overall Consensus• The proposed competencies framework (Slide 16) represents the

task force’s vision for what every child everywhere should learn and be able to do, whether at the classroom, system, or global level, by the time they complete post-primary education.

• All seven domains should remain the aspiration for every child throughout the education lifespan.

• While we anticipate that global assessment capability will improve, we do not yet have perfect measures in all of these areas at the global level.

• The task for the Measures and Methods working group is to:• Determine what subset of domains can be measured globally

within our current capacity; and• Identify options for a hybrid approach to measuring learning at

the global and national levels.

Next Steps• Based on the meeting outcomes, the task force will develop a final

report with recommendations on what learning is important globally, to be released in December 2012.

• Participants for the Measures and Methods Working Group will be announced in November 2012. The working group will then begin developing a proposal for how to measure learning based on the framework approved by the task force.

• Task force members will activate networks and constituencies to conduct public consultations on the proposal of the Measures and Methods Working Group. The next consultation period is scheduled for December 2012 – January 2013.

• Task force members will also plan to hold regional consultations before the next in-person meeting, scheduled for 20-21 February 2013.

Next Steps (continued)• Post-2015 Agenda: The task force will map out post-2015

discussions and develop a strategy for linking the work of the task force to the global education agenda.

• National-Level Engagement: The task force will develop guiding questions to go into the guidance that UNESCO provides for the in-country EFA review process.

• The task force will develop a comprehensive communications and consultation plan and accompanying communications tools to:• Generate greater awareness and build understanding about the project.• Increase participation in the project process and consultations. • Position task force recommendations to inform the post-2015

development policy discourse.• Build a supportive environment for and develop interest among national

and regional actors to implement task force recommendations.

Learn more and get involved…

For updates on the Learning Metrics Task Force and information about working groups and consultations, please visit http://www.brookings.edu/learningmetrics

To receive email updates on the Learning Metrics Task Force, please send your name, organization, and email address to: learningmetrics@brookings.edu