Data Reconciliation Issues

Neda Jafarjafarn@un.org

Workshop on MDG Data Reconciliation: Employment Indicators12-13 July, Beirut

“Not everything that can be counted counts; and not

everything that counts can be counted.”

—ALBERT EINSTEIN

International Mandates

• In July 2006, the Economic and Social Council adopted its resolution 2006/6 on strengthening statistical capacity in countries and included a set of recommendations to improve the coverage, transparency and reporting on all indicators

• ESCWA resolution 287 (XXV) on Strengthening statistical capacities for evidence-based policymaking which “Encourages member countries to produce MDG indicators, and requests the secretariat to assist member countries in building their capacity to unify concepts and definitions”.

297 (XXVI). Arab MDG monitor for societal progress

1. Calls upon all member countries to enhance coordination between national statistical offices and implement national strategies for statistical development, with a view to improving the coverage and transparency of indicators and methods of reporting on them and disseminating effective methods of monitoring nationally and internationally agreed development goals, including MDGs, by:

(a) Defining priorities and developing a strategy to provide data for all indicators;

(b) Identifying ways, including through capacity-building to improve monitoring and reporting on development indicators, including indicators relating to MDGs;

(c) Ensuring that the supporting metadata comply with standard guidelines;

2. Requests the secretariat to assess the quality of national data and development indicators, including MDGs, and providing adequate resources to improve data quality and convergence with international standards

Findings:

• Major differences exist in the data availability reported by the two sources.

• The greater the difference in data availability reported, the higher the possibility of major shortcomings in the reporting mechanism between them

• UNSD therefore disseminates little more than half the data reported in national sources

• @least third of the national data are not reported in UNSD db

• National disaggregated data available and are not reported in UNSD database

• Discrepancy in data value emanates from one or more components related to metadata :

– definition– classifications– method of calculation– targeted population and subpopulation– proxy indicators– sources of data– data series– extrapolation/estimation methods

Objectives

• Build national capacities

• Improve data quality

• Ensure transparency

• Reduce data gaps and increase availability

• Reduce inconsistency

• Increase production

• Enhance dissemination

Reconciling international and national sources for effective global monitoring

1. Global monitoring - IAEG• Compilation of international sources• Improving international sources and resolving data gaps

and discrepancies

2. Regional monitoring - ESCWA• Compilation of national data• Improving national sources and resolving data gaps and

discrepancies with international sources

Data compilation: from national sources to the MDG database

International agency

country office

Agency Headquarte

rs eg. UNICEF

Line Ministry in

the countryNational

Statistical Office in the

country

Agency Headquarte

rs eg. UNESCO

Agency Headquart

erseg. ILO

MDG Indicators database60 MDG indicators + background/additional indicators192 Member States

Data provided by the international agencies

(a)compiling data for the global/regional monitoring of MDGs

Indicator/seriesAgency MDGs Other Total

FAO 4 1 5ILO 5 16 21IPU 1 3 4ITU 3 5 8OECD 8 7 15UNAIDS 1 5 6UNEP-Ozone 1 1 2UNEP-WCMC 2 5 7UNESCO 6 10 16UNFCCC (CDIAC) 6 0 6

UN-HABITAT 1 1 2UNICEF 17 7 24UNPD 3 5 8WB 7 4 11WHO 9 2 11WTO 5 0 5

17 79 72 151

DATA: national, modeled or estimated

Source: MDG Indicators Database, at mdgs.un.org

IndicatorCountries with at

least 1 data pointCountries with at least 2

data points

Number % Number %

Population below $1 (PPP) per day 89 55 67 41

Children under 5 moderately or severely underweight 116 71 98 60

Total net enrolment ratio in primary education 142 87 126 77

Literacy rates 119 73 99 61

Share of women in wage employment in non-agricultural sector 155 95 108 66

Children under five mortality rate per 1,000 live births 138 85 138 85

Maternal mortality ratio per 100,000 live births 120 74 0 0

HIV prevalence among population 15-24 years old 101 62 101 62

Condom use at last high-risk sex, women 52 32 24 15

Contraceptive use 126 77 102 63

Tuberculosis death rate per 100,000 population 156 96 156 96

Proportion of the population using improved sanitation 137 84 137 84

Slum population 108 66 105 64

Country data

Estimated

Modelled

Different types of data in international data sources

MDG metadata compilation

• Development and enhancement of metadata for the global monitoring - Custodian agencies provide metadata and updates as necessary- Indicator metadata is stored in a repository -Footnotes are accessible together with the data -Exchanges usually via email

Improve transparency in the MDG Indicators Database

Metadata for MDG Indicators in MDG Database

CONTACT POINT in international agency

DEFINITION

METHODS OF COMPUTATION

COMMENTS AND LIMITATIONSSOURCES OF DISCREPANCIES BETWEEN GLOBAL AND NATIONAL FIGURES

PROCESS OF OBTAINING DATA

TREATMENT OF MISSING VALUES

DATA AVAILABILITY

REGIONAL AND GLOBAL ESTIMATES

EXPECTED TIME OF RELEASE

Regional Priorities

• Improve data quality and transparency of methods• Identify good practices for coordination within national statistical systems• Identify good practices in reporting mechanisms to the international

statistical system• Address key methodological issues, including the use of population

figures, in the computation of the indicators • Develop improved training tools on the compilation of the indicators• Improve consistency and transparency in reporting and presenting data

and metadata for the international monitoring (DevInfo and SDMX trainings)

• Provide technical assistance to countries in the use of international definitions.

• Improve the process of consultation by international agencies with countries before publishing their data

9th SC PROPOSALS FOR IMPROVEMENT @ national level:

(i) Data availability can be improved in the following ways:

1. Review current methodologies for imputations and consultation mechanisms with national statistical offices;

2. Organize workshops and/or producing handbooks and guidelines to improve the production and transparency of indicators and methodologies

3. Provide direction on recommended consultation mechanisms, with a view to bringing the least-tracked indicators, in particular, into line with international standards;

3. Carry out the required surveys and censuses, and improving administrative registers for the periodic production of data on MDG indicators, other development data and country-specific indicators;

4. Develop and maintain a central repository at the national and subnational levels that is disaggregated by sex, where applicable, and user-accessible;

(ii) Dissemination can be improved in the following ways:

1. Publish metadata with relevant indicators in order to improve transparency, quality and dissemination practices in line with international standards;

2. Provide disaggregated data, where applicable, by age, educational attainment, geographical area, ethnic group, urban/rural and gender in order to highlight patterns within countries, thereby facilitating comparisons across subpopulations for effective planning and budgeting by policymakers;

3. Publish a new round of MDG reports, taking note of the new MDG indicators and incorporating comprehensive coverage in terms of disaggregated data with relevant metadata and trend analysis to track progress towards the achievement of MDGs;

@ regional level:

1. Review and identify regional priorities and propose ways of improving the production and analysis of MDGs, including development indicators;

2. Propose future courses of action, particularly in terms of recommending areas and modalities for technical cooperation and statistical capacity-building;

3. Develop and maintain a regional central database derived from national databases and publications aimed at monitoring availability, tracking progress and planning capacity-building activities in focused statistical areas;

4. Review and discuss data gathering mechanisms available to international agencies, their methods of compilation of international data series, and the imputation techniques used to calculate regional and global estimates for MDG indicators;

@ regional level:

• Identify ways of improving compilation of regional data series by improving reporting mechanisms from national statistical systems to international agencies;

• Compile and review national metadata published in national central databases and make recommendations on ways of improving them;

• Review current methodologies for imputations and consultation mechanisms with member countries and recommend methods to improve methodologies, transparency and consultation mechanisms, both within countries and with international agencies.

• Thank you