ESTAT International Seminar on Modernizing Official Statistics: Meeting Productivity and New Data Challenges Tianjin, People’s Republic of China 24 - 26

ESTAT

International Seminar on Modernizing Official Statistics:Meeting Productivity and New Data ChallengesTianjin, People’s Republic of China24 - 26 October 2013

Modernization of official statistics: European Statistical System experience

Mariana Kotzeva, Advisor Hors Classe, Eurostat

Eurostat

This presentation :

• Describes the ESS vision for modernizing EU statistical production;

• Shares the results achieved and lessons learned so far;

• Outlines challenges ahead and next steps in the implementation of the Vision.

ESTATEurostat

modernisation in the supranational context of the EU.

modernisation as in any other

production system of statistics.

Mariana Kotzeva, Eurostat

All that having in mind the specificity of the ESS construction:

Background:

• The Communication of the European Commission 2009 (404): introduces the Vision calling for efficiency gains through standardisation and industrialisation of statistical production;

• A number of internal Eurostat Vision Implementation Projects (VIPs) and ESSnets (collaborative projects with Members States) were launched to implement the Vision;

• The ESS.VIP Programme, started in 2012, consolidates the efforts and focuses on a limited number of projects to achieve efficiency gains in the production of European statistics;

• The European Statistical Programme 2013-2017 includes concrete actions and projects for Vision implementation.

ESTATEurostat


Modernization of EU statistical production:

from pre to post-industrialisation.

ESTATEurostat


ESTAT

Industrialisation ?Industrialisation ?

Multiple

sources

Data integration

Multiple purposes

Eurostat


ESTATEurostat


Modernisation of Statistics includes also:

• Change in the set of products and services;

• Change in the organisation and management of the statistical production;

• Adjustment of the quality framework;

• Implementation of technical and statistical standards;

• Making up the HR strategy an integral part of the modernisation strategy.

ESTATEurostat


Census 2011: Example of a modern design of statistical production

• Combines different sources: administrative registers, geographical data, sample survey data;

• Employs mixed mode data collection (CAWI, CATI);

• Uses output quality orientation with emphasis on the validation at the beginning of the production chain.

Modernisation of the production chain in the context of the EU

ESTAT

Shared : InformationInfrastructureServicesCostsamong ESS partners


National solutions based on subsidiarity principle

Coordinated common solutions when cost-effective and compatible



Vision for modernization of EU

statistics

Vision for modernization of EU

statistics

Data validationData validation

DisseminationDissemination

DevelopmentDevelopment



Data processing, integration

and analysis

Data processing, integration

and analysis





Data acquisitionData acquisition

Eurostat


ESTATEurostat


Statistics on intra-EU trade (SIMSTAT project)= example of modern design of statistics

Re-uses available information by making microdata on export of other Member State available;

Thus:

•opening up the possibility of gradually replacing the import survey by data on export provided by the other Members states;

•providing opportunities for improving quality of import flow, i.e. through using as far as possible sampling surveys for quality assurance.

ESTATEurostat


SIMSTAT requires:

•Physical Networks such as EDAMIS, CCN-CCI;

•Shared services accompanying data exchange;

•Application software and hardware at both national and European level;

•Standards for data exchange (SDMX and DDI) and appropriate legal frameworks.

Key changes in the statistical processes

Data acquisition:

•Integrating data from different sources;

•Mixed mode data collection;

•Digital data capture and new data sources (big data).

Data validation:

•Verifying the quality of raw data;

•Verifying the quality of processes;

•Output orientation of quality assurance.

ESTATEurostat


Data integration and reusability

• Use generic software solutions;

• Shared infrastructure and new forms of data exchange;

• Data warehousing around clusters of statistics (i.e. households and enterprises).

ESTAT

MS2MS2

MS1MS1

Processing Database

Processing Database

Transmission

Data Processing

Staging Warehouse

Staging Warehouse

Extract

CubeCube

CubeCube

ReportReportReportReportData

WarehouseData

Warehouse

Data Disseminate

Load

Transform

Source: Gartner

Eurostat


Data dissemination

• Updating mix of disseminated products and services;

• Micro data dissemination;

• Visualisation tools and communication of statistics;

• Combining geographic and statistical information.

ESTATEurostat


Where we are with the implementation of the Vision ?

ESTAT

?

?

VIPs

ESSnets MEET

S

ESS.VI

P

Eurostat


Which of the aspects of the Vision have been covered by VIPs and ESSnets so far

ESTAT

ESSnetsESSnets

MEETS

Methodology

Standards and

architecture

Access to Microdata

Sectoral Culture Health Tourism

Energies SILC ICT

MEETS programme

SDC Access to microdata

Small Area Estimation

Data Integration Multimode Data

Collection

SDMX CORA CORE Standardisation

EurostatMariana Kotzeva, Eurostat

Where we are: conclusions

• A lot has been achieved in terms of setting legal frameworks, ESS governance and redesigning concrete statistical domains;

• The projects undertaken so far have addressed individual aspects of the Vision, however, not all aspects have been equally covered;

• IT strategy needs to be incorporated as a key element of modernisation of statistical production;

• The role of modern organisation methods and new cooperation models (i.e. matrix organisation and Centres of Competences) are still to be explored.

ESTATEurostat



Are we too ambitious? Challenges ahead and lessons learned

ESTATEurostat

Lesson learned:

• Transform the Vision into reality;

• Clear governance and allocation of responsibilities of all stakeholders;

• Modernisation is a long-term process that benefits from small but consistent steps;

• Leadership and mobilisation of skills and expertise are crucial;

• Setting priorities and sequence the Redesign projects;

• Monitoring of the progress towards the goals.

ESTATEurostat


Thank you for your attention!

[email protected] http://ec.europa.eu/eurostat

ESTATEurostat

Documents

ESTAT International Seminar on Modernizing Official Statistics: Meeting Productivity and New Data Challenges Tianjin, People’s Republic of China 24 - 26