Short-Term Economic Statistics Working PartyJune 25 - 27 2007 Short Term Economic Statistics Timeliness Framework Richard McKenzie OECD

Short-Term Economic Statistics Working PartyJune 25 - 27 2007

Short Term Economic Statistics Timeliness Framework

Richard McKenzie OECD


The STES Timeliness Framework

• Review of the framework, its original development, usage and promotion

• Plans for 2007 update – and comparison with 2005 and 2006 updates

• Discussion by STESWP on the need for future updates to the framework


STES Timeliness Framework - Background

• Developed by the STESEG taskforce on timeliness and benchmarking

• Aims to assist countries to improve the timeliness of the STES they produce (reduce costs & improve accuracy as well)

• A collection of good practices which cover all aspects of the statistical production process

• Documentation from a wide variety of countries (22 in all), so relevant to widest possible range of NSOs which operate under different circumstances


STES Timeliness Framework - Background

• First version went live on the OECD website in September 2004, updated in September 2005 & 2006

• STESWP has the role to improve, maintain, use and promote the framework

• Documentation and updates now coordinated with Administrative data framework and links are made between these two products


Development of the STES Timeliness Framework

• Timeliness is a function of the statistical production process

• However best practice in one country may not be applicable to another

– e.g. different user requirements, legislation, economic structures, institutional structures etc.

• Desire to develop a framework which presents a range of good practices for improving timeliness across different aspects of the statistical production process


Developing the STES Timeliness Framework

• Multi-dimensional web based product

• Each dimension providing more detail on specific methods to improve timeliness

• Emphasis on how processes link together, for developing overall strategies

• Only references methods with proven operational success

• Contains a breath of material sourced from many countries to ensure wide applicability


Broad statistical function Statistical functions most relevant to timeliness

1 Frame selection and administrative data use

1.1 Direct use of administrative data for STES

1.2 Maintaining Survey Frames from Admin source

2 Questionnaire design 2.1 Flexible Questionnaire and Form Design

2.2 Minimising Data Items Collected

3 Sample design and selection

3.1 Efficient Sample Designs

3.2 Sample Designs for Sub Samples

3.3 Effective business selection methods

4 Reference period & due dates

4.1 Choice of Reference Periods

4.2 Due Date for Businesses Providing Data

5 Data collection and validation

5.1 Efficient Collection Methods Using Technology

5.2 Follow Up of Non Respondents

5.3 Automated Data Validation (Editing) Methods

5.4 Selective (or Significance) Editing

Structure of the STES Timeliness Framework


Broad statistical function Statistical functions most relevant to timeliness

5 Data collection and validation

5.5 Effectively Combining Technology and Staff

5.6 Relationships With Respondents

6 Estimation 6.1 Data imputation methods

6.2 Preliminary Estimates from Sub Samples

6.3 Estimation Based on Lower Response Rates

6.4 Preliminary Estimates Based on Statistical Model

7 Evaluation and dissemination

7.1 Assessment of User Requirements

7.2 Analysis of Revisions

7.3 Quality Assessment of Timeliness Improvements

7.4 Use of Benchmarking Techniques

7.5 Efficient Dissemination Processes

Structure of the STES Timeliness Framework


The web-based version

www.oecd.org/std/research/timeliness


Promoting the STES Timeliness Framework

• Maximise visibility on the OECD website

• STESEG members promotion in their own organisations

• Distribution by other international organisations to their relevant working groups

• Articles in OECD and UNSD Statistics Newsletters

• OECD Statistics Working paper & keynote address at the April 2006 Quality in Official Statistics Conference in Cardiff


Use of the STES Timeliness Framework

• OECD web trend statistics currently not available

– New system being put in place

• Was previously averaging around 200 visits per month on the home page

• STESWP 2006 meeting concluded material was still useful and framework should continue to be updated


2007 update of the framework

• Request sent to most NSOs that participated in 2006 STESWP to provide any new documentation

– 10 NSOs responded, with 4 providing a total of 12 new papers (7 of which come from Finland)

– In 2006, 8 NSOs responded, with 4 providing a total of 20 new papers for assessment (of which 12 came from the BLS)

– In 2005, 20 NSOs responded, with 11 providing a total of 33 new papers for assessment


Future updates of the framework / discussion points

• Does the lower response from NSOs suggest less work is being done to improve timeliness of STES?

• Relevant conference proceedings to review for the 2007 update – suggestions please!

• Framework structure and content continues to be relevant and OECD will continue to promote it– Especially for non OECD countries which are most of the

subscribers

– Also very useful as a statistical training tool

– How to better reach countries developing their SS?

Documents

Short-Term Economic Statistics Working PartyJune 25 - 27 2007 Short Term Economic Statistics Timeliness Framework Richard McKenzie OECD