United Nations Economic Commission for EuropeStatistical DivisionUnited Nations Economic Commission for EuropeStatistical Division

Mapping Data Production Processes to the GSBPM

Steven ValeUNECE

steven.vale@unece.org

Introduction

All processes that result in data outputs can be mapped to the GSBPM

Why do this?• Standardised documentation• Benchmarking• Quality assurance• First step towards common solutions for

similar processes

Reminder

Not a linear model Sub-processes are not followed in a strict

order It is a matrix, through which there are

many possible paths

Example 1

Australian project to improve production of prices data

Identified activities within GSBPM sub-processes

Some phases “out of scope”

Example 2

Another price index, this time for legal services in Norway

Note the difference in phases / sub-processes covered• E.g. no data integration or classification in

this process

5.8Finalise data files

5.6Calculate weights

Price index for legal services

Quality Management / Metadata ManagementSpecify Needs

Design Build Collect Process Analyse Disseminate

1.1Determine needs for information

• Eurostat regulation• Ministry of Justice• Trade association• Major companies

1.2Consult & confirm needs

• See 1.1

1.6Prepare business case

1.4Identify concepts

1.3Establish output objectives

1.5Check data availability

• Provided in regulation

• Variables• Classifications

• Project plan• Finances

• Choose companies (population) together with trade association

2.2Design variable descriptions

• See Eurostat regulation• Agree on level of detail• Translation

2.6Design production systems & workflow

2.4Design frame & sample methodology

2.3Design data collection methodology

2.5Design statistical processing methodology

• Paper & electronic questionnaires• Scanning

• Establish population• Make sample plan• Stratification by size

• Scanning paper questionnaires• Electronic data capture

• Micro controls• Weighting• Estimation

3.1Build data collection instrument

• Standard first page• Test paper & electronic

3.2Build or enhance process components

• Integrated system for editing and estimation• Sample register

3.6Finalise production system

3.4Test production systems

3.3Configure workflows

3.5Test statistical business process

• Meetings with the various data capture divisions

• Test micro-controls

• Documentation• Training• Meetings with 1st and 2nd line support

• No field test or pilotcarried out

4.1Select sample

• Companies selectedaccording to sample plan

4.2Set up collection

• Time plan• Preprinting, packing, sending, scanning etc.

4.4Finalise collection

4.3Run collection

• Packing & sending• Receive electronic data• Scan papir• Update received reg.• Send warnings & fines

5.1Integrate data

• No integration carried out

5.2Classify and code

• No classifying or coding carried out

5.4Impute

5.3Review, validate & edit

5.5Derive new variables & statistical units

• Duplicates• Regional and product views• Discover outliers• Correct microdata

• No imputation carried out

• Weights are established in phase 2• Weights are stored per survey

• Publication variables• Observation units = analysis units

6.1Prepare draft outputs

• Index & 4 sub-indices• Confidence intervals• Coefficient of variation• Tables & graphs

6.2Validate outputs

• Check most important companies have replied. Iterative with 4.3• Check variation coefficient.

6.4Apply disclosure control

6.3Scrutinize & explain

6.5Finalize outputs

• Consult trade association.• Trade trends• Any previous periods• Other price indexes

• Aggregation & publication level

• Final consistency checks• Supporting internal documentation

7.1Update output systems

• Load data into StatBank

7.2Produce dissemination products

• Daily statistics• About the statistics• Tables & graphs

7.4Promote dissemination products

7.3Manage release of dissemination products

7.5Manage user support

• Statistical calender• Approval routines• ssb.no

• Daily statistics

• Web statistics• Mail or telephone • Contact 1.1 users

• Data from electronic &paper questionnaires• Deliver data to processing

5.7Calculate aggregates

• Data files are finalised

2.1Design outputs

General dissemination policy:• About the statistics• Tables in StatBank• Text & graphs

• Aggregates are calculated

Example 3

Irish tourism survey Mapped GSBPM to 78 survey process

steps

Example 4

Denmark – quarterly survey on employment in construction

Established, regular survey• Just phases 4 to 7

Example 5

Mapping business register processes to GSBPM

New Eurostat project:• Build up the capacity for using GSBPM and

GSIM to document the national statistical business register processes

• Describe national statistical business register processes by using GSBPM and GSIM

• Grants will be available

GSBPM for business registers?

Business register maintenance is a continuous activity, not a single process

But BRs have:• Inputs “collected” from different sources• A sequence of processing and analysis• Outputs – statistics and sampling frames

Therefore BR maintenance can be seen as similar to other statistical production

Is this just an academic exercise?

No – there are practical benefits:• Standardisation of terminology• Standard framework for benchmarking• Facilitates use of common tools / methods• Efficiency savings• Tool for managing process quality

Conclusion

GSBPM can be applied to statistical business register maintenance

There is clear potential benefits in terms of shared knowledge, methods and tools

Exercise

Map two processes to the GSBPM

• Step 1 – determine which sub-processes are used, and in which order

• Step 2 – For the “Process” phase, list the steps within each sub-process used