Embed Size (px)
Citation preview
A possible Accreditation Procedure for Big Data Sources
Session 17A – Assessment of Big Data
NTTS, Brussels 12 March 2015
Eurostat
2 © Copyright Brett
Ryder 2010
3
How does ubiquitous data collection and networking
• Mobile communication
• Smart devices
• Internet of [every]Things,
• Cloud services,
• Wearables,
• Autonomous traffic,
• Smart systems,
•…
impact official statistics?
4
The statistical office of the future
• Data flows and secondary data sources instead of surveys and censuses
• Data customer instead of data provider
• Product designers instead of data collection designers
• Accreditation and certification instead of data production
5
Accreditation
• Big data repositories and data flows are potential data sources for producers of official statistics
• Users of official statistics trust NSIs that they provide statistics of high quality
• Producers of official statistics must therefore evaluate repositories before adopting them as data sources
• The project proposes a draft accreditation procedure of five steps
Principles for Accreditation Procedure
6
1 Fully compliant with principles of quality frameworks
2 Flexible
3 Sequential decision making based on stepwise approach
4 Empirical assessment with real data conducted by statistical office
5 Assessment of sources, metadata and data
6 Final decision based on combination of corporate criteria
7
• Initial Examination Potential Usefulness
Stage 1
•Acquisition of source data Potential Usefulness
Stage 2
•Forensic Investigation Usability
Stage 3
•Office Decision Cost benefit and Risk Analysis
Stage 4
•Formal Agreement Cooperation
Stage 5
Decision Point 1
Decision Point 2
Decision Point 3
Decision Point 4
Decision Point 5
Thank you for your Attention!
8
• Accreditation procedure for statistical data from non-official sources
• Authors: • [email protected]
