Implementing air quality e-Reporting Data deliverables in 2013 and 2014 and the process of reporting
Tony Bush ETC/ACM AQ e-Reporting task leader
18th EIONET Workshop - Dublin, 24-25 October 2013
European Environment Agency
AQ data model
AQ zones
Assessment regimes
Assessment methods
Primary UTD data
Primary validated
data
Aggregated data
Attainment information
AQ Plans
European Environment Agency
Introduction
• Aim of this presentation
• Timeline for AQ e-Reporting
• Roles & responsibilities
• Deliverables for 31 December 2013
• Tooling up to prepare your deliverables
• Uploading & CDR structure for new deliverables
• What to expect when you upload
• Forward look at 2014
European Environment Agency
Aim of this presentation
Introduction to implementing Air Quality e-Reporting
• A low-tech and light-touch general introduction
• Trying to avoiding jargon and acronyms
• Focusing on using air quality terminologies not INSPIRE
• Detailed explanations to follow later today
European Environment Agency
We in a transition phase to AQ e-Reporting
• Replace old rules for regulatory and informative information on air quality to the Commission
• Upgrade standards for data encoding and sharing
• Streamline duplication in reporting data flows
• Reinforce internal consistency in regulatory data flows
• Embark on the first step towards INSPIRE for AQ to support information sharing and the SEIS
European Environment Agency
Air Quality e-Reporting timeline
European Environment Agency
B - Zones in 2013
C - Assessment carried out in 2013
D - Assessment methods in 2013
E - Validated data in 2013
F - Statistics & aggregation in 2013
G - Compliance statement in 2013✔
Timeline for implementation
Provides a prognosis of what you are planning or expecting to happens in the forthcoming year
There will be gaps in knowledge for some dataflows
This is ok at this stage
B - Zones planned in 2014
C - Assessments planned in 2014
D - Some metadata for 2014
Provides a prognosis of what you are planning or expecting to happens in the forthcoming year
There will be gaps in knowledge for some dataflows
This is ok at this stage
B - Zones planned in 2014
C - Assessments planned in 2014
D - Some metadata for 2014
December 2011
December 2012
December 2013
September 2014
December 2014
European Environment Agency
• Roles & responsibilities vary according to you EIONET affiliation
8-data themes for Member State regulatory reporting
4-data themes for EIONET users for exchange of information reporting
Roles & responsibilities
European Environment Agency
Data flow deliverables for end 2013
• 31 December is your regulatory deadline
• AQ zones
AQD Header AQD Zone
Provides information on the person & status
of the report
Provides information on AQ zones established to manage & improve pollution levelson the person & status of the report
European Environment Agency
• 31 December is your regulatory deadline• AQ assessment regimes
Data flow deliverables for end 2013
AQD HeaderAQD Assessment
Regimes
Provides information on the person & status
of the report
Provides information on AQ stations & models used to
assess pollution levels
European Environment Agency
• 31 December is your deadline for an informative
delivery to support regulatory data flows
• AQ assessment methods
AQD HeaderAQD Assessment
Methods
Provides information on the person & status
of the report
Provides information on AQ monitoring stations, models & other assessment techniques,
including their configuration
Data flow deliverables for end 2013
European Environment Agency
• 2 regulatory data flow deliverables• 1 supporting informative dataflow
Summary of deliverables December 2013
European Environment Agency
AQD Header AQD up-to-date dataObserving
Capabilities
AQD Process
Data Array
AQD HeaderAQD Assessment
Methods
AQD HeaderAQD Assessment
Regimes
AQD Header AQD Zone
• 4 data flow deliverables overall
• Don’t forget to your Near Real Time datafeeds now called up-to-date data (UTD)
Summary of deliverables December 2013
European Environment Agency
How should I be preparing now ?
2012 Eionet workshop recommendations
• Get your house in order !
Know how holds your data
Where is it
How it’s stored
• Cross check your data holdings against the IPR data specifications
• Migrate your data holdings to a database or think of a work around if file based system is a must
• Get some IT support for your AQ experts
XML
Extract Transform and Load (ETL) software to load the XML deliveries
European Environment Agency
How should I prepare now ?
• Do some reading
The IPR Decisionhttp://eur-lex.europa.eu/LexUriServ/LexUriServ.do?uri=OJ:L:2011:335:0086:0106:EN:PDF
Commission guidance part Ihttp://ec.europa.eu/environment/air/quality/legislation/pdf/IPR_guidance1.pdf
Commission guidance part IIhttp://ec.europa.eu/environment/air/quality/legislation/pdf/IPR_guidance2.pdf
Data model & schema user guidehttp://www.eionet.europa.eu/aqportal/guidelines/UserGuide2_AQD_XML_v19.3b.pdf
European Environment Agency
How should I prepare now ?
• Work out your minimum requirements
• Work out where (if) there are gaps in your data holdings
• Decide how to close the gaps
• Familiarise yourself with the AQUI software
• Collect, organise and rationalise your data
Reporting Header (AQQ form 1 / DEM)
Stations (DEM / AQQ forms 3-7)
Zones (AQQ form 2)
Shapefiles
Assessment regimes threshold exceedances (AQQ forms 9-10)
European Environment Agency
How generate data flow deliveries ?
• Gather your data
• Process your data
• Use your preferred method to write XML
AQUI
Bespoke system
• Check that it validates against the schema locally
• Upload to the CDR as you currentlydo for DEM and AQQ
• FTP up-to-date data flow to EEA
EEA’s Repornet CDR
AQUIBespoke MS system
ReportNet CDR
European Environment Agency
CDR structure
• CDR envelope will be organisedwith folders for each delivery
• Upload data flows into appropriate envelope
• If uploading shapefiles for zones generate a sub-envelope and upload
(B) AQ zones
Shapefiles
AQ zone XML delivery
Shapefile(s)
European Environment Agency
What happens after upload ?
• On upload automatic CDR QC routines will run
• QC routines generate feedback reportsWarnings on format & content
Fatal errors that will prevent delivery
• Reporter can review, take action & redeliver
European Environment Agency
B - Zones in 2013
C - Assessment carried out in 2013
D - Assessment methods in 2013
E - Validated data in 2013
F - Statistics & aggregation in 2013
G - Compliance statement in 2013✔
Timeline for implementation
Provides a prognosis of what you are planning or expecting to happens in the forthcoming year
There will be gaps in knowledge for some dataflows
This is ok at this stage
B - Zones planned in 2014
C - Assessments planned in 2014
D - Some metadata for 2014
December 2011
December 2012
December 2013
September 2014
December 2014
European Environment Agency
September 2014 deliveries
• Replicate existing DEM / AQQ September obligations in the e-Reporting system
• Act as a confirmation of what actually happened
• Delivers valid data
• September 2014 will report on 2013 calendar year
6-data themes for Member State regulatory reporting
4-data themes for EIONET users for exchange of information reporting
European Environment Agency
Summary of September deliverables
• Confirm or update information on the methods applied in the previous year
• Zones applied• Assessment regimes used• Assessment methods operating
AQD HeaderAQD Assessment
Methods
AQD HeaderAQD Assessment
Regimes
AQD Header AQD Zone
AQD Header AQD valid data • Deliver validated measurement data
• Deliver valid aggregated data (measurements & models)
• Deliver an attainment (compliance) statement
European Environment Agency
• Good luck
• Use the AQ Portal
• If you are starting from today look at AQUI
• Contact us early if you have questionshttp://projects.eionet.europa.eu/implementation-2011-850-eu/library
• Hard work now will allow you & us all to enjoy our Christmas
The autumn will be busy
European Environment Agency
Questions & Answers
Tony BushETC/ACM AQ e-Reporting task lead
Principal Consultant
Gemini BuildingFermi AvenueHarwellOxonOX11 0QR
Tel: 0870 190 6423 Mobile: 07968 707 386 E-mail: [email protected] Web: www.ricardo-aea.com
Thank for your attention.