63
Aggregation rules for e-reporting (Following Decision 2011/850/EU) v 0.8.2 March 2017 Working Paper Subtask 1.1.1.3 in ETC/ACM AP2017 February 2016 Jaume Targa, Tony Bush, Wim Mol The European Topic Centre on Air Pollution and Climate Change Mitigation (ETC/ACM) is a consortium of European institutes under contract of the European Environment Agency RIVM UBA-V ÖKO AEAT EMISIA CHMI NILU VITO INERIS 4Sfera PBL CSIC

Aggregation rules for e-reporting

  • Upload
    others

  • View
    7

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Aggregation rules for e-reporting

Aggregationrulesfore-reporting

(FollowingDecision2011/850/EU)

v0.8.2

March2017

WorkingPaper

Subtask1.1.1.3inETC/ACMAP2017February2016JaumeTarga,TonyBush,WimMol

TheEuropeanTopicCentreonAirPollutionandClimateChangeMitigation(ETC/ACM)isaconsortiumofEuropeaninstitutesundercontractoftheEuropeanEnvironmentAgencyRIVMUBA-VÖKOAEATEMISIACHMINILUVITOINERIS4SferaPBLCSIC

Page 2: Aggregation rules for e-reporting
Page 3: Aggregation rules for e-reporting

DISCLAIMER

©ETC/ACM,2017.

ETC/ACMworkingPaper2017

EuropeanTopicCentreonAirPollutionandClimateChangeMitigation

POBox1

3720BABilthoven

TheNetherlands

Phone+31302748562

Fax+31302744433

[email protected]

Websitehttp://acm.eionet.europa.eu/

ThisETC/ACMWorkingPaperhasnotbeensubjectedtoEuropeanEnvironmentAgency(EEA)membercountryreview.ItdoesnotrepresenttheformalviewsoftheEEA.

Page 4: Aggregation rules for e-reporting

Documenthistory

Version Authors/Reviewers Date Comments

0.0 JaumeTarga 07/05/2012 ThisisaworkingpaperforEEA,EEAdevelopersandETC/ACMtodescribeaggregationandstatisticstobecalculatedunderthenewe-Reportingprocess.ThisdocumentinitiallydescribestheaggregationforSOR

-Firststabledraftfollowinginitialfeedback0.1 JaumeTarga 21/05/2012 Incorporationofsuggestionsandcomments

followinginternalreview0.2 JaumeTarga 05/06/2012 Incorporationofsuggestionandcommentsfollowing

commentsfromWimMol,FrankdeLeeuw,SheilaCryan,LiborCernosky,PederGabrielsen.

0.3 WimMol/JaumeTarga

25/06/2012 Re-drafttoincorporatewideraggregationrules

0.4 WimMol 27/06/2012 Comments/trackchangesprocessedinversion0.30.41 JaumeTarga 28/06/2012 Minoraddsongeneralstatisticstables+re-drafting

ofsomesectionsfore-reporting0.5 WimMol/Frank

deLeeuw28/06/2012 Somechangesandcommentsprocessedinversion

0.410.51 TonyBush 12/07/2012 Re-structuringofsomesections+re-draftingsome

sections+consistencyofstyle0.52 JaumeTarga 13/07/2012 Minormodifications0.60 TonyBush 13/07/2012 Minormodifications0.62 TonyBush 26/07/2012 Minormodifications,inclusionofweightedmean

commentaryfromWimMol0.63 WimMol 27/07/2012 Improvementformulasin4.2.1,4.2.2and5.1.2 0.64 WimMol/Frank

deLeeuw30/07/2012 Somesmallmodifications

0.65 TonyBush 08/08/2012 MinormodificationsactioningEEAcomments0.66 TonyBush 31/08/2012 FurtherminormodificationsactioningEEA

comments0.67 JaumeTarga

TonyBush24/09/2012 Minormodifications+commenting

0.68 TonyBush Updatesin2013 Furthermodifications0.69 JaumeTarga Updatesin2013 Furthermodifications0.7 JaumeTarga 24/05/2014 Updatedtoincludecodelistforaggregation,XML

exampleupdated+updateonothercodelistadded0.7.1 JaumeTarga 03/06/2014 Minorupdates0.8_draft JaumeTarga 21/07/2015 Updateddocumenttoinclude:SOMO35,AOT40c-5

years,betterdescriptiononhowtocalculatedatacapture,datacoverage&timecoverage,managementofvaliditycodes,

0.8 JaumeTarga 23/12/2015 Final0.8.1 JaumeTarga 19/02/2016 AddclarificationonSO2wintermean

Page 5: Aggregation rules for e-reporting

Version Authors/Reviewers Date Comments

0.8.2 JaumeTarga 22/03/2017 Add99percentileforPM10andPM2.5

Page 6: Aggregation rules for e-reporting

Contents

1 Introduction...............................................................................................................11.1 Structureofthisdocument.............................................................................................................................21.2 Scriptsforthecalculationofaggregationsandstatistics..................................................................2

2 Configurationofthedatadelivery.............................................................................32.1 Configurationofthedataarray....................................................................................................................32.1.1 Validityandverificationstatusflags.........................................................................................................42.1.2 Encodingforautomatedmeasurements/observations...................................................................42.1.3 Encodingforsamplerbasedmultidaymeasurements/observations........................................5

3 ProcessingofrawdatabyEEAsystem........................................................................93.1 Storageofprimarydata&keyattributesonrecords.........................................................................93.1.1 Keymeta-information.......................................................................................................................................93.1.2 Pollutant&unit...................................................................................................................................................93.1.3 Startandendtimeoftherecord..................................................................................................................93.1.4 om:resultTime(timewhenrecordwasgeneratedbyprovider)....................................................93.1.5 Validityandverificationflag.........................................................................................................................93.1.6 Originofthevalue(CDRofficialrepositoryvsFTP/SOS)..............................................................10

3.2 Databasestorageofprimarydata............................................................................................................10

4 Calculationofbaseaggregationsforhourlyanddailyvalues....................................124.1 Dailyaverage(24-hourmean)...................................................................................................................124.2 8-hourrunningmean.....................................................................................................................................134.3 Dailymaximum8-hourrunningmean(daymax)..............................................................................13

5 Calculationofdatacapture,timecoverage&datacoverage....................................155.1 Definition.............................................................................................................................................................155.1.1 Datacapture(Dcap)......................................................................................................................................155.1.2 Timecoverage(TC).........................................................................................................................................155.1.3 Datacoverage(DC).........................................................................................................................................15

5.2 Datacapturerates...........................................................................................................................................165.2.1 Datacapturecalculationsforhourlyanddailydatatypes...........................................................165.2.2 Datacapturecalculationsfrombaseaggregationdata................................................................175.2.3 Missingdatafractionsarisingfrommaintenanceandcalibration...........................................17

5.3 Datacaptureformultidaysamplerbaseddatatypesintegratedoveranaveragingperiod 185.3.1 Datacaptureformultidaysamplerbaseddatatypes....................................................................185.3.2 Timecoverageformultidaysamplerbaseddatatypes.................................................................19

6 Calculationofstatistics............................................................................................206.1 Averagesandmeans.......................................................................................................................................246.1.1 Forhourlyanddailydatatypes................................................................................................................246.1.2 Formulti-daysamplerbaseddatatypes...............................................................................................256.1.3 Wintermean......................................................................................................................................................26

6.2 Otherstatisticsforhourlyanddailydata..............................................................................................276.2.1 Percentiles...........................................................................................................................................................276.2.2 Maxima.................................................................................................................................................................276.2.3 kthhighestvalue(maxk)...............................................................................................................................286.2.4 AOT40(onlyO3)................................................................................................................................................29

Page 7: Aggregation rules for e-reporting

6.2.5 SOMO35(onlyO3)............................................................................................................................................316.2.6 AEI(onlyPM2.5)(AverageExposureIndicator)..................................................................................326.2.7 NationalExposureReductionTarget(NERT).....................................................................................32

6.3 Calculationofbasicexceedanceinformation......................................................................................336.3.1 Exceedanceofthresholdsbasedoncalendaryear,wintermeanandmaximumdailyeighthourmeanaggregatedstatistics...................................................................................................................346.3.2 Numberofhoursordayswithconcentration>yμg/m3................................................................346.3.3 Threeconsecutivehourswithconcentration>yμg/m3.................................................................34

6.4 XMLencodingofaggregatedstatistics...................................................................................................35

7 Up-To-DateandSummerOzoneReportingcalculations...........................................387.1 Datasources.......................................................................................................................................................387.2 Roundingoffrules...........................................................................................................................................387.3 Aggregations......................................................................................................................................................387.4 Aggregatingvaliddata...................................................................................................................................387.5 Verificationofdata..........................................................................................................................................387.6 Percentageofvaliddata................................................................................................................................387.7 CalculationstatisticsonUTDdata............................................................................................................397.7.1 ALT–NO2:Numberoftimeswhen3consecutivehourshavebeenaboveALTenvironmentalObjectiveof400mg/m3..................................................................................................................407.7.2 ALT–SO2:Numberoftimeswhen3consecutivehourshavebeenaboveALTenvironmentalObjectiveof500mg/m3..................................................................................................................417.7.3 LTO–Max.daily8-hourmean-Dayswhenmaxdaily8-hourmeanexceededtheLTOinoneyear-120mg/m3......................................................................................................................................................427.7.4 O3-Health-INT-Onehour-Hoursinexceedanceinacalendaryear-180mg/m3........437.7.5 O3->Health->ALT->Onehour->Hoursinexceedanceinacalendaryear->240mg/m3

447.8 AdditionalaggregationonSummerOzoneReportingandoutputreport..............................447.8.1 LTO–Max.daily8-hourmean–................................................................................................................467.8.2 INT&ALT–hourlymean.............................................................................................................................47

8 References...............................................................................................................48

AnnexA Environmentalobjectivesandreportingmetrics...........................................49

AnnexB Marginoftoleranceandupper/lowerassessmentthresholds.......................52

AnnexC Definitionoftheaveragingtime“var”..........................................................53

AnnexD Historicalmethodsforcalculationofdatacaptureandtimecoveragefrommultidaysamplerbaseddatatypesintegratedoveranaveragingperiod........................54

AnnexE ListofpollutantswithMonitoringObjective.................................................55

Page 8: Aggregation rules for e-reporting

Page1

1 IntroductionThisdocumentprovidestherulesforcalculationofaggregationsandstatisticalvaluesonairqualityobservationsasspecifiedbytheDirectives2004/107/EC(EU,2004)and2008/50/EC(EU,2008)andthederivedImplementingProvisions2011/850/EC(EU,2011).Italsoprovidestheaggregationandstatisticalvaluestobecalculatedfortheup-to-datedataflows(UTD).ThedocumentisintendedasatechnicalspecificationfordeveloperswhowillwritethesoftwareroutinesforEEAandthereforeassumesnobackgroundknowledgeofairqualitylegislationorairqualityreporting.

TheaggregationsandstatisticspresentedunderpintheevidencebaserequiredtoassesscompliancewiththeDirectivesordemonstrateattainmentofenvironmentobjectives.However,thescopeofthisdocumentislimitedtothecalculationbaseaggregationsandstatistics,includingsomebasiclogicfortheassessmentofexceedancewhichisusedforUTDinparticular.Itdoesnotextendtothefulllogicandextensiverulesforassessingofattainmentofenvironmentobjectives;thiswillbethesubjectofaseparatedocument.

Figure1presentsanoverviewthelifecycleforairqualitymeasurements(andothersequenceofeventsfordataprocessing)withinthee-Reportingsystemfromthestart-point(reporting)toend-point(calculationofexceedancesforassessmentofcompliance).

Figure1Overviewcalculationbasevalues,statisticsandexceedances

Page 9: Aggregation rules for e-reporting

Page2

Thecalculationsaremadeonallprimary(base)measurementdata(observations)delivered(reported)bythecountriesundertheAirQualitye-Reportingsystem.TherulespresentedinthisdocumentarebasedonthoseinoperationwithinAirBase.Notethattheaggregationrulesarealsoapplicableformodeledairqualitydata.

Statisticalparametersareinitiallycalculatedforallsamplingpointsirrespectiveofdatacapturerates(theproportionofvaliddataavailable).Theaggregateddataandstatisticssoderivedarestoredinadatabasewithoutroundingtogetherwithassociatedinformationonthedatacapture,timecoverageanddatacoverage.Tosupportend-userdataneedsandforcomplianceassessmentthestatisticalparametersmaybeselectedanddownloadedfromtheaggregateddatabasebasedonuserdefineddatacapture,timecoverageanddatacoverageselectionsincludingthosespecifiedbytheDirective(s)dataqualityobjectives(DQOs).

1.1 StructureofthisdocumentChapter2ofthisdocumentpresentsanoverviewoftheconfigurationofthedatadelivery(thereportedobservationaldatainXML).Chapter3definesfirstlevelofdataprocessing,thecalculationofbaseaggregationsforhourlyanddailyvalues.Chapter4documentshowthecalculationofdatacaptureandtimecoverageratesaretobemade,theseareimportantfordownstreamcalculations.Chapter5defineshowairqualitycomplianceandgeneralstatisticsaretobecalculated.Chapter6documentcalculationforUp-to-date(UTD)andsummerozonereporting(SOR).

1.2 ScriptsforthecalculationofaggregationsandstatisticsInthepreviousdataexchangesystems(Exchangeofinformation,EoI)severalscriptsweredevelopedforthecalculationoftheaggregationsandstatisticalvalues.Thesemaybeusedarereferencematerialtoassistinthedesignanddevelopmentofthenewe-Reportingdatahandlingandprocessingsystems.

ScriptswritteninC:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/c-sources

Awkscripts:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/AWK-scripts-aggregation-and-statistical-routines_EEA-checks-ver20120131.zip

Page 10: Aggregation rules for e-reporting

Page3

2 ConfigurationofthedatadeliveryPrimarymeasurementdatawillbereported(delivered)inXMLfollowingthespecificationssetoutathttp://www.eionet.europa.eu/aqportal.ThisschemaprovidesgenericrulesforencodingofobservationsbasedontheOGC’sO&MandSWEencodingstandards.Atpresent2encodingformatsareproposedtoaccommodatetheparticularneedsfor

1. Automaticmeasurements/observations

2. Samplerbasedmultidaymeasurements/observations

DetailedexamplesofthethesegenericdatadeliveriesarepresentedinFigure2andFigure3anddescribehowmeasurementswill(a)beencodedaspartofaswe:dataArray,(b)importantmetadataontheobservationswillbemarked-upusingtheOGCandISOObservationsandMeasurements(O&M)conceptualmodel.

ThecoredataelementsoftheschemaaresummarisedinTable1.Theseneedtoberecognisedandstoredinthedatabasesystemsinordercrossreferenceanyderivedstatisticscalculatedwithmetadataassociatedwiththemeasurement.Pleaserefertothe“UserGuidetoXML”atYYYYforspecificITdescriptionofthereportedXML.

Table1AdescriptionofthecorecomponentsoftheXMLdatadeliveries

XMLelement Description

om:OM_Observationgml:id Providesauniqueidentifierforthegroupofobservationsom:phenomenonTime Providesinformationonthetimeperiodoverwhichobservationhave

beentakenom:resultTime Providesatimestampforwhentheresultoftheobservationwas

generatedom:procedure Documentsconfigurationdetailsoftheequipmentperforming

observations(includinganalyticaldetailsinappropriate)om:parameter Allowsdeclarationofthesamplingpoint(Samplingpoint_GB0729A_sp2)

toassociatewiththeobservationsom:observedProperty Definesthecomponentbeingobservedom:featureOfInterest Providesdetailedinformationonthepropertiesparcelofairbeing

sampledswe:elementCount Definesthenumberofrecordstoexpectintheswe:dataArrayswe:dataRecord Providesamechanismforconfiguringtheswe:dataArray.(furtherdetails

givenbelow).

2.1 ConfigurationofthedataarrayTheprimarymeasurementdatatobeimportedandprocessedmaybedeliveredatavarietyoftimeresolutionsdependingonthemeasurementtechniqueused.Automaticmeasurements(forexample)willroutinelyberesolvedtohourlyanddailymeasurementperiodsandareregularlysorted.Forthesemeasurementsthedataarraywillbecomposedof6fields;atimestampforthestartofthemeasurement,atimestampfortheendofthemeasurement,avalidityflag,averification

Page 11: Aggregation rules for e-reporting

Page4

flagandtheconcentrationvalue.Thetimestampreferenceswillusethefull(extended)ISO-8601format.

Samplebasedmultidaymeasurements(e.g.samplerbasedmeasurementsforHeavyMetalsandPAH)mayuseotheraveragingtimes.Thesecanbeweekly,2-weekly,4-weekly,monthly,3-monthly,yearly,variable.Forthesemeasurementsthedataarraywillbeconfiguredasfollows;measurementstartdate/time,measurementenddate/time,validityflag,verificationflagandthe%ofvalidperiodfortheperiodcoveredbytheobservation.Thetimecoveragefortheperiodcoveredbytheobservationiscalculatedfromstartandendtime.Ifthe%ofvalidperiodisnotprovideditwillbeassumedthatthe%is100.

Iftheaveragingtimedeviatestoomuchfromaconstantperiod,theaveragingtimereceivesa“var”flag.ForthedefinitionseeAnnexC.

2.1.1 ValidityandverificationstatusflagsInputdatawillbeflaggedaccordingtothenumbersbelow.Thevaliditystatusspecifieswhetheravalueisacceptabletobeusedorwhetheritisinvalidormissing.Verificationstatusspecifieswhetherthedatahasbeencheckedandprovidesitsstatus.

Table2Validityandverificationstatusflags

Name Code Codenumber

Validity ValidValidbelowdetectionlimitandthemeasurementvalueisgivenValidbelowdetectionlimitandnumberreplacedby0.5*detectionlimitNotvalidduetostationmaintenanceorcalibrationNotvalidduetootherreasons

123-99-1

Verificationstatus

NotverifiedPreliminaryverifiedVerified

321

See http://dd.eionet.europa.eu/vocabulary/aq/observationvalidity/view http://dd.eionet.europa.eu/vocabulary/aq/observationverification/view

Editorsnote:StilltobediscussedwithEEA

Eachvalue(measurement/observation)willhaveavalidityflagandverificationflag.Theverificationstatus(flag)forvalidatedassessmentdatasets(DataflowsE1a–measurementsandE1b-modelling)mustonlybe1(verified)whendatahasbeenfullyverifiedanditisreadyforcompliancereporting.TheverificationstatusforUTDdatasets(DataflowsE2a)maybeofanytype.

Section3providesfurtherinformationonhowandwhererawprimarydataisprocessedincludingvalidityandverificationflags.

2.1.2 Encodingforautomatedmeasurements/observationsAnexampleofavalidXMLdeliveryforautomaticmeasurementsispresentedinFigure2.

Thisexampleclearlyshowshowmeasurements(observations)willbeencodedaspartofaswe:dataArrayandalsohowimportantmetadatarelatedtotheobservationswillbemarked-up

Page 12: Aggregation rules for e-reporting

Page5

usingtheO&M.ThecoredataelementsdescribedinTable1areimplementedandthedataarrayconfiguredtothespecificrequirementsofautomaticmeasurementsandobservationswhichhaveregularlyspacedsampling/observationperiods.Asaresulttheswe:DataRecordswithinthearraymaybeconfiguredasshowninFigure2alsoat

EXAMPLETOBEPROVIDED.

Where:

<swe:fieldname="startTime"> Specifiesthetimestampofthestartofthemeasurementperiod.AlltimereferencesarereportedusingUTCandencodedinaccordancewithISO8601:2004(E).

<swe:fieldname="endTime"> Specifiesthetimestampoftheendofthemeasurementperiod.AlltimereferencesarereportedusingUTCandencodedinaccordancewithISO8601:2004(E).

<swe:fieldname="Verification"> Allowsforthedeclarationoftheverificationflagassociatedwiththeobservation,,seesection2.1.1.

<swe:fieldname="Validity"> Allowsforthedeclarationofthevalidityflagassociatedwiththeobservation,seesection2.1.1.

<swe:fieldname="Value"> Allowsforthedeclarationoftheprimaryobservationandthemeasurementunit.

2.1.3 Encodingforsamplerbasedmultidaymeasurements/observationsForsamplerbasedobservationsormultidayobservations,theobservingperiod(s)maybeirregularlyspaced.Asaresult,theswe:dataArrayisconfiguredslightlydifferentlytoinclude:

1. thepercentageofvaliddatainthesamplingperiod

ThecoredataelementsdescribedinTable1areimplementedinthesamewayasforautomaticmeasurements,asaretheswe:DataRecordsforvalidity,verificationandthemeasurandquantity.

Where:

<swe:fieldname="startTime"> Specifiesthetimestampofthestartofthemeasurementperiod.AlltimereferencesarereportedusingUTCandencodedinaccordancewithISO8601:2004(E).

<swe:fieldname="endTime"> Specifiesthetimestampoftheendofthemeasurementperiod.AlltimereferencesarereportedusingUTCandencodedinaccordancewithISO8601:2004(E).

<swe:fieldname="Verification"> Allowsforthedeclarationoftheverificationflagassociatedwiththeobservation,,seesection2.1.1.

<swe:fieldname="Validity"> Allowsforthedeclarationofthevalidityflagassociatedwiththeobservation,seesection2.1.1.

<swe:fieldname="Value"> Allowsforthedeclarationoftheprimaryobservationandthemeasurementunit.

<swe:fieldname="DataCapture"> Allowsforthedeclarationofthedatacaptureintegratedoveranobservation(averaging)periodastheproportionofvalidmeasurementtimerelativetotalmeasuredtime

Page 13: Aggregation rules for e-reporting

Page6

intheaveragingperiod,expressedasanpercentage.Seesection5.3.1.Thisinformationisessentialincalculatingtimeweightedaggregatedstatisticse.g.theannualmean,seesection6.1.2.

Seealso;

http://cdr.eionet.europa.eu/gb/eu/aqd/e1a

Editorialnote:ExampleUKdatafilewillbeprovidedwhenthisdatasetisreleasedatendSept2012.

Figure2AnexampleXMLencodingofaUTDdatadeliveryfromanautomaticmonitorobservationsmeasuringSO2

<gml:featureMember> <om:OM_Observation gml:id="PrimaryUTDobservations_1"> <om:phenomenonTime> <gml:TimePeriod gml:id="ObserrvationTimePeriod_3"> <gml:beginPosition>2010-01-01T01:00:00+01:00</gml:beginPosition> <gml:endPosition>2010-01-01T24:00:00+01:00</gml:endPosition> </gml:TimePeriod> </om:phenomenonTime> <om:resultTime> <gml:TimeInstant gml:id="ObservationResultInstant_3"> <gml:timePosition>2010-02-T14:00:00+01:00</gml:timePosition> </gml:TimeInstant> </om:resultTime> <om:procedure xlink:href="xlink:href="http://environment.data.gov.uk/air-quality/so/GB_SamplingPointProcess_2774"/> <om:parameter> <om:NamedValue> <om:name xlink:href="http://dd.eionet.europa.eu/vocabulary/aq/processParameter/AssessmentType”/> <om:value>>"Fixed measurement from UK compliance assessment network selected by UK for UTD reporting”</om:value> </om:NamedValue> </om:parameter> <om:parameter> <om:NamedValue> <om:name xlink:href="http://dd.eionet.europa.eu/vocabulary/aq/processparameter/SP”/> <om:value xlink:href="http://environment.data.gov.uk/air-quality/so/GB_SamplingPoint_65647"/> </om:NamedValue> </om:parameter> <om:observedProperty xlink:href="http://dd.eionet.europa.eu/vocabulary/aq/pollutant/8”/> <om:featureOfInterest xlink:href="http://environment.data.gov.uk/air-quality/so/GB_SamplingFeature_2774"/> <om:result xsi:type="swe:DataArrayType"> <swe:elementCount> <swe:Count> <swe:value>24</swe:value> </swe:Count> </swe:elementCount> <swe:elementType name="FixedObservations"> <swe:DataRecord> <swe:field name="StartTime"> <swe:Time definition="http://www.opengis.net/def/property/OGC/0/SamplingTime"> <swe:uom xlink:href="http://www.opengis.net/def/uom/ISO-8601/0/Gregorian"/> </swe:Time> </swe:field> <swe:field name="EndTime"> <swe:Time definition="http://www.opengis.net/def/property/OGC/0/SamplingTime"> <swe:uom xlink:href="http://www.opengis.net/def/uom/ISO-8601/0/Gregorian"/> </swe:Time> </swe:field> <swe:field name="Verification"> <swe:Category definition="http://dd.eionet.europa.eu/vocabularies/aq/observationverification”/> </swe:field> <swe:field name="Validity"> <swe:Category definition="http://dd.eionet.europa.eu/vocabularies/aq/observationvalidity”/>

Page 14: Aggregation rules for e-reporting

Page7

</swe:field> <swe:field name="Value"> <swe:Quantity definition="http://dd.eionet.europa.eu/vocabulary/aq/primaryObservation/hour"> <swe:uom code=" http://dd.eionet.europa.eu/vocabulary/uom/concentration/ug.m-3"/> </swe:Quantity> </swe:field> </swe:DataRecord> </swe:elementType> <swe:values>2010-01-01T01:00:00+01:00,2010-01-01T02:00:00+01:00,1,1,15@@2010-01-01T02:00:00+01:00,2010-01-01T03:00:00+01:00,1,1,15@@2010-01-01T03:00:00+01:00,2010-01-01T04:00:00+01:00,1,1,15@@2010-01-01T04:00:00+01:00,2010-01-01T05:00:00+01:00,1,1,15@@2010-01-01T05:00:00+01:00,2010-01-01T06:00:00+01:00,1,1,15@@2010-01-01T06:00:00+01:00,2010-01-01T07:00:00+01:00,1,1,15@@2010-01-01T07:00:00+01:00,2010-01-01T08:00:00+01:00,1,1,15@@2010-01-01T08:00:00+01:00,2010-01-01T09:00:00+01:00,1,1,15@@2010-01-01T09:00:00+01:00,2010-01-01T10:00:00+01:00,1,1,15@@2010-01-01T10:00:00+01:00,2010-01-11T11:00:00+01:00,1,1,15@@2010-01-01T11:00:00+01:00,2010-01-01T12:00:00+01:00,1,1,15@@2010-01-01T12:00:00+01:00,2010-01-01T13:00:00+01:00,1,1,15@@2010-01-01T13:00:00+01:00,2010-01-01T14:00:00+01:00,1,1,15@@</</swe:values> </om:result> </om:OM_Observation> </gml:featureMember>

Figure3AnexampleXMLencodingofamultidaydatadeliveryfromasamplerbasedobservation(measuredBaP)

<gml:featureMember> <om:OM_Observation gml:id="PrimaryUTDobservations_1"> <om:phenomenonTime> <gml:TimePeriod gml:id="ObserrvationTimePeriod_4"> <gml:beginPosition>2010-01-01T01:00:00+01:00</gml:beginPosition> <gml:endPosition>2010-12-31T24:00:00+01:00</gml:endPosition> </gml:TimePeriod> </om:phenomenonTime> <om:resultTime> <gml:TimeInstant gml:id="ObservationResultInstant_4"> <gml:timePosition>2011-02-T14:00:00+01:00</gml:timePosition> </gml:TimeInstant> </om:resultTime>

<om:procedure xlink:href="xlink:href="http://environment.data.gov.uk/air-quality/so/GB_SamplingPointProcess_2003"/> <om:parameter> <om:NamedValue> <om:name xlink:href="http://dd.eionet.europa.eu/vocabulary/aq/processParameter/AssessmentType”/> <om:value>>"Fixed measurement from UK compliance assessment network selected by UK for UTD reporting”</om:value> </om:NamedValue> </om:parameter> <om:parameter> <om:NamedValue> <om:name xlink:href="http://dd.eionet.europa.eu/vocabulary/aq/processparameter/SP”/> <om:value xlink:href="http://environment.data.gov.uk/air-quality/so/GB_SamplingPoint_68117"/> </om:NamedValue> </om:parameter> <om:observedProperty xlink:href="http://dd.eionet.europa.eu/vocabulary/aq/pollutant/5029”/> <om:featureOfInterest xlink:href="http://environment.data.gov.uk/air-quality/so/GB_SamplingFeature_2003"/> <om:result xsi:type="swe:DataArrayType"> <swe:elementCount> <swe:Count> <swe:value>12</swe:value> </swe:Count> </swe:elementCount> <swe:elementType name="FixedObservations"> <swe:DataRecord> <swe:field name="StartTime"> <swe:Time definition="http://www.opengis.net/def/property/OGC/0/SamplingTime"> <swe:uom xlink:href="http://www.opengis.net/def/uom/ISO-8601/0/Gregorian"/> </swe:Time> </swe:field> <swe:field name="EndTime"> <swe:Time definition="http://www.opengis.net/def/property/OGC/0/SamplingTime"> <swe:uom xlink:href="http://www.opengis.net/def/uom/ISO-8601/0/Gregorian"/>

Page 15: Aggregation rules for e-reporting

Page8

</swe:Time> </swe:field> <swe:field name="Verification"> <swe:Category definition="http://dd.eionet.europa.eu/vocabularies/aq/observationverification”/> </swe:field> <swe:field name="Validity"> <swe:Category definition="http://dd.eionet.europa.eu/vocabularies/aq/observationvalidity”/> </swe:field> <swe:field name="Value"> <swe:Quantity definition="http://dd.eionet.europa.eu/vocabulary/aq/primaryObservation/month"> <swe:uom code=" http://dd.eionet.europa.eu/vocabulary/uom/concentration/ug.m-3"/> </swe:Quantity> </swe:field> <swe:field name="DataCapture"> <swe:Quantity definition="http://dd.eionet.europa.eu/vocabulary/aq/primaryObservation/dc"> <swe:uom code=" http://dd.eionet.europa.eu/vocabulary/uom/statistics/percentage"/> </swe:Quantity> </swe:field> </swe:DataRecord> </swe:elementType> <swe:values>2010-01-01T01:00:00+01:00,2010-01-31T24:00:00+01:00,1,1,1.58,100@@2010-02-01T01:00:00+01:00,2010-02-28T24:00:00+01:00,1,1,1.324,100@@2010-03-01T01:00:00+01:00,2010-03-31T24:00:00+01:00,1,1,1.261,70.97@@2010-04-01T01:00:00+01:00,2010-04-30T24:00:00+01:00,1,1,0.736,40@@2010-05-01T01:00:00+01:00,2010-05-31T24:00:00+01:00,1,1,0.548,100@@2010-06-01T01:00:00+01:00,2010-06-30T24:00:00+01:00,1,1,0.512,100@@2010-07-01T01:00:00+01:00,2010-07-31T24:00:00+01:00,1,1,0.356,100@@2010-08-01T01:00:00+01:00,2010-08-31T24:00:00+01:00,1,1,0.462,100@@2010-09-01T01:00:00+01:00,2010-09-30T01:00:00+01:00,1,1,0.894,93.33@@2010-10-01T01:00:00+01:00,2010-10-31T24:00:00+01:00,1,1,1.092,64.52@@2010-11-01T01:00:00+01:00,2010-11-30T24:00:00+01:00,1,1,0.99,100@@2010-12-01T01:00:00+01:00,2010-12-31T24:00:00+01:00,1,1,1.358,100@@</</swe:values> </om:result> </om:OM_Observation> </gml:featureMember>

Page 16: Aggregation rules for e-reporting

Page9

3 ProcessingofrawdatabyEEAsystemPrimarymeasurementsdatareported(delivered)inXMLbycountriesareprocessedbyEEAinordertocalculatestatisticsdescribedinthisdocument.

Primarydatacanbedeliveredvia:

- Primaryvalidateddata(E1a)viaCDRforofficialreporting

- Uptodateprimarydata(E2a)viaFTPorSOSservices

3.1 Storageofprimarydata&keyattributesonrecordsInordertokeepfulltraceabilityofdatadeliveredandcorrectlyprocessit,keyattributesarerecordedbyEEAforallrecords.Theseareessentialinordertoprocessincomingrawdataandtocalculatestatistics.

ForeachrecordreportedEEAstoresthefollowing:

- Keymeta-information(SamplingPoint,SamplingPointProcess,Sample…)

- Pollutant&unit

- Startandendtimeoftherecord

- om:resultTime(timewhenrecordwasgeneratedbyprovider)

- Validityandverificationflag

- Origenofthevalue(CDRofficialrepositoryvsFTP/SOS)

3.1.1 Keymeta-informationTobecompleted

3.1.2 Pollutant&unitAllrecordsarestoredwiththecorrespondingpollutantcodeandunit.

3.1.3 StartandendtimeoftherecordAllrecordsarestoredwiththecorrespondingstartandendtimerecorded.AllprimaryhourlydataarestoredasUTC+1.

3.1.4 om:resultTime(timewhenrecordwasgeneratedbyprovider)AllrecordsarestoredwithresultTimeprovidedbydataprovider.Thisisessentialtopreventprocessingolderdataovernewerdatasets.

3.1.5 ValidityandverificationflagAccordingtosection2,allprimarydatamustbeprovidedwithavalidityflag.Thisvalidityflagisessentialinordertocorrectlycalculateanystatisticsandaccompanyinginformationlikedatacapture/timecoverage/datacoverage.Thevalidityflagisessential.

Page 17: Aggregation rules for e-reporting

Page10

Table3Validityandverificationstatusflags

EEA’sgeneralcategory

ValidityCode Codenumber

validdata 123

Validdatawillusedtocalculateanystatistic.Validdatawillalsobeusedtocalculateaccompanyinginformationlikedatacapture/timecoverage/datacoverage

notvalid_maint -99

Ignoredwhencalculatinganystatistic.Usedtocalculateaccompanyinginformationlikedatacapture

notvalid_other -1 Ignoredwhencalculatinganystatistic.Usedtocalculateaccompanyinginformationlikedatacapture

notvalid_null 0missing

Ignoredwhencalculatinganystatistic.

3.1.6 Originofthevalue(CDRofficialrepositoryvsFTP/SOS)Inordertokeepfulltraceabilityofdataprocessed,eachvalueprocessedbyEEAsystemisstoredwithaflagaccordingtotheoriginofthedata.Thiswaydata,datathathasbeenprovidedasup-to-datedatacanbedifferentiatedfromCDRofficialdata.

3.2 DatabasestorageofprimarydataPrimarymeasurementsprovidedwillbeprocessedin3differentdatabasesdependingontheoriginofthedataandtheaggregationpurpose:

- E1adatabasewhichonlyincludesdatafromCDR

- E2adatabasewhichonlyincludesdatafromFTP/SOS

- Edatabasewhichcontainsalldata&aggregations

KeyaspectsofEEA’sdataprocessing:

- EssentiallinksbetweenD&primarydata(bothE1a&E2a)

- ProcessingofE1adatainE1adb

- ProcessingofE2adatainE2adb

- ProcessingofE1a&E2ainEdb

- AggregationinEdb

Page 18: Aggregation rules for e-reporting

Page11

Theverificationstatusflagisimportantforallcalculationsandprovides3differentoptionsdependingonthelevelofcheckingthathasbeenconductedonthemeasurementsbydataprovider.Theverificationstatusflagofthedatamustbeconsideredwhenaggregatingdata.

1. Aggregationsforregulatorycomplianceassessmentsmustonlycontainvalidandverifieddatarecords

2. Aggregationsforothernon-regulatorycomplianceassessments(e.g.UTD)may(will)containunverifieddatatoo(codes1,2and/or3)

3. Sometimesitwillalsobeusefultoperformaggregationsusingallverificationstatustypes(codes1-3)butprovide%breakdownofthedifferentstatustypesusedintheaggregation

Page 19: Aggregation rules for e-reporting

Page12

4 CalculationofbaseaggregationsforhourlyanddailyvaluesBaseaggregationsonrawhourlyanddailydataistobecarriedoutasdetailedbelow,takingintoaccounttheproportionofvaliddataforeachbaseaggregation.Thedatawillbeprovidedusingcodelist(withinswe:fieldname="Value">)togetherwiththeunit(…vocabulary/uom/….):

• Rawhourly-http://dd.eionet.europa.eu/vocabulary/aq/primaryObservation/hour

• Rawdaily-http://dd.eionet.europa.eu/vocabulary/aq/primaryObservation/day

KEYNOTE:Section5specifieswhatbaseaggregationmustbecalculatedforwhichpollutants.Foroptimisationofprocesses,onlythosenecessarybaseaggregationsaretobecalculated.

Asanoverarchingruleforallbaseaggregatingperiods,iftheproportionofvaliddataisbelowa75%threshold,theaggregatedvaluewillbeflaggedas“Notvalidbecauseofinsufficientdatacapture”.Thisruleappliestohourly1,dailyand8-hourbasedstatisticalaggregations.Invalidbaseaggregationsalthoughcalculatedandstoredarenotbeentakenintoaccountinanythestatisticalcalculationsandmustbeflaggedas“Notvalidbecauseofinsufficientdatacapture”.SeeTable4.Table4Aggregationflagsforflaggingthevaliditystatusofbaseaggregations

Codelabel Codeid

ConceptURI

Valid 1 http://dd.eionet.europa.eu/vocabulary/aq/observationvalidity/1

Notvalidbecauseofinsufficientdatacapture

-1 http://dd.eionet.europa.eu/vocabulary/aq/observationvalidity/-1

Thecalculationrulesforthedailyaverages,8-hourrunningmeansanddailymaximum8-hourrunningmeansaredescribedbelow.

4.1 Dailyaverage(24-hourmean)Definition:Thedailyaverageordailymeanistheaverageofallvalidhourlyvaluesforaday.

Minimumrequiredproportionofvaliddata:adailyor24-houraverageiscalculatedifatleast18validhourlyvaluesareavailableinthe24-hourperiodstartingatthehourending0100hours.

Iftheminimumrequiredproportionofvaliddataisnotavailable,thedailyor24-houraverageisnotcalculatedforthatparticulardayandaninvalidaggregationflagshallbereturn(-1).

Theresultofthisbaseaggregationistobeencodedas:http://dd.eionet.europa.eu/vocabulary/aq/aggregationprocess/P1D

Therawprimarydatawillbeencodedlike:1 Even thoughthe shortest averaging time that will be reported for raw data is one hour, where the 1-hour average is made up from multiple integrated measurements the 75% rule applies; so, for example, if a reported hourly average we composed of 60 1-minute observations , at 45 valid minute observations are required. These checks are the responsibility of the data provider.

Page 20: Aggregation rules for e-reporting

Page13

http://dd.eionet.europa.eu/vocabulary/aq/primaryObservation/hour

Thedailyaverageshallbecalculatedforpollutantswithenvironmentalobjectivesbasedondailyvalues(SO2,PM10andPM2.5)andforwhichhourlyvalueshavebeendeliveredaspartoftherawdatadelivery.

Theinclusionofcalculationofdailyaveragesforallpollutantswithhourlydataisrecommendedasparttheenduserdatainterfacerequirements.TheserecommendationsandinterfacerequirementsareaseparatedeliverableunderETC/ACMTask1.0.1.3.

ScriptswritteninC:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/c-sources

Awkscripts:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/AWK-scripts-aggregation-and-statistical-routines_EEA-checks-ver20120131.zip

4.2 8-hourrunningmeanDefinition:The8-hourrunningmeanvalueforeachhouriscalculatedastheaverageofthevalidhourlyvaluesforthathourandthe7previoushours(thereforecumulativelyand8-houraveragingperiod).Hence,theaveragingperiodofhour1ofdaynishour17ofdayn-1untilhour1ofdayn(inclusive).Theaveragingperiodofhour24ofdaynishour16ofdaynuntilhour24ofdayn(inclusive).

Minimumrequiredproportionofvaliddata:an8-hourrunningaverageconcentrationiscalculatedifatleast6validhourlyvaluesareavailableoverthe8-houraveragingperiod.

Iftheminimumrequiredproportionofvaliddataisnotavailable,the8-hourrunningaverageisnotcalculatedforthatparticularhourandaninvalidaggregationflagshallreturn.

Theresultofthisbaseaggregationistobeencodedas:http://dd.eionet.europa.eu/vocabulary/aq/aggregationprocess/P8H-run

Therawprimarydatawillbeencodedlike:http://dd.eionet.europa.eu/vocabulary/aq/primaryObservation/hour

ScriptswritteninC:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/c-sources

Awkscripts:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/AWK-scripts-aggregation-and-statistical-routines_EEA-checks-ver20120131.zip

4.3 Dailymaximum8-hourrunningmean(daymax)Definition:Thedailymaximum8-hourrunningmeanisthemaximumofthevalid8-hourrunningmeansforthatday.Calculationofallthe8-hourrunningmeans(above)foragivendayisapre-requisite.Adayrunsfromhour1tohour24asdefinedabove.

Minimumrequiredproportionofvaliddata:adailymaximum8-hourmeaniscalculatedifatleast18

Page 21: Aggregation rules for e-reporting

Page14

valid8-hourrunningmeansareavailableforthatparticularday.

Iftheminimumrequiredproportionofvaliddataisnotavailable,thedailymaximum8-hourrunningmeanisnotcalculatedforthatparticulardayandaninvalidaggregationshouldreturn.

Theresultofthisbaseaggregationistobeencodedas:http://dd.eionet.europa.eu/vocabulary/aq/aggregationprocess/P8H-dmax

Therawprimarydatawillbeencodedlike:http://dd.eionet.europa.eu/vocabulary/aq/aggregationprocess/P8H-run

ScriptswritteninC:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/c-sources

Awkscripts:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/AWK-scripts-aggregation-and-statistical-routines_EEA-checks-ver20120131.zip

The8-hourrunningmeananddailymaximum8-hourrunningmeanshallbecalculatedforO3andCO.Twenty-four8-hourrunningmeansandonedailymaximum8-hourrunningmeanshallbecalculatedpereachday.

Page 22: Aggregation rules for e-reporting

Page15

5 Calculationofdatacapture,timecoverage&datacoverageKEY NOTE: All statistics, calculated from the primary data or from the base aggregations, described in section 5 shall be accompanied with information on data capture, time coverage and data coverage.

These will be provided for all aggregations in order for user to select data appropriately for their needs. If aggregation is used for compliance purposes, the user needs to use those percentages required under the Directive and latest IPR Guidance from DG Environment.

5.1 DefinitionThedefinitionsofthese3statisticsarekeyinordertounderstandtheaggregationresults.Inordertoautomatethecalculationacrossallpollutants,reportedprimarydataandstatistics,the3accompanyingstatisticsaredefineasbelow.

5.1.1 Datacapture(Dcap)Thedatacaptureisthepercentageofvalidmeasurementsoverthetotalnumberofreportedmeasurementsovertheaveragingperiod.

Forcontinuousmeasurementmonitoring,EEAexpectsfulldeliveryacrossallmeasuringperiodwithappropriatevalidityflag.Seesection2.1.1inordertounderstandhowtoreportdata.Pleasenotethatiffulldeliveryarenotprovidedforcontinuousmeasurements(hourly/daily),thedatacapturecalculatedbyEEAmightdifferfromreporterscalculations.Iffulldatadeliveryisnotprovided,pleaseusedatacoveragetoobtainthe%ofvalidmeasuresovertheaveragingperiod.

5.1.2 Timecoverage(TC)Thetimecoverageisthepercentageofmeasurementtimeinagivenaveragingperiod.

5.1.3 Datacoverage(DC)Thedatacoverageisthepercentageofvalidmeasurementsoverthegivenaveragingperiod.

Whenassessingtheappropriatenessofanystatistics,datacoverageisconsideredtobemostappropriatestatistictounderstandtherepresentativenessofastatisticoveranaveragingperiod.

Forallaggregations,thefollowingis“counted”:

• count_validdata(validityflag1,2,3)

• count_notvalid_maint(validityflag-99)

• count_notvalid_other(validityflag-1)

• count_notvalid_null(validityflag0ormissing)

Foraggregation,DcapDC&TCarecalcuatedfollowingthesealgorithms(PLEASENOTETHISUPDATESPREVIOUSGUIDANCE):

Page 23: Aggregation rules for e-reporting

Page16

DataCapture=[count_validdata]/([count_validdata]+[count_notvalid_maint]+[count_notvalid_other])

DataCoverage=[count_validdata]/[interval]

TimeCoverage=[count_validdata]+[count_notvalid_maint]+[count_notvalid_other]/[interval]

[ie.DatacapturexTimeCoverage=DataCoverage]

5.2 Datacapturerates

5.2.1 DatacapturecalculationsforhourlyanddailydatatypesThedatacaptureforhourlyanddailymeasurementsisthepercentageofvalidmeasurementvaluesinagivendataset.Thedatacaptureinagivenaveragingperiodisdefinedasfollows:

Datacapture=Nvalid/NtotalReported*100%

whereNvalidisthenumberofvalidhourly/dailyvalues(validityflag>02)andNtotalReportedisthenumberofhours/daysreportedinthatmeasurementperiod.

Example[tc1]whencalculatinganannualmeanfromNO2primaryhourlyvaluesNvalid=7724hNtotalReported=8760h(fulldatasetreportedforaveragingperiod)TimeCoverage=100%DataCapture=88,17%

Example[tc3]whencalculatinganannualmeanfromPM10primarydailyvaluesNvalid=309dNtotalReported=365d(fulldatasetreportedforaveragingperiod)TimeCoverage=100%DataCapture=84,66%

Note: Where a measurement method delivers hourly values, Nvalid and NtotalReported shall be calculated using number of hours. Where a measurement method delivers daily values, Nvalid and NtotalReported shall be calculated using number of days.

ScriptswritteninC:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/c-sources

Awkscripts:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/AWK-scripts-aggregation-and-statistical-routines_EEA-checks-ver20120131.zip

Ifdatacaptureneedstobeencodedseparatelytoastatistic,theaggregationtypecanusethefollowingcodes(InternalEEAsystemcodesfordatacapture):

2 Valid primary data or valid base aggregation data will be flagged using 1, 2 or 3 according to codelist http://dd.eionet.europa.eu/vocabulary/aq/observationvalidity/1

Page 24: Aggregation rules for e-reporting

Page17

• Datacaptureofhourlyvaluesin1day-http://dd.eionet.europa.eu/vocabulary/aq/aggregationprocess/P1D-dc

• Datacaptureofhourly/daily/othervaluesin1year-http://dd.eionet.europa.eu/vocabulary/aq/aggregationprocess/P1Y-dc

5.2.2 DatacapturecalculationsfrombaseaggregationdataThedatacaptureforbaseaggregationdataiscalculatedfollowingsamelogicasshowninsection5.2.1.Thedatacaptureisthepercentageofvalidaggregatedvaluesinagivenaveragingperiod.Thedatacaptureinagivenaveragingperiodisdefinedasfollows:

Datacapture=Nvalid/Naveraging_period*100%

whereNvalidisthenumberofvalidhourly/dailyvalues(validityflag>03)andNtotalisthenumberofhours/daysinthatmeasurementperiod.

Example:AyearO3dailymaximumvaluesNvalid=315dNtotal=365dTimeCoverage=100%DataCapture=86,3%

ScriptswritteninC:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/c-sources

Awkscripts:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/AWK-scripts-aggregation-and-statistical-routines_EEA-checks-ver20120131.zip

Ifdatacaptureneedstobeencodedseparatelytoastatistic,theaggregationtypecanusethefollowingcodes(InternalEEAsystemcodesfordatacapture):

• Datacaptureofhourly/daily/othervaluesin1year-http://dd.eionet.europa.eu/vocabulary/aq/aggregationprocess/P1Y-dc

• Datacaptureofdailymaximumvaluesin1year–http://dd.eionet.europa.eu/vocabulary/aq/aggregationprocess/P1Y-dx-dc

5.2.3 MissingdatafractionsarisingfrommaintenanceandcalibrationThepercentageofvaluesmissingduetostationmaintenanceorcalibrationinagivenaveragingperiodiscalculatedasfollows:

Percmain_cal=Nmain_cal/Naveraging_period*100%

3 Valid primary data or valid base aggregation data will be flagged using 1, 2 or 3 according to codelist http://dd.eionet.europa.eu/vocabulary/aq/observationvalidity/1

Page 25: Aggregation rules for e-reporting

Page18

whereNmain_calisthenumberofinvalidhourlyordailyvalueswithavalidityflag=-99(Notvalidduetostationmaintenanceorcalibration)andNaveraging_periodisthenumberofhours/daysintheaveragingperiod.

Example:AyearNO2hourlyvaluesNmain_cal=300hNaveraging_period=8760hPercmain_cal=3,42%

ScriptswritteninC:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/c-sources

Awkscripts:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/AWK-scripts-aggregation-and-statistical-routines_EEA-checks-ver20120131.zip

5.3 Datacaptureformultidaysamplerbaseddatatypesintegratedoveranaveragingperiod

Forhandlingmultidaysamplerbaseddatatypes,weareproposingtochangetheformatandcontentofthedatadeliverytoincludeinformationonthe%ofvaliddatawithinthesamplingperiod.Thecalculationoftheseparametersforaggregationsmaybeperformedasfollows.4

5.3.1 DatacaptureformultidaysamplerbaseddatatypesThedatacaptureformultidaysamplerbaseddatatypesintegratedoveranaveragingperiodiscalculatedastheproportionofvalidmeasurementtime(ataminimumhours,alternativelydays)relativetotalmeasuredtimeintheaveragingperiod,expressedasanpercentage.

KEY NOTE: The data capture for multi day sampler based data types is to be provided via the extended version of the swe:array

Thedatacaptureforagivenaveragingperiodshallbecalculatedasfollows:

Datacapture=ΣiDCi*Nvalid,i/ΣiNi*100%

Where

DCi=thedatacapture(in%)ofthevalidsampleI,thatis,theeffectivesamplingtimeinameasuringperiod5

Nvalid,i=thenumberofhoursinthevalidsamplei(validityflagsample>0)

Ni=numberofhoursinsamplei

4ThisrepresentsadeparturefromthewayinwhichAirBasehastraditionallyperformedthesecalculationswhichispresentsforinformationandcontextinAnnexD.5Forexample,toavoidoverflowofthefilterduringameasuringperiodof8days,activesamplingisdoneduring4x24hours.Inthiscasethedatacaptureforthisperiodis50%.

Page 26: Aggregation rules for e-reporting

Page19

ScriptswritteninC:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/c-sources

Awkscripts:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/AWK-scripts-aggregation-and-statistical-routines_EEA-checks-ver20120131.zip

5.3.2 TimecoverageformultidaysamplerbaseddatatypesThetimecoverageisthepercentageofmeasurementtimeinagivenaveragingperiod.Alsothetimecoverageiscalculatedonbaseofthenumberofhoursinthesampleperiods.Thetimecoverageforagivenaveragingperiodiscalculatedasfollows(weightedaverage):

Timecoverage=ΣiTCi*Ni/Naveraging_period*100%

Where

TCi=thetimecoverageofsamplei

Ni=numberofhoursinsamplei

Naveraging_period=thetotalnumberofhoursinthegivenaveragingperiod(e.g.ayear)

ScriptswritteninC:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/c-sources

Awkscripts:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/AWK-scripts-aggregation-and-statistical-routines_EEA-checks-ver20120131.zip

Page 27: Aggregation rules for e-reporting

Page20

6 CalculationofstatisticsThissectionprovidesadescriptionofcomplianceassessmentandgeneralstatisticsthatarerequiredbythee-Reportingsystem.Thestatisticalareparametersarecalculatedfromtherawand/orbaseaggregationspresentedinsection3.ThestatisticstobecalculatedonapollutantandSamplingPointbasisandthebaseparametersusedarepresentedinthearray.Allstatisticsshallbeaccompaniedbyanassociate%datacapturerateasspecifiedinsection5.

KEY NOTE: The table details all the KEY aggregation (necessary for checking compliance with the different AQ Directives and the IPR Decision to be calculated at SamplingPoint (i.e station) level. The EXTRA statistics might be useful for Air Quality Assessement.

Page 28: Aggregation rules for e-reporting

Page21

KEYANNUAL(ormulti-annual)STATISTICSFORDATAPROVIDEDHOURLY/DAILY

Component****

AggregationbasedonHourlyvalues(…/aq/primaryObservation/hour)

Dailyvalues(…/aq/primaryObservation/day)(…/aq/aggregationprocess/P1D)

Dailymaximum8-hourrunningmean(aggregatedfromhourly)(…/aq/aggregationprocess/P8H-dmax)

Nonhourly/daily(sample)data(…/aq/primaryObservation/week)(…/aq/primaryObservation/fortnight)(…/aq/primaryObservation/month)(…/aq/primaryObservation/quarter)(…/aq/primaryObservation/var)

Sulphurdioxide(SO2)CODE:1

KEYSTATS • annualmean*

• hourswithc>350µg/m3*• wintermean*• periodsof3consecutive

hoursc>500µg/m3*

…/P1Y…/P1Y-hrsAbove350…/winter-avg…/P1Y-3hAbove500

• dayswithc>125μg/m3

• annualmean**• wintermean**

P1Y-daysAbove125P1Ywinter-avg

• annualmeanweightedaverage

• wintermeanweightedaverage

…/P1Y-WA-avg…/winter-WA-avg

EXTR

A • 25thhighesthourlyvalue*

• 99.73percentile*• 50percentile*• hourlymaximum*• hourlyminimum*

…/P1Y-hr-max25P1Y-hr-max-per99.73…/P1Y-hr-per50…/P1Y-hr-max…/P1Y-hr-min

• 4thhighestdailyvalue• 99.18percentile• dailymaximum• dailyminimum

P1Y-day-max4P1Y-day-max-per99.18P1Y-day-maxP1Y-day-min

Nitrogendioxide(NO2)CODE:8

KEY • annualmean*

• hourswithc>200µg/m3*• periods3consecutivehours

c>400µg/m3*

…/P1Y…/P1Y-hrsAbove200…/P1Y-3hAbove400

• annualmean**

P1Y

• annualmeanweightedaverage

…/P1Y-WA-avg

EXTR

A • 19thhighesthourlyvalue*

• 99.79percentile(max19)*• hoursc>400µg/m3*• 50percentile*• hourlymaximum*• hourlyminimum*

…/P1Y-hr-max19…/P1Y-hr-per99.79…/P1Y-hrsAbove400…/P1Y-hr-per50…/P1Y-hr-max…/P1Y-hr-min

Nitrogenoxides(NOx)CODE:9

KE Y• annualmean* …/P1Y • annualmeanweightedaverage

…/P1Y-WA-avg

• 50percentile*• hourlymaximum*• hourlyminimum*

…/P1Y-hr-per50…/P1Y-hr-max…/P1Y-hr-min

Ozone(O3)CODE:7

KEY • hourswithc>180µg/m3*

• hourswithc>240µg/m3*• AOT40*• AOT40averagedover5y*

…/P1Y-hrsAbove180…/P1Y-hrsAbove240…/AOT40c…/AOT40c-P5Y

• dayswithc>120µg/m3• dayswithc>120µg/m3

averagedover3years

…/P1Y-dmaxAbove120…/P3Y-dmaxAbove120

EXTR

A • AOT40forestprotection*

• 50percentile*• annualmean*• hourlymaximum*• hourlyminimum*• summeraverage*• SOMO35*

…/AOT40f…/P1Y-hr-per50…/P1Y…/P1Y-hr-max…/P1Y-hr-min…/summer-avg…/P1Y-SOMO35

• Maximumdaily8-hourmaxinayear

• 26thhighest8hdaymax• 93.15percentile(max26)• daymaxaverageover1y

…/P1Y-dx-max…/P1Y-dx-max26…/P1Y-dmax-per93.15…/P1Y-dx-avg

Page 29: Aggregation rules for e-reporting

Page22

KEYANNUAL(ormulti-annual)STATISTICSFORDATAPROVIDEDHOURLY/DAILY

Component****

AggregationbasedonHourlyvalues(…/aq/primaryObservation/hour)

Dailyvalues(…/aq/primaryObservation/day)(…/aq/aggregationprocess/P1D)

Dailymaximum8-hourrunningmean(aggregatedfromhourly)(…/aq/aggregationprocess/P8H-dmax)

Nonhourly/daily(sample)data(…/aq/primaryObservation/week)(…/aq/primaryObservation/fortnight)(…/aq/primaryObservation/month)(…/aq/primaryObservation/quarter)(…/aq/primaryObservation/var)

Carbonmonoxide(CO)CODE:10

• dayswithc>10mg/m3 …/P1Y-8hdmxAbove10

EXTR

A • annualmean*

• 50percentile*• hourlymaximum*• hourlyminimum*

…/P1Y…/P1Y-hr-per50…/P1Y-hr-max…/P1Y-hr-min

• daymaxaverageover1y• Maximumdaily8-hour

maxover1y

…/P1Y-dx-avg…/P1Y-dx-max

Particulatematter(PM10)CODE:5

KEY • annualmean* …/P1Y

• annualmean**• dayswithc>50µg/m3• 90.4percentile

…/P1Y…/P1Y-daysAbove50…/P1Y-P1D-per90.4

• annualmeanweightedaverage

…/P1Y-WA-avg

EXTR

A • dailymean*

• 50percentile*• hourlymaximum*• hourlyminimum*

…/P1D…/P1Y-hr-per50…/P1Y-hr-max…/P1Y-hr-min

• 90.41percentile• 99percentile• 36thhighestdailyvalue• 50thpercentile• dailymaximum• dailyminimum

…/P1Y-P1D-per90.41…/P1Y-P1D-per99…/P1Y-day-max36…/P1Y-day-per50…/P1Y-day-max…/P1Y-day-min

Particulatematter(PM2.5)CODE:6001

KEY • annualmean*

• interimyearlyAEI*• AEI*

…/P1Y…/AEI-P1Y…/AEI

• annualmean**• interimyearlyAEI• AEI

…/P1Y…/AEI-P1Y…/AEI

• annualmeanweightedaverage

…/P1Y-WA-avg

EXT. • dailymean*

• 50percentile• hourlymaximum*• hourlyminimum*

…/P1D…/P1Y-hr-per50…/P1Y-hr-max…/P1Y-hr-min

• 99percentile• 50percentile• dailymaximum• dailyminimum

…/P1Y-P1D-per99…/P1Y-day-per50…/P1Y-day-max…/P1Y-day-min

Benzene(C6H6)CODE:20

• annualmean* …/P1Y

• 50percentile*• hourlymaximum*• hourlyminimum*

…/P1Y-hr-per50…/P1Y-hr-max…/P1Y-hr-min

Arsenic(As)PM10

CODE:5018Cadmium(Cd)PM10

CODE:5014Nickel(Ni)PM10

CODE:5015Lead(Pb)PM10

CODE:5012Benzo(a)pyreneinPM10

KEY • annualmean** …/P1Y

• annualmeanweightedaverage

…/P1Y-WA-avg

EXTR

A • 50percentile

• dailymaximum• dailyminimum

…/P1Y-day-per50…/P1Y-day-max…/P1Y-day-min

Page 30: Aggregation rules for e-reporting

Page23

KEYANNUAL(ormulti-annual)STATISTICSFORDATAPROVIDEDHOURLY/DAILY

Component****

AggregationbasedonHourlyvalues(…/aq/primaryObservation/hour)

Dailyvalues(…/aq/primaryObservation/day)(…/aq/aggregationprocess/P1D)

Dailymaximum8-hourrunningmean(aggregatedfromhourly)(…/aq/aggregationprocess/P8H-dmax)

Nonhourly/daily(sample)data(…/aq/primaryObservation/week)(…/aq/primaryObservation/fortnight)(…/aq/primaryObservation/month)(…/aq/primaryObservation/quarter)(…/aq/primaryObservation/var)

CODE:5029PollutantswithMonitoringObjective****(seeannexE)

KEY • annualmean* …/P1Y

• annualmean** …/P1Y

EXTR

A • dailymean*

• 50percentile*• hourlymaximum*• hourlyminimum*

…/1D…/P1Y-hr-per50…/P1Y-hr-max…/P1Y-hr-min

• 50percentile• dailymaximum• dailyminimum

…/P1Y-per50…/P1Y-day-max…/P1Y-day-min

Allotherpollutants

EXTR

A • annualmean*

• dailymean*• 50percentile*• hourlymaximum*• hourlyminimum*

…/P1Y…/P1D…/P1Y-hr-per50…/P1Y-hr-max…/P1Y-hr-min

• annualmean**• 50percentile• dailymaximum• dailyminimum

…/P1Y…/P1Y-day-per50…/P1Y-day-max…/P1Y-day-min

NOTES: *Ifhourlyvaluesreported **Ifdailyvaluesreported

***ifvaluesarenothourlyordaily

****Componentcodelistishttp://dd.eionet.europa.eu/vocabulary/aq/pollutant/[code]

Editorsnote:GuidancefromAQUILAoncalculationsispending

Page 31: Aggregation rules for e-reporting

Page24

Thefollowingsectionsmathematicallydescribethestatisticstobecalculatedaspertableabove.

6.1 AveragesandmeansTheannualaverages(means)shallbecalculatedusingtheshortestreportedaveragingtimeavailable

(seeDirective2008/50/EC(EU,2008)AnnexXI).Underthispremise,thepreferenceforcalculationof

annualmeanscanberankedasfollows;hourly,daily,weekly,monthlyetc.(samplerdatamayhave

irregularlyresolvedaveragingperiods,thehighestresolutionaveragingtimesavailableshallbeused

onacasebycasebasis).

6.1.1 ForhourlyanddailydatatypesThemeanforanygivenaveragingperiodshallbecalculatedasfollows:

Mean=ΣiCi/Nvalid

whereCiisthevalidhourly/daily/daymaxconcentrationandthesummationisoverallvalid

hourly/daily/daymaxvaluesmeasuredinthataveragingperiod.Nvalidisthetotalnumberofvalid

hourly/daily/daymaxvaluesintheperiod.

Asnotedabove,themeanshallbecalculatedfromthedataserieswiththehighesttimeresolution,

forexample,ifbothhourlyanddailyvaluesareavailablethemeanshallbecalculatedfromthe

hourlydata.

ScriptswritteninC:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/c-sources

Awkscripts:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/AWK-scripts-aggregation-

and-statistical-routines_EEA-checks-ver20120131.zip

Theresultantaggregationshouldbeencodedas(seeXMLexamplein6.4):

• http://dd.eionet.europa.eu/vocabulary/aq/aggregationprocess/P1D

(seebenchmarkingexample:tc2fromhourly)

• http://dd.eionet.europa.eu/vocabulary/aq/aggregationprocess/P1Y

(seebenchmarkingexample:tc1fromhourly&tc3fromdaily)

• http://dd.eionet.europa.eu/vocabulary/aq/aggregationprocess/P1Y-dx-avg

(seebenchmarkingexample:tc2_dymaxfromdaymax)

• http://dd.eionet.europa.eu/vocabulary/aq/aggregationprocess/summer-avg

(seebenchmarkingexample:tc1fromhourly)

• http://dd.eionet.europa.eu/vocabulary/aq/aggregationprocess/winter-avg

(seebenchmarkingexample:tc8)

Page 32: Aggregation rules for e-reporting

Page25

6.1.2 Formulti-daysamplerbaseddatatypesThemeanforamulti-daysamplerbaseddatatypesshallbeevaluatedinasimilarwaytothedata

capture(seesection5.3),althoughinthisinstanceiscalculatedasthetimeweightedmeanofvalid

measurementsoverthesampleperiod.

Weightedmean=ΣiCvalid,i*Naveraging_period*DCi/ΣiNaveraging_period*DCii=1....n

Where

Cvalid,i=concentrationforvalidsamplingperiodi

Naveraging_periodisthenumberofsecondsintheaveragingperiod.

DCi=thedatacaptureofsampleiasa%(default=100%ifnotprovided)(i.e%ofvaliddata

withintheindividualaveragingperiod)

Whenthesamplingtimefallsacrosstwocalendaryears,thesamplingtimerefersto

timeinthecurrentreportingyearonly

KEYNOTE:Thedatacaptureformultidaysamplerbaseddatatypesistobeprovidedviathe

extendedversionoftheswe:array

Startofsampling

period

Endofsampling

period

Measured

concentratio

n

ng/m3

(C)

Validity

flag

(valid)

Validdata

inperiod

(%)

(DCi)

Seconds

inperiod

()

Weightedconc.

(takingintoaccount

DLflag,ng/m3)

(X*Y*Z)

Weighted

sampled

time??

(Y*Z)

01/01/201100:00 01/02/201100:00 3.90532 1 100 31 12106.493100

01/02/201100:00 01/03/201100:00 1.40378 1 100 28 3930.582800

01/03/201100:00 01/04/201100:00 0.976502 1 70.97 31 2148.372200.07

01/04/201100:00 01/05/201100:00 0.129041 1 40 30 154.851200

01/05/201100:00 01/06/201100:00 0.078314 1 100 31 242.773100

01/06/201100:00 01/07/201100:00 0.088956 1 100 30 266.873000

01/07/201100:00 01/08/201100:00 0.077084 1 100 31 238.963100

01/08/201100:00 01/09/201100:00 0.140637 1 100 31 435.973100

01/09/201100:00 01/10/201100:00 0.070045 1 93.33 30 196.122799.9

01/10/201100:00 01/11/201100:00 0.338542 1 64.52 31 677.122000.12

01/11/201100:00 01/12/201100:00 1.41943 1 100 30 4258.293000

01/12/201100:00 01/01/201200:00 1.09143 1 100 31 3383.433100

Sum 365 28039.84

32500.09

AnnualMean 0.8627620

ScriptswritteninC:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/c-sources

Awkscripts:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/AWK-scripts-aggregation-

and-statistical-routines_EEA-checks-ver20120131.zip

Page 33: Aggregation rules for e-reporting

Page26

Theresultantaggregationshouldbeencodedas(seeXMLexamplein6.4):

• http://dd.eionet.europa.eu/vocabulary/aq/aggregationprocess/P1Y-WA-avg

(seebenchmarkingexamplestc4,tc5,tc6&tc7)

6.1.3 WintermeanThewinteraveragesshallbecalculatedusingtheshortestreportedaveragingtimeavailablelikethe

annualmeans.

Themeanforshallbecalculatedasfollows:

Mean=ΣiCWi/NWvalid

whereCWiisthevalidhourly/daily/varconcentrationandthesummationisoverallvalid

hourly/daily/varvaluesmeasuredoverwinterperiod(1st

OctoberYearX-1to31st

MarchYearX).

NWvalidisthetotalnumberofvalidhourly/daily/varvaluesinthewinterperiod.

Asnotedabove,themeanshallbecalculatedfromthedataserieswiththehighesttimeresolution,

forexample,ifbothhourlyanddailyvaluesareavailablethemeanshallbecalculatedfromthe

hourlydata.

ScriptswritteninC:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/c-sources

Theresultantaggregationshouldbeencodedas(seeXMLexamplein6.4):

• http://dd.eionet.europa.eu/vocabulary/aq/aggregationprocess/winter-avg

Clarification:

ThewintermeancorrespondingtoyearXiscalculatedoverthewintermonths(i.e.1Octoberyear

x-1to31Marchyearx)

Example:

Wintermeancorrespondingtoyear2014correspondstothemeanovertheperiodwithabegindate2013-10-01T01:00:00+01:00andanenddate2014-03-31T24:00:00+01:00.

Page 34: Aggregation rules for e-reporting

Page27

6.2 Otherstatisticsforhourlyanddailydata

6.2.1 PercentilesTheythpercentileshouldbeselectedfromthevalidvalues(forhourly/daily/daymaxconcentrations).

Allthevaluesshallberankedinincreasingorder:

X1≤X2≤X3≤…≤Xk≤…≤XN-1≤XN

TheythpercentileistheconcentrationXk,wherethevalueofkiscalculatedasfollows:

k=(q.N)

Whereqisequaltoy/100andNthenumberofvalidvalues.

Thevalueofk(q.N)shallberoundedofftothenearestwholenumber(values<0.499999…are

roundedto0,values=0.5areroundedto1).

ScriptswritteninC:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/c-sources

Awkscripts:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/AWK-scripts-aggregation-

and-statistical-routines_EEA-checks-ver20120131.zip

TherelationshipofimportantpercentilesfortheAQDirectivestocorrespondingkthhighestvaluesarepresentedbelow

CalculationbasedonthecombinationofPollutant&specificvalues:

kthhighestvalues AQDpercentiles Aggregationcode

…/aq/pollutant/1

…/aq/aggregationprocess/P1D

4th

highestvalue(max4) 99.18percentile P1Y-day-max-per99.18

…/aq/pollutant/1

…/aq/primaryObservation/hour

25th

highestvalue

(max25)

99.73percentile P1Y-hr-max-per99.73

…/aq/pollutant/9

…/aq/primaryObservation/hour

19th

highestvalue

(max19)

99.79percentile P1Y-hr-max-per99.79

…/aq/pollutant/5

…/aq/primaryObservation/dayor

…/aq/aggregationprocess/P1D

AQDirective

90.4percentile P1Y-P1D-per90.4

…/aq/pollutant/5

…/aq/primaryObservation/dayor

…/aq/aggregationprocess/P1D

36th

highestvalue

(max36)

90.41percentile P1Y-P1D-per90.41

…/aq/pollutant/5or/6001

…/aq/primaryObservation/dayor

…/aq/aggregationprocess/P1D

WHO 99percentile P1Y-P1D-per99

…/aq/pollutant/7

…/aq/aggregationprocess/P8H-

dmax

26ht

highestvalue

(max26)

93.15percentile P1Y-dmax-per93.15

…/aq/primaryObservation/houror

…/aq/primaryObservation/day

Median 50percentile P1Y-per50

6.2.2 MaximaThe(annual)maximumshallbecalculatedasfollows:

Page 35: Aggregation rules for e-reporting

Page28

Maximum=max(Ci)

WhereCiisthevalidhourly/daily/daymaxconcentrationsmeasuredinthecalendaryear.

ScriptswritteninC:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/c-sources

Awkscripts:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/AWK-scripts-aggregation-

and-statistical-routines_EEA-checks-ver20120131.zip

Theresultantaggregationshouldbeencodedas:

• http://dd.eionet.europa.eu/vocabulary/aq/aggregationprocess/P1Y-hr-max

• http://dd.eionet.europa.eu/vocabulary/aq/aggregationprocess/P1Y-day-max

• http://dd.eionet.europa.eu/vocabulary/aq/aggregationprocess/P1Y-dx-max

6.2.3 kthhighestvalue(maxk)Calculationofthekthhighestvalueshallbebasedonrankedvalidmeasurementvalues

X1≥X2≥X3≥…≥Xk≥…≥XN1≥XN

ThekthhighestvalueistheconcentrationXkevaluatedindescendingorderfromthemaximum(1st

highest).The4th

,25th

,19th

,26th

and36th

highestvalues(kmax)areimportanttoairquality

regulations,seethearrayatthetopofthissection.

ScriptswritteninC:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/c-sources

Awkscripts:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/AWK-scripts-aggregation-

and-statistical-routines_EEA-checks-ver20120131.zip

CalculationbasedonthecombinationofPollutant&specificvalues:

kthhighestvalues Aggregationcode

…/aq/pollutant/1

…/aq/aggregationprocess/P1D

4th

highestvalue(max4) P1Y-day-max4

…/aq/pollutant/1

…/aq/primaryObservation/hour

25th

highestvalue(max25) P1Y-hr-max25

…/aq/pollutant/9

…/aq/primaryObservation/hour

19th

highestvalue(max19) P1Y-hr-max19

…/aq/pollutant/5

…/aq/primaryObservation/dayor

…/aq/aggregationprocess/P1D

AQDirective

P1Y-day-max36

…/aq/pollutant/7

…/aq/aggregationprocess/P8H-dmax

26ht

highestvalue(max26) P1Y-dx-max26

Page 36: Aggregation rules for e-reporting

Page29

6.2.4 AOT40(onlyO3)AOT40isthecumulativeconcentrationobservedabove80µg/m

3

(=40partsperbillion)basedon

hourlymeasurements.Therearecurrently2differentAOT40tobecalculated:

• AOT40crops(vegetationprotection)–1Mayto31July–AOT40c

• AOT40forest(forestprotection)–1Aprilto30September–AOT40f

InordertocalculateAOT40,somebaseaggregationmightbenecessary.Thesearedescribedbelow

inmoredetailinsection6.2.4.1.TwostatisticsshallbecalculatedinordertoobtainafinalAOT40for

compliance:

• AOT40measured

• AOT40estimate(=final)

AOT40measured=Σimax(0,(Ci-80))

whereCiisthehourlymeanozoneconcentrationinµg/m3

andthesummationistotheperiod08.00

–20.00CentralEuropeanTimeeachdayinacertaintimeperiod6

.FortheAOT40vegetation

(AOT40c)thetimeperiodisthe3monthgrowingseasoncropsfrom1Mayto31Julyeachyear.For

theAOT40f,thetimeperiodis1Aprilto30September.

AOT40hasadimensionof(µg/m3

)·hoursandissensitivetomissingvalues.Therequiredproportion

ofvaliddatais90%oftheonehourvaluesoverthetimeperioddefinedforcalculatingtheAOT40

value.Therefore,AOT40measuredshallberoutinelycorrectedtofulltimecoveragetoderive

AOT40estimateasfollows;

AOT40estimate=(AOT40measured·Nperiod)/Nvalid

whereNvalidisthenumberofvalidhourlyvaluesandNperiodisthenumberofhoursintheperiod.

6.2.4.1 BaseaggregationforAOT40InordertoprocessAOT40,someinternalbaseaggregationmightbenecessarywhichhasbeen

includedinthecodelist:

• http://dd.eionet.europa.eu/vocabulary/aq/aggregationprocess/AOT40h

AOT40h:max(0,Ci–80)

Calculatethedifferencebetweenhourlyvalueinµg/m-3

and80forhourswithStartTime=>07:00

UTCandEndTime=<19:00andperiodYYYY-04-01T01:00:00+00:00andYYYY-09-31T24:00:00.

6TheAQDprescribestheuseofCETastimereferenceinthecalculationoftheAOT40;thisisincontrasttothecalculationsforallother

aggregatesandaverageswhicharebasedonthetimereferenceofthenetworki.e.thetimereferencesdeclaredintheswe:DataArrayof

thedatasetEdelivery..

Page 37: Aggregation rules for e-reporting

Page30

Inaddition,thenumberofvalidhourlyvalueswillneedtobecalculated.Thiswilldependon

whethertheAOT40iscalculatedfortheprotectionofvegetationandtheforestprotection.The

codelistsare:

• http://dd.eionet.europa.eu/vocabulary/aq/aggregationprocess/AOT40c-nv

• http://dd.eionet.europa.eu/vocabulary/aq/aggregationprocess/AOT40f-nv

AOT40c-nv

Numberofvalidhourlyvalues(flag1,2,3)betweenStartTime=>07:00UTCandEndTime=<19:00

ANDYYYY-05-01T01:00:00+00:00andYYYY-07-31T24:00:00+00:00.

AOT40f-nv

Numberofvalidhourlyvalues(flag1,2,3)betweenStartTime=>07:00UTCandEndTime=<19:00

ANDYYYY-04-01T01:00:00+00:00andYYYY-09-31T24:00:00+00:00).

6.2.4.2 AOT40forvegetationprotectionFortheAOT40vegetation(AOT40c)thetimeperiodisthe3monthgrowingseasonforcropsfrom1

Mayto31Julyeachyear.

AOT40cmeasured

SUMofallAOT40-hbetweenYYYY-05-01T01:00:00+00:00andYYYY-07-31T24:00:00+00:00.

AOT40c

AOT40c=AOT40c-measured*1104/AOT40c-nv

6.2.4.3 AOT40forforestprotectionFortheAOT40forest(AOT40f)thetimeperiodfrom1Aprilto30Septembereachyear.

AOT40fmeasured

SUMofallAOT40-hbetweenYYYY-04-01T01:00:00+00:00andYYYY-09-30T24:00:00+00:00.

AOT40f

AOT40f=AOT40f-measured*2196/AOT40f-nv

Page 38: Aggregation rules for e-reporting

Page31

6.2.4.4 AOT40forvegetationprotectionaveragedover5years

• http://dd.eionet.europa.eu/vocabulary/aq/aggregationprocess/AOT40c-P5y

Ayearshallbeincludedinthe5-yearaverageifatleast86%ofdatacoverageachievedforthehours

between0800and2000CETinthisyear(949hours).

ScriptswritteninC:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/c-sources

Awkscripts:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/AWK-scripts-aggregation-

and-statistical-routines_EEA-checks-ver20120131.zip

6.2.5 SOMO35(onlyO3)ForquantificationofthehealthimpactstheWorldHealthOrganisationrecommendstheuseofthe

SOMO35indicator.SOMO35standsformeansthesumofthedifferencesbetweenmaximumdaily

8-hourrunningmeanconcentrationsgreaterthan70µg/m3

(=35partsperbillion)and70µg/m3

.

• http://dd.eionet.europa.eu/vocabulary/aq/aggregationprocess/SOMO35

SOMO35measured=Σimax(0,(Ci-70))

whereCiisthemaximumdaily8-hourrunningmeanozoneconcentrationinµg/m3

andthe

summationisoveralldayspercalendaryear.

SOMO35hasadimensionof(µg/m3

)·days.SOMO35issensitivetomissingvaluesandacorrectionto

fulltimecoveragehasbeenapplied:

SOMO35estimate=(SOMO35measured·Nperiod)/Nvalid

whereNvalidisthenumberofvaliddailyvaluesandNperiodisthenumberofdaysperyear.

Page 39: Aggregation rules for e-reporting

Page32

6.2.6 AEI(onlyPM2.5)(AverageExposureIndicator)PartAofAnnexXIVofDirective2008/50/ECdefinesthattheAEIshallbeassessedasathree-

calendaryearrunningannualmeanconcentrationaveragedoverallsamplingpointsestablished

pursuanttoSectionBofAnnexVoftheDirective.

KEYNOTEFOREEADEVELOPERS:AEIstatisticsarecalculatedatNationallevel.Forthisreason,thecalculations

atSamplingPointlevelforPM2.5willgoasfarascalculatingtheAnnualaverage(P1Y)andthecorresponding

datacapture.

ToensuretransparentandunambiguouscalculationforthereportedAEI,thefollowingshallbe

observed:

• calculatetheannualaveragePM2.5concentrationateachAEImonitoringstation,applying

thecriterialaiddowninAnnexXI.AofDir.2008/50/ECforeachyear

• calculatetheaverageoverallAEImonitoringstationswithintheMSforeachyear

• calculatetheaverageoverthreeyears(theactualreportingyear,andthetwoyearsbefore).

Theseaggregationstepshavetobeappliedondatawithnumericaccuracyavailableinthe

monitoringnetwork.Roundinghastobedoneattheendoftheaggregationprocedure.

Dataonstationsandmeasurementconfigurationsareconsideredtobestable.Anymodificationof

thesetofAEImonitoringstationsisstronglydiscouraged.Theselectionofthesamplingpointshasto

bedocumentedindatasetD.

TheAEIshallbereportedannuallyasathreeyearrunningmean(coveringtheactualreportingyear,

andthetwoyearsbefore).

Inthecasewhenthedatacaptureof≥90%wasnotachievedthenitisrecommendedtofollowthe

proceduredevelopedbyAQUILA.[seeAQUILA_AEIguidanceasaseparatedocument].

6.2.7 NationalExposureReductionTarget(NERT)ItisacknowledgedthatthetablegiveninAnnexXIV,BofDirective2008/50/ECisnotconsistentas

regardsthenumericalaccuracyoftheinitialconcentrationthresholdfortheAEI.Itisrecommended

thattheinitialAEIconcentrationthresholdshouldbepresentedtoonedecimalplacei.e.8.5,13.0,

18.0and22.0µg/m3.Inordertobeconsistent,alsothenumericalaccuracyoftheAEIobtainedin

practiceinaMSshouldberoundedto1decimalplace.

Example:theaverageexposureindicatorofoneMSisequalto16.4µg/m3.Inordertoestablishthe

reductiontarget,thisvaluehastobecomparedwiththeinitialconcentrationthresholdof18.0

µg/m3.

Page 40: Aggregation rules for e-reporting

Page33

6.3 CalculationofbasicexceedanceinformationSomebasicexceedanceinformationisrequiredtosupporttheassessmentofattainment

environmentalobjectivesandevaluationofUTDdataflows.

Todetermineexceedancesituations,concentrationsarecomparedwithathreshold(known

variouslyaslimitvalues,targetvalues,thresholdsandmarginsabovethresholdsintheDirectives).In

thiscomparisonnumericalroundingshallbethelaststepofanycalculation,i.e.immediatelybefore

comparingtheresultwithanythresholdofanytypeandshallbedoneonlyonce.Forinformationon

thehowvalidityandverificationflagsshallbeappliedaspartofexceedancecalculationseesection

2.1.1.Ingeneral,theverificationstatus(flag)forvalidatedassessmentdatasets(DataflowsE1a–

measurementsandE1b-modelling)canonlybe3(verified).TheverificationstatusforUTDdatasets

(DataflowsE2a)maybeofanytype.

Theroundingoffrulesshallbebasedontheprinciplepresentedinthetablebelow;

Valuex Numberofdecimals

x≥10 integer

1≤x<10 1decimal

0.1≤x<1 2decimals

0.01≤x<0.1 3decimals

Etc…

DataExample1

PM10dailyvalueof50.49μg/m3

wouldberoundedto50μg/m3

(whencomparingthisvaluetothe

dailylimitvalueof50μg/m3

theresultwouldbeanoexceedanceonthatday.

DataExample2

PM10dailyvalueof50.5μg/m3

wouldberoundedto51μg/m3

(whencomparingthisvaluetothe

dailylimitvalueof50μg/m3

theresultwouldbeanexceedance.

DataExample3

Ozone(O3)hourlyvalueof180.49μg/m3

wouldberoundedto180μg/m3

(whencomparingthis

valuetothehourlyinformationthresholdof180μg/m3

theresultwouldbeanoexceedanceofthe

informationthreshold).

DataExample4

Ozone(O3)hourlyvalueof180.50μg/m3

wouldberoundedto181μg/m3

(whencomparingthis

valuetothehourlyinformationthresholdof180μg/m3

theresultwouldbeanexceedanceofthe

informationthreshold).

DataExample5

Page 41: Aggregation rules for e-reporting

Page34

Ozone(O3)hourlyvalueof180.90μg/m3

wouldberoundedto181μg/m3

(whencomparingthis

valuetothehourlyinformationthresholdof180μg/m3

theresultwouldbeanexceedanceofthe

informationthreshold).

DataExample6

Benzeneannualmeanof4.36μg/m3

wouldberoundedto4.4μg/m3

(whencomparingthisvalueto

thecalendaryearlimitvalueof5μg/m3

theresultwouldreturnnoexceedanceofthelimitvalue).

DataExample7

Benzeneannualmeanof5.12μg/m3

wouldberoundedto5.1μg/m3

(whencomparingthisvalueto

thecalendaryearlimitvalueof5μg/m3

theresultwouldreturnanexceedanceofthelimitvalue).

6.3.1 Exceedanceofthresholdsbasedoncalendaryear,wintermeanandmaximumdailyeighthourmeanaggregatedstatistics

Anexceedanceofthecalendaryear(annualmean),wintermean(1Octoberto31March)and

maximumdailyeighthourmeanenvironmentalthresholdswhenaroundedaveragefromatime

seriesofvalidmeasurementvaluesis>yμg/m3

(withy=limit,thresholdortargetvalue).

6.3.2 Numberofhoursordayswithconcentration>yμg/m3Thenumberofhoursordayswithroundedconcentration>yμg/m

3

(withy=limitorthreshold

value)shallbecalculatedfromthevalidmeasurementvalues:

Z1,Z2,Z3,…,Zk,…,ZN-1,ZN

NisthenumberofZk-valuesforwhichZk>yμg/m3

whereZkistheconcentrationroundedaccordingtotherulesgivenbefore.

ScriptswritteninC:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/c-sources

Awkscripts:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/AWK-scripts-aggregation-

and-statistical-routines_EEA-checks-ver20120131.zip

6.3.3 Threeconsecutivehourswithconcentration>yμg/m3Threeconsecutivehoursareinexceedancewhenaconsecutivemeasurementtriple(Zk-1,Zk,Zk+1)fromatimeseriesofvalidmeasurementvaluesis>yμg/m

3

(withy=limitorthresholdvalue).

Z1,Z2,Z3,…,Zk,…,ZN-1,ZN

Nisthenumberoftriplesinexceedance.

Page 42: Aggregation rules for e-reporting

Page35

ScriptswritteninC:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/c-sources

Awkscripts:http://acm.eionet.europa.eu/schemas/airbase/calc_stats_aggregs/AWK-scripts-aggregation-

and-statistical-routines_EEA-checks-ver20120131.zip

6.4 XMLencodingofaggregatedstatisticsAggregatedstatisticsgeneratedusingtherulespresentedabovewillbestoredandmadeavailable

viaanaggregationanddownloadserviceforallmeasurementdata.Theresultsofaggregationswill

formpartofDataflowF-InformationongeneratedaggregateddataandwillbeencodedinXML.

Figure4presentsaproposedexampleXMLencodingofaggregatedstatics(DataflowF).The

exampleisconfiguredsimilarlytotheDataflowEdeliveriespresentedinsection2,usinga

combinationofGML,O&MandSWEdatastandardsallofwhichareimportedbytheAQD.xsd.In

contrasttotheDataflowEdeliverieswhichutilisedanswe:DataBlocktoencodemeasurementsover

theobservationalperiod,DataflowFwilluseasimpleswe:DataRecordelementencodingforthe

aggregatedstatisticsderivedfrominputmeasurements.Theinputdatasets(DataflowE)usedto

deriveaggregateddata(DataflowF)maybecitedviaxlinkhrefwithinthedataflowFwithinthe

om:relatedObservationelement.

Figure4ExampleXMLinstancefileoftheproposedXMLencodingofDataflowF–aggregatedstatistics

<gml:featureMember> <om:OM_Observation gml:id="AggregatedObservation_1"> <om:phenomenonTime> <gml:TimePeriod gml:id="ObserrvationTimePeriod_3"> <gml:beginPosition>2010-01-01T01:00:00+01:00</gml:beginPosition> <gml:endPosition>2010-12-31T24:00:00+01:00</gml:endPosition> </gml:TimePeriod> </om:phenomenonTime> <om:resultTime> <gml:TimeInstant gml:id="ObservationResultInstant_3"> <gml:timePosition>2011-07-29T14:00:00+01:00</gml:timePosition> </gml:TimeInstant> </om:resultTime> <om:procedure xlink:href="http://environment.data.gov.uk/air-quality/so/GB_SamplingpointProcess_2774"/> <om:parameter> <om:NamedValue> <om:name xlink:href="http://dd.eionet.europa.eu/vocabulary/aq/processparameter/EO”/> <om:value> <aqd:environmentalObjective> <aqd:EnvironmentalObjective> <aqd:objectiveType xlink:href="http://dd.eionet.europa.eu/vocabulary/aq/objectivetype/LV”/> <aqd:reportingMetric xlink:href="http://dd.eionet.europa.eu/vocabulary/aq/reportingmetric/hrsAbove”/> <aqd:protectionTarget xlink:href="http://dd.eionet.europa.eu/vocabulary/aq/protectiontarget/H”/> </aqd:EnvironmentalObjective> </aqd:environmentalObjective> </om:value> </om:NamedValue> </om:parameter> <om:parameter> <om:NamedValue> <om:name xlink:href="http://dd.eionet.europa.eu/vocabulary/aq/processparameter/AT”/> <om:value>"Fixed measurement"</om:value> </om:NamedValue> </om:parameter> <om:observedProperty xlink:href="http://dd.eionet.europa.eu/vocabulary/aq/pollutant/8”/> <om:featureOfInterest xlink:href="http://data.umweltbundesamt.at/inspire/AT.UBA.AQD/SamplingFeature_1"/>

Page 43: Aggregation rules for e-reporting

Page36

<om:resultQuality> <gmd:DQ_DomainConsistency> <gmd:result> <gmd:DQ_ConformanceResult> <gmd:specification> <gmd:CI_Citation> <gmd:title> <gco:CharacterString>EC/50/2008</gco:CharacterString> </gmd:title> <gmd:date> <gmd:CI_Date> <gmd:date> <gco:Date>2008</gco:Date> </gmd:date> <gmd:dateType> <gmd:CI_DateTypeCode codeListValue="publication" codeList="eng">publication</gmd:CI_DateTypeCode> </gmd:dateType> </gmd:CI_Date> </gmd:date> </gmd:CI_Citation> </gmd:specification> <gmd:explanation> <gco:CharacterString>Time Coverage</gco:CharacterString> </gmd:explanation> <gmd:pass> <gco:Boolean>true</gco:Boolean> </gmd:pass> </gmd:DQ_ConformanceResult> </gmd:result> </gmd:DQ_DomainConsistency> </om:resultQuality> <om:resultQuality> <gmd:DQ_DomainConsistency> <gmd:result> <gmd:DQ_ConformanceResult> <gmd:specification> <gmd:CI_Citation> <gmd:title> <gco:CharacterString>EC/50/2008</gco:CharacterString> </gmd:title> <gmd:date> <gmd:CI_Date> <gmd:date> <gco:Date>2008</gco:Date> </gmd:date> <gmd:dateType> <gmd:CI_DateTypeCode codeListValue="publication" codeList="eng">publication</gmd:CI_DateTypeCode> </gmd:dateType> </gmd:CI_Date> </gmd:date> </gmd:CI_Citation> </gmd:specification> <gmd:explanation> <gco:CharacterString>Data Capture</gco:CharacterString> </gmd:explanation> <gmd:pass> <gco:Boolean>true</gco:Boolean> </gmd:pass> </gmd:DQ_ConformanceResult> </gmd:result> </gmd:DQ_DomainConsistency> </om:resultQuality> <om:resultQuality> <gmd:DQ_DomainConsistency> <gmd:result> <gmd:DQ_QuantitativeResult> <!-- <gmd:valueUnit xlink:href="http://dd.eionet.europa.eu/vocabulary/uom/statistics/percentage"/> -->

Page 44: Aggregation rules for e-reporting

Page37

<gmd:valueUnit> <gml:BaseUnit gml:id="PercentageUnit_3"> <gml:identifier codeSpace="http://dd.eionet.europa.eu/vocabularies/aq/resultquality/uncertaintyestimation/"/> <gml:catalogSymbol codeSpace=" http://dd.eionet.europa.eu/vocabulary/uom/statistics/">http://dd.eionet.europa.eu/vocabulary/uom/statistics/percentage</gml:catalogSymbol> <gml:unitsSystem xlink:href="http://www.opengis.net/def/uom/UCUM/"/> </gml:BaseUnit> </gmd:valueUnit> <gmd:value> <gco:Record> 5 </gco:Record> </gmd:value> </gmd:DQ_QuantitativeResult> </gmd:result> </gmd:DQ_DomainConsistency> </om:resultQuality> <om:result xsi:type="swe:DataArrayType"> <swe:elementCount> <swe:Count> <swe:value>1</swe:value> </swe:Count> </swe:elementCount> <swe:elementType name=" FixedAggregatedObservations"> <swe:DataRecord> <swe:field name="StartTime"> <swe:Time definition="http://www.opengis.net/def/property/OGC/0/SamplingTime"> <swe:uom xlink:href="http://www.opengis.net/def/uom/ISO-8601/0/Gregorian"/> </swe:Time> </swe:field> <swe:field name="EndTime"> <swe:Time definition="http://www.opengis.net/def/property/OGC/0/SamplingTime"> <swe:uom xlink:href="http://www.opengis.net/def/uom/ISO-8601/0/Gregorian"/> </swe:Time> </swe:field> <swe:field name="Verification"> <swe:Category definition="http://dd.eionet.europa.eu/vocabularies/aq/observationverification”/> </swe:field> <swe:field name="Validity"> <swe:Category definition="http://dd.eionet.europa.eu/vocabularies/aq/observationvalidity”/> </swe:field> <swe:field name="Value"> <swe:Quantity definition=" http://dd.eionet.europa.eu/vocabulary/aq/aggregationprocess/P1Y-hrsAbove200"> <swe:uom code=" http://dd.eionet.europa.eu/vocabulary/uom/statistics/count"/> </swe:Quantity> </swe:field> </swe:DataRecord> </swe:elementType> <swe:values>2010-01-01T01:00:00+01:00,2010-12-31T24:00:00+01:00,1,1,20@@</swe:values> </om:result> </om:OM_Observation> </gml:featureMember>

Page 45: Aggregation rules for e-reporting

Page38

7 Up-To-DateandSummerOzoneReportingcalculations

7.1 DatasourcesForUp-To-Date(UTD)data,countrieswillprovidetheprimarydatainatimelymannerinorderto

submitthedataasearlyaspossible.Ideallydatawillbeprovidedonanhourlybasisasinthecurrent

operationalNearRealTime(NRT)systemattheEEA.

TheUTDprimarydatawillbereportedwithatimestampandvalidityandaverificationstatusflagas

previouslydiscussedandpresentedintheexampleXMLinFigure1.

Section6,describesallthestatisticstobecarriedoutforallprimarydata.Thissectiondescribesall

specificstatisticstobecarriedoutonUTDonlydata.AllthestatisticsinSection6applicableto

hourlydatashallbecarriedoutusingUTDdata

7.2 RoundingoffrulesSeesection6.3.

7.3 AggregationsSeethe75%ruleinsection3.

7.4 AggregatingvaliddataForanyaggregation,onlythosevalueswithavalidityflagof“Valid”(1),“Validbelowdetectionlimit

andthemeasurementvalueisgiven”(2)or“Validbelowdetectionlimit&numberreplacedby

0.5*detectionlimit”(3)aretobeused.ForUTDdata,mostvaliddatawillbeflagas1.

Alldata,regardlessoftheirvaliditystatus,shouldbestoredintheUTDdatabase.ThiswillallowEEA,

ETC/ACMandthedataprovidertoassessthedatacapture.Thiswillallowthesystemtodistinguish

betweendataofallvaliditydatatypes.Provisionallyweproposeanotherinternallygeneratedflag

whichwillbeusedtoidentifypartsofUTDtimeseriesnotdeliveredbydataprovideras0.Thisis

analogouswithvalidityflagusedinEOIreportingwhichwhenacompletetimeseriesisdelivered(for

allhoursinayear)usesavalidityflag=0toindicatenomeasurementisavailableforthetimeperiod

specified.Likewiseunderthesamesystem,ifthereisagapinthetimeseriesthemissingtimeseries

isflaggedwithvalidityflag=0.

7.5 Verificationofdata.Seesection2.1.1

7.6 PercentageofvaliddataHavingtakenintoaccountthe75%criteriaofminimumrequiredseesection3tocalculate8hourly

meansanddailymaximum8hourlymean,itisimportantthatforanygivenaggregation,thesystem

alsocalculatesthepercentageofvaliddatathattheaggregationhasused.Inparticular,the

followingareimportant:

a) %ofvaliddataincluding1to3

b) %ofnotvalidduetostationmaintenanceorcalibration(-99)

Page 46: Aggregation rules for e-reporting

Page39

7.7 CalculationstatisticsonUTDdataThetablebelowgivestheEnvironmentalObjectivesandReportingMetricscoveredforozone(O3),

nitrogendioxide(NO2)andsulphurdioxide(SO2)usedinUTD

Table5EnvironmentalObjectivesandReportingMetricsrelevanttoUTD

Formula Protection

target

Environ

-mental

Objective

type(Code

(1))

Averaging

periodof

assessments

ReportingMetricof

environmentalobjective

Numericalvaluesof

theenvironmental

objective(allowed

numberof

exceedances)

NO2 Health ALT 1hour Threeconsecutivehoursin

exceedance(atlocations

representativeofairquality

overatleast100km2oran

entirezoneoragglomeration,

whicheverissmaller*)

400μg/m3

SO2 Health ALT 1hour Threeconsecutivehoursin

exceedance(atlocations

representativeofairquality

overatleast100km2oran

entirezoneoragglomeration,

whicheverissmaller*)

500μg/m3

O3 Health LTO Maximum

daily

8-hourmean

Dayswhenmaximumdaily

eight-hourmeanexceeded

thelongtermobjectivein1

calendaryear

120μg/m3

INT Onehour Hoursinexceedanceina

calendaryear

180μg/m3

ALT Onehour Hoursinexceedanceina

calendaryear

240μg/m3

*PleasenotethatfortheNO2andSO2HealthAlertthresholdofthreeconsecutivehoursin

exceedancesisalwayscalculatedduetocurrentlymissinginformationonthe100km2criteria

Thefollowingsectionspresentdataflowdiagramswhichdescribetheaggregation,statistical

calculations,roundingatstoragerequirementsfordifferentUTDmetricsandpollutants.

Page 47: Aggregation rules for e-reporting

Page40

7.7.1 ALT–NO2:Numberoftimeswhen3consecutivehourshavebeenaboveALTenvironmentalObjectiveof400mg/m3

Page 48: Aggregation rules for e-reporting

Page41

7.7.2 ALT–SO2:Numberoftimeswhen3consecutivehourshavebeenaboveALTenvironmentalObjectiveof500mg/m3

Page 49: Aggregation rules for e-reporting

Page42

7.7.3 LTO–Max.daily8-hourmean-Dayswhenmaxdaily8-hourmeanexceededtheLTOinoneyear-120mg/m3

Page 50: Aggregation rules for e-reporting

Page43

7.7.4 O3-Health-INT-Onehour-Hoursinexceedanceinacalendaryear-180mg/m3

Page 51: Aggregation rules for e-reporting

Page44

7.7.5 O3->Health->ALT->Onehour->Hoursinexceedanceinacalendaryear->240mg/m3

7.8 AdditionalaggregationonSummerOzoneReportingandoutputreportInadditiontotheenvironmentalobjectivescalculationrequiredabovewhicharerequired

throughouttheyeartheSummerOzoneReporting(SOR)arerequiredfortheperiodsbetweenApril

andSeptemberhttp://www.eea.europa.eu/maps/ozone/compare/explorer.SORrequiresthe

followingmetrictobecalculatedandevaluatedseparatelyoverthisperiod

• HealthLTOforozone,• HealthINTforozoneand• HealthALTforozone.

TheaggregationforSORwillneedtobegroupedinordertoproducethereportsimilarto

http://www.eea.europa.eu/maps/ozone/compare/explorer.Thedataiscurrentlygroupedintheas

follows:

1. Countrypermonth2. Countrypersummerseason

Page 52: Aggregation rules for e-reporting

Page45

3. Europepermonth4. Europepersummerseason

Inthefuture,thegroupingmightbecarriedoutbyzonedeclaredviadatasetBoftheIPR.

ThefollowingdiagramsreflectthespecificoutputsnecessarytocalculatetheSORaggregation

statistics.

Page 53: Aggregation rules for e-reporting

Page46

7.8.1 LTO–Max.daily8-hourmean–I

Page 54: Aggregation rules for e-reporting

Page47

7.8.2 INT&ALT–hourlymean

Page 55: Aggregation rules for e-reporting

Page48

8 ReferencesEU(2004):Directive2004/107/ECoftheEuropeanParliamentandtheCouncilof15December2004

relatingtoarsenic,cadmium,mercury,nickelandpolycyclicaromatichydrocarbonsinambientair

(fourthDaughterDirective(2004/107/EC)).OfficialJournalL23,26/01/2005,pp.3–16.See

http://ec.europa.eu/environment/air/ambient.htm

EU(2008):Directive2008/50/ECoftheEuropeanParliamentandtheCouncilof21May2008on

ambientairqualityandcleanerairforEurope.OfficialJournalL152,11/06/2008,pp.1–44.See

http://ec.europa.eu/environment/air/quality/legislation/existing_leg.htm

EU(2011):Directive2011/850/ECoftheEuropeanParliamentandtheCouncilof17December2011

layingdownrulesforDirectives2004/107/ECand2008/50/ECoftheEuropeanParliamentandofthe

Councilasregardsthereciprocalexchangeofinformationandreportingonambientairquality.

OfficialJournalL335,17/12/2011,pp.86–106.See

http://ec.europa.eu/environment/air/quality/legislation/existing_leg.htm

EU(2012):GuidanceontheImplementingProvisionsfortheDirectives2004/107/ECand

2008/50/EC.IndevelopmentinlinewiththeImplementingProvisions.

Page 56: Aggregation rules for e-reporting

Page49

AnnexA EnvironmentalobjectivesandreportingmetricsLV:limitvalue,LVMT:Limitvalueplusmarginoftolerance,TV:targetvalue,LTO:long-term

objective,INT:Informationthreshold,ALT:Alertthreshold,CL:Criticallevel,NAT:Assessmentof

naturalcontribution,WSS:Assessmentofwintersandingandsalting,ERT:Exposurereduction

target,ECO:Exposureconcentrationobligation;*indicates:atlocationsrepresentativeofairquality

overatleast100km2

oranentirezoneoragglomeration,whicheveristhesmaller

Formula Protection

target

Env.

Objective

type

ReportingMetric Objective

Value

Averaging

period

Alternative

ReportingMetric

Targetdate

NO2 Health LV Hoursinexceedance

inacalendaryear

200µg/m3

(18)

calendaryear max19(99.79

percentile)

1.1.2010

LVMT

LV Annualaverage 40µg/m3

calendaryear 1.1.2010

LVMT

ALT (Numberof)three

consecutivehoursin

exceedance*

400µg/m3

NOx Vegetatio

n

CL Annualaverage 30µg/m3

calendaryear

PM10 Health LV Daysinexceedance

inacalendaryear

50µg/m3

(35) calendaryear max36(90.41

percentile)

LV Annualaverage 40µg/m3

calendaryear

WSS Deducteddaysin

exceedanceina

calendaryear

50µg/m3

calendaryear

Deductionofannual

average

40µg/m3

calendaryear

NAT Deducteddaysin

exceedanceina

calendaryear

50µg/m3

calendaryear

Deductionofthe

annualaverage

40µg/m3

calendaryear

PM2.5 Health ECO AverageExposure

Indicator:

(calculationsee

Directive

2008/50/EC)

20µg/m3

3subsequent

calendar

years

1.1.2015

ERT Exposurereduction

target

Percentage

reduction

1.1.2020

Page 57: Aggregation rules for e-reporting

Page50

Formula Protection

target

Env.

Objective

type

ReportingMetric Objective

Value

Averaging

period

Alternative

ReportingMetric

Targetdate

TV Annualaverage 25µg/m3

calendaryear 1.1.2010

LV 25µg/m3

(20

µg/m3)

1.1.2015

(1.1.2020)

LVMT 27(2012);26

(2013,2014);

25(2015)

SO2 Health LV Hoursinexceedance

inacalendaryear

350µg/m3

(24)

calendaryear max25(99.73

percentile)

1.1.2005

Daysinexceedance

inacalendaryear

125µg/m3

(3) calendaryear max4(99.18

percentile)

1.1.2005

ALT (Numberof)three

consecutivehoursin

exceedance*

500µg/m3

NAT Deductedhoursin

exceedanceina

calendaryear

350µg/m3

calendaryear

Deducteddaysin

exceedanceina

calendaryear

125µg/m3

calendaryear

Vegetatio

n

CL Annualaverage 20µg/m3

calendaryear

Averagevalueover

thewintermonths

(winteraverage),i.e.

1Octoberyearx-1

to31Marchyearx

20µg/m3

Wintermean

O3 Health TV Dayswhen

maximumdaily8-

hourmean

exceededthetarget

value(averagedover

threeyears)

120µg/m3

(25)

3years max26(93.15

percentile)

1.1.2010

LTO (numberof)days

whenmaximum

daily8-hourmean

exceededthelong

termobjectivein

onecalendaryear

120µg/m3

(1)

calendaryear

INT (Numberof)hoursin

exceedanceina

calendaryear

180µg/m3

ALT (Numberof)hoursin

exceedanceina

calendaryear

240µg/m3

Page 58: Aggregation rules for e-reporting

Page51

Formula Protection

target

Env.

Objective

type

ReportingMetric Objective

Value

Averaging

period

Alternative

ReportingMetric

Targetdate

Vegetatio

n

TV AOT40(calculation

seeDir.2008/50/EC

AnnexVII)(averaged

overfiveyears)

180000

(µg/m3).h

Mayuntil

July;averaged

over5years

1.1.2010

LTO AOT40(calculation

seeDir.2008/50/EC

AnnexVII)

(calculationover1

year)

6000

(µg/m3).h

MayuntilJuly

CO Health LV (Numberof)days

whenmaximum

daily8-hourmean

exceededthelimit

value

10mg/m3

(1)

calendaryear 1.1.2005

Benzene Health LV Annualaverage 5µg/m3 calendaryear 1.1.2010

Lead Health LV Annualaverage 0.5µg/m3 1.1.2005

Cadmiu

m

Health TV Annualaverage 5ng/m3

Arsenic Health TV Annualaverage 6ng/m3

Nickel Health TV Annualaverage 20ng/m3

B(a)P Health TV Annualaverage 1ng/m3

Page 59: Aggregation rules for e-reporting

Page52

AnnexB Marginoftoleranceandupper/lowerassessmentthresholdsFormula Protection

target

Env.

Objective

type

ReportingMetric Objective

Value

MOT LAT UAT

NO2 Health LV Hoursinexceedancein

acalendaryear

200µg/m3 100

µg/m3

140

µg/m3

LVMT

LV Annualaverage 40µg/m3 26

µg/m3

32

µg/m3

LVMT

NOx Vegetation CL Annualaverage 30µg/m3 19.5

µg/m3

24

µg/m3

PM10 Health LV Daysinexceedancein

acalendaryear

50µg/m3 25

µg/m3

35

µg/m3

LV Annualaverage 40µg/m3 20

µg/m3

28

µg/m3

TV Annualaverage 25µg/m3

LV 25µg/m3(20

µg/m3)

2(2012);1

(2013,2014);0

(2015)

12

µg/m3

17

µg/m3

LVMT 27(2012);26

(2013,2014);25

(2015)

SO2 Health LV Hoursinexceedancein

acalendaryear

350µg/m3

Daysinexceedancein

acalendaryear

125µg/m3

50

µg/m3

75

µg/m3

Vegetation CL Annualaverage 20µg/m3

Averagevalueoverthe

wintermonths(winter

average),i.e.1

Octoberyearx-1to

31Marchyearx

20µg/m3

8

µg/m3

12

µg/m3

CO Health LV (Numberof)days

whenmaximumdaily

8-hourmeanexceeded

thelimitvalue(annual

mean?)

10mg/m3

.5*10=

5

µg/m3

.7*10=

7

µg/m3

Benzene Health LV Annualaverage 5µg/m3

2

µg/m3

3.5

µg/m3

Lead Health LV Annualaverage 0.5µg/m3

.25

µg/m3

0.35

µg/m3

Cadmium Health TV Annualaverage 5ng/m3

2

ng/m3

3

ng/m3

Arsenic Health TV Annualaverage 6ng/m3

2.4

ng/m3

3.6

ng/m3

Nickel Health TV Annualaverage 20ng/m3

10

ng/m3

14

ng/m3

B(a)P Health TV Annualaverage 1ng/m3

0.4

ng/m3

0.6

ng/m3

Page 60: Aggregation rules for e-reporting

Page53

AnnexC Definitionoftheaveragingtime“var”Theaveragingtimeistheperiodofthesample(enddate/timeminusstartdate/time).Ifthesample

periodsofacomponentdiffer25%ormorefromaconstantaveragingtime,theaveragingtimehas

beendefinedas“var”.Example:ifallperiodsof4-weeksamplesarewithin21and35days,the

averagingtimeisstill4-week.The100%periodforann-monthsamplehasbeendefinedasthe

periodstartingfromthestartdate/timeofthesampleandendingonthesamedaynumberandtime

nmonthslater.Example:thesamplestartsat5Marchat00:00,the100%1-monthperiodisuntil5

Aprilat00:00.Otherexample:thesamplestartsat30Januaryat00:00,the100%1-monthperiodis

until“virtual”30February,thatisactually2Marchat00:00(noleapyear).Soiftheenddate/timeis

between27March18:00and22April18:00thesampleperiodhasstill1monthaveragingtime.

Page 61: Aggregation rules for e-reporting

Page54

AnnexD HistoricalmethodsforcalculationofdatacaptureandtimecoveragefrommultidaysamplerbaseddatatypesintegratedoveranaveragingperiodBecausenodatacaptureandtimecoveragepersample/observationaredeliveredtotheexisting

AirBasesystems,itisassumedthatthetimecoveragepersample/observationis100%.Ifthis

sample/observationhasavalidityflag>0,wealsoassumethatthevalidityflagofallcomponent

valuesinthesample/observationalsohavevalidityflag>0.

Forthecalculationofthedatacaptureandtimecoveragewecountthehoursinthesamplingperiod

(endtimesample–starttimesample).

ThedatacaptureDCinagivenaveragingperiod(e.g.ayear)iscalculatedasfollows

DC=ΣiNvalid,i/ΣiNi*100%

Where

Nvalid,i=thenumberofhoursinthevalidsamplei(validityflagsample>0)

Ni=numberofhoursinsamplei

ThetimecoverageTCisthepercentageofmeasurementtimeinagivenaveragingperiod.Alsothe

timecoverageiscalculatedonbaseofthenumberofhoursinthesampleperiods.Thetime

coverageforagivenaveragingperiodiscalculatedasfollows:

TC=ΣiNi/Naveraging_period*100%

Where

Ni=numberofhoursinsamplei

Naveraging_period=thetotalnumberofhoursinthegivenaveragingperiod(e.g.ayear)

Themeanforagivenperiodislikethedatacapturecalculatedonbaseofthenumberofhoursinthe

validsampleperiods.Themeanforagivenperiodarecalculatedaccordingtotheformula:

mean=ΣiNvalid,iCvalid,i/ΣiNvalid,ii=1n

Where

Nvalid,i=thenumberofhoursofthevalidsamplingperiodi

Cvalid,i=concentrationforvalidsamplingperiodi

Whenasamplingperiodfallsovertwocalendaryears,Nireferstothehoursintheconsidered

calendaryearonly.

Page 62: Aggregation rules for e-reporting

Page55

AnnexE ListofpollutantswithMonitoringObjectivePollutantname Pollutantcode

AmmoniuminPM2.5(aerosol) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/1045

NitrateinPM2.5(aerosol) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/1046

sulphateinPM2.5(aerosol) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/1047

ElementalcarboninPM2.5(aerosol) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/1771

OrganiccarboninPM2.5(aerosol) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/1772

calciuminPM2.5(aerosol) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/1629

magnesiuminPM2.5(aerosol) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/1659

potassiuminPM2.5(aerosol) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/1657

sodiuminPM2.5(aerosol) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/1668

chlorideinPM2.5(aerosol) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/1631

Lead(precip) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/2012

Cadmium(precip) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/2014

Nickel(precip) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/2015

Arsenic(precip) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/2018

Mercury(precip+dry_dep) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/7013

ElementalGaseousMercury(air+aerosol) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/4013

Totalgaseousmercury(air+aerosol) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/4813

reactive_mercury(air+aerosol) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/653

MercuryinPM10(aerosol) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/5013

Benzo(a)anthraceneinPM10(aerosol) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/5610

Benzo(b)fluorantheneinPM10(aerosol) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/5617

Benzo(j)fluorantheneinPM10(aerosol) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/5759

Benzo(k)fluorantheneinPM10(aerosol) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/5626

indeno_123cd_pyreneinPM10(aerosol) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/5655

Dibenzo(ah)anthraceneinPM10(air+aerosol) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/5763

Benzo(a)pyrene(precip+dry_dep) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/7029

Benzo(a)anthracene(precip+dry_dep) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/611

Benzo(b)fluoranthene(precip+dry_dep) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/618

Benzo(j)fluoranthene(precip+dry_dep) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/760

Benzo(k)fluoranthene(precip+dry_dep) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/627

indeno_123cd_pyrene(precip+dry_dep) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/656

Dibenzo(ah)anthracene(precip+dry_dep) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/7419

Benzene(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/20

Ethane(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/428

Ethene(Ethylene)(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/430

Ethyne(Acetylene)(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/432

Propane(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/503

Propene(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/505

n-Butane(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/394

i-Butane(2-methylpropane)(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/447

1-Butene(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/6005

trans-2-Butene(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/6006

cis-2-Butene(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/6007

Page 63: Aggregation rules for e-reporting

Page56

1.3Butadiene(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/24

n-Pentane(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/486

i-Hexane(2-methylpentane)(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/316

1-Pentene(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/6008

2-Pentenes(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/6009

Isoprene(2-methyl-1,3-butadiene)(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/451

n-Hexane(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/443

i-Hexane(2-methylpentane)(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/316

n-Heptane(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/441

n-Octane(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/475

i-Octane(2,2,4-trimethylpentane)(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/449

Toluene(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/21

Ethylbenzene(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/431

m,p-Xylene(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/464

o-Xylene(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/482

1,2,4-Trimethylbenzene(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/6011

1,2,3-Trimethylbenzene(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/6012

Totalnon-methanehydrocarbons(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/32

Formaldehyde(air) http://dd.eionet.europa.eu/vocabulary/aq/pollutant/25