28
Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012

Concept of Data Collection

  • Upload
    corbin

  • View
    49

  • Download
    0

Embed Size (px)

DESCRIPTION

Concept of Data Collection. Vincent Scherrer Junior Adviser, System Development. ENTSOG’s Transparency Workshop. Brussels – 11 September 2012. Main goals of the project Current Situation Expected PDWS improvements Conclusion. - PowerPoint PPT Presentation

Citation preview

Page 1: Concept of Data Collection

Concept of Data Collection

Vincent ScherrerJunior Adviser, System Development

ENTSOG’s Transparency Workshop

Brussels – 11 September 2012

Page 2: Concept of Data Collection

2

Main goals of the project

Current Situation

Expected PDWS improvements

Conclusion

Page 3: Concept of Data Collection

3

Main goals of the project

Current Situation

Expected PDWS improvements

Conclusion

Page 4: Concept of Data Collection

4

Improve scope and qualityNew Transparency Guidelines> Binding publication> More relevant points (distribution systems, storages, production facilities...)> More data (physical flows, auction requests...)

More detailed ENTSOG deliverables> Demand breakdown (CCGT, final customers, industry)> More scenarios and cases> More accurate modelling

Upcoming tasks> Cost-benefit analysis> Gas quality

Page 5: Concept of Data Collection

5

Streamline the data collection processesData collection among members> Automation> Web-based interfaces> Eliminated redundancy> Warning system

ENTSOG internal data collection> Single repository of data> Versioning> User-friendly manual import mechanisms> More time for analysis and better deliverables

Page 6: Concept of Data Collection

6

Availability and openness

DataWarehouse TransparencyPlatform

Operational data

Future projects

Interruptions

TYNDP data

Auction results

Information should be meaningful, exploitable, and consistent

Page 7: Concept of Data Collection

7

Main goals of the project

Current Situation

Expected PDWS improvements

Conclusion

Page 8: Concept of Data Collection

8

Various data sources

Transparency TYNDP Forecast data

Infrastructure projects Other dataOutlook&Review

Historical data

System Development files

and databases

Transparency Platform/DB

TSOs TSOs TSOs Promoters Third parties (GSE, GLE, …)

Scattered environment, intensive treatment, insulated data

Page 9: Concept of Data Collection

9

Complex aggregation procedures

Balancing zones

Relevant points

System enhancem

ents

DemandSupply

Technical capacitiesFlows

(Re)Nominations

Page 10: Concept of Data Collection

10

Historical data analysisDetailed analysis of historical data and a comparison of multiple periods is a regular part of data processing

2008/2009 2009/2010 2010/2011 2011/2012 -

5,000

10,000

15,000

20,000

25,000

30,000

35,000

30 Jan - 14 FebAverage demand

Highest 16 dayAverage demand

Highest 16 daysPeak day demand

2008/2009 2009/2010 2010/2011 2011/20120%

10%

20%

30%

40%

50%

60%

70%

80%

UGS stock level 30 Jan.

Page 11: Concept of Data Collection

Understanding the data and changes to them is crucial

> Different calculation assumptions ?> Uploaded at different points in time ?> Unmatched system enhancements ?

11

Data quality issues

Page 12: Concept of Data Collection

12

Forecast vs Historical

> Data questionnaire corrupted ?

> Non-Standard Gross Calorific Value ?

> What to do ?

Page 13: Concept of Data Collection

13

Varying data from different data sources

Spread ?

Page 14: Concept of Data Collection

14

Main goals of the project

Current Situation

Expected PDWS improvements

Conclusion

Page 15: Concept of Data Collection

Manual data collection : Web-based

15

Page 16: Concept of Data Collection

16

Automated imports : Monitoring

Monitor the flow of messages> TSOs : direct access to the system, warning per mail ?> Detect an inform about odd values> Detect missing values> …

Page 17: Concept of Data Collection

17

Data consistency and data views

Quality control and good datawarehouse practices will enable us to look at the data from many different angles

> Entry flows in a country ?> Exit flows out of a country ?> Aggregated EU-27 demand> For a particular relevant point, what infrastructure projects are planned ?> Analyze cross-border flows and loads> What are the most congested cross-border connections ?> What happened during the 2012 cold snap ?> Maximal and minimal demand over the last 52 weeks for each country ? At the EU

level ?> What is the net demand per country on a daily basis ?> What are the planned infrastructure projects per country ? Per infrastructure type ?

Page 18: Concept of Data Collection

18

Data consistency : Infrastructure projects

Available as a Transparency Module> Different views but same data> Advanced search capabilities

Page 19: Concept of Data Collection

19

Data consistency : Different time scales

From day…

To month…

To year

Page 20: Concept of Data Collection

20

Odd values

Detect odd values with…> Fixed constraints> Comparison with the past> Check if missing> Comparison with previous versions of the same data

Treat odd values with…> Quarantine dubious values> Each value has a state> Associate with workflows (manual or automatic)

Page 21: Concept of Data Collection

21

Data availability

Excel

XML

RSS

Conform to best practices> Push and pull mechanisms

> Most common formats

> Flexible data sets

> Quantitative and qualitative analysis

Page 22: Concept of Data Collection

22

Export flexibility

1/01/2009 7/04/2009 12/07/2009 16/10/2009 20/01/2010 26/04/2010 31/07/2010 4/11/2010 8/02/2011 15/05/2011 19/08/2011 23/11/2011 27/02/2012

-2000

-1000

0

1000

2000

3000

4000

5000

6000

7000

signed - Zone Germany - Hub - Demand - Energy quantity - GWh/d - Historical-Historical Demand by TSOssigned - Zone Connection Supplier Norway - Hub Germany - Flow Import - Energy quantity - GWh/d - Historical-Historical Flows from imports sent by the TSOssigned - Zone Connection Storage Germany - Hub Germany - Flow Storage - Energy quantity - GWh/d - Historical-historical Flows from storages sent by the TSOssigned - Zone Connection Supplier Russia(Mainland) - Interconnector OPAL - Flow Import - Energy quantity - GWh/d - Historical-Historical Flows from imports sent by the TSOssigned - Zone Germany - NP Send-out - Flow National Production - Energy quantity - GWh/d - Historical-Historical Flows from national production sent by the TSOs

Page 23: Concept of Data Collection

23

Analysis

Page 24: Concept of Data Collection

24

AggregationLNG imports

Hub-to-Hub

Page 25: Concept of Data Collection

25

Main goals of the project

Current Situation

Expected PDWS improvements

Conclusion

Page 26: Concept of Data Collection

The new system will facilitate data collection and processing and should significantly improve ENTSOG’s ability to deliver reports such as TYNDP, Outlooks and reviews

> Comprehensive quality control...

> Drastically expanded analysis possibilitiesfor ENTSOG, members, stakeholders, 3rd parties…

> Flexible data extracts and reports…

> Better deliverables from ENTSOG...

26

Benefits

Sound technical basis to face current and future

Transparency Requirements

Vincent Scherrer
Put them at the end for the global conclusions
Page 27: Concept of Data Collection

27

Do you have any questions ?

Page 28: Concept of Data Collection

Thank You for Your Attention

ENTSOG -- European Network of Transmission System Operators for GasAvenue de Cortenbergh 100, B-1000 Brussels

EML:WWW: www.entsog.eu

Vincent ScherrerJunior Adviser

[email protected]