JODI-Gas Data Quality Assessment · other modules. • Data Exchange ... West Bay, Doha, Qatar,...

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org

JODI-Gas Data Quality Assessment

By Majid Badihi , Computer System Analyst(Acting Head DISD)

and Mohamed Arafat , Databank Analyst

Joint Organisations Data Initiative (JODI)

12th Regional Training Workshop

20 – 22 October 2015, Port of Spain, Trinidad and Tobago

No portion of this presentation may be reproduced, reused or otherwise distributed in any form without prior written consent

GECF reporting procedure: Objectives

Promote exchange of Data and enhance close coordination with

GECF Member and Observer Countries.

Define the reference framework to regulate the collection of Data,

its consolidation and analysis.

Identify a network of National Coordinators/Focal points for Data

exchange with the GECF Secretariat.

Define and clarify the role and responsibilities of the key players in

the GECF reporting process.

Formalize and standardize the concepts and procedures of

dialogue and exchange of Data between the GECF Secretariat and

the GECF Member and Observer Countries.

Identify and approve Data categories to be exchanged between the

GECF Secretariat and the GECF Member and Observer Countries.

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org 3

Relevance

Simplicity / Clarity

Availability

Feasibility / Deadlines

Remarks MCs Data

Questionnaires

Elaboration Criteria

Level o

Questionnaires

Monthly

Annual

GECF Data Questionnaires

GECF Databank Platform

• GECF participation in the JoDI-Gas Data initiative is being managed as

part of the organization’s Integrated Data Management Process.

• GECF Integrated Data Bank Platform: Data Exchange Center (DEC),

Daily News Brief Web and Mobile App, Energy databases / data sets, and

other modules.

• Data Exchange Center (DEC) is the collaboration and communication

database for GECF member countries’ monthly and annual questionnaires.

• Data Transparency: all MCs have read access to data of other countries

and related statistical analytical reports.

• Future plans to expand the Databank Platform.

• GECF Databank is being developed in-house by DISD staff.

Launch of GECF Data Exchange Center with GECF Countries for MQ & AQ

Web-based GECF Databank Platform

• Data Exchange Center (DEC) is the collaboration and communication

database for GECF member countries’ monthly and annual questionnaires.

• Web and Windows Desktop interfaces.

• Security System

Role-based Security System

• What a user can see or do depends on what role(s) he has.

• Roles: Focal point, Analyst, Administrator, ……

GECF Monthly Questionnaire in DEC

Unified GECF monthly questionnaire and related products and flows

definitions are in place.

DEC : Data Accessibility / Transparency

A Focal Point can browse, group , search , filter , sort monthly questionnaire data

of all GECF countries.

DEC data Accessibility: Simple and Advanced Filter

Filter by one or more columns

Build a complex query with several

conditions

Export data into different file formats including Excel.

DEC data availability : Data Export

Monthly Questionnaire: Excel and DEC

MC Focal Point can fill the monthly questionnaire template in Excel file or directly

update the web-based Data Exchange Center (DEC).

DEC Data Quality: Country Specific Data Entry Validation Rules

Data Quality Visual Check

Data Quality Visual Check : Time-Series 2

Data Quality Visual Check : Domestic Consumption by Sector

Data Quality Visual Check :Statistical Difference

Country MQ DateMarket

Production

Imports

Pipeline

Import

Export

Pipeline

Export

Change

Statistical

Difference

Domestic Consumption

(Calculated)

Domestic Consumption

(Observed)

% Statistical Diff /

Iran 1-Sep-2014 14676.9 298.8 0 727.2 0 -1 983.5 14249.5 13266 7.41%

Iran 1-Aug-2014 16545.63 272.18 0 653 0 0.8 1315.01 16164.01 14849 8.86%

Iran 1-Jul-2014 16177.35 323.795 0 757.95 0 -1.74 1343.885 15744.935 14401.05 9.33%

Iran 1-Jun-2014 15097.2 493.8 0 790.8 0 0 1497.9 14800.2 13302.3 11.26%

10.00%

20.00%

30.00%

40.00%

50.00%

60.00%

70.00%

80.00%

90.00%

100.00%

1-Jun-2014 1-Jul-2014 1-Aug-2014 1-Sep-2014

% Statistical Diff / Obser

Domestic Consumption (Calculated)

Domestic Consumption (Observed)

Data Quality Visual Check : Monthly Growth Rate

Consistency with other energy statistics

The Data from other sources can allow to make comparisons, revisions, if necessary.

A comparison with external sources can sometimes be useful, however we need to be careful:

What is the methodology, definition and approach of Data collection of the other source?

What is the interest of external sources (such as subscriptions, Companies report Data..)?

What is the level of transparency of the external sources?

Does the source have a particular motive to provide accurate data?

JODI Data are supposed to be official and a primary source from the Country to the JODI

Database, why would a secondary source be more correct?

However this check can be useful to double check a suspicious number or check the order of

magnitude, but should not be relied upon.

Data Quality Sustainability, Timeliness, Completeness,

Smiley Face Approach is a way to encourage countries to participate and/or

improve their data

Sustainability

Rates number of submissions within six-month

period. JODI organizations proposed a fixed date to

determine this rating

Timeliness Indicates whether submissions were submitted at the

expected deadline (over a six months period)

Completeness Measures the number of expected data points in the

questionnaire.

Participation Assessment _ Smiley Face Approach

Quality Indicators : Sustainability Submission

MQ status for the last 12 moths ( from Aug 2014 – July 2015)

Quality Indicators : Timeliness, Completeness

Participation Assessment _ Smiley Face Approach – Jan to June 2015

From Jan 2015 to June 2015

[for GECF Monthly Questionnaire Format & M- 2]

Country Sustainability Timeliness Completeness

Sustainability Timeliness Completeness

Algeria 6 1 70% J L K

Bolivia 6 6 75% J J K

Egypt 6 6 92% J J J

Eq. Guinea 0 0 0% L L L

Iran 0 0 0% L L L

Libya 6 2 95% J L J

Nigeria 0 0 0% L L L

Oman 5 0 70% K L K

Qatar 4 4 45% K K L

Russia 0 0 0% L L L

Trinidad and Tobago 0 0 0% L L L

United Arab Emirates 0 0 0% L L L

Venezuela 2 0 92% L L J

Mapping GECF to JoDI-Gas

Natural Gas

in million m3

(at 15oC, 760 mm hg)

Natural Gas

in Terajoules

Natural Gas

in 1000 metric tons

Production 3888.427982

Receipts from Other Sources 340.123177

Imports 0

LNG 0 0

Pipeline 0

Exports 0

LNG 0 0

Pipeline 0

Stock Change 42.043871

Gross Inland Deliveries (Calculated) 3846.384111 0

Statistical Difference (Calculated) 0 0

Gross Inland Deliveries Observed 3833.698

of which: Electricity and Heat Generation 2087.42

Closing stocks

Marketed

Production – From

Other Sources

Thank You

for Your attention

www.gecf.org

JODI-Gas Data Quality Assessment · other modules. • Data Exchange ... West Bay, Doha, Qatar,...

Documents

Speech by the Secretary General of the GECF A path to stability of the gas market – a dialogue of exporters and importers of gas V International Conference

JODI Gas data quality assessment · Data Transparency, Accessibility and Usability DEC User can retrieve gas (and other energy) data, use system dashboards for analysis or quality

Data Transparency and JODI -Gas: Better Data, Better Decisions · JODI: From Oil to Gas ... Town, South Africa. June. GECF participated in the 19. th. JODI Workshop and 3. rd. JODI

The Extended JODI Oil Questionnaire - jodidata.org · The Extended JODI Oil Questionnaire. Stève Gervais . International Energy Agency . J. OINT. O. ... LPG Gasoline Kerosene Gas/Diesel

Secretary General of the GECF “The Role of the Gas Exporting Countries Forum in Global Energy Security” RPGC 2010 Moscow, June 22, 2010

BP Statistical Review and JODI data · BP Statistical Review and JODI data JODI Conference . October 2017 . Richard de Caux, BP Economics

Benefits of JODI for OPEC A focus on natural gas data · natural gas forecasting accuracy. • Natural gas demand: Natural gas demand forecast is based on adding growth projections

The Extended JODI-Oil Questionnaire and JODI-Oil … Extended JODI-Oil Questionnaire and JODI ... The extended JODI oil questionnaire. ... Volumes of LPG reported in all flows of the

The JODI Gas Questionnaire and the JODI Gas Manual · questionnaire! Trade data should transit” whenever possible (but any own use here would be considered as an import and part

Better Data– Better Decisions · 2005: JODI-Oil world database (90+ Countries) opened • 2009: JODI-Gas “exercise” (52 Countries) initiated • 2012: Extended JODI-Oil data

SIPA Center on Global Energy Policy - UNDER A …...The studies of BP, ExxonMobil, Rystad Energy, and the Gas-Exporting Countries Forum (GECF) also show strong growth; that by DNV

Jodi Eichelberger (Alfred Bell) Bruce Fiebach (Jebb Logan)Jodi Eichelberger (Alfred Bell) Jodi is an international puppeteer, actor, writer, director, and composer. This year Jodi

Cartelization in gas markets: Studying the potential for a ...Finally, OPEC did not play a signiﬁcant role in the oil market the ﬁrst decade after it was founded, and now GECF

Jodi - Seamans Book

Better Data – Better Decisions - IEF · 2005: JODI-Oil world database (90+ Countries) opened • 2009: JODI-Gas “exercise” (52 Countries) initiated • 2012: Extended JODI-Oil

Unforgettable - Jodi Beach

JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

Extending JODI to Natural Gas (JODI Gas)

JODI Challenges and opportunities - Oil and Gas Data

JODI Oil World Database · JODI (2 questions) III. JODI database (3 questions) IV. JODI data use (11 questions) V. JODI data quality (5 questions) VI. JODI database system (4 questions)