New CountrySTAT approach

New CountrySTAT approach

OverviewWork flowCodification: CPCCodifications: HSCodifications: UMCodifications: FlagsCodifications: GAULCodifications: CountrySTAT indicatorsCodifications: AttributesPreparing tables in CountrySTATUploading tables in CountrySTATMetadata EditorDSD EditorData EditorImportant rules for creating tablesRetrieving tables in CountrySTATEditing an already uploaded dataset

• Have the data ready

01/05/2023 3

Work flow• Create your

table following the rules

• Have the metadata ready

• Use the right codification

• Fill all metadata

• Create the DSD structure

• CVS format• No columns with

labels

• Upload the values

• CPC 2.1• HS• GAUL• CountrySTAT indicators• Attributes• Unit of Measurement• Flag

• Go to the metadata editor

• Title• Subject• Data type• Domain• Key

Your table is

published

Codifications

CPC 2.1For goods and services

HSFor trade data

UMUnit of measurement

FlagsTo indicate missing and estimated values

GAULFor geo data

CountrySTAT indicatorsFor all indicators

AttributesCharacteristics of the indicators

• The Central Product Classification (CPC) constitutes a complete product classification covering all goods and services based on a set of internationally agreed concepts, definitions, principles and classification rules

• It provides a comprehensive framework within which data on products can be collected and presented in a format that allows for economic analysis supporting decision-taking and policy-making

01/05/2023 5

Codification: CPC

The current version, CPC version 2.1, is the result of a scheduled review of the CPC structure and detail, in order to ensure the classification’s relevance for describing current products in the economy.

All detailed structure and explanatory notes can be found at the following link (CPC 2.1 not expanded version):

http://unstats.un.org/unsd/cr/registry/regcst.asp?Cl=31

Codification: CPC

Here all the available correspondences:http://unstats.un.org/unsd/cr/registry/regot.asp?Lg=1

CPC 2.1 : Broad structure

The Harmonized Commodity Description and Coding System generally referred to as "Harmonized System" or simply "HS" is a multipurpose international product nomenclature developed by the World Customs Organization (WCO).

The Harmonized Commodity Description and Coding System (HS) is an exhaustive nomenclature of internationally traded commodities (goods) classified according to the following criteria:

– raw or basic material– degree of processing– use or function– economic activities

01/05/2023 12

Codifications: HS

Codifications: UM

0101 head0102 Ha0103 ton0104 US$0105 local currency0106 index0107 thousands0108 units0109 cubic meter0110 kg/capita/yr0111 Kcal/capita/day0112 g/capita/day0113 1000 US$0114 Liter0115 Cubic meter/second

0116 Centimeter0117 local currency by ton0118 Degree Celsius0119 Percentage0120 MT or Cubic meter0121 Local currency/hectar

0122Local currency/1 cubic meter

0123 Kg/Ha0124 Local currency/Kg0125 1000 Ha0126 mm0127 Square meter

Codifications: FLAGS

FLAGS

• Category not applicable / Data not available = “m” Data for these categories do not even hypothetically exist and/or data included in another category / Missing data (data exist but were not collected)

• Estimated value = “e”

Codifications: GAUL

The Global Administrative Unit Layers (GAUL) is an initiative implemented by FAO within the Bill & Melinda Gates Foundation, Agricultural Market Information System (AMIS) and AfricaFertilizer.org projects.

The GAUL compiles and disseminates the best available information on administrative units for all the countries in the world, providing a contribution to the standardization of the spatial dataset representing administrative units. The GAUL always maintains global layers with a unified coding system at country, first (e.g. departments) and second administrative levels (e.g. districts). Where data is available, it provides layers on a country by country basis down to third, fourth and lowers levels

Codifications: GAUL

The overall methodology consists in

a) collecting the best available data from most reliable sources

b) establishing validation periods of the geographic features (when possible)

c) adding selected data to the global layer based on the last country boundaries map provided by the UN Cartographic Unit (UNCS)

d) generating codes using GAUL Coding System

e) distribute data to the users

Codifications: GAUL

Because GAUL works at global level, unsettled territories are reported. The approach of GAUL is to deal with these areas in such a way to preserve national integrity for all disputing countries .

GAUL is released once a year and the target beneficiary of GAUL data is the UN community and other authorized international and national partners. Data might not be officially validated by authoritative national sources and cannot be distributed to the general public. A disclaimer should always accompany any use of GAUL data.

GAUL keeps track of administrative units that has been changed, added or dismissed in the past for political causes. Changes implemented in different years are recorded in GAUL on different layers. For this reason the GAUL product is not a single layer but a group of layers, named "GAUL Set" .

Codifications: GAUL

ADM0_NAME ADM1_CODE ADM1_NAMEKenya 51325 CentralKenya 51326 CoastKenya 51327 EasternKenya 51328 NairobiKenya 51329 North EasternKenya 51330 NyanzaKenya 51331 Rift ValleyKenya 51332 Western

Codifications: CountrySTAT indicatorsDomain code indicator

Production

0101 Production quantity0102 Production value0103 Yield0104 Area Harvested0105 Area sown0106 Seeds quantity0107 Slaughtered animals0108 Live animals0109 Laying hens0110 Lactating live animals

Food availability0201 Protein quantity0202 Lipid quantity0203 Food supply quantity

Trade

0301 Export quantity0302 Export value0303 Import quantity0304 Import value0305 Consumption quantity0306 Re-export quantity0307 Re-export value

Machinery 0401 Machines in service

Population

0501 Population

0502Economically active population

0503 Population total density0504 Population growth Rate

Prices

0601 Consumer price0602 Producer price0603 Commercial rate0604 Official rate

Value added 0701 Constant prices0702 Current prices

Land use

0801 Agricultural area0802 Permanent crops area0803 Temporary crops area

0804Arable land and permanent crops area

0805 Forest area0806 Other wooded land

Employment 0901 Unemployment Rate 0902 Labourforce Participation Rate

Water 1001 Average rainfall

Codifications: Attributes

code dimensions8001 Total8002 Male8003 Female

Food

code dimensions8004 Rural8005 Urban8006 Total

code dimensions8007 Food8008 Non Food

code dimensions8009 Rainfed8010 Irrigated

Residence

Gender

Field management

code dimensions8011 Agricultural8012 Non-Agricultural

Agricultural Population

Codifications: Attributes – DAC: SectorDAC 5 CODE

DESCRIPTION

110 EDUCATION111 Education, level unspecified112 Basic education113 Secondary education114 Post-secondary education120 HEALTH121 Health, general122 Basic health130 POPULATION POLICIES/PROGRAMMES AND REPRODUCTIVE HEALTH140 WATER SUPPLY AND SANITATION150 GOVERNMENT AND CIVIL SOCIETY151 Government and civil society, general152 Conflict prevention and resolution, peace and security160 OTHER SOCIAL INFRASTRUCTURE AND SERVICES210 TRANSPORT AND STORAGE230 ENERGY GENERATION AND SUPPLY240 BANKING AND FINANCIAL SERVICES250 BUSINESS AND OTHER SERVICES310 AGRICULTURE+FORESTRY+FISHERY311 AGRICULTURE

Preparing tables in CountrySTATUnit of measurement: code and label2° dimension :

code and label1° dimension : Year 3° dimension :

code and label

Value

Flag

Preparing tables in CountrySTATUnit of measurement: code and label2° dimension :

code and label

Once done, DELETE ALL LABEL COLUMNS

1° dimension : Year 3° dimension : code and label

Value

Flag

Preparing tables in CountrySTAT

Preparing tables in CountrySTATyear Indicator (code) species (code) Value Flag um (code)1990 0102 21115 454 01011990 0102 21113 15532 01011990 0102 21116 1534 01011990 0102 21121 19000000 01011990 0102 21111 126318 01011991 0102 21111 124281 01011991 0102 21115 285 01011991 0102 21113 16189 01011991 0102 21116 2166 01011991 0102 21121 19500000 01011992 0102 21116 1107 01011992 0102 21113 13155 01011992 0102 21111 114086 01011992 0102 21121 18000000 01011992 0102 21115 297 01011993 0102 21113 7000 01011993 0102 21115 176 01011993 0102 21121 17500000 0101

This is how a table should look like after deleting its label columns!

Preparing tables in CountrySTAT

•Save it and keep the Excel table open

•Go in the Metadata Editor

•Go in the DSD Editor

•Save the file in CVS and close it

Important rules for creating tables

The Excel spreadsheet must be formatted as text

The name of the Excel file must NOT contain any accent and/or symbol and/or numbers and/or empty spaces

Always convert to CSV file at the very end and do not open the CSV file afterwards!

Important rules for creating tables

NEVER use comma or dot for separating the thousandse.g. one thousand: NO 1.000 NO 1,000 YES 1000

Always use a dot for separating decimalse.g. three dot four: NO 3,4 YES 3.4

In each “value cell” input only a numeric value or only texte.g. two tons: NO 2 tons YES 2 in the other column

called “unit” write tons

Uploading tables in CountrySTAT

Uploading tables in CountrySTAT

METADATA

• Definition: a metadata is a data defining a data.

– Metadata on statistical data (to insure quality of data): units, source, contact, creation date, last-updated date …

– And additional statistical metadata (methodology, survey/census, frequency of data collection, etc…)

05/01/2023

Metadata example

Raw data without any data :I don't know the meaning of the data, I suspect it's the age of the races.

Data with metadata:With two metadata, (title – name of variable), I know the meaning of the data.

01/05/2023 32

METADATA

Metadata EditorThe more fields are filled in, the more accurate the description of data and the

retrieval of the dataset will be.

Metadata Editor

Once the previous section has been filled, by clicking on each of these elements, new sections will appear. These new sections need to be completed as well.

All these information enhance data quality and end-users’ trust in the related data!

Metadata Editor

After every category has been filled with the right metadata information, click on the “save” button at the top right of the page, in order to get to the next phase of the uploading.

DSD Editor

The green boxes in the upper right corner signify that the resource has been created and metadata has been correctly stored.

The “edit resource” box contains three buttons:• “Metadata”, which brings back the metadata editor tool.• “DSD”, to create the DSD structure mirroring the one of your dataset• “Data”, to upload and modify your dataset

DSD Editor

Start adding columns to the DSD structure by clicking on the “+” sign. The structure should mirror the one of the dataset you wish to upload.

• Dimension refers to time and geo information as well as indicators and commodities• Value refers to actual numeric or percentage values• Other refers to flag, unit of measurement columns, etc.

DSD EditorClicking on the “Dimension +” will lead to this page in which the following information can be entered:

• Title, which refers to the column header’s name

• Supplemental, which refers to supplemental info regarding that column data

• Subject, which refers to the type of data contained in the column

• Data type, which specifies the type of data chosen in the subject

• Domain, which requires the user to choose the appropriate codelist from those available, if needed Once done don’t forget to click

here!

Download DSD if you want to save this DSD structure.

Don't forget to save itOnce all the columns have been entered, it will look like this!

Next time you’ll just need to upload it and the DSD will automatically show up

Data editor

Once in the Data editor, the dataset can be uploaded by clicking on “Browse”

Don’t forget that the dataset must be in CSV format

Data editor

Once the dataset you wish to upload is selected, a new interface will open. Here you will have to align the columns of your dataset with the ones you created through the DSD editor.

To switch two columns just drag and drop the name of any column.

Don’t forget to press the Ok button once everything is ok

Data editor

Once the dataset is uploaded it will look like this!

Retrieving tables in CountrySTAT

Tables’ retrieval is driven by the metadata previously stored during the uploading of the dataset. By clicking on the “Search” button, datasets can be retrieved by imposing metadata fields as filters.


By clicking on content, the retrieval of datasets can be filtered by selecting “Resource type”, “Reference period” and so on.More than one filter can be selected at once.


The more criteria are imposed the more the dataset’s retrieval will be refined since, by selecting more than one filter at once, only datasets compliant with every one of those filters will be shown.


Underneath the selectors, a “selection resume” will be displayed showing the selected filters.

By clicking on “show result” datasets compliant with the chosen criteria will be displayed.

Editing an already uploaded dataset

After successfully retrieving a dataset, by clicking on the “Data” button from the “Edit Resource” box, the above-mentioned dataset will be shown


• By clicking on the “Pencil” button of any row, a pop-up will be displayed allowing the chosen row to be modified.

• By clicking on the “Dustbin” button of any row, the chosen row will be removed from the dataset.

Editing an already uploaded datasetA new row can be added to the dataset without uploading it again from the beginning.This can be done by clicking on the “Plus” button located at the bottom left of the page and compiling the newly-appeared pop-up.


After all the editing has been done, remember to click on the “Save” button on the top right of the page.