Embed Size (px)
Citation preview
Response rate to FAO
questionnaires
1
APCAS/20/3.2
Jose Rosero MoncayoDirector, Statistics Division
Food and Agriculture Organization of the [email protected]
28th Session of Asia and Pacific Commission on Agricultural Statistics
Bali, Indonesia, 10 – 14 February 2020
Measuring data quality
FAO produces international statistics
In order to do this it needs to compile, harmonize and
standardize the information provided by countries
Countries are our main source of data and as such FAO
is heavily depended on the quantity and the quality of
the data countries provide to us.
Therefore, it is important to measure the level of
response of the questionnaires by countries, and the
level of completeness of the resulting databases with
data coming from official sources.
210 February 2020 APCAS 28, Bali, Indonesia
Measuring data quality
The Statistics Division of FAO (ESS) dispatches 6 annual
questionnaires, and collects data for the following
agricultural domains:
◦ Agricultural Production
◦ Producer prices
◦ Fertilizers use
◦ Pesticides use
◦ Government Expenditures in Agriculture (GEA)
◦ Land Use
APCAS 28, Bali, Indonesia10 February 2020 3
Measuring data quality (ct’d)
The Fisheries Division dispatches mainly 6 annual
questionnaires, and collects data for the following
agricultural domains:
◦ Aquaculture Production
◦ Capture production
◦ Disposition of fishery production
◦ Fleet
◦ Number of fishers and fish farmers
◦ Production of processed commodities
APCAS 28, Bali, Indonesia10 February 2020 4
Measuring data quality
Response rate indicator is defined here by:
Response rate = 𝑁𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝑞𝑢𝑒𝑠𝑡𝑖𝑜𝑛𝑛𝑎𝑖𝑟𝑒𝑠 𝑓𝑖𝑙𝑙𝑒𝑑 (𝑏𝑦 𝑦𝑒𝑎𝑟)
𝑁𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝑞𝑢𝑒𝑠𝑡𝑖𝑜𝑛𝑛𝑛𝑎𝑖𝑟𝑒𝑠 𝑑𝑖𝑠𝑝𝑎𝑡𝑐ℎ𝑒𝑑 (𝑏𝑦 𝑦𝑒𝑎𝑟)
APCAS 28, Bali, Indonesia10 February 2020 5
Measuring data quality
Data completeness indicator is defined here by:
Completeness rate = 𝑁𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝑜𝑓𝑓𝑖𝑐𝑖𝑎𝑙 𝑑𝑎𝑡𝑎 𝑝𝑜𝑖𝑛𝑡𝑠 (𝑏𝑦 𝑦𝑒𝑎𝑟)
𝑁𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝑒𝑥𝑝𝑒𝑐𝑡𝑒𝑑 𝑑𝑎𝑡𝑎 𝑝𝑜𝑖𝑛𝑡𝑠 (𝑏𝑦 𝑦𝑒𝑎𝑟)
The presentation will focus on the response
indicator
APCAS 28, Bali, Indonesia10 February 2020 6
Findings: The majority of the regions (except Pacific
Islands) have a response rate that is above the average of the
world (ESS-Questionnaires).
Average 2013-2018 response and completeness rates, by region
APCAS 28, Bali, Indonesia10 February 2020 7
84%
50%
67%
28%
34%
61%66%
45%
34% 33% 34%
18%
24%
32%
40%
50%
Australia andNew Zealand
Central Asia Eastern Asia Oceaniaexcluding
Australia andNew Zealand
Oceania South-EasternAsia
Southern Asia APCAS World
Response rate Completeness rate
Findings: response rate for APCAS members is
slightly below the world’s average (Fisheries-
Questionnaires).Average 2013-2018 response rates, by region
APCAS 28, Bali, Indonesia10 February 2020 8
85%
38%
60%
36%41%
54%
75%
53%56%
Australia andNew Zealand
Central Asia Eastern Asia Oceaniaexcluding
Australia andNew Zealand
Oceania South-EasternAsia
Southern Asia APCAS World
Response rate: Fisheries questionnaires
Findings: Across time there is general improvement in
response rate for the ESS-AG Questionnaires
9 APCAS 28, Bali, Indonesia10 February 2020
20%
30%
40%
50%
60%
70%
80%
90%
2013 2014 2015 2016 2017 2018
Trend of response rate: ESS Questionnaires
Central Asia Eastern Asia
Oceania excluding Australia and New Zealand South-Eastern Asia
Southern Asia World
Findings: Across time and regions, there is a decrease
in response rate for the Fisheries Questionnaires
10 APCAS 28, Bali, Indonesia10 February 2020
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
2013 2014 2015 2016 2017 2018
Trend of respose rate : Fisheries questionnaires
Central Asia Eastern Asia
Oceania excluding Australia and New Zealand South-Eastern Asia
Southern Asia World
Findings: Across domains, Prices and Production had higher
response rates than other domains over time (ESS-
Questionnaires)
11 APCAS 28, Bali, Indonesia10 February 2020
20%
25%
30%
35%
40%
45%
50%
55%
60%
65%
2013 2014 2015 2016 2017 2018
Trend of response rate by questionnaire
Fertilizers Food Loss GEA Land Pesticide Prices Production
Findings: Aquaculture and Capture had higher
response rates than other domains over time
(Fisheries-Questionnaires)
12 APCAS 28, Bali, Indonesia10 February 2020
30%
35%
40%
45%
50%
55%
60%
65%
70%
75%
2013 2014 2015 2016 2017 2018
Response rate APCAS: Fisheries Questionnaires
Capture production Aquaculture production
FLEET Number of fishers and fish farmers
Disposition of fishery production Production of processed commodities
Why do we have a low or no response:
Is it that we do not reach the countries
◦ Lack of accuracy on list of relevant contact points at country level
Is it that countries can not report due to different
reasons like:
◦ Increased burden: from FAO questionnaires (length, complexity,
number, etc.); from all sources (regional/international
organizations, NGOs, etc.)
◦ Resource limitations: lack of expertise; budget/HR constraints at
country level; staff turnover/loss of experience
◦ Lack of data availability: less than annual frequency, or no data
collection, in some domains (though this absence should be
reported)
13 APCAS 28, Bali, Indonesia10 February 2020
What can we do about it?: for discussion
• To improve in the coordination mechanisms: • Maintain up-to-date national focal point(s) with the
support of the FAO regional and country offices
• Continue to harmonize the questionnaire dispatch
• Develop alternative data reporting/ collection means• FAO pilots multiple-mode data collection, such as on-line
questionnaires;
• Promote an open and continuous communication with the national focal point to ask for missing information or clarify doubts
14 APCAS 28, Bali, Indonesia10 February 2020
What can we do about it?: for discussion
▪ FAO and member countries explore how best to implement statistical capacity development activities in the areas of data collection and data reporting/compilation
▪ Expand national data peer-review process for imputed data
▪ Others?
15 APCAS 28, Bali, Indonesia10 February 2020
Thank you!
16
28th Session of Asia and Pacific Commission on Agricultural Statistics
Bali, Indonesia, 10 – 14 February 2020
