Upload
hanshoogeveen
View
222
Download
0
Embed Size (px)
Citation preview
8/4/2019 Rapid Data Gathering
1/20
collection
using mobile phones
Johannes Hoogeveen
8/4/2019 Rapid Data Gathering
2/20
Data collection using surveys
Surveys allow to collect high quality data fromhouseholds or firms
But surveys are:
costly time consuming
inflexible (once a questionnaire is designed itcannot be changed)
As a consequence:
Surveys are typically not able to provide timelydata or data that is needed to address urgentpolicy issues
8/4/2019 Rapid Data Gathering
3/20
Data collection using phones
Mobile phones allow to collect data fromhouseholds and firms without a need to visitthem
This allows mobile surveys to: collect data at low cost and rapidly
collect data from the same respondent over time
change questions every week or month
But
the number of questions that can be asked islimited
respondents may need training (and a phone!)
8/4/2019 Rapid Data Gathering
4/20
A word of caution
Mobile data can be collected in a variety of ways: Calls
SMS
Mobile surveys
USSD
Embedded on SIM card
Avoid the attraction of technology. Simple call centers often do the job. They: work with all phones (also very low end ones)
incur no cost to the respondent
elicit responses from illiterate people
are cheap. Cost of calling within network is low
cost of labor in a call center is typically low
Moreover call centers:
allow enumerators to be well trained
real time supervision and quality control are possible
data collection is flexible: well trained enumerators can explain
difficult questions and can ask follow up questions
in repeat surveys, respondents appreciate personal contact
Low end phones do the
8/4/2019 Rapid Data Gathering
5/20
MOBILE DATACOLLECTION INPRACTICE
A mobile phone call center
8/4/2019 Rapid Data Gathering
6/20
Dar es Salaam mobile phone
survey Phase 1: Baseline survey
Scientific sample (550 households; 150 enumeration areas)
Questionnaire collects basic data about respondents (personaldetails, location, education, basic welfare information)
Use household visit to explain how mobile survey will work
No phones were distributed (they were in Sudan!)
Phase II: Mobile data collection respondents receive a notification by SMS
3 enumerators in call center call respondents
over course of 2-3 days
Weekly (8-20) questions
Questions differ every week
Respondents are remunerated with call credit
8/4/2019 Rapid Data Gathering
7/20
RESULTS AND LESSONS
Respondent answering
8/4/2019 Rapid Data Gathering
8/20
Results: service qualityInconveniencies faced when visiting health
facilities
48%
20%15%
4%
5%
3%
5%
0% 10% 20% 30% 40% 50% 60%
There are no
No medicine
Long queue
Corruption
Services is rude
Not clean
Negligence by health
8/4/2019 Rapid Data Gathering
9/20
Results: opinions
Opinions about constitutionalchanges
5%
59%
24%
12%
0%
10%
20%
30%
40%
50%
60%
70%
President shouldget more powersto make decisions
President shouldget less power tomake decisions
Presidential powerpowers should
remain unchanged
Don't know
8/4/2019 Rapid Data Gathering
10/20
Results: track food crisis
Goods/services for which citizens reportsignificant price changes
32%
4%
13%
5%
7%
39%Food
Water
Electricity
Housing
Beverages
Commuter bus transport
8/4/2019 Rapid Data Gathering
11/20
Results: bed net use
Citizens reporting sleeping under bed net treatedwith Ngao
20%
30%
40%
10%
Does not sleep under bednet
Sleeps under long lastinginsecticide treated bednet
Sleeps under bednet treatedwith Ngao
Sleeps under an untreated
bednet
8/4/2019 Rapid Data Gathering
12/20
Some lessons:
Most attrition happened in the first weeks. Main reasons: Respondents did not fully understand, training is required
Respondents did not have good phone access
Maybe we should have prepared a small contract
Remuneration is appreciated, but the amount does not matter forthe response rate
In some areas, response rates are low because of problems withcell phone reception or electricity
Some training may be required
8/4/2019 Rapid Data Gathering
13/20
Most important:Data is of good quality and non-
response is largely random
dF/dx T-stat
D-wealthiest quintile 0.13 2.124th wealth quintile 0.07 1.09
3rd wealth quintile 0.12 1.91
2nd wealth quintile 0.10 1.65
D-female -0.02 -0.55
Age in years 0.00 0.99
D-Tshs 400 remuneration 0.05 0.99
D-Tshs 500 remuneration 0.05 1.05
Regression on participation in week 14 of survey
8/4/2019 Rapid Data Gathering
14/20
OTHER APPROACHES TO RAPID
DATA GATHERING WITH MOBILE
PHONES
8/4/2019 Rapid Data Gathering
15/20
Water price survey Baseline survey collects price of water and telephone
numbers of clients at 30 water kiosks. Follow up throughtelephone.
Prices at DSM water kiosks
0
50
100
150
200
TipTop
MabiboK
waCassian
Keko
MwangaA
KekoMolemo(behindTanzania
M
abiboRelini
Kigog
oLandaBar
MabibokwaKikanzo
Ubu
ngoMaziwa
Mkunduge
Mtogole
AliMauaA(NearCUFElimika
ManzeseMidizini
Manze
seKiembeni
TandaleUzuri
Tandale
kwaTumbo
Tan
daleYemen
Ma
nzeseUzuri
TandaleMafichoni
MivuleniA
MwembeMkole
MivuleniB
ManzeseKilimani
Manze
seBakhresa
AliMauaB
Pipe Tank
Aug-10 Nov-10 Official price
8/4/2019 Rapid Data Gathering
16/20
Capitation grant monitoring Telephone numbers from an existing data base were
used to call 90 headmasters. They were asked to verifywhether capitation grant had arrived by a certain date
8/4/2019 Rapid Data Gathering
17/20
Price data collection
Local enumerators in 21 rural andurban locations collect price dataon a monthly basis.
Enumerators use a paper bookletand fill a price form on a certaindate of the month.
The next day, they receive a callfrom a call centre to relay their
data.
Data is processed at the centerand made public.
8/4/2019 Rapid Data Gathering
18/20
Business confidence
Telephone numbers of business wereobtained from business incubatorprogram
150 entrepreneurs are called everymonth. Questions about businessconfidence, investments and jobscreated.
Data is processed at the center and
made public.
8/4/2019 Rapid Data Gathering
19/20
Roadblock monitoring
Selected truck drivers (20) on a three main routes beep a callcentre every time they are stopped at a road block.
Call centre operator calls back and asks
specific questions:
Location
Time taken
Amount paid
(identity of driver is known through his number)
This gives weekly data about
number and location of road blocks
8/4/2019 Rapid Data Gathering
20/20
In conclusion
Data collected using call centers and mobile phones provides ampleopportunity to collect
Relevant and Reliable data
In a cost effective and flexible manner
But
contrary to what is often thought, rapid data collection using mobile phonesrequires less ICT skills and more typical survey skills as well as writingskills to implement effectively.
More information on experience with data collection using mobile phones inSouthern Sudan can be found at:http://digitalmedia.worldbank.org/SSP/africa/mobile-phone-data-collection/