Emerging Issues in Data Collection

by : DUDY S. SULAIMAN

2012-02-24 @ UNStat, NY, USA

Indonesia Population Census Case

Agenda• Achievement

Facts Constraints Strategies Behind the scene Benefit

• Next Population and Housing Census• Challenges• Opportunities• Strategies• Operation & Monitoring• Benefits

Achievement2010 Indonesia Population and Housing Census

Facts

• 550.000.000 pages of census forms have had ICR processed

• 237.641.326 individual records of data has been captured for 43 variables

• 61.164.435 HH records of data has been captured for 24 Housing Variables

• 17.504 islands (13.000 inhabits), 33 provinces; 497 districts; 6.654 sub districts; 77.144 villages; 724.447 census blocks; ± 360 Ethnic groups; ± 250 Local languages

• 700K+ Enumerators and 6K+ Operators• 6 months

Constraints

• Respondent Burden• Geographical Issue• Cultural Issue• Writing Style• Questionnaire Design• Number of Respondent• Number of Variables• HR• Technology Barrier• Timeline• Desired Outcomes• Data Processing Center

Strategies

• Field Management:– Training : Concepts, Definition, Interview, …, Write– Team Interview– Quality Monitoring

Strategies (Cont…)

• Technology– ICR– VPN– Modularity System– Web Apps– SMS– Social Media

Strategies (Cont…)

• Engagement– Campaign– Socialization– Local government cooperation

Behind The Scene

Processing Centre

FIELDS

DROP-OFF SERVICE STAGING

DOC PREP

REPACKINGFUMIGATION

DOCUMENT STORAGE

Drop Off Receiving & Handling Registering

Sorting

Unpack &Checking

Cutting

SCANNING & RECOGNIZING

DOCUMENTPREPARATIONCORRECTION & COMPLETIONVALIDATION

Benefits

• Reduce : Time; Costs• Maintain Quality• Staff Performance• Auditable Process

Next Population And Housing Census

2020 Indonesia Population and Housing Census

Challenges

• Wide-spread geographical location– 17.504 islands (13.000 inhabits),– Diverse density in each region,– 33+ provinces*,– 500+ districts*,– 7.000+ sub districts*,– 80.000+ villages*,– 730.000+ census blocks*,– 66 million+ HH*– 260 million+ people*

Note: * 2020 forecasted

Challenges (cont..)• Massive

– process about 260 million peoples and 66 million households• Limited time

– maximum 6 months• Distributions

– Some remote rural area• HR

– Manages hundred thousand officers with diverse IT capablility

• Data Processing Center– Diverse infrastructure for every region

Opportunities

• Network & Communication Growth– Fiber Optic across Indonesia– 3G 4G LTE ?– Wimax– Fast Wireless Connection– Free Wifi

• ICT literacy– More staff has ICT capability

Opportunities (cont...)

• New Technology– Devices: ubiquitious computing

• Mobile Devices• Intelligent interfaces

– Computing: • Grid Computing• Virtualisation• Cloud Computing

– Capturing Technology• Advance ICR, IVR

– Semantic Technology– Web 3.0 ? :

• HTML 5 ?• XML• Web Services• Ajax• SOA

– Global Positioning System (GPS)

– Geospatial Information System (GIS)

Opportunities (cont...)

• Other drivers– Indonesian e-ID– Open Government Initiative– Statistics Industrialisation

• GSBPM, GSIM, SDMX, DDI, etc.

– Eco/Green IT– Sociality & Digital Lifestyle (Social Media)– Transformation of media

Internet(Secured)

StrategiesNetwork Infrastructure – nation wide

Province

Province

ProvinceProvince

HQ

Strategies (cont...)

Network Infrastructure - province

Internet(Secured)

Province

Mobile Apps (C/MAPI)

Web Apps (CAWI)

E-ID (external)Phone (CATI)

Paper

Strategies (cont...)

System Stack - province

Mobile Apps

Web Apps

B2B Gateway

CATI

Paper ICR

IVR Dat

a Va

lidati

on

OLT

P

Security

Monitoring

Strategies (cont...)

Listing Scenario

OLTP

CitizenEnumerator

E-ID (external)

Strategies (cont...)

a. Scenario 1:- Enumerator comes to every HH and does census using GPS enabled

tabletb. Scenario 2 :

- Citizens can directly use our web app to input their data using E-ID or username and password that we provided

c. Scenario 3 :- Citizens also can be interviewed by phone which is mostly drived by

machine. The answer is recognised by IVR and converted into data.d. Scenario 4 :

- If something goes wrong or the area is not suitable for 3 other scenario than we use paper based census which will be process by advanced ICR.

Data Collection Scenario

Operation & Monitoring

Repositories Corporate Databases

Exchange

Monitoring

HTTP(s), TCP/IP, FTP

Operation & Monitoring (cont..)– Monitoring:

• Productivity & Availability Dashboard• Hardware & Network• Software (Processes)• Target VS Output

– Diagnose:• Hardware & Network failure• Processes (services) failure• Target unachievable• Diagnose result Notification and escalation (by email / sms)

– Repair:• Automatic repair Failed services

– Report:• Productivity Report(Location – Process – Personnel)• Availability Report (Server, Network, Database, etc.)

Benefits

• Green ICT/ ECO: environmental concern – paperless, efficient hardware and software

• Time efficiency and fast delivery• Accuracy• Easy to manage (modularity)• Cost effective

Thank You