Copyright 2010, The World Bank Group. All Rights Reserved. Reducing Non-Response Section B 1

Copyright 2010, The World Bank Group. All Rights Reserved.

Reducing Non-Response

Section B

1


Nonresponse Prevention Grouping

• Front-end techniques

• Special reporting arrangements

• Follow-up techniques

2


Front-End Techniques

• Advance notification

• Interviewer performance guidelines

• Questionnaire design

• Respondent incentives

3


Special Reporting Arrangements

• Sample rotation in longitudinal surveys

• Short form questionnaires administered a subsample of long forms

4


Follow-up Techniques

• Reminder cards and call backs

• Reinterview

• Periodic telephone calls

5


Monitoring Data Collection Responses

• Number of contacts (interviews and noninterviews) by location

• Respondent sociodemographic characteristics

• Study effects of various prior contact schemes on cooperation rates

• Number of visits required before conversion of refusals

6


Monitoring Data Collection Responses

• Using listing sheet for interviewer response rate notes

• Determine meaningful data for interviews and noninterviews

• Provide simplified interview outcome codes for use by interviewers

7


Importance of the Enumerator

• The enumerator represents the survey and the organization to the respondent

• Compile information on interviewer characteristics and interview outcome rates

• Include lessons learned from successful interviewers in training and manuals

• Cover a wide range of respondent concerns during training

8


Enumerator Characteristics

• Match interviewer characteristics to their respondents to reduce measurement errors

• Enumerator confidence can improve participation rates

• Experienced enumerators have higher cooperation rates

9


Improving Contact and Cooperation

• Study at home patterns

• Respect local cultural norms

• Practice communication skills

• Post-interview checklist

• Callback notices

10


Factors that Affect Participation

11

• Standardization

• Required during questionnaire administration

• Discouraged during introductions

• Survey sponsorship

• Response rates differ by sponsor


Factors that Affect Participation

• Survey Topics

• Response rates differ by survey topic, all things being equal

• Enumerator knowledge of survey affects cooperation rates

• Confidentiality

– Can affect response rates

12


Publicity and Community Liaison Strategy

• Advance notice of field operations

• Develop key messages

• Form local and national partnerships to deliver message to target populations

• Develop media, publicity, and community organization contact data base

• Regular information kits for contacts

13


Hard to Reach Populations

Partnerships with community groups

• Develop data base/ list of community groups that work with hard to reach populations by area

• Recruit enumerators from hard to reach populations

• Enumerate transient groups in a single night

14


Implications for Survey Implementation

For National Statistical Offices:

• Non-response measurement can improve survey methodologies

• Include contact, communication and cooperation in enumerator training curriculum

• Plan and budget for pre-testing of training instruments

15


Implications for Survey Implementation

For Field Operations

• Implement performance based training programs including communications

• Give enumerators an interview checklist

• Ensure quality of listing operations

• Ensure quality of contact and interview outcome notes

16


Reporting Nonresponse

• Basic response rates should be included in all survey reports

• More complex nonresponse measures would be reported in special reports

• Always include definitions for nonresponse components

• Document actions to reduce nonresponse during data collection

17



Analytical reports should include:

• Unit and item nonresponse that affect critical analysis

• Total unit response rate

• Multi-stage surveys should report for each level

• Longitudinal surveys for each round

• Nonresponse adjustment procedures

• Results of nonresponse bias studies and reports

18



• Technical reports and user guides should include:

– Description of nonresponse compensation measures (weighting and/or imputation)

– Evaluation of compensation procedures

– All actions to increase response rate, including nonresponse follow-up

– Nonresponse data by reason

19


Section B Quiz

1. Nonresponse prevention can be carried out at what three times during data collection?

2. Statistical agencies are focusing more on efforts at which of the three times during data collection?

3. What measure should be included in all survey reports?

4. What survey staff member position is the most important in reducing nonresponse?

20

Documents

Copyright 2010, The World Bank Group. All Rights Reserved. Reducing Non-Response Section B 1