Upload
others
View
6
Download
0
Embed Size (px)
Citation preview
Dipl. Soz. Felix Bader Institute for Sociology, LMU Munich Institute for Sociology, University Mannheim
Numeric Codes in Questionnaires The Influence on Unit Nonresponse, Item Nonresponse, and Misreporting
Dr. Johannes Bauer Institute for Sociology, LMU Munich Institute for Empolyment Research
Dipl. Soz. Martina Kroher Institute for Sociology, University Hannover
Dipl. Soz. Patrick Riordan Institute for Sociology, LMU Munich
Johannes Bauer, Institute for Employment Research / Institute of Sociology, LMU Munich # 2
paper questionnaires: optical mark recognition
Readsoft AXIOME Yomark SQS queXF Udai OMR TCExam C# (OMR) Remark Office OMR
Teleform Neoptec Ogami OMR FormReturn Form Scanner DRS SDAPS OMR Mark Engine Leadtools OMR SDK
Johannes Bauer, Institute for Employment Research / Institute of Sociology, LMU Munich
How a questionnaire scanner works
# 3
982012
001421
340003 217561
411131
317142
982012
982012
982012
Data
Johannes Bauer, Institute for Employment Research / Institute of Sociology, LMU Munich
How a questionnaire scanner works
# 3
Are numbers a problem?
982012
001421
340003 217561
411131
317142 982012
982012
Johannes Bauer, Institute for Employment Research / Institute of Sociology, LMU Munich
Are numbers a problem?
# 4
when?
anonymity
Johannes Bauer, Institute for Employment Research / Institute of Sociology, LMU Munich
Survey on Group Focused Enmity
# 5
Group Focused Enmity
disabled people
long-term unemployed
homeless people
immigrants
muslims
jews
homosexuals national socialism
Johannes Bauer, Institute for Employment Research / Institute of Sociology, LMU Munich
Survey Experiment
# 7
no scancode (n = 1863)
with scancode (n = 931)
scancode with explanation (n = 931)
Johannes Bauer, Institute for Employment Research / Institute of Sociology, LMU Munich # 6
Response rate: 30.2 percent 30.1 percent 31.0 percent
Responses: 281 280 577
Johannes Bauer, Institute for Employment Research / Institute of Sociology, LMU Munich
Measuring Items and Sensitivity
# 7
long-term unemployed
muslims
fully disagree
fully agree
fully disagree
fully agree
Most unemployed persons make an effort to find a job.
There are too many Muslims in Germany.
Johannes Bauer, Institute for Employment Research / Institute of Sociology, LMU Munich
Regression on all 38 GFE-Items
# 8
Multivariate Regression
without scanncode (reference) with scanncode with scanncode and explanation
Additional variables: Sex Age, Age² Religion German Citizenship Education Employment Status Unemployment Experience Income Sense of Belonging Contact to Foreigners in the Family Contact to Foreigners at Work Politically Involved Trust in Government Social Participation „Getting my Fair Share“ Socio-Economic Comparison Sentiment during Childhood City District
muslims in Germany
unemployed make effort
With scann-
code + expla-
nation
-0.3
-0.2
-0.1
0.0
0.1
0.2
0.3
Reg
ress
ion
Par
amet
er
standardized GFE-Items
Johannes Bauer, Institute for Employment Research / Institute of Sociology, LMU Munich
Regression on all 38 GFE-Items
# 8
Multivariate Regression
without scanncode (reference) with scanncode with scanncode and explanation
Additional variables: Sex Age, Age² Religion German Citizenship Education Employment Status Unemployment Experience Income Sense of Belonging Contact to Foreigners in the Family Contact to Foreigners at Work Politically Involved Trust in Government Social Participation „Getting my Fair Share“ Socio-Economic Comparison Sentiment during Childhood City District
-0.3
-0.2
-0.1
0.0
0.1
0.2
0.3
With scann-
code
Reg
ress
ion
Par
amet
er
+ expla-
nation
standardized GFE-Items
With scann-
code + expla-
nation
standardized Non sensitive Items
Johannes Bauer, Institute for Employment Research / Institute of Sociology, LMU Munich
Regression on all 38 GFE-Items
# 8
Multivariate Regression
without scanncode (reference) with scanncode with scanncode and explanation
-0.3
-0.2
-0.1
0.0
0.1
0.2
0.3
With scann-
code
Reg
ress
ion
Par
amet
er
+ expla-
nation
standardized GFE-Items
With scann-
code + expla-
nation
standardized Non sensitive Items
0
1
2
3
4
Item
Nonre
spon
se (
Per
cen
t)
GFE-Items Item Nonresponse
With scan-
code
+ expla-
nation
No scan-
code
Non sensit. Items
With scan-
code
+ expla-
nation
No scan-
code
Johannes Bauer, Institute for Employment Research / Institute of Sociology, LMU Munich
Regression on Xenophobia Index, Interactions with scancode
# 10
Regression
without scanncode (reference) with scanncode with scanncode and explanation
immigrants
Additional variables: Sex Age, Age² Religion German Citizenship Education Employment Status Unemployment Experience Income Sense of Belonging Contact to Foreigners in the Family Contact to Foreigners at Work Politically Involved Trust in Government Social Participation „Getting my Fair Share“ Socio-Economic Comparison Sentiment during Childhood
n = 706
Interaction Parameter
-1.96 SE 0 +1.96 SE
Male Age
2
Catholic Religion
Lutheran-Protestant No Religion
German Citizenship No Degree/Junior High School Degree
Middle School (“Realschule”) Degree
Adv. Tech. College Qualification University Qualification
Full-Time Employed Reg. Part-Time Employment
Marginal Part-Time Employment
No Unemployment Experience Income Per Capita (in 1000 €)
Sense of Belonging to Germany No Sense of Belonging to Europe
Contact to Foreigners in the Family No Contact to Foreigners at Work
Politically Involved
Trust in Government Social Participation
'Getting My Fair Share' (Negative) Socio-Economic Comparison
Sentiment During Childhood
Age
Johannes Bauer, Institute for Employment Research / Institute of Sociology, LMU Munich
t-values of six GFE Indices
# 10
Regression
without scanncode (reference) with scanncode with scanncode and explanation
immigrants
muslims
jews
long-term unemployed
homosexuals
national socialism
t-Values
-3 -2 -1 0 1 2 3 4
0.0
0
.1
0.2
0
.3
0.4
0
.5
0.6
Den
sity
Standard Normal Distribution
𝑝𝐴𝐷 = 0.556
𝑝𝑆𝑊 = 0.614
𝑝𝐾𝑆 = 0.676
𝑝𝐴𝐷 = 0.052
𝑝𝑆𝑊 = 0.092
𝑝𝐾𝑆 = 0.007
156 interactions and t-values
Johannes Bauer, Institute for Employment Research / Institute of Sociology, LMU Munich
discussion
Scancode has an effect on responses to sensitive questions
An explanation in the cover letter does not weaken this effect
Researcher has to decide what is more relevant, bias or cost?
Improve Software – Use alternatives to Scancode
Thank you for the attention
# 11