American Statistical Association

1994

Proceedings

of the

Section on Survey Research Methods

Volume II

Papers presented at theAnnual Meeting of the American Statistical Association,

Toronto, Canada, August 13-18,1994and the

49th Annual Conference of the

American Association for Public Opinion Research,Danvers, Massachusetts, May 11-15,1994

UB/TIB Hannover 89

^

111 III 111 1 llllllll 1American Statistical Association 1429 Duke Street, Alexandria, VA 22314

Mover Nonresponse Adjustment Research for the Survey of Income and Program Participation.TiwandaM. Allen and Rita J. Petroni, U.S. Bureau of the Census 662

The Redesign of the Survey of Income and Program Participation.Vicki J. Huggins and Donald P. Fischer, U.S. Bureau of the Census 668

Oversampling in Panel Surveys.

Rajendra P. Singh, Rita J. Petroni, and Tiwanda M. Allen, U.S. Bureau of the Census 674

Discussion. Sylvie Michaud and Pierre Lavallee, Statistics Canada 680

XXI. Issues in Stratified SamplingChair: Kennon R. Copeland, IMS America

An Application of Mathematical Programming to Sample Allocation.

Richard Valliant, U.S. Bureau of Labor Statistics; James E. Gentle, George Mason University 683

Sample Allocation in Multivariate Stratified Design: An Alternative to Convex Programming.M. A. Rahim and WisnerJocelyn, Statistics Canada 689

Applying the Lavallee and Hidiroglou Method to Obtain Stratification Boundaries for the

Census Bureau's Annual Capital Expenditures Survey.John Slanta and Thomas Krenzke, U.S. Bureau of the Census 693

The 1995 Taxpayer Compliance Measurement Program (TCMP) Sample Redesign-A Case History.Wendy Rotz, JeriMulrow, and Eric Falk, Internal Revenue Service 699

Optimum Sample Design for Personal-Visit Establishment Surveys.David W. Chapman, Klemm Analysis Group 704

XXII. Measurement Error in SurveysChair: PaulP. Biemer, Research Triangle Institute

The Influence of Administration Mode on Responses to Numeric Rating Scales.

Roberta L, Songster, U.S. Bureau of Labor Statistics;

ToddH. Rockwood and Don A. Dillman, Washington State University 708

A Records - Survey Comparison of Eligibility and Health Care Utilization Measures for Medicaid

Beneficiaries: Adult and Child Reports.

Donna Eisenhower andAngela Schmitt, Mathematica Policy Research, Inc 713

Analysis of Self and Proxy Responses in the Assessment of Health Status.

Mamatha Swamy, Agency for Health Care Policy and Research 719

An Experiment to Reduce Measurement Error in the SIPP: Preliminary Results.

KentH. Marquis, Jeffrey C. Moore, and Karen Bogen, U.S. Bureau of the Census 725

xm

The Influence of Implicit Methodologies in the Analysis of the CCO and the CPS.

Yves Thibaudeau, Donna Kostanich, and Randall Parmer, U.S. Bureau of the Census 730

XXm. Exploring Fundamental Change: The 1995 Census Test

Organizer: Mary H. Mulry, U.S. Bureau of the Census

Chair: Clifford C. Clogg, Pennsylvania State University

The Role of Questionnaire Design in Reducing Census Coverage Error.

Elizabeth A. Martin and Deborah H. Griffin, U.S. Bureau of the Census 736

New Applications of Sampling and Estimation in the 1995 Census Test.

MaryH. Mulry and Rajendra P. Singh, U.S. Bureau of the Census 742

Master Address File: Update Methodology and Quality Improvement Program.

Philip M. Gbur, MachellKindred, andMichaelL. Mersch, U.S. Bureau of the Census 748

Discussion. Tommy Wright, Oak Ridge National Laboratory 754

XXIV. Advances in Alternative Data Capture Techniques

Chair: Jane D. Shepherd, Westat, Inc.

New CASIC Technologies at the U.S. Bureau of the Census.

William L, Nicholls II and Martin V. Appel, U.S. Bureau of the Census 757

Converting Mail Reporters to Touchtone Data Entry.

RichardJ. Rosen, RichardL. Clayton, andLyndaL. Pivetz, U.S. Bureau of Labor Statistics 763

Results from a Feasibility Test of an Alternative Automated Data Capture Methodology During the

1992 Census of Agriculture.

Magdalena Ramos, Bruce Hughes, and Betty McKay, U.S. Bureau of the Census 769

Desktop Documentation: Individual Income Tax Microdata, SOI.

Martin David, University of Wisconsin, Madison 775

Developing Metadata Database at the Census Bureau.

Daniel W. Gillman and Martin V. Appel, U.S. Bureau of the Census 781

XXV. Design, Weighting and Imputation Issues for Panel Surveys

Chair: James M. Lepkowski, University of Michigan

Weighting Schemes for Household Panel Surveys.

Graham Kalton and J. Michael Brick, Westat, Inc 785

Income Stratification in Panel Surveys: Issues in Design and Estimation.

John L. Czajka, Mathematica Policy Research, Inc 791

xiv

Introducing Births Into the Employment Cost Index Survey.

MaryK Gessley, E. Thomas Kelly, and Chester H. Ponikowski, U.S. Bureau of Labor Statistics 797

The National Population Health Survey: Design and Issues.

MP. Singh, J.L. Tambay, andS. Krawchuk, Statistics Canada 803

Longitudinal Imputation of SIPP Food Stamp Benefits.

Antoinette Tremblay, U.S. Bureau of the Census 809

XXVI. Response and Coverage Issues in School Surveys

Organizer: Daniel Kasprzyk, National Center for Education Statistics

Chair: Calvin Jones, Abt Associates

Some Data Issues in School-Based Surveys.

DanielKasprzyk and Kerry Gruber, National Center for Education Statistics;Sameena Salvucci, Mehrdad Saba, Fan Zhang, and Steven Fink,

Synectics for Management Decisions 815

The 1991-92 Teacher Follow-up Survey Reinterview and Extensive Reconciliation.

Cleo R. Jenkins andAngela-Jo Wetzel, U.S. Bureau of the Census 821

Improving Coverage in a National Survey of Teachers.

Daniel Royce and Irwin Schreiner, U.S. Bureau of the Census 827

Improving the Coverage of Private Elementary-Secondary Schools.

Betty J. Jackson, Richard L. Frazier, Karen E. King, and Dennis J. Schwanz,

U.S. Bureau of the Census 833

XXVII. Computer Assisted Personal Interviewing: Effects on Data

Quality, Interviewers, and Survey Costs

Chair: DwightB. Brock, National Institute on Aging

Data Quality of Income Data Using Computer Assisted Interviewing: The Experience of the

Canadian Survey of Labour and Income Dynamics.

Chantal Grondin and Sylvie Michaud, Statistics Canada 839

Measuring Interviewer Performance Using CAPI.

MickP. Couper, Sally A. Sadosky, andSue Ellen Hansen, University of Michigan 845

CAPI: An Experimental Evaluation.

Reg Baker, Norman Bradburn, and RobertJohnson, National Opinion Research Center 851

Problems, Trade-Offs, and Solutions for CAPI Surveys.

John S. Gardenier, Centers for Disease Control and Prevention 857

Discussion. Bill Connett, University of Michigan 861

xv

XXVni. Survey Weighting

Chair: Ronalds. Fecso, U.S. Department of Agriculture

Optimally Weighted Means in Stratified Sampling.

Jiahe Qian, National Opinion Research Center; Bruce D. Spencer, Northwestern University 863

Composite Weights for the Current Population Survey.

Janice Lent,sa\A Stephen Miller, U.S. Bureau of Labor Statistics;

Patrick Cantwell, U.S. Bureau of the Census 867

Composite Estimation in National and State Surveys.

John Burke, Leyla Mohadjer, Jim Green, andJoseph Waksberg, Westat, Inc.;

Irwin S. Kirsch, Educational Testing Service;

AndrewKolstad, National Center for Education Statistics 873

Poststratification of Pooled Survey Data.

Mansour Fahimi, Westat, Inc 879

Weighting Sample Data When Multiple Sample Frames are Used.

Barbara Lepidus Carlson and John W. Hall, Mathematica Policy Research, Inc 882

XXIX. ImputationChair: DavidA. Binder, Statistics Canada

Estimation of the Variance in the Presence of Nearest Neighbour Imputation.

Eric Rancourt, Carl Sarndal, andHyunshikLee, Statistics Canada 888

Exploring Cross-Match Estimators With Multiply-Imputed Data Sets,

John Barnard andXiao-Li Meng, The University of Chicago 894

Analyzing Imputed Survey Data Sets With Model Assisted Estimators.

RobertE. Fay, U.S. Bureau of the Census 900

Discussion. John G. Kovar, Statistics Canada 906

XXX. Canadian Labour Force Survey: Questionnaire and Sample Redesign

Chair: Shail Butani, U.S. Bureau of Labor Statistics

Redesigning the Canadian Labour Force Survey Questionnaire: Development and Testing.

Deborah Sunter and Mark Kinack, Statistics Canada 908

Sample Allocation for the Canadian Labour Force Survey.

Ijaz U.H. Mian and Normand Laniel, Statistics Canada 913

Design and Estimation Issues for Income in the Redesign of the Canadian Labour Force Survey.

EJ. Chen, J. Gambino, N. Laniel, and J. Lindeyer, Statistics Canada 919

xvi

Cost Modelling of Alternative Sample Designs for Rural Areas in the Canadian Labour Force Survey.Harold Mantel, Normand Laniel, Marie-Claude Duval, and Jocelyne Marion, Statistics Canada 925

Analysis of Urban Cluster Size in the Canadian Labour Force Survey.NormandLaniel and Chris Mohl, Statistics Canada 931

Control Charts for Non-Response Rates in the Canadian Labour Force Survey.K..P. Hapuarachchi andA. Wronski, Statistics Canada 937

XXXI. Exploring Causes and Effects ofSurvey NonresponseChair: Judith Lessler, Battelle, Durham

Nonresponse and its Effects in a Followup Telephone Survey of Low Income Women.William D. Kalsbeek and ToddA. Durham, University ofNorth Carolina 943

An Evaluation of Nonresponse Bias in NHANES III (1988-91).Meena Khare and Trena M. Ezzati-Rice, National Center for Health Statistics;LeylaK. Mohadjer andJoseph Waksberg, Westat, Inc 949

Modeling of Response Propensity in the Third National Health and Nutrition Examination Survey.Trena M. Ezzati-Rice and Meena Khare, National Center for Health Statistics 955

A Revised Theory of Longitudinal Nonresponse.MonicaL. Wolford, University of Michigan 960

Characteristics of Nonrespondents to the Current Population Survey (CPS) and Consumer ExpenditureInterview Survey (CEIS).

BrianA. Kojetin, U.S. Bureau of Labor Statistics 966

XXXII. Nonresponse Trends in Government SurveysOrganizer: WendyAlvey, Internal Revenue Service

Chair: Robert M. Groves, University of Michigan

Investigating Nonresponse in Federal Surveys.Carolyn F. Shettle, National Science Foundation; Patricia M. Guenther,

Agricultural Research Service; Daniel Kaspryzk, National Center for Education Statistics;Maria Elena Gonzalez, Office of Management and Budget 972

Response in Federally Sponsored Establishment Surveys.JeffreyB. Osmint, U.S. Bureau of Mines; PaulB. McMahon, Internal Revenue Service;Antoinette Ware Martin, Energy Information Administration 977

Nonresponse in Federal Demographic Surveys: 1981-1991.

Ayah E. Johnson, Henry M. Jackson Foundation; Steven L. Botman,National Center for Health Statistics; PeterBasiotis, U.S. Department ofAgriculture 983

xvii

Model-Based Reweighting for Nonresponse Adjustment.

DavidA. Binder, Sylvie Michaud, and Claude Poirier, Statistics Canada 989

XXXm. Nonsampling Errors in Establishment Surveys

Chair: RichardAllen, U.S. Department of Agriculture

The Impact of Dropping the Business Area Sample as a Means of Covering Birth Employers and

Nonemployers in the Current Business Surveys.

CarlA. Konschnik, U.S. Bureau of the Census 995

Statistics of Income Partnership Studies: Evaluation of Preliminary Estimates.

PaulB. McMahon, Internal Revenue Service 1001

A Response Model for the International Price Program.

Gwyn R. Ferguson and Tamara M. Ciapponi, U.S. Bureau of Labor Statistics 1007

One Way to Build an EstimatorWith Applications to Sampling Theory.

Steve Woodruff, U.S. Bureau of Labor Statistics 1013

1992 Census of Agriculture Coverage Evaluation Estimation.

Paul J. Lewis, Trilogy Consulting Corporation; Glenn S. Wolfgang andE. Ann Vacca,

U.S. Bureau of the Census 1019

Commercial Payroll Software and the Quality of Employment Data.

Karen L. Goldenberg, Susan E. Moore, and RichardJ. Rosen, U.S. Bureau of Labor Statistics 1025

XXXIV. Issues in BLS's Occupational Compensation Survey Program

Chair/Organizer: Stephen H. Cohen, U.S. Bureau of Labor Statistics

The Reliability of the Locality Pay Estimates.

Joan L. Coleman andPenny L. James, U.S. Bureau of Labor Statistics 1031

Confidence Intervals for Sub-Domain Means and Totals.

Robert J. Casady andAlan Dorfinan, U.S. Bureau of Labor Statistics;

Suojin Wang, Texas A&M University 1036

Reducing Nonsampling Error in the Bureau of Labor Statistics Occupational Compensation Surveys.

Elizabeth Dieiz, U.S. Bureau of Labor Statistics 1042

Updating Occupational Compensation Survey Program Data Using the Employment Cost Index.

Jason Tehonica, U.S. Bureau of Labor Statistics 1048

XXXV. Small Area Estimation

Chair: William C. Iwig, U.S. Department of Agriculture

Two-Phase Estimation by Imputation.

Anita McVey, F. JayBreidt, and Wayne A. Fuller, Iowa State University 1053

xviu

Rank-Based Predictive Inference for the Finite Population Mean of a Small Area.M. MushfiqurRashid and Balgobin Nandram, Worcester Polytechnic Institute 1059

Synthetic Estimates for Small Areas in PRAMS.

Christopher H. Johnson, Centers for Disease Control and Prevention 1065

The Relative Accuracy of Direct and Indirect Estimates of State Poverty Rates.

Allen L. Schirm, Mathematica Policy Research, Inc 1071

State Unemployment Rate Time Series Models.

Tamara Sue Zimmerman, Thomas D. Evans, and Richard B. Tiller, U.S. Bureau of Labor Statistics. ..

1077

XXXVI. Estimating Substance Abuse in Special Populations

Chair/Organizer: Ronaldo lachan, Research Triangle Institute

Substance Abuse Among Runaway and Homeless Youth.

Ronaldo lachan, Chris L. Ringwalt, andJody M. Greene, Research Triangle Institute 1083

The Validity of Self-Reported Drug Use Among the Incarcerated.David Cantor, Westat, Inc.; Gregory Gaertner andLinda Keil, Gallup, Inc 1088

Estimating the Prevalence of Substance Abuse Among People Who Are Homeless.

Ronaldo lachan, MichaelL. Dennis, and RobertM. Bray, Research Triangle Institute 1094

Sample Design of the National Pregnancy and Health Survey.Ralph DiGaetano, John Ward, Diane Cadell, andLana Ryaboy, Westat, Inc 1100

XXXVII. Estimation Issues in School Surveys

Organizer: Daniel Kasprzyk, National Center for Education Statistics

Chair: PaulD. Planchon, National Center for Education Statistics

Intersurvey Consistency in School Surveys.Albert Holt, Synectics for Management Decisions; Steven Kaufman,National Center for Education Statistics; Fritz Scheuren, George Washington University;Wray Smith, Synectics for Management Decisions 1105

Estimation Issues Related to the Student Component of the SASS.

Karen Ellen King, U.S. Bureau of the Census;Steve Kaufman, National Center of Education Statistics 1111

Properties of the Schools and Staffing Survey's Bootstrap Variance Estimator.

Steven Kaufman, National Center for Education Statistics 1116

Optimal Periodicity of a Survey: Sampling Error, Data Deterioration, and Cost.

Dhiren Ghosh, Synectics for Management Decisions; Steven F. Kaufman,National Center for Education Statistics; Wray Smith and Michael Chang,Synectics for Management Decisions 1122

xtx

Discussion. Gary Shapiro, Abt Associates 1128

XXXVIII. Quality Issues in Data Coding, Editing and Estimation

Chair: Rachel Caspar, Research Triangle Institute

A Comparison of Two Methods of Automated Industry Coding.

JohnH. Rowland andMarkD. Kinack, Statistics Canada 1130

A Data Collection Methodology for the 2001 Canadian Census.

G. H. Choudhry, Statistics Canada 1134

Improving Outlier Detection in Two Establishment Surveys.

Julia L. Bienias, David M. Lassman, ScottA. Scheleur, and Howard Hogan,

U.S. Bureau of the Census 1140

Development of Edit Parameters for 1992 Economic Census Enterprise Reports.

Sungsoo Oh, Dave Paletz, Jay Kim, andEddie Salyers, U.S. Bureau of the Census 1144

Evaluation of the Canadian Potato Area Estimation Program.

Patricia J. Whitridge and ClaudePoirier, Statistics Canada 1150

Measuring and Reporting Nonresponse Rates in Agricultural Surveys.

LaurentRoy, Statistics Canada 1156

Contributed Papers —Poster Sessions

Sample Surveys at National Center for Health Statistics.

Jai Won Choi and Lester R. Curtin, National Center for Health Statistics 1162

Estimation and Analysis Effects Resulting from a Sample Size Reduction in a Large National Survey.

StevenL. Botman, National Center for Health Statistics 1168

Accelerated Sequential Procedure to Estimate the Mean of Unknown Distribution.

H. I. Hamdy and M.S. Son, University of Vermont 1173

Comparison of National and Regional Gasoline Prices from Two Surveys.

Pedro J. Saavedra and Nancy C. Hassett, Macro International Inc.;

Paula Weir, U.S. Department of Energy 1179

The Challenges of Preparing Sensitive Data for Public Release.

Gerhard Fries, Federal Reserve Board; R. Louise Woodburn, Internal Revenue Service 1184

State Estimates for the National Health Interview Survey Using a Random Digit Dialing Supplement.

Donald Make and VanL. Parsons, National Center for Health Statistics 1190

xx

Papers Presented at the

49th Annual Conference of the

American Association for Public Opinion Research

May 11-15,1994

Danvers, Massachusetts

Conducting Global Consumer Research: Considerations and Pitfalls.

Susan L. Mendelsohn, Chip Walker, and Hank Bernstein, D'Arcy Masius Benton & Bowles, Inc 1196

Non-Response to Sensitive Questions: Nationalism in Germany.Dagmar Krebs, Center for Survey Research, Methodology and Analyses (ZUMA) 1199

The Cognitive Evaluation of the Nativity Questions for the Current Population Survey.Tracy Wellens, U.S. Bureau of the Census 1204

Results from a Cognitive Exploration of the 1993 American Housing Survey.Dawn R. Von Thurn andJeffrey C. Moore, U.S. Bureau of the Census 1210

Cognitive Issues and Methodological Implications in the Development and Testing of a

Traffic Safety Questionnaire.

Susan Schechter andPaul Beatty, National Center for Health Statistics;Alan Block, National Highway Traffic Safety Administration 1215

Prospects for Measuring the Child Radio Audience in the U.S. Using the Seven-DayPersonal Diary Method.

Robert H. Patchen, Bonnie B. Burgess, and Maria D. Cralley, The Arbitron Company 1220

Issues and Guidelines for Translation in Cross-Cultural Research.

Beverly Weidmer, RAND Corporation 1226

Evaluating Translations of Survey Instruments in Spanish and English: The 1990 Spanish LanguageCensus Long Form.

Susan M. Gabbard andJorge Nakamoto, Aguirre International 1232

Response to a Government Survey as Political Participation: The Relation of Economic and PoliticalConditions to Refusal Rates in the Current Population Survey.

Brian Kojetin, Clyde Tucker, andErin Cashman, U.S. Bureau of Labor Statistics 1236

Does "I'm Not Selling Anything" Increase Response Rates in Telephone Surveys?Bruce Pinkleton, Joey Reagan, Dustin Aaronson, and EduardRamo, Washington State University 1242

Confidentiality Issues in Videotaped Data Collection.

Ann E. Cederlund, National Opinion Research Center 1248

xxi

Can We Get Respondents to Use Their Personal Income Records.

Karen Bogen, Jeffrey C. Moore, andKent H. Marquis, U.S. Bureau of the Census 1252

Improving Validity of Parental Reports of Child Immunization Status in a Telephone Survey.

Lois M. Haggard andDonaldZ. Gray, University of Utah 1258

Increasing Response Rates in Follow-Up Surveys of Drug Treatment Patients.

RobertJohnson, Kay Malloy, Dean Gerstein, and Natalie Suter, National Opinion Research Center;

Susan Nisenbaum, California Department of Alcohol and Drug Programs 1263

Hidden Assumptions: The Use of Vignettes in Cognitive Interviewing.

Eleanor R. Gerber, U.S. Bureau of the Census 1269

An Examination of Mode Effects in Cognitive Laboratory Research.

Paul Beatty and Susan Schechter, National Center for Health Statistics 1275

A Cognitive and Linguistic Exploration of the Meaning of Training: Implications for Survey Design.

Pamela Campanelli, SCPR; Joanna Channell andLizMcAulay, University of Birmingham;

Antoinette Renouf, University of Liverpool; Roger Thomas, SCPR 1281

Coverage Error and Cost Issues in Small Area Telephone Surveys.

Judith A. Schejbal andPaul J. Lavrakas, Northwestern University 1287

Bias in List-Assisted Telephone Samples.J. Michael Brick andJoseph Waksberg, Westat, Inc.;

DaleKulp andAmy Starer, GENESYS Sampling Systems 1293

The Effect of Varying the Respondent Selection Script on Respondent Self-Selection in

RDD Telephone Surveys.KristinaS. Romuald and Lois M. Haggard, University of Utah; 1299

Counting Gays and Lesbians: A Case for "New" Survey Methods.

BradEdwards, Westat, Inc 1305

Spoken Language Recognition of the Year 2000 Census Questionnaire Feasibility Test.

Martin V. Appel, U.S. Bureau of the Census;

Ronald Cole, Center for Spoken Language Understanding 1310

Interactive Polling and Americans' Comfort Level With Technology.

Kathleen A. Frankovic, Cheryl Mercado Arnedt, and Bala Ramnath, CBS News 1316

Effects of Rank Versus Category in Measuring Subjective Social Inequality.

Jtirgen HP. Hoffmeyer-Zlotnik, Center for Survey Research, Methodology and Analysis ZUMA 1322

The Basis of Norms for Vague Quantifiers.

Colm O'Muircheartaigh and George Gaskell, London School of Economics and Political Science 1327

xxn

Effects of Benefits Appeals, Mandatory Appeals and Variations in Statements of Confidentiality onCompletion Rates for Census Questionnaires.

Don A. Dillman, Eleanor Singer, JonR. Clark, andJames B. Treat, U.S. Bureau of the Census 1333

A Spatial Analysis of Contextual Effects on Voter Participation in the 1992 Presidential Election.

Kurt C. Schlichting, Fairfield University; PeterS. Tuckel, Hunter College 1339

Strategies for Estimating Category Frequency: Effects of Abstractness and Distinctiveness.

Frederick G. Conrad, U.S. Bureau of Labor Statistics; Norman R. Brown, University of Alberta 1345

Cognitive Aspects of Organizational Reporting.Seymour Sudman and Joan M. Phillips, University of Illinois 1351

Answering Questions, Questioning Answers: Evaluating Data Quality in an Establishment Survey.KarenL. Goldenberg, U.S. Bureau of Labor Statistics 1357

Using an Establishment Survey Response Model, and Focus Groups in the Redesign of an

Establishment Survey Questionnaire.

YoungI. Chun and Deborah Stone, U.S. Bureau of Labor Statistics 1363

Scheduling Initial Calls in a Telephone Survey of Businesses.

W. Sherman Edwards and Patricia Cunningham, Westat, Inc 1368

Design-Oriented Focus Groups and Cognitive Laboratories: A Comparison.Donna L. Eisenhower, Mathematica Policy Research, Inc 1374

Economic Knowledge and Public Opinion on Economic Issues.

WilliamB. Walstad, University of Nebraska-Lincoln 1380

Effects ofIncentive Payments on Response Rates and Field Costs in a Pretest ofa National CAPI Survey.Allen Duffer, Research Triangle Institute; Judith Lessler and Michael Weeks, Battelle;William Mosher, National Center for Health Statistics 1386

Index 1393

xxui