![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
Scholars increasingly rely on indirect questioning techniques to reduce social desirability bias and item nonresponse for sensitive survey questions. The major drawback of these approaches, however, is their inefficiency relative to direct questioning. We show how to improve the statistical analysis of the list experiment, randomized response technique, and endorsement experiment by exploiting auxiliary information on the sensitive trait. We apply the proposed methodology to survey experiments conducted among voters in a controversial antiabortion referendum held during the 2011 Mississippi General Election. By incorporating the official county-level election results, we obtain precinct- and individual-level estimates that are more accurate than standard indirect questioning estimates and occasionally even more efficient than direct questioning. Our simulation studies shed light on the conditions under which our approach can improve the efficiency and robustness of estimates based on indirect questioning techniques. Open-source software is available for implementing the proposed methodology.
References
|
Adams, G. D. 1997. “Abortion: Evidence of an Issue Evolution.” American Journal of Political Science 41:718–37. Google Scholar | Crossref | ISI | |
|
Aronow, P. M., Coppock, A., Crawford, F. W., Green, D. P.. 2015. “Combining List Experiment and Direct Question Estimates of Sensitive Behavior Prevalence.” Journal of Survey Statistics and Methodology 3:43–66. Google Scholar | Crossref | Medline | |
|
Blair, G., Imai, K.. 2012. “Statistical Analysis of List Experiments.” Political Analysis 20:47–77. Google Scholar | Crossref | ISI | |
|
Blair, G., Imai, K.. 2016. “List: Statistical Methods for the Item Count Technique and List Experiment.” Comprehensive R Archive Network (CRAN). Version 8.3. Retrieved September 26, 2017. (http://CRAN.R-project.org/package=list). Google Scholar | |
|
Blair, G., Imai, K., Lyall, J.. 2014. “Comparing and Combining List and Endorsement Experiments: Evidence from Afghanistan.” American Journal of Political Science 58:1043–63. Google Scholar | Crossref | ISI | |
|
Blair, G., Imai, K., Zhou, Y.-Y.. 2015. “Design and Analysis of Randomized Response Technique.” Journal of the American Statistical Association 110:1304–19. Google Scholar | Crossref | |
|
Blair, G., Zhou, Y.-Y., Imai, K.. 2016. “rr: Statistical Methods for the Randomized Response.” Comprehensive R Archive Network (CRAN). Version 1.4. Retrieved September 26, 2017. (http://CRAN.R-project.org/package=rr). Google Scholar | |
|
Bullock, W., Imai, K., Shapiro, J. N.. 2011. “Statistical Analysis of Endorsement Experiments: Measuring Support for Militant Groups in Pakistan.” Political Analysis 19:363–84. Google Scholar | Crossref | ISI | |
|
Coutts, E., Jann, B.. 2011. “Sensitive Questions in Online Surveys: Experimental Results for the Randomized Response Technique (RRT) and the Unmatched Count Technique (UCT).” Sociological Methods & Research 40:169–93. Google Scholar | SAGE Journals | ISI | |
|
Cross, P. J., Manski, C. F.. 2002. “Regressions, Short and Long.” Econometrica 70:357–68. Google Scholar | Crossref | |
|
Duncan, O. D., Davis, B.. 1953. “An Alternative to Ecological Correlation.” American Sociological Review 18:665–66. Google Scholar | Crossref | ISI | |
|
Gingerich, D. W. 2010. “Understanding Off-the-books Politics: Conducting Inference on the Determinants of Sensitive Behavior with Randomized Response Surveys.” Political Analysis 18:349–80. Google Scholar | Crossref | ISI | |
|
Gonzalez-Ocantos, E., de Jonge, C. K., Meléndez, C., Osorio, J., Nickerson, D. W.. 2012. “Vote Buying and Social Desirability Bias: Experimental Evidence from Nicaragua.” American Journal of Political Science 56:202–17. Google Scholar | Crossref | ISI | |
|
Greiner, D. J., Quinn, K. M.. 2010. “Exit Polling and Racial Bloc Voting: Combining Individual Level and Ecological Data.” Annals of Applied Statistics 4:1774–96. Google Scholar | Crossref | |
|
Handcock, M. S., Rendall, M. S., Cheadle, J. E.. 2005. “Improved Regression Estimation of a Multivariate Relationship with Population Data on the Bivariate Relationship.” Sociological Methodology 35:291–334. Google Scholar | SAGE Journals | ISI | |
|
Hansen, L. P. 1982. “Large Sample Properties of Generalized Method of Moments Estimators.” Econometrica 50:1029–54. Google Scholar | Crossref | ISI | |
|
Hansen, L. P., Heaton, J., Yaron, A.. 1996. “Finite-sample Properties of Some Alternative GMM Estimators.” Journal of Business & Economic Statistics 14:262–80. Google Scholar | ISI | |
|
Hanson, T. E., Branscum, A. J., Johnson, W. O.. 2014. “Informative g-priors for Logistic Regression.” Bayesian Analysis 9:597–612. Google Scholar | Crossref | ISI | |
|
Hellerstein, J. K., Imbens, G. W.. 1999. “Imposing Moment Restrictions from Auxiliary Data by Weighting.” Review of Economics and Statistics 81:1–14. Google Scholar | Crossref | ISI | |
|
Imai, K. 2011. “Multivariate Regression Analysis for the Item Count Technique.” Journal of the American Statistical Association 106:407–16. Google Scholar | Crossref | ISI | |
|
Imai, K., Khanna, K.. 2016. “Improving Ecological Inference by Predicting Individual Ethnicity from Voter Registration Record.” Political Analysis 24:263–72. Google Scholar | Crossref | |
|
Imbens, G., Lancaster, T.. 1994. “Combining Micro and Macro Data in Microeconometric Models.” The Review of Economic Studies 61:655–80. Google Scholar | Crossref | ISI | |
|
Jackson, C., Best, N., Richardson, S.. 2008. “Hierarchical Related Regression for Combining Aggregate and Individual Data in Studies of Socio-economic Disease Risk Factors.” Journal of the Royal Statistical Society: Series A (Statistics in Society) 171:159–78. Google Scholar | ISI | |
|
Janus, A. L. 2010. “The Influence of Social Desirability Pressures on Expressed Immigration Attitudes.” Social Science Quarterly 91:928–46. Google Scholar | Crossref | ISI | |
|
Karp, J. A., Brockington, D.. 2005. “Social Desirability and Response Validity: A Comparative Analysis of Overreporting Voter Turnout in Five Countries.” Journal of Politics 67:825–40. Google Scholar | Crossref | ISI | |
|
Kim, C., Tamborini, C. R.. 2014. “Response Error in Earnings: An Analysis of the Survey of Income and Program Participation Matched with Administrative Data.” Sociological Methods & Research 43:39–72. Google Scholar | SAGE Journals | ISI | |
|
Kling, J. R., Ludwig, J., Katz, L. F.. 2005. “Neighborhood Effects on Crime for Female and Male Youth: Evidence from a Randomized Housing Voucher Experiment.” The Quarterly Journal of Economics 120:87–130. Google Scholar | Crossref | ISI | |
|
Krumpal, I. 2012. “Estimating the Prevalence of Xenophobia and Anti-semitism in Germany: A Comparison of Randomized Response and Direct Questioning.” Social Science Research 41:1387–403. Google Scholar | Crossref | Medline | |
|
Kuklinski, J. H., Cobb, M. D., Gilens, M.. 1997. “Racial Attitudes and the “New South.”” Journal of Politics 59:323–49. Google Scholar | Crossref | ISI | |
|
Lyall, J., Blair, G., Imai, K.. 2013. “Explaining Support for Combatants during Wartime: A Survey Experiment in Afghanistan.” American Political Science Review 107:679–705. Google Scholar | Crossref | ISI | |
|
Martin, L. M., Leff, M., Calonge, N., Garrett, C., Nelson, D. E.. 2000. “Validation of Self-reported Chronic Conditions and Health Services in a Managed Care Population.” American Journal of Preventive Medicine 18:215–18. Google Scholar | Crossref | Medline | ISI | |
|
Raftery, A. E., Givens, G. H., Zeh, J. E.. 1995. “Inference from a Deterministic Population Dynamics Model for Bowhead Whales.” Journal of the American Statistical Association 90:402–16. Google Scholar | Crossref | ISI | |
|
Rosenfeld, B., Imai, K., Shapiro, J.. 2016. “An Empirical Validation Study of Popular Survey Methodologies for Sensitive Questions.” American Journal of Political Science 60:783–802. Google Scholar | Crossref | ISI | |
|
Schräpler, J.-P. 2004. “Respondent Behavior in Panel Studies: A Case Study for Income Non-response by Means of the German Socio-economic Panel (SOEP).” Sociological Methods & Research 33:118–56. Google Scholar | SAGE Journals | ISI | |
|
Shiraito, Y., Imai, K.. 2015. “Endorse: R Package for Analyzing Endorsement Experiments.” Comprehensive R Archive Network (CRAN). Version 1.6.0. Retrieved September 26, 2017. (http://CRAN.R-project.org/package=endorse). Google Scholar | |
|
van der Heijden, P. G., van Gils, G., Bouts, J., Hox, J. J.. 2000. “A Comparison of Randomized Response, Computer-assisted Self-interview, and Face-to-face Direct Questioning: Eliciting Sensitive Information in the Context of Welfare and Unemployment Benefit.” Sociological Methods & Research 28:505–37. Google Scholar | SAGE Journals | ISI | |
|
Warner, S. L. 1965. “Randomized Response: A Survey Technique for Eliminating Evasive Answer Bias.” Journal of the American Statistical Association 60:63–69. Google Scholar | Crossref | Medline | ISI | |
|
Wolter, F., Preisendörfer, P.. 2013. “Asking Sensitive Questions: An Evaluation of the Randomized Response Technique versus Direct Questioning Using Individual Validation Data.” Sociological Methods & Research 42:321–53. Google Scholar | SAGE Journals | ISI | |
|
Wyner, G. A. 1980. “Response Errors in Self-reported Number of Arrests.” Sociological Methods & Research 9:161–77. Google Scholar | SAGE Journals | ISI |
