![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
In the modeling of ordinal responses in psychological measurement and survey-based research, response styles that represent specific answering patterns of respondents are typically ignored. One consequence is that estimates of item parameters can be poor and considerably biased. The focus here is on the modeling of a tendency to extreme or middle categories. An extension of the partial credit model is proposed that explicitly accounts for this specific response style. In contrast to existing approaches, which are based on finite mixtures, explicit person-specific response style parameters are introduced. The resulting model can be estimated within the framework of generalized mixed linear models. It is shown that estimates can be seriously biased if the response style is ignored. In applications, it is demonstrated that a tendency to extreme or middle categories is not uncommon. A software tool is developed that makes the model easy to apply.
References
|
Anderson, D. A., Aitkin, M. (1985). Variance component models with binary response: Interviewer variability. Journal of the Royal Statistical Society, Series B:Statistical Methodology, 47, 203-210. Google Scholar | |
|
Austin, E. J., Deary, I. J., Egan, V. (2006). Individual differences in response scale use: Mixed rasch modelling of responses to NEO-FFI items. Personality and Individual Differences, 40, 1235-1245. Google Scholar | Crossref | ISI | |
|
Baumgartner, H., Steenkamp, J.-B. E. M. (2001). Response styles in marketing research: A cross-national investigation. Journal of Marketing Research, 38, 143-156. Google Scholar | SAGE Journals | ISI | |
|
Bock, R. D. (1972). Estimating item parameters and latent ability when responses are scored in two or more nominal categories. Psychometrika, 37, 29-51. Google Scholar | Crossref | ISI | |
|
Böckenholt, U. (2012). Modeling multiple response processes in judgment and choice. Psychological Methods, 17, 665-678. Google Scholar | Crossref | Medline | ISI | |
|
Böckenholt, U. (2017). Measuring response styles in Likert items. Psychological Methods, 22, 69-83. Google Scholar | Crossref | Medline | |
|
Böckenholt, U., Meiser, T. (2017). Response style analysis with threshold and multi-process IRT models: A review and tutorial. British Journal of Mathematical and Statistical Psychology, 70, 159-181. Google Scholar | Crossref | Medline | |
|
Bolt, D. M., Newton, J. R. (2011). Multiscale measurement of extreme response style. Educational and Psychological Measurement, 71, 814-833. Google Scholar | SAGE Journals | ISI | |
|
Bolt, D. M., Johnson, T. R. (2009). Addressing score bias and differential item functioning due to individual differences in response style. Applied Psychological Measurement, 33, 335-352. Google Scholar | SAGE Journals | ISI | |
|
Breslow, N. E., Clayton, D. G. (1993). Approximate inference in generalized linear mixed model. Journal of the American Statistical Association, 88(421), 9-25. Google Scholar | ISI | |
|
Byrd, R. H., Lu, P., Nocedal, J., Zhu, C. (1995). A limited memory algorithm for bound constrained optimization. SIAM Journal on Scientific Computing, 16, 1190-1208. Google Scholar | Crossref | ISI | |
|
De Boeck, P., Partchev, I. (2012). Irtrees: Tree-based item response models of the glmm family. Journal of Statistical Software, 48, 1-28. Google Scholar | Crossref | ISI | |
|
Eddelbuettel, D. (2013). Seamless R and C++ integration with Rcpp. New York, NY: Springer-Verlag. Google Scholar | Crossref | |
|
Eid, M., Rauber, M. (2000). Detecting measurement invariance in organizational surveys. European Journal of Psychological Assessment, 16, 20-30. Google Scholar | Crossref | ISI | |
|
Fahrenberg, J. (2010). Freiburg Complaint Checklist [Freiburger Beschwerdenliste (FBL)]. Göttingen, Germany: Hogrefe. Google Scholar | |
|
Fahrmeir, L., Tutz, G. (1997). Multivariate statistical modelling based on generalized linear models. New York, NY: Springer-Verlag. Google Scholar | |
|
Falk, C. F., Cai, L. (2016). A flexible full-information approach to the modeling of response styles. Psychological Methods, 21, 328-347. Google Scholar | Crossref | Medline | ISI | |
|
Gollwitzer, M., Eid, M., Jürgensen, R. (2005). Response styles in the assessment of anger expression. Psychological Assessment, 17, 56-69. Google Scholar | Crossref | Medline | ISI | |
|
Hinde, J. (1982). Compound poisson regression models. In Gilchrist, R. (Ed.), International Conference on Generalized Linear Models (pp. 109-121). New York, NY: Springer-Verlag. Google Scholar | Crossref | |
|
Irtel, H. (1995). An extension of the concept of specific objectivity. Psychometrika, 60, 115-118. Google Scholar | Crossref | |
|
Jeon, M., De Boeck, P. (2016). A generalized item response tree model for psychological assessments. Behavior Research Methods, 48, 1070-1085. Google Scholar | Crossref | Medline | |
|
Jin, K.-Y., Wang, W.-C. (2014). Generalized IRT models for extreme response style. Educational and Psychological Measurement, 74, 116-138. Google Scholar | SAGE Journals | ISI | |
|
Johnson, T. R. (2003). On the use of heterogeneous thresholds ordinal regression models to account for individual differences in response style. Psychometrika, 68, 563-583. Google Scholar | Crossref | ISI | |
|
Johnson, T. R. (2014). A note on conditional and quasi-conditional maximum likelihood estimation for polytomous item response models: Robust inference in the presence of individual differences in response scale use. Applied Psychological Measurement, 38, 599-613. Google Scholar | SAGE Journals | ISI | |
|
Johnson, T. R., Bolt, D. M. (2010). On the use of factor-analytic multinomial logit item response models to account for individual differences in response style. Journal of Educational and Behavioral Statistics, 35, 92-114. Google Scholar | SAGE Journals | ISI | |
|
Kankaraš, M., Moors, G. (2009). Measurement equivalence in solidarity attitudes in Europe insights from a multiple-group latent-class factor approach. International Sociology, 24, 557-579. Google Scholar | SAGE Journals | ISI | |
|
Kelderman, H. (1996). Multidimensional rasch models for partial-credit scoring. Applied Psychological Measurement, 20, 155-168. Google Scholar | SAGE Journals | ISI | |
|
Khorramdel, L., von Davier, M. (2014). Measuring response styles across the big five: A multiscale extension of an approach using multinomial processing trees. Multivariate Behavioral Research, 49, 161-177. Google Scholar | Crossref | Medline | |
|
Maij-de Meij, A. M., Kelderman, H., van der Flier, H. (2008). Fitting a mixture item response theory model to personality questionnaire data: Characterizing latent classes and investigating possibilities for improving prediction. Applied Psychological Measurement, 32, 611-631. Google Scholar | SAGE Journals | ISI | |
|
Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149-174. Google Scholar | Crossref | ISI | |
|
Masters, G. N., Wright, B. (1984). The essential process in a family of measurement models. Psychometrika, 49, 529-544. Google Scholar | Crossref | ISI | |
|
McCulloch, C., Searle, S. (2001). Generalized, linear, and mixed models. New York, NY: John Wiley. Google Scholar | |
|
Messick, S. (1991). Psychology and methodology of response styles. In Snow, R. E., Wiley, D. E. (Eds.), Improving inquiry in social science: A volume in honor of Lee J. Cronbach (pp. 161-200). Hillsdale, NJ: Lawrence Erlbaum Google Scholar | |
|
Moors, G. (2004). Facts and artefacts in the comparison of attitudes among ethnic minorities. A multigroup latent class structure model with adjustment for response style behavior. European Sociological Review, 20, 303-320. Google Scholar | Crossref | ISI | |
|
Moors, G. (2010). Ranking the ratings: A latent-class regression model to control for overall agreement in opinion research. International Journal of Public Opinion Research, 22, 93-119. Google Scholar | Crossref | ISI | |
|
Naemi, B. D., Beal, D. J., Payne, S. C. (2009). Personality predictors of extreme response style. Journal of Personality, 77, 261-286. Google Scholar | Crossref | Medline | ISI | |
|
Plieninger, H. (2016). Mountain or molehill? A simulation study on the impact of response styles. Educational and Psychological Measurement, 77, 32-53. doi:10.1177/0013164416636655 Google Scholar | SAGE Journals | |
|
Plieninger, H., Meiser, T. (2014). Validity of multiprocess IRT models for separating content and response styles. Educational and Psychological Measurement, 74, 875-899. Google Scholar | SAGE Journals | ISI | |
|
Rasch, G. (1966). An item analysis which takes individual differences into account. British Journal of Mathematical and Statistical Psychology, 19, 49-57. Google Scholar | Crossref | Medline | ISI | |
|
Rasch, G. (1977). On specific objectivity. an attempt at formalizing the request for generality and validity of scientific statements in symposium on scientific objectivity. Danish Year-Book of Philosophy Kobenhavn, 14, 58-94. Google Scholar | |
|
R Core Team . (2016). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Google Scholar | |
|
Rost, J. (1991). A logistic mixture distribution model for polychotomous item responses. British Journal of Mathematical and Statistical Psychology, 44, 75-92. Google Scholar | Crossref | ISI | |
|
Samejima, F. (1997). Graded response model. In Van der Linden, W., Hambleton, R. (Eds.), Handbook of modern item response theory (pp. 85-100). New York, NY: Springer. Google Scholar | Crossref | |
|
Suh, Y., Bolt, D. M. (2010). Nested logit models for multiple-choice item response data. Psychometrika, 75, 454-473. Google Scholar | Crossref | ISI | |
|
Thissen-Roe, A., Thissen, D. (2013). A two-decision model for responses to likert-type items. Journal of Educational and Behavioral Statistics, 38, 522-547. Google Scholar | SAGE Journals | |
|
Tutz, G. (2012). Regression for categorical data. Cambridge, UK: Cambridge University Press. Google Scholar | |
|
Tutz, G., Berger, M. (2016). Response styles in rating scales: Simultaneous modeling of content-related effects and the tendency to middle or extreme categories. Journal of Educational and Behavioral Statistics, 41, 239-268. Google Scholar | SAGE Journals | |
|
Van Rosmalen, J., Van Herk, H., Groenen, P. (2010). Identifying response styles: A latentclass bilinear multinomial logit model. Journal of Marketing Research, 47, 157-172. Google Scholar | SAGE Journals | ISI | |
|
Van Vaerenbergh, Y., Thomas, T. D. (2013). Response styles in survey research: A literature review of antecedents, consequences, and remedies. International Journal of Public Opinion Research, 25, 195-217. Google Scholar | Crossref | ISI | |
|
von Davier, M., Rost, J. (1995). Polytomous mixed rasch models. In Fischer, G., Molenaar, I. (Eds.), Rasch models (pp. 371-379). New York, NY: Springer-Verlag. Google Scholar | Crossref | |
|
von Davier, M., Yamamoto, K. (2007). Mixture-distribution and hybrid rasch models. In von Davier, M., Carstensen, C. (Eds.), Multivariate and mixture distribution Rasch models (pp. 99-115). New York, NY: Springer-Verlag. Google Scholar | Crossref | |
|
Wang, W.-C, Wilson, M., Shih, C.-L. (2006). Modeling randomness in judging rating scales with a random-effects rating scale model. Journal of Educational Measurement, 43, 335-353. Google Scholar | Crossref | ISI | |
|
Wetzel, E., Carstensen, C. H. (2017). Multidimensional modeling of traits and response styles. European Journal of Psychological Assessment, 33, 352-364. doi:10.1027/1015-5759/a000291 Google Scholar | Crossref | |
|
Yee, T. W. (2014). VGAM: Vector generalized linear and additive models (R package version 0.9-4). Retrieved from https://www.stat.auckland.ac.nz/~yee/VGAM Google Scholar | |
|
ZPID . (2013). PsychData of the Leibniz Institute for Psychology Information ZPID. Trier, Germany: Center for Research Data in Psychology. Google Scholar |
