![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
In this study, the author examined potential mediators of the negative relationship between the absolute difference in items’ lengths and their inter-item correlation size. Fifty-two randomly ordered items from five personality scales were administered to 622 university students, and 46 respondents from a survey website rated the items’ readability, clarity, and generality. Based on prior research, the author hypothesized that the difference in mean ratings of item pairs’ generality, but not readability or clarity, would mediate the negative relationship between the difference in the item pairs’ lengths and their inter-item correlation size. In pairs of items, difference in item length was negatively correlated with inter-item correlation size. However, only difference in ratings of generality, not readability or clarity, was associated with correlation size, and as predicted, it mediated the relationship between item length and correlation size. Theoretical and practical implications are discussed.
References
Section:
|
Angleitner, A., John, O. P., Löhr, F. (1986). It’s what you ask and how you ask it: An itemmetric analysis of personality questionnaires. In Angleitner, A., Wiggins, J. S. (Eds.), Personality assessment via questionnaire: Current issues in theory and measurement (pp. 61-108). Berlin, Germany: Springer-Verlag. Google Scholar | |
|
Baron, R. M., Kenny, D. A. (1986). The moderator-mediator variable distinction in social psychological research: Conceptual, strategic and statistical considerations. Journal of Personality and Social Psychology, 51, 1173-1182. doi:10.1037//0022-3514.51.6.1173 Google Scholar | Medline | ISI | |
|
Churchill, G. A., Peter, J. P. (1984). Research design effects on the reliability of rating scales: A meta-analysis. Journal of Marketing Research, 21, 360-375. doi:10.2307/3151463 Google Scholar | Abstract | ISI | |
|
Clark, L. A., Watson, D. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7, 309-319. doi:10.1037//1040-3590.7.3.309 Google Scholar | ISI | |
|
DeYoung, C. G. (2006). Higher-order factors of the Big Five in a multi-informant sample. Journal of Personality and Social Psychology, 91, 1138-1151. doi:10.1037/0022-3514.91.6.1138 Google Scholar | Medline | ISI | |
|
Diab, D. L., Gillespie, M. A., Highhouse, S. (2008). Are maximizers really unhappy? The measurement of maximizing tendency. Judgment and Decision Making, 3, 364-370. Google Scholar | ISI | |
|
Falk, C. F., Savalei, V. (2011). The relationship between unstandardized and standardized alpha, true reliability, and the underlying measurement model. Journal of Personality Assessment, 93, 445-453. doi:10.1080/00223891.2011.594129 Google Scholar | Medline | ISI | |
|
Flesch, R. (1948). A new readability yardstick. Journal of Applied Psychology, 32, 221-233. doi:10.1037/h0057532 Google Scholar | Medline | ISI | |
|
Goldberg, L. R. (1999). A broad-bandwidth, public domain, personality inventory measuring the lower-level facets of several five-factor models. In Mervielde, I., Deary, I., De Fruyt, F., Ostendorf, F. (Eds.), Personality psychology in Europe (Vol. 7, pp. 7-28). Tilburg, The Netherlands: Tilburg University Press. Google Scholar | |
|
Goldberg, L. R., Kilkowski, J. M. (1985). The prediction of semantic consistency in self-descriptions: Characteristics of persons and of terms that affect the consistency of responses to synonym and antonym pairs. Journal of Personality and Social Psychology, 48, 82-98. doi:10.1037/0022-3514.48.1.82 Google Scholar | Medline | ISI | |
|
Gough, H. G. (1987). California Psychological Inventory administrator’s guide. Palo Alto, CA: Consulting Psychologists Press. Google Scholar | |
|
Hamby, T., Ickes, W. (2015). Do the readability and average item length of personality scales affect their reliability? Some meta-analytic answers. Journal of Individual Differences, 36, 54-63. doi:10.1027/1614-0001/a000154 Google Scholar | ISI | |
|
Hamby, T., Ickes, W., Babcock, M. (2016). Evidence for context switching in the effects of average item length and item-length variability on internal consistency. Journal of Personality Assessment, 98, 491-502. doi:10.1080/00223891.2016.1147044 Google Scholar | Medline | |
|
Hamby, T., Peterson, R. A. (2016). A meta-analytic investigation of the relationship between scale-item length, label format, and reliability. Methodology, 12, 89-96. doi:10.1027/1614-2241/a000112 Google Scholar | |
|
Hamby, T., Taylor, W. (2016). Survey satisficing inflates reliability and validity measures: An experimental comparison of college and Amazon Mechanical Turk samples. Educational and Psychological Measurement, 76, 912-932. doi:10.1177/0013164415627349 Google Scholar | SAGE Journals | ISI | |
|
Hayes, A. F. (2013). Introduction to mediation, moderation, and conditional process analysis: A regression-based approach. New York, NY: Guildford Press. Google Scholar | |
|
Holden, R. R., Fekken, G. C., Jackson, D. N. (1985). Structured personality test item characteristics and validity. Journal of Research in Personality, 19, 386-394. doi:10.1016/0092-6566(85)90007-8 Google Scholar | ISI | |
|
John, O. P., Donahue, E. M., Kentle, R. L. (1991). The Big Five Inventory—Versions 4a and 5a. Berkeley: Institute of Personality and Social Research, University of California at Berkeley. Google Scholar | |
|
John, O. P., Naumann, L. P., Soto, C. J. (2008). Paradigm shift to the integrative Big Five Trait taxonomy: History, measurement, and conceptual issues. In John, O. P., Robins, R. W., Pervin, L. A. (Eds.), Handbook of personality: Theory and research (3rd ed., pp. 114-158). New York, NY: Guilford Press. Google Scholar | |
|
Johnson, J. (2004). The impact of item characteristics on item and scale validity. Multivariate Behavior Research, 39, 273-302. doi:10.1207/s15327906mbr3902_6 Google Scholar | Medline | ISI | |
|
Kenny, D. A., Kashy, D. A., Bolger, N. (1998). Data analysis in social psychology. In Gilbert, D., Fiske, S., Lindzey, G. (Eds.), The handbook of social psychology (4th ed., Vol. 1, pp. 233-265). Boston, MA: McGraw-Hill. Google Scholar | |
|
Kincaid, J. P., Fishburne, R. P., Rogers, R. L., Chissom, B. S. (1975). Derivation of new readability formula for navy enlisted personnel. Millington, TN: Navy Research Branch. Google Scholar | |
|
Krakauer, S. Y., Archer, R. P., Gordon, R. A. (1993). The development of the Items-Easy (Ie) and Items-Difficult (Id) subscales for the MMPI-a. Journal of Personality Assessment, 60, 561-571. doi:10.1207/s15327752jpa6003_13 Google Scholar | Medline | |
|
Lubin, B., Collins, J. F., Seever, M., Whitlock, R. V., Dennis, A. J. (1990). Relationships among readability, reliability, and validity in a self-report adjective check list. Psychological Assessment, 2, 256-261. doi:10.1037/1040-3590.2.3.256 Google Scholar | |
|
McCrae, R. R., Costa, P. T., Martin, T. A. (2005). A more readable revised NEO Personality Inventory. Journal of Personality Assessment, 84, 261-270. doi:10.1207/s15327752jpa8403_05 Google Scholar | Medline | ISI | |
|
Misuraca, R., Faraci, P., Gangemi, A., Carmeci, F. A., Miceli, S. (2015). The Decision Making Tendency Inventory: A new measure to assess maximizing, satisficing, and minimizing. Personality and Individual Differences, 85, 111-116. doi:10.1016/j.paid.2015.04.043 Google Scholar | |
|
Morey, L. C. (2003). Measuring personality and psychopathology. In Weiner, I. B. (Series Ed.). Handbook of psychology: Research methods in psychology (Vol. 2, pp. 377-405). Hoboken, NJ: John Wiley. Google Scholar | |
|
Mõttus, R., Pullmann, H., Allik, J. (2006). Toward more readable Big Five personality inventories. European Journal of Psychological Assessment, 22, 149-157. doi:10.1027/1015-5759.22.3.149 Google Scholar | ISI | |
|
Oakland, T., Lane, H. B. (2004). Language, reading, and readability formulas: Implications for developing and adapting tests. International Journal of Testing, 4, 239-252. Google Scholar | |
|
Rim, H. B., Turner, B. M., Betz, N. E., Nygren, T. E. (2011). Studies of the dimensionality, correlates, and meaning of measures of the maximizing tendency. Judgment and Decision Making, 6, 565-575. Google Scholar | ISI | |
|
Schinka, J. A. (2012). Further issues in determining the readability of self-report items: Comment on McHugh and Behar (2009). Journal of Consulting and Clinical Psychology, 80, 952-955. doi:10.1037/a0029928 Google Scholar | Medline | |
|
Schinka, J. A., Borum, R. (1993). Readability of adult psychopathology inventories. Psychological Assessment, 5, 384-386. doi:10.1037/1040-3590.5.3.384 Google Scholar | |
|
Schwartz, B., Ward, A., Monterosso, J., Lyubomirsky, S., White, K., Lehman, D. R. (2002). Maximizing versus satisficing: happiness is a matter of choice. Journal of Personality and Social Psychology, 83, 1178-1197. doi:10.1037//0022-3514.83.5.1178 Google Scholar | Medline | ISI | |
|
Schwarz, N., Groves, R. M., Schuman, H. (1998). Survey methods. In Gilbert, D. T., Fiske, S. T., Lindzey, G. (Eds.), The handbook of social psychology (4th ed., Vol. 1, pp. 143-179). Boston, MA: McGraw-Hill. Google Scholar | |
|
Simpson, G. B. (1994). Context and the processing of ambiguous words. In Gernsbacher, M. A. (Ed.), Handbook of psycholinguistics (pp. 359-374). San Diego, CA: Academic Press. Google Scholar | |
|
Soto, C. J., John, O. P., Gosling, S. D., Potter, J. (2008). The developmental psychometrics of big five self-reports: Acquiescence, factor structure, coherence, and differentiation from ages 10 to 20. Journal of Personality and Social Psychology, 94, 718-737. doi:10.1037/0022-3514.94.4.718 Google Scholar | Medline | ISI | |
|
Strack, F., Schwarz, N., Wänke, M. (1991). Semantic and pragmatic aspects of context effects in social and psychological research. Social Cognition, 9, 111-125. doi:10.1521/soco.1991.9.1.111 Google Scholar | ISI | |
|
Swain, S. D., Weathers, D., Niedrich, R. W. (2008). Assessing three sources of misresponse to reversed Likert items. Journal of Marketing Research, 45, 116-131. doi:10.1509/jmkr.45.1.116 Google Scholar | SAGE Journals | ISI | |
|
Turner, B. M., Rim, H. B., Betz, N. E., Nygren, T. E. (2012). The maximization inventory. Judgment and Decision Making, 7, 48-60. Google Scholar | ISI | |
|
Weijters, B., Baumgartner, H. (2012). Misresponse to reversed and negated items in surveys: A review. Journal of Marketing Research, 49, 737-747. doi:10.1509/jmr.11.0368 Google Scholar | SAGE Journals | ISI | |
|
Weijters, B., Geuens, M., Schillewaert, N. (2009). The proximity effect: The role of inter-item distance on reverse-item bias. International Journal of Research in Marketing, 26, 2-12. doi:10.1016/j.ijresmar.2008.09.003 Google Scholar | ISI | |
|
Wiggins, J. S., Goldberg, L. R. (1965). Interrelationships among MMPI item characteristics. Educational and Psychological Measurement, 25, 381-397. doi:10.1177/001316446502500208 Google Scholar | SAGE Journals | ISI |
