The Issue Of Measurement Invariance Revisited

First Published March 1, 2003 Research Article

Authors

University of Ottawa
by this author
,
University of Hong Kong
by this author
First Published Online: July 27, 2016

The purposes of this study were twofold: (a) based on the analysis of covariance structures, to test for the equivalence of a well-known measuring instrument across two culturally diverse groups and (b) provided with findings of nonequivalent items, to identify possible determinants of their noninvariance; post hoc investigations included tests for evidence of item bias using an ANOVA-based approach and examination of graphical displays of item response and distributional patterns. Example data comprised item responses to the four nonacademic subscales of the Self Description Questionnaire I (SDQ-I) for Australian (N = 497) and Nigerian (N = 439) adolescents. Despite similarly specified and well-fitting factor structures for both cultural groups, findings revealed evidence of both measurement and structural noninvariance. Results underscore previous caveats regarding interpretation of instrument equivalence; they add also to the growing body of skepticism that queries whether measuring instruments can ever be totally equivalent when used in cross-cultural comparisons.

Beck, A.T. , Ward, C.H. , Mendelson, M. , Mock, J. , & Erbaugh, J. (1961). An inventory for measuring depression. Archives of General Psychiatry, 4, 561-571.
Google Scholar | Crossref | Medline
Bentler, P.M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238-246.
Google Scholar | Crossref | Medline | ISI
Bentler, P.M. (2001). EQS: Structural equations program manual. Encino, CA: Multivariate Software Inc.
Google Scholar
Bijnen, E.J. , & Poortinga, Y.H. (1988). The questionable value of cross-cultural comparisons with the Eysenck Personality Questionnaire. Journal of Cross-Cultural Psychology, 19, 193-202.
Google Scholar | SAGE Journals | ISI
Browne, M.W. , & Cudeck, R. (1993). Alternative ways of assessing model fit. In K.A. Bollen & J.S. Long (Eds.), Testing structural equation models (pp. 136-162). Newbury Park, CA: Sage.
Google Scholar
Byrne, B.M. (1994). Structural equation modeling with EQS and EQS/Windows: Basic concepts, applications, and programming. Thousand Oaks, CA: Sage.
Google Scholar
Byrne, B.M. (1996). Measuring self-concept across the lifespan: Issues and instrumentation. Washington, DC: American Psychological Association.
Google Scholar | Crossref
Byrne, B.M. (1998). Structural equation modeling with LISREL, PRELIS, and SIMPLIS: Basic concepts, applications, and programming. Mahwah, NJ: Lawrence Erlbaum.
Google Scholar
Byrne, B.M. (2001). Structural equation modeling with AMOS: Basic concepts, applications, and programming. Mahwah, NJ: Lawrence Erlbaum.
Google Scholar
Byrne, B.M. , & Campbell, T.L. (1999). Cross-cultural comparisons and the presumption of equivalent measurement and theoretical structure: A look beneath the surface. Journal of Cross-Cultural Psychology, 30, 555-574.
Google Scholar | SAGE Journals | ISI
Byrne, B.M. & Shavelson, R.J. (1987). Adolescent self-concept: Testing the assumption of equivalent structure across gender. American Educational Research Journal, 24, 365-385.
Google Scholar | SAGE Journals | ISI
Byrne, B.M. , Shavelson, R.J. , & Muthén, B. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105, 456-466.
Google Scholar | Crossref | ISI
Cheung, G.W. , & Rensvold, R.B. (2000). Assessing extreme and acquiescence response sets in cross-cultural research using structural equation modeling. Journal of Cross-Cultural Research, 31, 187-212.
Google Scholar
Hambleton, R.K. (in press). Issues, designs, and technical guidelines for adapting tests into multiple languages and cultures. In R.K. Hambleton , P. Merenda , & C. Spielberger (Eds.), Adapting educational and psychological tests for cross-cultural assessment. Mahwah, NJ: Lawrence Erlbaum.
Google Scholar
Hui, C.H. , & Triandis, H.C. (1989). Effects of culture and response format on extreme response style. Journal of Cross-Cultural Psychology, 20, 296-309.
Google Scholar | SAGE Journals | ISI
Little, R.J.A. , & Rubin, D.B. (1987). Statistical analysis with missing data. New York: John Wiley.
Google Scholar
Little, R.J.A. , & Rubin, D.B. (1989). The analysis of social science data with missing values. Sociological Methods and Research, 18, 292-326.
Google Scholar | SAGE Journals | ISI
Marín, G. , Gamba, R.J. , & Marín, B.V. (1992). Extreme response style and acquiescence among hispanics. Journal of Cross-Cultural Psychology, 23, 498-509.
Google Scholar | SAGE Journals | ISI
Markus, H.R. , & Kitayama, S. (1991). Cultural variation in the self-concept. In J. Strauss & G.R. Goethals (Eds.), The self: Interdisciplinary approaches (pp. 18-48). New York: Springer-Verlag.
Google Scholar | Crossref
Marsh, H.W. (1986). The negative item bias in rating scales for preadolescent children: A cognitive-developmental perspective. Developmental Psychology, 22, 37-49.
Google Scholar | Crossref | ISI
Marsh, H.W. (1992). Self Description Questionnaire (SDQ) I: A theoretical and empirical basis for the measurement of multiple dimensions of preadolescent self-concept: A test manual and research monograph. Macarthur, New South Wales, Australia: University of Western Sydney, Faculty of Education.
Google Scholar
Mellenbergh, G.J. (1982). Contingency table models for assessing item bias. Journal of Educational Statistics, 7, 105-118.
Google Scholar | Crossref
Oyserman, D. , & Markus, H.R. (1993). The sociocultural self. In J. Suls (Ed.), Psychological perspectives on the self; The self in social perspective (pp. 187-220). Hillsdale NJ: Lawrence Erlbaum.
Google Scholar
Paunonen, S.V. , & Ashton, M.C. (1998). The structured assessment of personality across cultures. Journal of Cross-Cultural Psychology, 29, 150-170.
Google Scholar | SAGE Journals | ISI
Poortinga, Y.H. (1995). Use of tests across cultures. In T. Oakland & R.K. Hambleton (Eds.), International perspectives on academic assessment (pp. 187-206). Boston: Kluwer Academic.
Google Scholar | Crossref
Satorra, A. , & Bentler, P.M. (1988). Scaling corrections for chi-square statistics in covariance structure analysis. American Statistical Association 1988 proceedings of the business and economics section (pp. 308-313). Alexandria, VA: American Statistical Association.
Google Scholar
Tanzer, N.K. (1995). Cross-cultural bias in Likert-type inventories: Perfect matching pattern structures and still biased? European Journal of Psychological Assessment, 11, 194-201.
Google Scholar | Crossref | ISI
Tanzer, N.K. , Sim, C.Q.E. , & Marsh, H.W. (1992). Using personality and attitude inventories over cultures: Theoretical considerations and empirical findings. Bulletin of the International Test Commission, 19, 151-171.
Google Scholar
van de Vijver, F. , & Leung, K. (1997). Methods and data analysis for cross-cultural research. Thousand Oaks, CA: Sage.
Google Scholar
van de Vijver, F. , & Tanzer, N.K. (1997). Bias and equivalence in cross-cultural assessment: An overview. European Review of Applied Psychology, 47, 263-279.
Google Scholar | ISI
Watkins, D. , & Cheung, S. (1995). Culture, gender, and response bias: An analysis of responses to the Self Description Questionnaire. Journal of Cross-Cultural Psychology, 26, 490-504.
Google Scholar | SAGE Journals | ISI

Access content

To read the fulltext, please use one of the options below to sign in or purchase access.
  • Access Options

    My Account

    Welcome
    You do not have access to this content.

    Chinese Institutions / 中国用户

    Click the button below for the full-text content

    请点击以下获取该全文

    Institutional Access

    does not have access to this content.

    Purchase Content

    24 hours online access to download content

    Added to Cart

    Cart is full

    There is currently no price available for this item in your region.

    Research off-campus without worrying about access issues. Find out about Lean Library here


Purchase

JCC-article-ppv for GBP29.00
JCC-article-ppv for $37.50
Single Issue 24 hour E-access for GBP177.42
Single Issue 24 hour E-access for $227.46

Cookies Notification

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies. Find out more.
Top