Abstract
The purposes of this study were twofold: (a) based on the analysis of covariance structures, to test for the equivalence of a well-known measuring instrument across two culturally diverse groups and (b) provided with findings of nonequivalent items, to identify possible determinants of their noninvariance; post hoc investigations included tests for evidence of item bias using an ANOVA-based approach and examination of graphical displays of item response and distributional patterns. Example data comprised item responses to the four nonacademic subscales of the Self Description Questionnaire I (SDQ-I) for Australian (N = 497) and Nigerian (N = 439) adolescents. Despite similarly specified and well-fitting factor structures for both cultural groups, findings revealed evidence of both measurement and structural noninvariance. Results underscore previous caveats regarding interpretation of instrument equivalence; they add also to the growing body of skepticism that queries whether measuring instruments can ever be totally equivalent when used in cross-cultural comparisons.
|
Beck, A.T. , Ward, C.H. , Mendelson, M. , Mock, J. , & Erbaugh, J. (1961). An inventory for measuring depression. Archives of General Psychiatry, 4, 561-571. Google Scholar | Crossref | Medline | |
|
Bentler, P.M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238-246. Google Scholar | Crossref | Medline | ISI | |
|
Bentler, P.M. (2001). EQS: Structural equations program manual. Encino, CA: Multivariate Software Inc. Google Scholar | |
|
Bijnen, E.J. , & Poortinga, Y.H. (1988). The questionable value of cross-cultural comparisons with the Eysenck Personality Questionnaire. Journal of Cross-Cultural Psychology, 19, 193-202. Google Scholar | SAGE Journals | ISI | |
|
Browne, M.W. , & Cudeck, R. (1993). Alternative ways of assessing model fit. In K.A. Bollen & J.S. Long (Eds.), Testing structural equation models (pp. 136-162). Newbury Park, CA: Sage. Google Scholar | |
|
Byrne, B.M. (1994). Structural equation modeling with EQS and EQS/Windows: Basic concepts, applications, and programming. Thousand Oaks, CA: Sage. Google Scholar | |
|
Byrne, B.M. (1996). Measuring self-concept across the lifespan: Issues and instrumentation. Washington, DC: American Psychological Association. Google Scholar | Crossref | |
|
Byrne, B.M. (1998). Structural equation modeling with LISREL, PRELIS, and SIMPLIS: Basic concepts, applications, and programming. Mahwah, NJ: Lawrence Erlbaum. Google Scholar | |
|
Byrne, B.M. (2001). Structural equation modeling with AMOS: Basic concepts, applications, and programming. Mahwah, NJ: Lawrence Erlbaum. Google Scholar | |
|
Byrne, B.M. , & Campbell, T.L. (1999). Cross-cultural comparisons and the presumption of equivalent measurement and theoretical structure: A look beneath the surface. Journal of Cross-Cultural Psychology, 30, 555-574. Google Scholar | SAGE Journals | ISI | |
|
Byrne, B.M. & Shavelson, R.J. (1987). Adolescent self-concept: Testing the assumption of equivalent structure across gender. American Educational Research Journal, 24, 365-385. Google Scholar | SAGE Journals | ISI | |
|
Byrne, B.M. , Shavelson, R.J. , & Muthén, B. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105, 456-466. Google Scholar | Crossref | ISI | |
|
Cheung, G.W. , & Rensvold, R.B. (2000). Assessing extreme and acquiescence response sets in cross-cultural research using structural equation modeling. Journal of Cross-Cultural Research, 31, 187-212. Google Scholar | |
|
Hambleton, R.K. (in press). Issues, designs, and technical guidelines for adapting tests into multiple languages and cultures. In R.K. Hambleton , P. Merenda , & C. Spielberger (Eds.), Adapting educational and psychological tests for cross-cultural assessment. Mahwah, NJ: Lawrence Erlbaum. Google Scholar | |
|
Hui, C.H. , & Triandis, H.C. (1989). Effects of culture and response format on extreme response style. Journal of Cross-Cultural Psychology, 20, 296-309. Google Scholar | SAGE Journals | ISI | |
|
Little, R.J.A. , & Rubin, D.B. (1987). Statistical analysis with missing data. New York: John Wiley. Google Scholar | |
|
Little, R.J.A. , & Rubin, D.B. (1989). The analysis of social science data with missing values. Sociological Methods and Research, 18, 292-326. Google Scholar | SAGE Journals | ISI | |
|
Marín, G. , Gamba, R.J. , & Marín, B.V. (1992). Extreme response style and acquiescence among hispanics. Journal of Cross-Cultural Psychology, 23, 498-509. Google Scholar | SAGE Journals | ISI | |
|
Markus, H.R. , & Kitayama, S. (1991). Cultural variation in the self-concept. In J. Strauss & G.R. Goethals (Eds.), The self: Interdisciplinary approaches (pp. 18-48). New York: Springer-Verlag. Google Scholar | Crossref | |
|
Marsh, H.W. (1986). The negative item bias in rating scales for preadolescent children: A cognitive-developmental perspective. Developmental Psychology, 22, 37-49. Google Scholar | Crossref | ISI | |
|
Marsh, H.W. (1992). Self Description Questionnaire (SDQ) I: A theoretical and empirical basis for the measurement of multiple dimensions of preadolescent self-concept: A test manual and research monograph. Macarthur, New South Wales, Australia: University of Western Sydney, Faculty of Education. Google Scholar | |
|
Mellenbergh, G.J. (1982). Contingency table models for assessing item bias. Journal of Educational Statistics, 7, 105-118. Google Scholar | Crossref | |
|
Oyserman, D. , & Markus, H.R. (1993). The sociocultural self. In J. Suls (Ed.), Psychological perspectives on the self; The self in social perspective (pp. 187-220). Hillsdale NJ: Lawrence Erlbaum. Google Scholar | |
|
Paunonen, S.V. , & Ashton, M.C. (1998). The structured assessment of personality across cultures. Journal of Cross-Cultural Psychology, 29, 150-170. Google Scholar | SAGE Journals | ISI | |
|
Poortinga, Y.H. (1995). Use of tests across cultures. In T. Oakland & R.K. Hambleton (Eds.), International perspectives on academic assessment (pp. 187-206). Boston: Kluwer Academic. Google Scholar | Crossref | |
|
Satorra, A. , & Bentler, P.M. (1988). Scaling corrections for chi-square statistics in covariance structure analysis. American Statistical Association 1988 proceedings of the business and economics section (pp. 308-313). Alexandria, VA: American Statistical Association. Google Scholar | |
|
Tanzer, N.K. (1995). Cross-cultural bias in Likert-type inventories: Perfect matching pattern structures and still biased? European Journal of Psychological Assessment, 11, 194-201. Google Scholar | Crossref | ISI | |
|
Tanzer, N.K. , Sim, C.Q.E. , & Marsh, H.W. (1992). Using personality and attitude inventories over cultures: Theoretical considerations and empirical findings. Bulletin of the International Test Commission, 19, 151-171. Google Scholar | |
|
van de Vijver, F. , & Leung, K. (1997). Methods and data analysis for cross-cultural research. Thousand Oaks, CA: Sage. Google Scholar | |
|
van de Vijver, F. , & Tanzer, N.K. (1997). Bias and equivalence in cross-cultural assessment: An overview. European Review of Applied Psychology, 47, 263-279. Google Scholar | ISI | |
|
Watkins, D. , & Cheung, S. (1995). Culture, gender, and response bias: An analysis of responses to the Self Description Questionnaire. Journal of Cross-Cultural Psychology, 26, 490-504. Google Scholar | SAGE Journals | ISI |
