Abstract
Structural equation modeling (SEM) serves as one of the most important advances in the social sciences in the past 40 years. Through a combination of factor analysis and path analysis, SEM allows organizational researchers to test causal models while accounting for random and nonrandom (bias) measurement error. SEM is now one of the most commonly used analytic techniques and its modern day ubiquity can be traced in large part to a series of intellectual contributions by Larry James. The current article focuses on the seminal work, James, Mulaik, and Brett (1982), and the unique contribution of the “conditions” required for appropriate confirmatory inference with the path and latent variable models. We discuss the importance of James et al.’s Condition 9 and 10 tests, systematically review 14 years of studies using SEM in leading management journals and reanalyze results based on new techniques that extend James et al. (1982), and conclude with suggestions for improved Condition 9 and 10 assessments.
References
|
Anderson, J. C., Gerbing, D. W. (1984). The effect of sampling error on convergence, improper solutions, and goodness-of-fit indices for maximum likelihood confirmatory factor analysis. Psychometrika, 49(2), 155–173. Google Scholar | Crossref | ISI | |
|
Anderson, J. C., Gerbing, D. W. (1988). Structural equation modeling in practice: A review and recommended two-step approach. Psychological Bulletin, 103(3), 411–423. Google Scholar | Crossref | ISI | |
|
Austin, P. C. (2002). Bayesian extensions of the Tobit model for analyzing measures of health status. Medical Decision Making, 22(2), 152–162. Google Scholar | SAGE Journals | ISI | |
|
Bagozzi, R. P. (1980). Causal models in marketing. New York, NY: John Wiley. Google Scholar | |
|
Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107(2), 238–246. Google Scholar | Crossref | Medline | ISI | |
|
Bentler, P. M. (1995). EQS structural equations program manual. Encino, CA: Multivariate Software. Google Scholar | |
|
Bentler, P. M., Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88(3), 588–606. Google Scholar | Crossref | ISI | |
|
Billings, R. S., Wroten, S. P. (1978). Use of path analysis in industrial/organizational psychology: Criticisms and suggestions. Journal of Applied Psychology, 63(6), 677–688. Google Scholar | Crossref | |
|
Bollen, K. A. (1990). Overall fit in covariance structure models: Two types of sample size effects. Psychological Bulletin, 107(2), 256–259. Google Scholar | Crossref | ISI | |
|
Brosseau-Liard, P. E., Savalei, V., Li, L. (2012). An investigation of the sample performance of two nonnormality corrections for RMSEA. Multivariate Behavioral Research, 47(6), 904–930. Google Scholar | Crossref | Medline | |
|
Chen, F., Curran, P. J., Bollen, K. A., Kirby, J., Paxton, P. (2008). An empirical evaluation of the use of fixed cutoff points in RMSEA test statistic in structural equation models. Sociological Methods & Research, 36(4), 462–494. Google Scholar | SAGE Journals | ISI | |
|
Cohen, J. (1968). Multiple regression as a general data-analytic system. Psychological Bulletin, 70(6), 426–443. Google Scholar | Crossref | ISI | |
|
Darlington, R. B. (1968). Multiple regression in psychological research and practice. Psychological Bulletin, 69(3), 161–182. Google Scholar | Crossref | Medline | |
|
Duncan, O. D. (1975). Introduction to structural equation models. New York, NY: Academic Press. Google Scholar | |
|
Edwards, J. R., Berry, J. W. (2010). The presence of something or the absence of nothing: Increasing theoretical precision in management research. Organizational Research Methods, 13(4), 668–689. Google Scholar | SAGE Journals | ISI | |
|
Feldman, J. (1975). Considerations in the use of causal-correlational technique in applied psychology. Journal of Applied Psychology, 60(6), 663–670. Google Scholar | Crossref | |
|
Harris, M. M., Schaubroeck, J. (1990). Confirmatory modeling in organizational behavior/human resource management: Issues and applications. Journal of Management, 16(2), 337–360. Google Scholar | SAGE Journals | ISI | |
|
Hu, L. T., Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3(4), 424–453. Google Scholar | Crossref | ISI | |
|
James, L. A., James, L. R. (1989). Integrating work environment perceptions: Explorations into the measurement of meaning. Journal of Applied Psychology, 74(5), 739–751. Google Scholar | Crossref | ISI | |
|
James, L. R., Mulaik, S. A., Brett, J. M. (1982). Causal analysis: Assumptions, models, and data (Vol. 1). Beverly Hills, CA: Sage. Google Scholar | |
|
Jöreskog, K. G., Sörbom, D. (1979). Advances in factor analysis and structural equation models. Cambridge, MA: Abt books. Google Scholar | |
|
Kenny, D. A. (1979). Correlation and causality. New York, NY: John Wiley. Google Scholar | |
|
Kenny, D. A., Kaniskan, B., McCoach, D. B. (2015). The performance of RMSEA in models with small degrees of freedom. Sociological Methods & Research, 44(3), 486–507. Google Scholar | SAGE Journals | ISI | |
|
Khattab, A., Hocevar, D. (1982, 3). Significance testing in confirmatory factor analytic models. Paper presented at the conference of the American Educational Research Association, New York, NY. Google Scholar | |
|
Kline, R. B. (2015). Principles and practice of structural equation modeling. New York, NY: Guilford. Google Scholar | |
|
Lai, K., Green, S. B. (2016). The problem with having two watches: Assessment of fit when RMSEA and CFI disagree. Multivariate Behavioral Research, 51, 220–239. Google Scholar | Crossref | Medline | |
|
Lance, C. E. (1986). Disturbance term regression test procedures for recursive and nonrecursive models: Solutions from intercorrelation matrices. Multivariate Behavioral Research, 21, 429–439. Google Scholar | Crossref | Medline | |
|
Lance, C. E., Beck, S. S., Fan, Y., Carter, N. T. (2016). A taxonomy of path-related goodness-of-fit indices and recommended criterion values. Psychological Methods, 21(3), 388–404. Google Scholar | Crossref | Medline | |
|
LeBreton, J., Wu, J., Bing, M. (2008). The truth(s) on testing for mediation in the social and organizational sciences. In Lance, C. E., Vandenberg, R. J. (Eds.), Statistical and methodological myths and urban legends: Doctrine, verity, and fable in organizational and social sciences (pp. 107–142). New York, NY: Routledge. Google Scholar | |
|
Li, L., Bentler, P. M. (2011). Quantified choice of root-mean-square errors of approximation for evaluation and power analysis of small differences between structural equation models. Psychological Methods, 16(2), 116–126. Google Scholar | Crossref | Medline | |
|
Marsh, H. W., Balla, J. R., McDonald, R. P. (1988). Goodness-of-fit indexes in confirmatory factor analysis: The effect of sample size. Psychological Bulletin, 103(3), 391–410. Google Scholar | Crossref | ISI | |
|
McDonald, R. P., Ho, M. H. R. (2002). Principles and practice in reporting structural equation analyses. Psychological Methods, 7(1), 64–82. Google Scholar | Crossref | Medline | ISI | |
|
Medsker, G. J., Williams, L. J., Holahan, P. J. (1994). A review of current practices for evaluating causal models in organizational behavior and human resources management research. Journal of Management, 20(2), 439–464. Google Scholar | SAGE Journals | ISI | |
|
Moshagen, M., Auerswald, M. (2017). On Congruence and Incongruence of Measures of Fit in Structural Equation Modeling. Psychological Methods. Advance online publication. http://dx.doi.org/10.1037/met0000122 Google Scholar | |
|
Mulaik, S. A. (2009). Linear causal modeling with structural equations. Boca Raton, FL: CRC Press. Google Scholar | Crossref | |
|
Mulaik, S. A., James, L. R., Van Alstine, J., Bennett, N., Lind, S., Stilwell, C. D. (1989). Evaluation of goodness-of-fit indices for structural equation models. Psychological Bulletin, 105(3), 430–445. Google Scholar | Crossref | ISI | |
|
O’Boyle, E. H., Williams, L. J. (2011). Decomposing model fit: Measurement versus theory in organizational research using latent variables. Journal of Applied Psychology, 96, 1–12. Google Scholar | Crossref | Medline | |
|
Pornprasertmanit, S., Lee, J., Preacher, K. J. (2014). Ignoring clustering in confirmatory factor analysis: Some consequences for model fit and standardized parameter estimates. Multivariate Behavioral Research, 49(6), 518–543. Google Scholar | Crossref | Medline | |
|
Ryu, E. (2014). Model fit evaluation in multilevel structural equation models. Frontiers in Psychology, 5, 81. Google Scholar | Crossref | Medline | |
|
Shook, C., Ketchen, D., Hult, T., Kacmar, M. (2004). Use of structural equation modeling in strategic management research. Strategic Management Journal, 25, 397–404. Google Scholar | Crossref | ISI | |
|
Sobel, M. E., Bohrnstedt, G. W. (1985). Use of null models in evaluating the fit of covariance structure models. Sociological Methodology, 1985, 152–178. Google Scholar | Crossref | |
|
Steiger, J. H., Lind, J. C. (1980, 5). Statistically-based tests for the number of common factors. Paper presented at the annual Spring Meeting of the Psychometric Society, Iowa City, IA. Google Scholar | |
|
Sterba, S. K., Pek, J. (2012). Individual influence on model selection. Psychological Methods, 17(4), 582–599. Google Scholar | Crossref | Medline | |
|
Tanaka, J. S., Huba, G. J. (1984). Confirmatory hierarchical factor analyses of psychological distress measures. Journal of Personality and Social Psychology, 46(3), 621–635. Google Scholar | Crossref | |
|
Tucker, L. R., Lewis, C. (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38(1), 1–10. Google Scholar | Crossref | ISI | |
|
Werts, C. E., Linn, R. L. (1970). Path analysis: Psychological examples. Psychological Bulletin, 74(3), 193–212. Google Scholar | Crossref | |
|
West, S. G., Taylor, A. B., Wu, W. (2012). Model fit and model selection in structural equation modeling. In Hoyle, R. H. (Ed.), Handbook of structural equation modeling (pp. 209–231). New York, NY: Guilford. Google Scholar | |
|
Williams, L. J., Gavin, M., Hartman, N. (2004). Structural equation modeling methods in strategy research: Applications and issues. In Ketchen, D., Bergh, D. (Eds.), Research methodology in strategy and management (pp. 303–346). San Diego, CA: Elsevier. Google Scholar | Crossref | |
|
Williams, L. J., Holahan, P. J. (1994). Parsimony-based fit indices for multiple-indicator models: Do they work? Structural Equation Modeling, 1(2), 161–189. Google Scholar | Crossref | |
|
Williams, L. J., O’Boyle, E. H. (2011). The myth of global fit indices and alternatives for assessing latent variable relations. Organizational Research Methods, 14, 350–369. Google Scholar | SAGE Journals | ISI | |
|
Williams, L. J., Williams, A. (2017, 8). In defense of the RMSEA-P: Reconsidering results of Lance et al. (2016). Paper presented at the meeting of the Academy of Management, Atlanta, GA. Google Scholar | |
|
Yuan, K. H., Hayashi, K. (2010). Fitting data to model: Structural equation modeling diagnosis using two scatter plots. Psychological Methods, 15(4), 335–351. Google Scholar | Crossref | Medline | |
|
Yuan, K. H., Zhong, X. (2013). Robustness of fit indices to outliers and leverage observations in structural equation modeling. Psychological Methods, 18(2), 121–136. Google Scholar | Crossref | Medline |
