A Monte Carlo Study Investigating the Impact of Item Parceling on Measures of Fit in Confirmatory Factor Analysis
Abstract
A simulation study was conducted to examine the effect of item parceling on goodness-of-fit indices at different levels of sample size, number of indicators per factor, factor structure/pattern coefficients, interfactor correlations, and item-level data distribution. Results revealed that the use of item parcels yielded more nonconverged solutions and Heywood cases than individual items. The likelihood of nonconverged solutions and Heywood cases increased as the number of indicators per factor (more items per parcel) decreased. Meanwhile, parcel solutions as compared with item solutions resulted in better fit as measured by the chi-square to degrees-of-freedom ratio, Goodness-of-Fit Index (GFI), Expected Cross-Validation Index (ECVI), and root mean square error of approximation (RMSEA), as well as two incremental fit indices, the Non-Normed Fit Index (NNFI) and Comparative Fit Index (CFI). The same pattern of results was found with data that varied in terms of skewness and kurtosis at the item level. However, the likelihood of nonconverged solutions and Heywood cases was more pronounced when data were extremely skewed/kurtotic at the item level.
Get full access to this article
View all access and purchase options for this article.
References
Anderson, J. C., & Gerbing, D. W. (1984). The effect of sampling error on convergence, improper solutions, and goodness-of-fit indices for maximum likelihood confirmatory factor analysis. Psychometrika, 49, 155-173.
Bandalos, D. (1999, April). The effects of item parceling in structural equation modeling: A Monte Carlo study. Paper presented at the annual meeting of the American Educational Research Association, Montreal, Canada.
Bandalos, D., & Finney, J. S. (2001). Item parceling issues in structural equation modeling. In A. G. Marcoulides & E. R. Schumacker (Eds.), New developments and techniques in structural equation modeling (pp. 269-295). Hillsdale, NJ: Lawrence Erlbaum.
Bentler, P. M. (1990). Comparative fit indices in structural models. Psychological Bulletin, 107, 238-246.
Bentler, P. M., & Bonnet, D. G. (1980). Significance tests and goodness-of-fit in the analysis of covariance structures. Psychological Bulletin, 88, 588-606
Bernstein, H., & Teng, G. (1989). Factoring items and factoring scales are different: Spurious evidence for multidimensionality due to item categorization. Psychological Bulletin, 105, 467-477.
Bollen, K. A. (1989). Structural equations with latent variables. New York: John Wiley.
Bollen, K. A. (1990). Overall fit in covariance structure models: Two types of sample size effects. Psychological Bulletin, 107, 256-259.
Boomsma, A. (1985). Nonconvergence, improper solutions, and starting values in LISREL maximum likelihood estimation. Psychometrika, 50, 229-242.
Browne, M. W., & Cudeck, R. (1989). Single sample cross-validation indices for covariance structures. Multivariate Behavioral Research, 24, 445-455.
Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural models (pp. 136-162). Newbury Park, CA: Sage.
Cattell, R. B., & Burdsal, C. A. (1975). The radial parcel double factoring design: A solution to item-vs.-parcel controversy. Multivariate Behavioral Research, 10, 165-179.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
Enders, K. C., & Bandalos, L. D. (1999). The effects of heterogeneous item distribution on reliability. Applied Measurement in Education, 12, 133-150.
Fan, X., Thompson, B., & Wang, L. (1999). The effects of sample size, estimation methods, and model specification on SEM fit indices. Structural Equation Modeling, 6, 56-83.
Fleishman, A. (1978). A method for simulation non-normal distributions. Psychometrika, 43, 521-532.
Gerbing, D. W., & Anderson, J. C. (1987). Improper solutions in analysis of covariance structures: Their interpretability, and a comparison of alternate respecifications. Psychometrika, 52, 99-111.
Gribbons, B. C., & Hocevar, D. (1998). Levels of aggregation in higher level confirmatory factor analysis: Application for academic self-concept. Structural Equation Modeling, 5, 377-390.
Hall, R. J., Snell, A. F., & Foust, M. S. (1999). Item parceling strategies in SEM: Investigating the subtle effects of unmodeled secondary constructs. Organizational Research Methods, 2, 233-256.
Hattie, A. J. (1986). Methodology review: Assessing unidimensionality of tests and items. Applied Psychological Measurement, 9, 139-164.
Hayduk, L. (1996). LISREL issues, debates, and strategies. Baltimore, MD: Johns Hopkins University Press.
Hoyle, R. H., & Panter, A. T. (1995). Writing about structural equation models. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 158-176). Thousand Oaks, CA: Sage.
Hu, L., & Bentler, P. M. (1995). Evaluation of model fit. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 76-99). Thousand Oaks, CA: Sage.
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indices in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-31.
Joormann, J., & Stöber, J. (1997). Measuring facets of worry: A LISREL analysis of the Worry Domains questionnaire. Personality and Individual Differences, 23, 827-837.
Jöreskog, K. G., & Sörbom, D. (1988). LISREL 7—A guide to the program and applications (2nd ed.). Chicago: SPSS.
Kaiser, H. F., & Dickman, K. (1962). Sample and population score matrices and sample correlation matrices from arbitrary population correlation matrix. Psychometrika, 27, 179-182.
Kishton, J. M., & Widaman, K. F. (1994). Unidimensional versus domain representative parceling of questionnaire items: An empirical example. Educational and Psychological Measurement, 54, 757-765.
Marsh, H. (1998, October 13). The myth of unidimensionality, parcel police & more indicators. Archives of Structural Equation Modeling Discussion Group. Retrieved from http://bama.ua.edu/cgi-bin/wa?A2=ind9810&L=semnet&P=R8335&m=9492
Marsh, H. W., & Hau, K.-T. (1996). Assessing goodness of fit: Is parsimony always desirable? Journal of Experimental Education, 64, 364-390.
Marsh, H. W., Hau, K.-T., Balla, J. R., & Grayson, D. (1998). Is more ever too much? The number of indicators per factor in confirmatory factor analysis. Multivariate Behavioral Research, 33, 181-220.
Nasser, F., Takahashi, T., & Benson, J. (1997). The structure of test anxiety in Israeli-Arab high school students: An application of confirmatory factor analysis with miniscales. Anxiety, Stress, and Coping, 10, 129-151.
Prats, D. C. (1990, April). The effects of forming miniscales on the construct validity of the test anxiety inventory. Paper presented at the annual meeting of the National Council of Measurement of Education, Boston.
Tanaka, S. J. (1993). Multifaceted conceptions of fit in structural equation models. In K. A. Bollen & S. J. Long (Eds.), Testing structural equation models (pp. 10-39). Newbury Park, CA: Sage.
Thompson, B. (2000). Ten commandments of structural equation modeling. In L. Grimm & P. Yarnold (Eds.), Reading and understanding multivariate statistics (pp. 261-284). Washington, DC: American Psychological Association.
Thompson, B., & Melancon, J. (1996, November). Using item “testlets/parcels” in confirmatory factor analysis: An example using the PPDP-78. Paper presented at the annual meeting of the Mid-South Educational Research Association, Tuscaloosa, AL. (ERIC Document Reproduction Service No. ED 404 349)
Velicer, W. F., & Fava, L. L. (1987). An evaluation of the effects of variable sampling on component, image, and factor analysis. Multivariate Behavioral Research, 22, 193-209.
Velicer, W. F., & Jackson, D. N. (1990). Component analysis versus common factor analysis: Some issues in selecting an appropriate procedure. Multivariate Behavioral Research, 25, 1-25.
Wainer, H., & Kiely, G. L. (1987). Item clusters and computerized adaptive testing: A case for testlets. Journal of Educational Measurement, 24, 185-201.
West, S. G., Finch, J. E., & Curran, P. J. (1995). Structural equation models with nonnormal variables: Problems, and remedies. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues and applications (pp. 56-75). Thousand Oaks, CA: Sage.
Yuan, K.-H., Bentler, P. M., & Kano, Y. (1997). On averaging variables in a CFA model. Behaviormetrika, 24, 71-83.
Cite article
Cite article
Cite article
OR
Download to reference manager
If you have citation software installed, you can download article citation data to the citation manager of your choice
Information, rights and permissions
Information
Published In
Article first published: October 2003
Issue published: October 2003
Keywords
Authors
Metrics and citations
Metrics
Journals metrics
This article was published in Educational and Psychological Measurement.
VIEW ALL JOURNAL METRICSArticle usage*
Total views and downloads: 494
*Article usage tracking started in December 2016
Altmetric
See the impact this article is making through the number of times it’s been read, and the Altmetric Score.
Learn more about the Altmetric Scores
Articles citing this one
Receive email alerts when this article is cited
Web of Science: 185 view articles Opens in new tab
Crossref: 185
- Conflict-solving as a mediator between customer incivility and service...
- The trickle-down effect of leader psychological capital on follower cr...
- Workplace status differences and proactive behaviours: The role of per...
- How Does Ethical Leadership Relate to Team Creativity? The Role of Col...
- Building organisational resilience capability in small and medium‐size...
- Being open, feeling safe and getting creative: The role of team mean o...
- A dual-path model: Bridge between heterogeneous environmental regulati...
- Factors Affecting Innovation Resistance of Smartphone AI Voice Assista...
- Exploring the Relationship between Mindfulness and Life Satisfaction i...
- Effects of sexual harassment on work–family enrichment: the roles of o...
- Development and construct validation of a short form of the interperso...
- Professional commitment matters! linking employee strengths use to org...
- Does an Employee-Experienced Crisis Help or Hinder Creativity? An Inte...
- Perceived overqualification and proactive behavior: The role of anger ...
- Ideological beliefs and gender essentialism: relations to individual a...
- How teacher and classmate support relate to students’ stress and acade...
- Brief Report: The Broad Autism Phenotype in Swedish Parents of Childre...
- Paradoxical Leadership and Innovation in Work Teams: The Multilevel Me...
- Parceling in Structural Equation Modeling
- Perception of organizational politics and innovative behavior in the w...
- Impact of Self-Perceived Employability on Sustainable Career Developme...
- Rumination and Internet Addiction Among Adolescents: The Mediating Rol...
- Sexual growth mindsets and rejection sensitivity in sexual satisfactio...
- Understanding additive composition is important for symbolic numerical...
- Knowledge Hiding and Hider's Innovative Behavior in Chinese Organizati...
- Mixed Effects of Item Parceling on Performance of Factor Mixture Model...
- The double‐edged sword: A work regulatory focus perspective on the rel...
- Perceived Overqualification and Intensive Smartphone Use: A Moderated ...
- Moral decline in the workplace: unethical pro-organizational behavior,...
- Bullying bystanders and emotional school engagement: The roles of rumi...
- The effects of a psychological contract breach on customer-directed de...
- The Impact of Item Parceling on Structural Parameter Invariance in Mul...
- Structural relationship among mindfulness, reappraisal and life satisf...
- Necessity of making water smart for proactive informed decisive action...
- The relationship between social support and suicidal ideation among ne...
- Patterns of love and sexting in teen dating relationships: The moderat...
- The voicer's reactions to voice: an examination of employee voice on p...
- Deciding Fast: Examining the Relationship between Strategic Decision S...
- The effects of mentor alcohol use norms on mentorship quality: The mod...
- Development and initial validation of the Spanish form of the adjustme...
- School‐related pressure and parental support as predictors of change i...
- Social Anxiety and Peer Communication Quality During Adolescence: The ...
- The Social Mentalities Scale: A new measure for assessing the interper...
- Graduate employability, skills development and the UK’s Universities B...
- Neuroticism, Trait Fear of Missing Out, and Phubbing: The Mediating Ro...
- Is the project ‘mine’ or ‘ours’? A multilevel investigation of the eff...
- The relationship of school self-concept, goal orientations and achieve...
- Assessing Fit in Ordinal Factor Analysis Models: SRMR vs. RMSEA
- Enjoyment benefits adolescents’ self-determined motivation in student-...
- How to fuel employees’ prosocial behavior in the hotel service encount...
- A comparison of Russian and Philippine secondary school students on th...
- Work–family conflict, negative affect and psychosomatic health complai...
- Subjective well-being key elements of Successful Aging: A study with L...
- References
- Parental Acceptance–Rejection and Adult Separation Anxiety: The Mediat...
- Internalized stigma and its impact on schizophrenia quality of life
- Customer service at altitude: effects of empowering leadership
- Access to Decent and Meaningful Work in a Sexual Minority Population
- Loneliness and social support: Differential predictive power on depres...
- ICT and Corporate Image
- Mothers and Fathers—Who Matters for STEM Performance? Gender-Specific ...
- Problems with Rationales for Parceling that Fail to Consider Parcel-Al...
- Where Have the Persons Gone? – An Illustration of Individual Score Met...
- Bad Feminists? Perceived Self-Discrepancy Predicts Differences in Gend...
- Character Strengths in Counselors: Relations With Meaningful Work and ...
- Delighting the Customer: Creativity-Oriented High-Performance Work Sys...
- Discrimination, Subjective Wellbeing, and the Role of Gender: A Mediat...
- Construction and Validation of the Touch Experiences and Attitudes Que...
- Flexible cutoff values for fit indices in the evaluation of structural...
- A motivational–cognitive model of creativity and the role of autonomy
- A basic model of integration of ICT by teachers: competence and use
- The essential role of the teacher-student relationship in students' ne...
- Assessing Fit in Structural Equation Models: A Monte-Carlo Evaluation ...
- The Interplay of Emotional Instability and Socio-Environmental Aspects...
- Detecting Curvilinear Relationships: A Comparison of Scoring Approache...
- Multivariate normal maximum likelihood with both ordinal and continuou...
- Does perceived stress moderate the association between depressive symp...
- How Does a Reward for Creativity Program Benefit or Frustrate Employee...
- A confirmatory factor analysis of the Mandarin-Chinese version of the ...
- Testing mediation effects of homosexual and bisexual's interpersonal f...
- Many-Level Multilevel Structural Equation Modeling: An Efficient Evalu...
- Determinants of Southern Italian households’ intention to adopt energy...
- The Empirical Study of Various Item Parceling Methods on Multidimensio...
- How hotel owner-operator goal congruence and GM autonomy influence hot...
- The Effect of Online Service Retailers' Quality Gaps on Customer Satis...
- When Do Employees Cyberloaf? An Interactionist Perspective Examining P...
- Pharmacist work stress and learning from quality related events
- The Relationships between Leader-Member Exchange Quality, Empowerment,...
- The Influence of Social Relationships on Conduct Problems in School Co...
- The Success Factors of Food Events: The Case Study of Umbrian Extra Vi...
- Above-Level Test Item Functioning Across Examinee Age Groups
- The influence of corporate social responsibility on consumers' attitud...
- Examining the Links Between Social Goals and Learning Strategies
- Using the H ealth B ...
- Socio-motivational moderators—two sides of the same coin? Testing the ...
- Trinidad and Tobago National Standardization of the Adjustment Scales ...
- The relationship between leadership support, workplace health promotio...
- Benevolent leadership in not-for-profit organizations
- Assessing Approaches to Learning in School Readiness...
- Structure and correlates of self-reported empathy in schizophrenia
- Predicting water quality associated with land cover change in the Groo...
- Trust and knowledge acquisition by small and medium-sized firms in wea...
- Brand anthropomorphism: Conceptualization, measurement, and impact on ...
- Application of Structural Equation Modeling to the Social Sciences: A ...
- An Exploratory Study of the Determinants of the Quality of Strategic D...
- How interpersonal leadership relates to employee engagement
- Quantifying and Predicting the Water Quality Associated with Land Cove...
- The effects of nonfinancial and financial measures on employee motivat...
- Assessing rumination in response to illness: the development and valid...
- Psychometric Properties of Adult Inventory of Procrastination in a Tur...
- Importance models of the physical self: Improved methodology supports ...
- Openness to Experience: Its Lower Level Structure, Measurement, and Cr...
- Information Security in Higher Education: A Neo-Institutional Perspect...
- Confirmatory factor analytic structure and measurement invariance of q...
- Contingency-Based Approach to Firm Performance in Construction: Critic...
- A Longitudinal Investigation of Perceived Friend Influence on Adolesce...
- Heritability of Acquiescence Bias and Item Keying Response Style Assoc...
- Assessing changes in socioemotional adjustment across early school tra...
- A Study on Management Strategies and Structural Relationships in the R...
- References
- Psychometric Properties of Frustration Discomfort Scale in a Turkish S...
- History and Development of Above-Level Testing of the Gifted
- Selection of representative calibration sample sets for near-infrared ...
- Validation of Proposed DSM-5 Criteria for Autism Spectrum Disorder
- The Healthcare Reform as a Critical Life Event: Investigating Medical ...
- Psychometric Evaluation of a Receptive Vocabulary Test for Greek Eleme...
- Implications of Parcel-Allocation Variability for Comparing Fit of Ite...
- A multi‐dimensional measure of vocational identity status
- How Does Bureaucracy Impact Individual Creativity? A Cross-Level Inves...
- Individual performance appraisal and appraisee reactions to workgroups
- Investigating Software Piracy in Jordan: An Extension of the Theory of...
- The QCAE: A Questionnaire of Cognitive and Affective Empathy
- A Characterization of Power Method Transformations through ...
- Adverse Life Events and Depressive Symptoms in African American Youth:...
- The Role of User Resistance in the Adoption of a Mobile Data Service
- Autism Spectrum Disorders as a Qualitatively Distinct Category From Ty...
- Body Dissatisfaction and Eating Disturbances in Early Adolescence: A S...
- Psychological Antecedents of Heterosexuals' Pro-gay Activism Behavior
- Testing for Factorial Invariance in the Context of Construct Validatio...
- The contribution of deficits in emotional clarity to stress responses ...
- Employees' Intentions to Remain Employed in Child Welfare: Testing a C...
- Development and Validation of Ambivalent Attitudes Toward Seeking Coun...
- Variability in Parameter Estimates and Model Fit Across Repeated Alloc...
- Three Approaches to Using Lengthy Ordinal Scales in Structural Equatio...
- The Observer Alexithymia Scale: A Reliable and Valid Alternative for A...
- Is the Structure of Affect Similar for Younger and Older Children? Cro...
- An empirical comparison of the efficacy of covariance-based and varian...
- Early Adolescents’ Perceptions of Their Mother’s Anxious Parenting as ...
- Religious beliefs, social support, self‐efficacy and adjustment to can...
- Decision‐making style among adolescents: Relationship with sensation s...
- Five-factor inventories have a major general factor related to social ...
- Perceptions of Racism and Depressive Symptoms in African American Adol...
- Reliability, validity and normative data for the Danish Beck Youth Inv...
- Peering into the “Magnum Mysterium” of Culture...
- An Empirical Comparison of the Efficacy of Covariance-Based and Varian...
- Item Parceling in Structural Equation Modeling: A Primer
- Measurement models for linking latent variables and indicators: A revi...
- The Computer Aversion, Attitudes, and Familiarity Index (CAAFI): A val...
- The Role of Relationship Attributions in Relationship Satisfaction Amo...
- Voluntary Retirement and Organizational Turnover Intentions: The Diffe...
- An Empirical Evaluation of the Use of Fixed Cutoff Points in RMSEA Tes...
- Distinguishing automatic and controlled components of attitudes from d...
- Cross-National Adolescent Multidimensional Life Satisfaction Reports: ...
- Regulatory Focus Strategies Scale: A measure of individual differences...
- Hierarchical Confirmatory Factor Analysis of the Bem Sex Role Inventor...
- The structure of the Levenson locus of control scale in young adults: ...
- 구조방정식 모텔에서 항목묶음이 인과 모수의 검정과 적합도 평가에 미치는 영향
- Examination of the content of individualism/collectivism scales in cul...
- Cultural differences related to positive and negative valence
- Academic Pathways between Attention Problems and Depressive Symptoms A...
- Validation of the Teacher’s Report Form for Teachers of Unaccompanied ...
- Measuring nurses' practice environments with the revised nursing work ...
- Factor Analysis of the KeyMath—Revised Normative Update Form A
- Cognitive tendencies of focusing on positive and negative information
- Validation of the child behavior checklist for guardians of unaccompan...
- Problems With Item Parceling for Confirmatory Factor Analytic Tests of...
- A Monte Carlo Study Investigating the Impact of Item Parceling Strateg...
- The Computer Aversion, Attitudes, and Familiarity Index (CAAFI): A Mea...
- The team‐level model of climate for innovation: A two‐level confirmato...
- The reliability and construct validity of ratings for the autism behav...
- Gender differences in the prediction of condom use among incarcerated ...
- Development and psychometric evaluation of the Male Body Attitudes Sca...
- A Multitrait?Multisource Confirmatory Factor Analytic Approach to the ...
- A Beginner's Guide to Partial Least Squares Analysis
- Wie generell ist das Modell?
Figures and tables
Figures & Media
Tables
View Options
Get access
Access options
If you have access to journal content via a personal subscription, university, library, employer or society, select from the options below:
loading institutional access options
Alternatively, view purchase options below:
Purchase 24 hour online access to view and download content.
Access journal content via a DeepDyve subscription or find out more about this option.
