![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
The present study examined the structure of the Comprehensive Test of Nonverbal Intelligence–Second Edition (CTONI-2) normative sample using exploratory factor analysis, multiple factor extraction criteria, and higher-order exploratory factor analytic techniques that were not reported in the in the CTONI-2 Examiner’s Manual. Results indicated that retention of the hypothesized CTONI-2 measurement model resulted in several theoretically inconsistent factor loadings, low factor loadings, and the retention of impermissible factors (e.g., factors with no salient loadings). Hierarchical exploratory analyses with the Schmid and Leiman procedure found that the second-order g factor accounted for large portions of total and common variance, in contrast to the two first-order factors that accounted for small portions of dimensional variance. Results suggest that the CTONI-2 provides a strong measure of general intelligence and clinical interpretation should be limited to that level of the measurement instrument.
References
Section:
|
American Educational Research Association, American Psychological Association, & National Council on Measurement on Education . (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association. Google Scholar | |
|
Beaujean, A. A., Firmin, M. W., Attai, S., Johnson, C. B., Firmin, R. L., Mena, K. E. (2011). Using personality and cognitive ability to predict academic achievement in a young adult sample. Personality and Individual Differences, 51, 709-714. doi:10.1016/j.paid.2011.06.023 Google Scholar | Crossref | ISI | |
|
Bentler, P. M., Kano, Y. (1990). On the equivalence of factors and components. Multivariate Behavioral Research, 25, 67-74. doi:10.1207/s15327906mbr2501_8 Google Scholar | Crossref | Medline | ISI | |
|
Canivez, G. L. (2011). Hierarchical factor structure of the cognitive assessment system: Variance partitions from the Schmid-Leiman (1957) procedure. School Psychology Quarterly, 26, 305-317. doi:10.1037/a0025973 Google Scholar | Crossref | ISI | |
|
Canivez, G. L. (2013). Psychometric versus actuarial interpretation of intelligence and related aptitude batteries. In Saklofske, D. H., Reynolds, C. R., Schwean, V. L. (Eds.), The oxford handbook of child psychological assessment (pp. 84-112). New York, NY: Oxford University Press. Google Scholar | |
|
Carroll, J. B. (1993). Human cognitive abilities: A survey of factor-analytic studies. New York, NY: Cambridge University Press. Google Scholar | Crossref | |
|
Carroll, J. B. (1995). On methodology in the study of cognitive abilities. Multivariate Behavioral Research, 30, 429-452. doi:10.1207/s15327906mbr3003_6 Google Scholar | Crossref | Medline | ISI | |
|
Cattell, R. B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1, 245-276. doi:10.1207/s15327906mbr0102_10 Google Scholar | Crossref | Medline | ISI | |
|
Chen, F. F., Hayes, A., Carver, C. S., Laurenceau, J.-P., Zhang, Z. (2012). Modeling general and specific variance in multifaceted constructs: A comparison of the bifactor model to other approaches. Journal of Personality, 80, 219-251. doi:10.1111/j.1467–6494.2011.00739.x Google Scholar | Crossref | Medline | ISI | |
|
Clark, L. A., Watson, D. (1995). Constructing validity: Basic issues in Objective Scale Development. Psychological Assessment, 7, 309-319. doi:10.1037/1040-3590.7.3.309 Google Scholar | Crossref | ISI | |
|
Costello, A. B., Osborne, J. W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation, 10, 1-9. Retrieved from http://pareonline.net/pdf/v10n7.pdf Google Scholar | |
|
Cronbach, L. J., Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281-302. doi:10.1037/h0040957 Google Scholar | Crossref | Medline | ISI | |
|
Delan, E., Kaya, F., Ritter, N. L. (2012). Test review: Comprehensive Test of Nonverbal Intelligence-Second Edition (CTONI-2). Journal of Psychoeducational Assessment, 30, 209-213. doi:10.1177/0734282911415614 Google Scholar | Crossref | ISI | |
|
DeThorne, L. S., Schaefer, B. A. (2004). A guide to child nonverbal IQ measures. American Journal of Speech-Language Pathology, 13, 275-290. doi:10.1044/1058-0360(2004/029) Google Scholar | Crossref | Medline | ISI | |
|
Dombrowski, S. C., Watkins, M. W., Brogan, M. J. (2009). An exploratory investigation of the factor structure of the Reynolds Intellectual Assessment Scales (RIAS). Journal of Psychoeducational Assessment, 27, 497-507. doi:10.1177/0734282909333179 Google Scholar | SAGE Journals | ISI | |
|
Fabrigar, L. R., Wegener, D. T. (2012). Exploratory factor analysis. New York, NY: Oxford University Press. Google Scholar | |
|
Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4, 272-299. doi:10.1037/1082-989X.4.3.272 Google Scholar | Crossref | ISI | |
|
Frazier, T. W., Youngstrom, E. A. (2007). Historical increase in the number of factors measured by commercial tests of cognitive ability: Are we overfactoring? Intelligence, 35, 169-182. doi:10.1016/j.intell.2006.07.002 Google Scholar | Crossref | ISI | |
|
Glutting, J. J., Watkins, M. W., Konold, T. R., McDermott, P. A. (2006). Distinctions without a difference: The utility of observed versus latent factors from the WISC-IV in estimating reading and math achievement on the WIAT-II. Journal of Special Education, 40, 103-114. doi:10.1177/00224669060400020101 Google Scholar | SAGE Journals | ISI | |
|
Golay, P., Reverte, I., Rossier, J., Favez, N., Lecerf, T. (2013). Further insights on the French WISC-IV factor structure through Bayesian structural equation modeling. Psychological Assessment, 25, 496-508. doi:10.1037/a0030676 Google Scholar | Crossref | Medline | ISI | |
|
Gorsuch, R. L. (1983). Factor analysis (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum. Google Scholar | |
|
Gorsuch, R. L. (1997). Exploratory factor analysis: Its role in item analysis. Journal of Personality Assessment, 68, 532-560. doi:10.1207/s15327752jpa6803_5 Google Scholar | Crossref | Medline | ISI | |
|
Gorsuch, R. L. (2003). Factor analysis. In Schinka, J. A., Velicer, F. F. (Eds.), Handbook of psychology: Vol. 2. Research methods in psychology (pp. 143-164). Hoboken, NJ: John Wiley. Google Scholar | Crossref | |
|
Guttman, L. (1954). Some necessary and sufficient conditions for common factor analysis. Psychometrika, 19, 149-161. doi:10.1007/BF02289162 Google Scholar | Crossref | |
|
Hammill, D. D., Pearson, N. A. (2009). Comprehensive Test of Nonverbal Intelligence-Second Edition. In Naglieri, J. A., Goldstein, S. (Eds.), Practitioner’s guide to assessing intelligence and achievement (pp. 233-264). Hoboken, NJ: John Wiley. Google Scholar | |
|
Hammill, D. D., Pearson, N. A., Wiederholt, J. L. (1997). Comprehensive Test of Nonverbal Intelligence. Austin, TX: Pro-Ed. Google Scholar | |
|
Hammill, D. D., Pearson, N. A., Wiederholt, J. L. (2009a). Comprehensive Test of Nonverbal Intelligence (2nd ed.). Austin, TX: Pro-Ed. Google Scholar | |
|
Hammill, D. D., Pearson, N. A., Wiederholt, J. L. (2009b). Comprehensive Test of Nonverbal Intelligence examiner’s manual (2nd ed.). Austin, TX: Pro-Ed. Google Scholar | |
|
Ho, R. (2014). Handbook of univariate and multivariate data analysis with IBM SPSS (2nd ed.). Boca Raton, FL: CRC Press. Google Scholar | |
|
Horn, J. L. (1965). A rationale and test for the number of factors in factor analysis. Psychomerika, 30, 179-185. doi:10.1007/BF02289447 Google Scholar | Crossref | Medline | ISI | |
|
Jensen, A. R. (1980). Bias in mental testing. New York, NY: Free Press. Google Scholar | |
|
Jensen, A. R. (1998). The g factor: The science of mental ability. Westport, CT: Praeger. Google Scholar | |
|
Kellow, J. T. (2005). Exploratory factor analysis in two prominent measurement journals: Hegemony by default. Journal of Modern Applied Statistical Methods, 4, 283-287. Retrieved from http://digitalcommons.wayne.edu/cgi/viewcontent.cgi?article=1178&;context=jmasm Google Scholar | |
|
Lakin, J. M. (2012). Multidimensional ability tests and culturally and linguistically diverse students: Evidence of measurement invariance. Learning and Individual Differences, 22, 397-403. doi:10.1016/j.lindif.2011.12.003 Google Scholar | Crossref | ISI | |
|
Lakin, J. M., Gambrell, J. L. (2012). Distinguishing verbal, quantitative, and figural facets of fluid intelligence n young students. Intelligence, 40, 560-570. doi:10.1016/j.intell.2012.07.005 Google Scholar | Crossref | ISI | |
|
Lassiter, K. S., Harrison, T. K., Matthews, T. D., Bell, N. L. (2001). The validity of the Comprehensive Test of Nonverbal Intelligence as a measure of fluid intelligence. Assessment, 8, 95-103. doi:10.1177/107319110100800109 Google Scholar | SAGE Journals | ISI | |
|
Lassiter, K. S., Matthews, T. D., Feeback, G. (2007). An examination of the CTONI utilizing Gc-Gf theory: A comparison of the CTONI and WJ-III. Psychology in the Schools, 44, 567-577. doi:10.1002/pits.20248 Google Scholar | Crossref | ISI | |
|
MacCallum, R. C., Roznowski, M., Necowitz, L. B. (1992). Model modifications in covariance structure analysis: The problem of capitalization on chance. Psychological Bulletin, 111, 490-504. doi:10.1037/0033-2909.111.3.490 Google Scholar | Crossref | Medline | ISI | |
|
McArdle, J. J. (1990). Principles versus principals of structural factor analysis. Multivariate Behavioral Research, 25, 81-87. doi:10.1207/s15327906mbr2501_10 Google Scholar | Crossref | Medline | ISI | |
|
McCallum, S., Bracken, B., Wasserman, J. (2001). Essentials of nonverbal assessment. New York, NY: John Wiley. Google Scholar | |
|
McDonald, R. P. (1999). Test theory: A unified treatment. Mahwah, NJ: Lawrence Erlbaum. Google Scholar | |
|
Nelson, J. M., Canivez, G. L., Lindstrom, W., Hatt, C. V. (2007). Higher-order exploratory analysis of the Reynolds Intellectual Assessment Scales with a referred sample. Journal of School Psychology, 45, 439-456. doi:10.1016/j.jsp.2007.03.003 Google Scholar | Crossref | ISI | |
|
O’Connor, B. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test. Behavioral Research Methods, 32, 396-402. doi:10.3758/BF03200807 Google Scholar | Crossref | ISI | |
|
Ortiz, S. O., Ochoa, S. H., Dynda, A. M. (2012). Testing with culturally and linguistically diverse populations: Moving beyond the verbal-performance dichotomy into evidence-based practice. In Flangan, D. P., Harrison, P. L. (Eds.), Contemporary intellectual assessment: Theories, tests, and issues (3rd ed., pp. 526-552). New York, NY: Guilford Press. Google Scholar | |
|
Pearson, N. (2003). Comprehensive Test of Nonverbal Intelligence. In McCallum, R. S. (Ed.), Handbook of nonverbal assessment (pp. 141-162). New York, NY: Plenum. Google Scholar | Crossref | |
|
Preacher, K. J., MacCallum, R. C. (2003). Repairing Tom Swift’s electric factor analysis machine. Understanding Statistics, 2, 13-43. doi:10.1207/S15328031US0201_02 Google Scholar | Crossref | |
|
Raiche, G., Walls, T. A., Magis, D., Riopel, M., Blais, J. (2012). Non-graphical solutions for Cattell’s scree test. Methodology, 9, 23-29. doi:10.1027/1614-2241/a000051 Google Scholar | Crossref | ISI | |
|
Reise, S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47, 667-696. doi:10.1080/00273171.2012.715555 Google Scholar | Crossref | Medline | ISI | |
|
Reise, S. P., Bonifay, W. E., Haviland, M. G. (2013). Scoring and modeling psychological measures in the presence of multidimensionality. Journal of Personality Assessment, 95, 129-140. doi:10.1080/00223891.2012.725437 Google Scholar | Crossref | Medline | ISI | |
|
Rossen, E. A., Shearer, D. K., Penfield, R. D., Kranzler, J. H. (2005). Validity of the Comprehensive Test of Nonverbal Intelligence (CTONI). Journal of Psychoeducational Assessment, 23, 161-172. doi:10.1177/073428290502300205 Google Scholar | SAGE Journals | ISI | |
|
Schmid, J., Leiman, J. M. (1957). The development of hierarchical factor solutions. Psychometrika, 22, 53-61. doi:10.1007/BF02289209 Google Scholar | Crossref | ISI | |
|
Spearman, C. (1904). “General intelligence,” objectively determined and measured. American Journal of Psychology, 15, 201-293. Retrieved from http://psychclassics.yorku.ca/Spearman Google Scholar | |
|
Tabachnick, B. G., Fiddell, L. S. (2007). Using multivariate statistics (5th ed.). Boston, MA: Pearson. Google Scholar | |
|
Velicer, W. F. (1976). Determining the number of components from the matrix of partial correlations. Psychometrika, 31, 321-327. doi:10.1007/BF02293557 Google Scholar | Crossref | ISI | |
|
Velicer, W. F., Jackson, D. N. (1990). Component analysis versus common factor analysis: Some further observations. Multivariate Behavioral Research, 25, 89-95. doi:10.1207/s15327906mbr2501_12 Google Scholar | Crossref | Medline | ISI | |
|
Watkins, M. W. (2000). Monte Carlo PCA for parallel analysis [Computer software]. State College, PA: Ed & Psych Associates. Google Scholar | |
|
Watkins, M. W. (2004). MacOrtho [Computer software]. State College, PA: Ed & Psych Associates. Google Scholar | |
|
Watkins, M. W. (2007). SEscree [Computer software]. Phoenix, AZ: Ed & Psych Associates. Google Scholar | |
|
Watkins, M. W. (2013). Omega [Computer software]. Phoenix, AZ: Ed & Psych Associates. Google Scholar | |
|
Weiss, L. G., Keith, T. Z., Zhu, J., Chen, H. (2013a). WAIS-IV and clinical validation of the four- and five-factor interpretative approaches. Journal of Psychoeducational Assessment, 31, 93-113. doi:10.1177/0734282913478030 Google Scholar | Crossref | ISI | |
|
Weiss, L. G., Keith, T. Z., Zhu, J., Chen, H. (2013b). WISC-IV and clinical validation of the four- and five-factor interpretative approaches. Journal of Psychoeducational Assessment, 31, 114-131. doi:10.1177/0734282913478032 Google Scholar | SAGE Journals | ISI | |
|
Widaman, K. F. (1993). Common factor analysis versus principal component analysis: Differential bias in representing model parameters? Multivariate Behavioral Research, 28, 263-311. doi:10.1207/s15327906mbr2803_1 Google Scholar | Crossref | Medline | ISI | |
|
Zoski, K. W., Jurs, S. (1996). An objective counterpart to the visual scree test for factor analysis: The standard error scree. Educational and Psychological Measurement, 56, 443-451. doi:10.1177/0013164496056003006 Google Scholar | SAGE Journals | ISI | |
|
Zwick, W. R., Velicer, W. F. (1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin, 99, 432-442. doi:10.1037/0033-2909.99.3.432 Google Scholar | Crossref | ISI |
