![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
Data from the standardization sample of the Woodcock–Johnson Psychoeducational Battery–Third Edition (WJ III) Cognitive standard battery and Test Session Observation Checklist items were analyzed to understand the relationship between g (general mental ability) and test session behavior (TSB; n = 5,769). Latent variable modeling methods were used to construct both the g and TSB factors, and measurement invariance of the two latent factors was tested across five age groupings (ages 6-8, 9-3, 14-19, 20-39, and 40+). Results indicated partial scalar invariance across age groups for both the g and TSB factors. Correlations between the g and TSB factors were moderately strong and statistically significant across all groups. Suggestions for future research that is most likely to advance theory development and scale development related to the relationship between g and TSB are discussed.
References
Section:
|
Alfonso, V. C., Flanagan, D. P. (1999). Assessment of cognitive functioning in preschoolers. In Nuttall, E. V., Romero, I., Kalesnik, J. (Eds.), Assessing and screening preschoolers: Psychological and educational dimensions (pp. 186-218). Boston, MA: Allyn and Bacon. Google Scholar | |
|
Aylward, G. P., MacGruder, R. W. (1986). Test Behavior Checklist. Brandon, VT: Clinical Psychology Publishing. Google Scholar | |
|
Beal, C. R., Adams, N. M., Cohen, P. R. (2010). Reading proficiency and mathematics problem solving by high school English language learners. Urban Education, 45, 58-74. Google Scholar | SAGE Journals | ISI | |
|
Bollen, K. A., Hoyle, R. H. (2012). Latent variables in structural equation modeling. In Hoyle, R. H. (Ed.), Handbook of structural equation modeling. New York, NY: Guilford. Google Scholar | |
|
Bradley-Johnson, S. (2001). Cognitive assessment for the youngest children: A critical review of tests. Journal of Psychoeducational Assessment, 19, 19-44. Google Scholar | SAGE Journals | ISI | |
|
Browne, M. W., Cudeck, R. (1993). Alternative ways of assessing model fit. In Bollen, K. A., Long, J. S. (Eds.), Testing structural equation models (pp. 136-162). Newbury Park, CA: Sage. Google Scholar | |
|
Caldwell, B. M. (1951). Test Behavior Observation guide. In Watson, R. (Ed.), The clinical method in psychology (pp. 67-71). New York, NY: Harper and Brothers. Google Scholar | |
|
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464-504. Google Scholar | Crossref | ISI | |
|
Cheung, G. W., Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233-255. Google Scholar | Crossref | ISI | |
|
Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4, 272-299. Google Scholar | Crossref | ISI | |
|
Flanagan, D. P., Alfonso, V. C. (1995). A critical review of the technical characteristics of new and recently revised intelligence tests for preschool children. Journal of Psychoeducational Assessment, 13, 66-90. Google Scholar | SAGE Journals | ISI | |
|
Flanagan, D. P., Ortiz, S. O., Alfonso, V. C. (2013). Essentials of cross-battery assessment (3rd ed.). Hoboken, NJ: John Wiley. Google Scholar | |
|
Frisby, C. L., Osterlind, S. J. (2006). A descriptive analysis of Test Session Observation Checklist Ratings from the Woodcock Johnson III standardization sample. Journal of Psychoeducational Assessment, 24, 342-357. Google Scholar | SAGE Journals | ISI | |
|
Frisby, C. L., Osterlind, S. J. (2007). Hispanic test-session behavior on the Woodcock Johnson Psychoeducational Battery-Third Edition. Journal of Psychoeducational Assessment, 25, 257-270. Google Scholar | SAGE Journals | ISI | |
|
Glutting, J., Oakland, T. (1993). Guide to The Assessment of Test Session Behavior for the WISC-II and the WIAT. San Antonio, TX: The Psychological Corporation. Google Scholar | |
|
Green, S. B., Yang, Y. (2009). Reliability of summed item scores using structural equation modeling: An alternative to coefficient alpha. Psychometrika, 74, 155-167. doi:10.1007/s11336-008-9099-3 Google Scholar | Crossref | ISI | |
|
Gregorich, S. E. (2006). Do self-report instruments allow meaningful comparisons across diverse population groups? Testing measurement invariance using the confirmatory factor analysis framework. Medical Care, 44(11, Suppl. 3), S78-S94. Google Scholar | Crossref | ISI | |
|
Gustafsson, J.-E., Aberg-Bengtsson, L. (2010). Unidimensionality and interpretability of psychological instruments. In Embretson, S. E. (Ed.), Measuring psychological constructs: Advances in model-based approaches (pp. 97-121). Washington, DC: American Psychological Association. Google Scholar | Crossref | |
|
Hu, L., Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3, 424-453. Google Scholar | Crossref | ISI | |
|
Hu, L., Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55. Google Scholar | Crossref | ISI | |
|
Kaufman, A. S., Kaufman, N. L., Dougherty, E. H., Tuttle, K. S. C. (1994). Kaufman Integrated Interpretive System Checklist for Behaviors Observed During Administration of WISC-III Subtests. Odessa, FL: Psychological Assessment Resources. Google Scholar | |
|
Konold, T. R., Maller, S. J., Glutting, J. J. (1998). Measurement and non-measurement influences of test-session behavior on individually administered measures of intelligence. Journal of School Psychology, 36(4), 417-432. Google Scholar | Crossref | ISI | |
|
Martin, R. (1988). Assessment of personality and behavior problems. New York, NY: Guilford. Google Scholar | |
|
Mather, N., Woodcock, R.W. (2001). Woodcock-Johnson III: Tests of cognitive abilities. Itasco, IL: Riverside Publishing. Google Scholar | |
|
McConaughy, S. H., Achenbach, T. M. (2004). Manual for the Test Observation Form for ages 2-18. Burlington, MA: University of Vermont, Research Center for Children, Youth, and Families. Google Scholar | |
|
McGrew, K. S. (2005). The Cattell-Horn-Carroll theory of cognitive abilities: Past, present, and future. In Flanagan, D. P., Genshaft, J. L., Harrison, P. L. (Eds.), Contemporary intellectual assessment: Theories, tests, and issues (2nd ed., pp. 136-182). New York, NY: Guilford. Google Scholar | |
|
McGrew, K., Woodcock, R. (2001). Woodcock-Johnson III technical manual. Itasca, IL: Riverside Publishing. Google Scholar | |
|
Muthén, B. (1993). Goodness of fit with categorical and other non-normal variables. In Bollen, K. A., Long, J. S. (Eds.), Testing structural equation models (pp. 205-234). Newbury Park, CA: Sage. Google Scholar | |
|
Muthén, B. O. (1984). A general structural equation model with dichotomous, ordered categorical, and continuous latent variable indicators. Psychometrika, 49, 115-132. Google Scholar | Crossref | ISI | |
|
Muthén, L. K., Muthén, B. O. (2012). Mplus user’s guide (7th ed.). Los Angeles, CA: Author. Google Scholar | |
|
Nagle, R. J. (2007). Issues in preschool assessment. In Bracken, B., Nagle, R. J. (Eds), Psychoeducational assessment of preschool children (4th ed., pp. 39-48). Mahwah, NJ: Lawrence Erlbaum Associates. Google Scholar | |
|
Nelson, S. A. (2008). Associations between intelligence test scores and test session behavior in children with ADHD, LD, and EBD (Unpublished doctoral dissertation). Retrieved from https://library.uvm.edu/jspui/bitstream/123456789/96/3/Nelson-PhD-2008.pdf Google Scholar | |
|
Oakland, T., Glutting, J., Watkins, M. W. (2005). Assessment of test behaviors with the WISC-IV. In Prifitera, A., Saklofske, D. H., Weiss, L. G. (Eds.), WISC-IV: Clinical use and interpretation (pp. 435-463). Burlington, MA: Elsevier. Google Scholar | Crossref | |
|
Raykov, T. (1997). Estimation of composite reliability for congeneric measures. Applied Psychological Measurement, 21, 173-184. doi:10.1177/01466216970212006 Google Scholar | SAGE Journals | ISI | |
|
Raykov, T. (2004). Behavioral scale reliability and measurement invariance evaluation using latent variable modeling. Behavior Therapy, 35, 299-331. doi:10.1016/S0005-7894(04)80041-8 Google Scholar | Crossref | ISI | |
|
Roid, G. H. (2003). Stanford-Binet Intelligence Scales (5th ed.). Itasca, IL: Riverside Publishing. Google Scholar | |
|
Roid, G. H., Miller, L. (2000). Leiter International Performance Scale Revised (Leiter R). Lutz, FL: Psychological Assessment Resources. Google Scholar | |
|
Sattler, J. M. (1988). Behavior and Attitude Checklist. In Sattler, J. M. (Ed.), Assessment of children (3rd ed., p. 92). San Diego, CA: Author. Google Scholar | |
|
Sattler, J. M. (2008). Assessment of children: Cognitive foundations (5th ed.). San Diego, CA: Author. Google Scholar | |
|
Sattler, J. M., Dumont, R. (2004). Assessment of children: WISC-IV and WPPSI-III supplement. San Diego, CA: Authors. Google Scholar | |
|
Schrank, F. A., McGrew, K. S., Mather, N., Woodcock, R. W. (2014). Woodcock-Johnson IV. Rolling Meadows, IL: Riverside Publishing. Google Scholar | |
|
Terman, L. M., Merrill, M. A. (1960). Stanford-Binet Intelligence Scale: Form L-M. Boston, MA: Houghton Mifflin. Google Scholar | |
|
Thorndike, R. L., Hagen, E. P., Sattler, J. J. (1986). Stanford-Binet Observation Schedule. Itasca, IL: Riverside Publishing. Google Scholar | |
|
Wang, Z., Rohrer, D., Chuang, C.-C., Fujiki, M., Herman, K., Reinke, W. (2015). Five methods to score the teacher observation of classroom adaptation checklist and to examine group differences. The Journal of Experimental Education, 83, 24-50. doi:10.1080/00220973.2013.876230 Google Scholar | Crossref | ISI | |
|
Wang, Z., Su, I. (2013). Longitudinal factor structure of general self-concept and locus of control among high school students. Journal of Psychoeducational Assessment, 31, 554-565. doi:10.1177/0734282913481651 Google Scholar | SAGE Journals | ISI | |
|
Woodcock, R. W., Johnson, M. B. (1989). Woodcock-Johnson psycho-educational battery-revised. Allen, TX: DLM Teaching Resources. Google Scholar | |
|
Yang, Y., Green, S. B. (2011). Coefficient alpha: A reliability coefficient for the 21st century? Journal of Psychoeducational Assessment, 29, 377-392. doi:10.1177/0734282911406668 Google Scholar | SAGE Journals | ISI |
