![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
The selection and interpretation of individually administered norm-referenced cognitive tests that are administered to culturally and linguistically diverse (CLD) students continue to be an important consideration within the psychoeducational assessment process. Understanding test directions during the assessment of cognitive abilities is important, considering the high-stakes nature of these assessments. Therefore, the linguistic demand of spoken test directions from the following commonly used cognitive test batteries was examined and compared: Wechsler Intelligence Scale for Children, Fifth Edition (WISC-V), Woodcock–Johnson IV Tests of Cognitive Abilities (WJ IV COG), Cognitive Assessment System, Second Edition (CAS2), and Kaufman Assessment Battery for Children, Second Edition (KABC-II). On average, the linguistic demand of the standard test directions was greater than the linguistic demand of the supplementary test directions. When examining individual test characteristics, very few individual tests were identified as outliers with respect to the linguistic demand of their test directions. This finding differs from previous research and suggests that the linguistic demand of the required directions for most tests included in commonly used cognitive batteries is similar. Implications for future research and test development are discussed.
References
Section:
|
Abedi, J. (2002). Standardized achievement tests and English language learners: Psychometrics issues. Educational assessment, 8, 231-257. doi:10.1207/ S15326977EA0803_02 Google Scholar | Crossref | |
|
Abedi, J. (2006). Psychometric issues in the ELL assessment and special education eligibility. Teachers College Record, 108, 2282-2303. Retrieved from http://www.tcrecord.org.login.ezproxy.library.ualberta.ca Google Scholar | |
|
Brigham, C. C. (1923). A study of American intelligence. Princeton, NJ: Princeton University Press. Google Scholar | |
|
Cormier, D. C., Kennedy, K. E., Aquilina, A. A. (2016). Wechsler Intelligence Scale for Children, Fifth Edition [Test Review: Wechsler Intelligence Scale for Children, Fifth Edition: Canadian (WISC-VCDN), by D. Wechsler]. Canadian Journal of School Psychology, 31(4), 322-334. doi:10.1177/0829573516648941 Google Scholar | SAGE Journals | ISI | |
|
Cormier, D. C., McGrew, K. S., Bulut, O., Funamoto, A. (2016). Revisiting the relationships between broad Cattell-Horn-Carroll (CHC) cognitive abilities and reading achievement during the school-age years. Journal of Psychoeducational Assessment. Advance online publication. doi:10.1177/0734282916659208 Google Scholar | SAGE Journals | |
|
Cormier, D. C., McGrew, K. S., Evans, J. J. (2011). Quantifying the “degree of linguistic demand” in spoken intelligence test directions. Journal of Psychoeducational Assessment, 29, 515-533. doi:10.1177/0734282911405962 Google Scholar | SAGE Journals | ISI | |
|
Cormier, D. C., McGrew, K. S., Ysseldyke, J. E. (2014). The influences of linguistic demand and cultural loading on cognitive test scores. Journal of Psychoeducational Assessment, 32, 610-623. doi:10.1177/0734282914536012 Google Scholar | SAGE Journals | ISI | |
|
Cormier, D. C., Wang, K., Kennedy, K. E. (2016). Linguistic Demands of the Oral Directions for Administering the WISC-IV and WISC-V. Canadian Journal of School Psychology, 3(4), 290-304. DOI: 10.1177/0829573516643314 Google Scholar | SAGE Journals | |
|
Cummins, J. (1979). Cognitive/academic language proficiency, linguistic interdependence, the optimum age question and some other matters. Working Papers on Bilingualism, 19, 121-129. Google Scholar | |
|
Cummins, J. (1984). Bilingualism and special education: Issues in assessment and pedagogy. Clevedon, UK: Multilingual Matters. Google Scholar | |
|
Dumais, S. T. (2005). Latent semantic analysis. Annual Review of Information Science and Technology, 38, 188-230. Google Scholar | Crossref | |
|
Faulkner-Bond, M., Sireci, S. G. (2015). Validity issues in assessing linguistic minorities. International Journal of Testing, 15, 114-135. doi:10.1080/15305058.2014.974763 Google Scholar | Crossref | |
|
Figueroa, R. (1989). Psychological testing of linguistic-minority students: Knowledge gaps and regulations. Exceptional Children, 56, 145-148. Google Scholar | SAGE Journals | ISI | |
|
Flanagan, D. P., McGrew, K. S., Ortiz, S. (2000). The Wechsler Intelligence Scales and Gf-Gc Theory: A contemporary approach to interpretation. Boston, MA: Allyn & Bacon. Google Scholar | |
|
Flanagan, D. P., Ortiz, S. O. (2001). Essentials of cross-battery assessment. New York, NY: John Wiley. Google Scholar | |
|
Flanagan, D. P., Ortiz, S. O., Alfonso, V. C. (2007). Essentials of cross-battery assessment with C/D ROM (2nd ed.). New York, NY: Wiley. Google Scholar | |
|
Flanagan, D. P., Ortiz, S. O., Alfonso, V. C. (2013). Essentials of cross-battery assessment (3rd ed.). Hoboken, NJ: John Wiley. Google Scholar | |
|
Fraine, N., McDade, R. (2009). Reducing bias in psychometric assessment of culturally and linguistically diverse students from refugee backgrounds in Australian schools: A process approach. Australian Psychologist, 44, 16-26. doi:10.1080/00050060802582026 Google Scholar | Crossref | ISI | |
|
Goddard, H. H. (1913). The Binet tests in relation to immigration. Journal of Psyco-Aesthenics, 18, 105-107. Google Scholar | |
|
Harry, B., Klingner, J. (2006). Why are so many minority students in special education? London, England: Teacher College Press. Google Scholar | |
|
Hutcheson, G. D., Sofroniou, N. (1999). The multivariate social scientist: Introductory statistics using generalized linear models. Thousand Oaks, CA: Sage. Google Scholar | Crossref | |
|
Jensen, A. R. (1980). Bias in mental testing. New York, NY: Free Press. Google Scholar | |
|
Kaiser, H. F. (1974). An index of factorial simplicity. Psychometrika, 39, 31-36. Google Scholar | Crossref | ISI | |
|
Kaufman, A. S., Kaufman, N. L. (2004). Kaufman assessment battery for children (2nd ed.). Circle Pines, MN: American Guidance Service. Google Scholar | |
|
Kranzler, J. H., Flores, C. G., Coady, M. (2010). Examination of the cross-battery approach for the cognitive assessment of children and youth from diverse linguistic and cultural backgrounds. School Psychology Review, 39, 431-446. Google Scholar | ISI | |
|
Micro Power and Light Co . (2012). Seven formulas software (Version 7.8). Dallas, TX: Author. Google Scholar | |
|
Naglieri, J. A., Das, J. P., Goldstein, S. (2014). Cognitive Assessment System (2nd ed.). Dallas, TX: Pro-Ed. Google Scholar | |
|
National Association of School Psychologists . (2010). Principles for professional ethics. Retrieved from https://www.nasponline.org/Documents/Standards%20and%20Certification/Standards/1_%20Ethical%20Principles.pdf Google Scholar | |
|
Ortiz, S. O., McGrew, K. S., Flanagan, D. P. (1998). Gf-Gc cross-battery interpretation and selective cross-battery assessment: Referral concerns and the needs of culturally and linguistically diverse populations. In McGrew, K. S., Flanagan, D. P. (Eds.), The intelligence test desk reference (ITDR): Gf-Gc cross-battery assessment (pp. 401-443). Needham Heights, MA: Allyn & Bacon. Google Scholar | |
|
Pearson, B. Z., Fernandez, M. C., Oller, D. K. (1992). Measuring bilingual children’s receptive vocabularies. Child Development, 63, 1012-1221. Google Scholar | Crossref | Medline | |
|
Rhodes, R. L., Ochoa, S. H., Ortiz, S. A. (2005). Assessing culturally and linguistically diverse students: A practical guide. New York, NY: Guilford Press. Google Scholar | |
|
Schon, J., Shaftel, J., Markham, P. (2008). Contemporary issues in the assessment of culturally and linguistically diverse learners. Journal of Applied School Psychology, 24, 163-189. doi:10.1080/15377900802089395 Google Scholar | Crossref | |
|
Schrank, F. A., McGrew, K. S., Mather, N. (2014). Woodcock-Johnson IV Tests of Cognitive Abilities. Rolling Meadows, IL: Riverside. Google Scholar | |
|
Sireci, S. G., Faulkner-Bond, M. (2015). Promoting validity in the assessment of English learners. Review of Research in Education, 39, 215-252. doi:10.3102/0091732X14557003 Google Scholar | SAGE Journals | ISI | |
|
Sotelo-Dynega, M., Ortiz, S. O., Flanagan, D. P., Chaplin, W. F. (2013). English language proficiency and test performance: An evaluation of bilingual students with the Woodcock-Johnson III tests of cognitive abilities. Psychology in the Schools, 50, 781-797. Google Scholar | Crossref | ISI | |
|
Spinelli, C. G. (2008). Addressing the issue of cultural and linguistic diversity and assessment: Informal evaluation measures for English language learners. Reading & Writing Quarterly, 24(1), 101-118. doi:10.1080/10573560701753195 Google Scholar | Crossref | |
|
Styck, K. M., Watkins, M. W. (2013). Diagnostic utility of the Culture-Language Interpretive Matrix for the Wechsler Intelligence Scales for Children—Fourth Edition among referred students. School Psychology Review, 42, 367-382. Google Scholar | ISI | |
|
Tabachnick, B. G., Fidell, L. S. (2007). Using multivariate statistics (5th ed.). Upper Saddle River, NJ: Pearson Allyn & Bacon. Google Scholar | |
|
Terman, L. M. (1916). The measurement of intelligence. New York, NY: Houghton Mifflin. Google Scholar | Crossref | |
|
Tychanska, J. (2009). Evaluation of speech and language impairment using the culture–language test classifications and interpretive matrix (Unpublished doctoral dissertation). Saint John’s University, New York, NY. Google Scholar | |
|
Uchikoshi, Y., Marinova-Todd, S. H. (2012). Language proficiency and early literacy skills of Cantonese-speaking English language learners in the U.S. and Canada. Reading and Writing, 25, 2107-2129. doi:10.1007/s11145-011-9347-2 Google Scholar | Crossref | |
|
Valdés, G., Figueroa, R. A. (1994). Bilingualism and testing: A special case of bias. Norwood, NJ: Ablex. Google Scholar | |
|
Van Deth, L. M . (2013). Validity of the KABC-II culture-language interpretive matrix: A comparison of native English speakers and Spanish-speaking English language learners (Unpublished doctoral dissertation). Pennsylvania State University, State College. Google Scholar | |
|
Vega, D., Lasser, J., Afifi, A. F. (2016). School psychologists and the assessment of culturally and linguistically diverse students. Contemporary School Psychology, 20, 218-229. doi:10.1007/s40688-015-0075-5 Google Scholar | Crossref | |
|
Verderosa, F. A. (2007). Examining the effects of language and culture on the differential ability scales with bilingual preschoolers (Unpublished doctoral dissertation). St. John’s University, New York, NY. Google Scholar | |
|
Wechsler, D. (2003). WISC-IV technical and interpretive manual. San Antonio, TX: The Psychological Corporation. Google Scholar | |
|
Wechsler, D. (2014). Wechsler Intelligence Scale for Children—Fifth Edition (WISC-V). San Antonio, TX: The Psychological Corporation. Google Scholar | |
|
Woodcock, R. W., McGrew, K. S., Mather, N. (2001). Woodcock-Johnson III. Itasca, IL: Riverside Publishing. Google Scholar | |
|
Yerkes, R. M. (1921). Psychological examining in the United States Army. Washington, DC: Washington Government Printing Office. Google Scholar | |
|
Ysseldyke, J., Burns, M., Dawson, P., Kelley, B., Morrison, D., Ortiz, S., Telzrow, C. (2006). School psychology: A blueprint for training and practice III. Bethesda, MD: National Association of School Psychologists. Google Scholar |
