![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
Maze tasks have appealing properties as progress-monitoring tools, but there is a need for a thorough examination of the psychometric properties of Maze tasks among middle school students. We evaluated form effects, reliability, validity, and practice effects of Maze among students in Grades 6 through 8. We administered the same (familiar) and novel Maze passages for progress monitoring of a reading intervention among typical readers (n = 588), struggling readers receiving researcher-provided intervention (n = 471), and struggling readers not receiving intervention (n = 284). Form effects accounted for significant variance in Maze performance. Familiar passages had greater test–retest reliability than novel passages. Both administrative conditions had similar, moderate correlations (validity coefficients) with other measures of reading fluency and comprehension. There were also significant practice effects. Students who read the same passage showed steeper slopes in Maze performance than students who read different passages over time. Practice effects were influenced by beginning levels of reading comprehension and by intervention status.
Keywords Maze, reading comprehension, measurement, middle school, progress monitoring
References
Section:
|
Ardoin, S. P., Christ, T. J. (2009). Curriculum-based measurement of oral reading: Standard errors associated with progress monitoring outcomes from DIBELS, AIMSweb, and an experimental passage set. School Psychology Review, 38, 266–283. Google Scholar | ISI | |
|
Ardoin, S. P., Witt, J. C., Suldo, S. M., Connell, J. E., Koening, J. L., Resetar, J. L., . . . Williams, K. L. (2004). Examining the incremental benefits of administering a Maze and three versus one curriculum-based measurement reading probes when conducting universal screening. School Psychology Review, 33, 218–233. Google Scholar | ISI | |
|
Brown-Chidsey, R., Davis, L., Maya, C. (2003). Sources of variance in curriculum-based measures of silent reading. Psychology in the Schools, 40, 363–377. Google Scholar | Crossref | ISI | |
|
Catts, H. W., Fey, M. E., Zhang, X., Tomblin, B. J. (1999). Language basis of reading and reading disabilities: Evidence from a longitudinal investigation. Scientific Studies of Reading, 3, 331–361. Google Scholar | Crossref | |
|
Christ, T. J. (2006). Short-term estimates of growth using curriculum-based measurement of oral reading fluency: Estimates of standard error of slope to construct confidence intervals. School Psychology Review, 35, 128–133. Google Scholar | ISI | |
|
Christ, T. J., Ardoin, S. P. (2009). Curriculum-based measurement of reading: Passage equivalence and selection. Journal of School Psychology, 47, 55–75. Google Scholar | Crossref | ISI | |
|
Cohen, J., Cohen, P., West, S. G., Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Mahwah, NJ: Lawrence Erlbaum. Google Scholar | |
|
Deno, S., Mirkin, P., Chiang, B. (1982). Identifying valid measures of reading. Exceptional Children, 49, 524–597. Google Scholar | ISI | |
|
Dodrill, C. B., Troupin, A. S. (1975). Effects of repeated administrations of a comprehensive neuropsychological battery among chronic epileptics. Journal of Nervous and Mental Disease, 161, 185–190. Google Scholar | Crossref | Medline | ISI | |
|
Dunn, E. K., Eckert, T. L. (2002). Curriculum-based measurement in reading: A comparison of similar versus challenging material. School Psychology Quarterly, 17, 24–46. Google Scholar | Crossref | ISI | |
|
Espin, C. A., Foegen, A. (1996). Validity of general outcome measures for predicting secondary students’ performance on content-area tasks. Exceptional Children, 62, 497–514. Google Scholar | SAGE Journals | ISI | |
|
Espin, C. A., Wallace, T., Lembke, E., Campbell, H., Long, J. D. (2010). Creating a progress-monitoring system in reading for middle-school students: Tracking progress toward meeting high-stakes standards. Learning Disabilities Research & Practice, 25, 60–75. Google Scholar | Crossref | |
|
Francis, D. J., Fletcher, J. M., Stuebing, K. K., Lyon, G. R., Shaywitz, B. A., Shaywitz, S. E. (2005). Psychometric approaches to the identification of LD: IQ and achievement scores are not sufficient. Journal of Learning Disabilities, 38, 98–108. Google Scholar | SAGE Journals | ISI | |
|
Francis, D. J., Santi, K. L., Barr, C., Fletcher, J. M., Varisco, A., Foorman, B. R. (2008). Form effects on the estimation of students’ oral reading fluency using DIBELS. Journal of School Psychology, 46, 315–342. Google Scholar | Crossref | Medline | ISI | |
|
Francis, D. J., Schatschneider, C., Carlson, C. (2000). Introduction to individual growth curve analysis. In Drotar, D. (Ed.), Handbook of research in pediatrics and clinical child psychology. New York, NY: Kluwer Academic/Plenum. Google Scholar | Crossref | |
|
Fuchs, L. S., Fuchs, D. (1992). Identifying a measure for monitoring student reading progress. School Psychology Review, 21, 45–58. Google Scholar | ISI | |
|
Fuchs, L. S., Fuchs, D., Maxwell, L. (1988). The validity of informal reading comprehension measures. Remedial and Special Education, 9, 20–28. Google Scholar | SAGE Journals | ISI | |
|
Fuchs, L. S., Fuchs, D., Maxwell, L. (2002). Treatment validity as a unifying construct for identifying learning disabilities. Learning Disability Quarterly, 25, 33–45. Google Scholar | SAGE Journals | ISI | |
|
Griffith, A., VanDerHeyden, A. M., Skokut, M., Lilles, E. (2009). Progress monitoring in oral reading fluency within the context of response to intervention. School Psychology Quarterly, 24, 13–23. Google Scholar | Crossref | ISI | |
|
Grigorenko, E., Sternberg, R. (1998). Dynamic testing. Psychological Bulletin, 124, 75–111. Google Scholar | Crossref | ISI | |
|
Guthrie, J. T. (1973). Reading comprehension and syntactic responses in good and poor readers. Journal of Educational Psychology, 65, 294–299. Google Scholar | Crossref | Medline | ISI | |
|
Hausknecht, J. P., Halpert, J. A., DiPaolo, N., Gerrard, M. O. (2007). Retesting in selection: A meta-analysis of coaching and practice effects for tests of cognitive ability. Journal of Applied Psychology, 92, 373–385. Google Scholar | Crossref | Medline | ISI | |
|
Hausknecht, J. P., Trevor, C. O., Farr, J. (2002). Retaking ability tests in a selection setting: Implications for practice effects, training performance, and turnover. Journal of Applied Psychology, 87, 243–254. Google Scholar | Crossref | Medline | ISI | |
|
Hintze, J. M., Christ, T. J. (2004). An examination of variability as a function of passage variance in CBM progress monitoring. School Psychology Review, 33, 204–217. Google Scholar | ISI | |
|
Hintze, J. M., Shapiro, E. S., Lutz, J. G. (1994). The effects of curriculum on the sensitivity of curriculum-based measurement in reading. Journal of Special Education, 28, 188–202. Google Scholar | SAGE Journals | ISI | |
|
Jenkins, J. R., Jewell, R. (1993). Examining the validity of two measures for formative teaching: Reading aloud and Maze. Exceptional Children, 59, 421–432. Google Scholar | SAGE Journals | ISI | |
|
Jenkins, J. R., Zumeta, R., Dupree, O., Johnson, K. (2005). Measuring gains in reading ability with passage reading fluency. Learning Disabilities Research & Practice, 20, 245–253. Google Scholar | Crossref | |
|
Kaufman, A. S., Kaufman, N. L. (2004). Kaufman Brief Intelligence Test manual. Circle Pines, MN: AGS. Google Scholar | |
|
Lee, E. S., Forthofer, R. N., Lorimor, R. J. (1989). Analyzing complex survey data. London: Sage. Google Scholar | |
|
Lezak, M. D. (1995). Neuropsychological assessment (3rd ed.). New York, NY: Oxford University Press. Google Scholar | |
|
National Center on Student Progress Monitoring . (2010). What is progress monitoring? Retrieved from http://www.studentprogress.org Google Scholar | |
|
Poncy, B. C., Skinner, C. H., Axtell, P. K. (2005). An investigation of the reliability and standard error of measurement of words read correctly per minute using curriculum-based measurement. Journal of Psychoeducational Assessment, 23, 326–338. Google Scholar | SAGE Journals | ISI | |
|
Powers, D. E., Rock, D. A. (1999). Effects of coaching on SAT I: Reasoning test scores. Journal of Educational Measurement, 36, 93–118. Google Scholar | Crossref | ISI | |
|
Reschly, A., Busch, T., Betts, J., Deno, S., Long, J. (2009). Curriculum-based measurement oral reading as an indicator of reading achievement: A meta-analysis of the correlational evidence. Journal of School Psychology, 47, 427–469. Google Scholar | Crossref | Medline | ISI | |
|
Shinn, M. R., Deno, S. L., Espin, C. A. (2000). Technical adequacy of the Maze task for curriculum-based measurement of reading growth. Journal of Special Education, 34, 164–172. Google Scholar | SAGE Journals | ISI | |
|
Shinn, M. R., Good, R., Knutson, N., Tilly, W., Collins, V. (1992). Curriculum-based measurement of oral reading fluency: A confirmatory analysis of its relation to reading. School Psychology Review, 21, 459–479. Google Scholar | ISI | |
|
Shinn, M. R., Shinn, M. M. (2002). AIMSweb training workbook: Administration and scoring of reading Maze for use in general outcome measurement. Eden Prairie, MN: Edformation. Google Scholar | |
|
Silberglitt, B., Burns, M. K., Madyun, N., Lail, K. E. (2006). Relationship of reading fluency assessment data with state accountability test scores: A longitudinal comparison of grade levels. Psychology in Schools, 43, 527–535. Google Scholar | Crossref | ISI | |
|
Slade, P. D., Towner, B. D., Rosenbaum, G., Martins, I. P., Luis, H., Bernardo, M., . . . DeRouen, T. A. (2008). The serial use of child neurocognitive tests: Development versus practice effects. Psychological Assessment, 20, 361–369. Google Scholar | Crossref | Medline | ISI | |
|
Texas Educational Agency . (2008). TAKS: Texas Assessment of Knowledge and Skills. Retrieved from http://www.tea.state.tx.us/index3.aspx?id=3839&menu_id=793 Google Scholar | |
|
Ticha, R., Espin, C., Wayman, M. W. (2009). Reading progress monitoring for secondary-school students: Reliability, validity, and sensitivity to growth of reading aloud and Maze selection measures. Learning Disabilities Research & Practice, 24, 132–142. Google Scholar | Crossref | |
|
Torgesen, J. K., Nettle, S., Howard, P., Winterbottom, R. (2005). Brief report of a study to investigate the relationship between several brief measures of reading fluency and performance on the Florida Comprehensive Assessment Test—Reading in 4th, 6th, 8th, and 10th grades (FCRR Technical Report 6). Retrieved from http://www.fcrr.org/TechnicalReports/Progress_monitoring_report.pdf Google Scholar | |
|
Torgesen, J. K., Wagner, R., Rashotte, C. (1999). Test of Word Reading Efficiency. Austin, TX: Pro-Ed. Google Scholar | |
|
Vaughn, S., Cirino, P. T., Wanzek, J., Wexler, J., Fletcher, J. M., Denton, C., . . . Francis, D. J. (2010a). Response to intervention for middle school students with reading difficulties: Effects of a primary and secondary intervention. School Psychology Review, 39, 3–21. Google Scholar | Medline | ISI | |
|
Vaughn, S., Wanzek, J., Wexler, J., Barth, A. E., Cirino, P. T., Fletcher, J. M., . . . Francis, D. J. (2010b). The relative effects of group size on reading progress of older students with reading difficulties. Reading and Writing: An Interdisciplinary Journal, 23, 931–956. Google Scholar | Crossref | Medline | ISI | |
|
Wayman, C., Wallace, T., Wiley, H., Ticha, R., Espin, C. (2007). Literature synthesis on curriculum-based measurement in reading. Journal of Special Education, 41, 85–120. Google Scholar | SAGE Journals | ISI | |
|
Williams, K. T. (2002). Group Reading Assessment and Diagnostic Evaluation. Circle Pines, MN: American Guidance Services. Google Scholar | |
|
Woehlke, A. B., Wilder, D. H. (1963). Differences in difficulty of Forms A and B of the Otis Self-Administering Test of Mental Ability. Personnel Psychology, 16, 395–398. Google Scholar | Crossref | ISI | |
|
Woodcock, R. W., McGrew, K. S., Mather, N. (2001). Woodcock-Johnson III Tests of Achievement. Itasca, IL: Riverside. Google Scholar |
