![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
Curriculum-based measurement of oral reading (CBM-R) is used to index the level and rate of student growth across the academic year. The method is frequently used to set student goals and monitor student progress. This study examined the diagnostic accuracy and quality of growth estimates derived from pre–post measurement using CBM-R data. A linear mixed effects regression model was used to simulate progress-monitoring data for multiple levels of progress-monitoring duration (6, 8, 10, . . ., 20 weeks) and data set quality, which was operationalized as residual/error in the model (σε= 5, 10, 15, and 20). Results indicate that the duration of instruction, quality of data, and method used to estimate growth influenced the reliability and precision of estimated growth rates, in addition to the diagnostic accuracy. Pre–post methods to derive CBM-R growth estimates are likely to require 14 or more weeks of instruction between pre–post occasions. Implications and future directions are discussed.
References
Section:
|
Ardoin, S. P., Christ, T. J. (2008). Evaluating curriculum based measurement slope estimate using data from tri-annual universal screenings. School Psychology Review, 37, 109–125. Google Scholar | ISI | |
|
Ardoin, S. P., Christ, T. J. (2009). Curriculum based measurement of oral reading: Standard errors associated with progress monitoring outcomes from DIBELS, AIMSweb, and an experimental passage set. School Psychology Review, 38, 266–283. Google Scholar | ISI | |
|
Ardoin, S. P., Christ, T. J., Morena, L. S., Cormier, D. C., Klingbeil, D. A. (in press). Curriculum based measurement of oral reading (CBM-R): A review and summary of progress monitoring decision rules and available evidence. Journal of School Psychology. Google Scholar | |
|
Christ, T. J. (2006). Short term estimates of growth using curriculum-based measurement of oral reading fluency: Estimates of standard error of the slope to construct confidence intervals. School Psychology Review, 35, 128–133. Google Scholar | ISI | |
|
Christ, T. J., Ardoin, S. P. (2009). Curriculum-based measurement of oral reading: Passage equivalence and probe-set development. Journal of School Psychology, 47, 55–75. Google Scholar | Crossref | ISI | |
|
Christ, T. J., Ardoin, S. P., Eckert, T. L., White, M. J. (2010a). Formative assessment instrumentation and procedures for reading (FAIP-R): Development of level one passage-sets (Tech. Rep. No. 1). Minneapolis, MN: Author. Google Scholar | |
|
Christ, T. J., Ardoin, S. P., Eckert, T. L., White, M. J. (2010b). Formative assessment instrumentation and procedures for reading (FAIP-R): Development of level two and three passage-sets (Tech. Rep. No. 2). Minneapolis, MN: Author. Google Scholar | |
|
Christ, T. J., Zopluoglu, C., Long, D. J., Monaghen, B.D. (2012). Curriculum-based measurement of oral reading (CBM-R): Quality of progress monitoring outcomes. Exceptional Children, 78(3), 356-373. Google Scholar | SAGE Journals | ISI | |
|
Christ, T. J., Zopluoglu, C., Monaghen, B., Van Norman, E. R. (in press). Curriculum-based measurement of oral reading: multi-study evaluation of schedule, duration, and dataset quality on progress monitoring outcomes. Manuscript submitted for publication. Google Scholar | |
|
Colon, E. P., Kranzler, J. H. (2006). Effect of instructions on curriculum-based measurement of reading. Journal of Psychoeducational Assessment, 24, 318–328. Google Scholar | SAGE Journals | ISI | |
|
Crocker, L., Algina, J. (1986). Introduction to classical and modern test theory. Orlando, FL: Harcourt Brace. Google Scholar | |
|
Cronbach, L. J., Furby, L. (1970). How we should measure “change”: Or should we? Psychological Bulletin, 74, 68–80. Google Scholar | Crossref | ISI | |
|
Deno, S. L. (1985). Curriculum-based measurement: The emerging alternative. Exceptional Children, 52, 219–232. Google Scholar | SAGE Journals | ISI | |
|
Deno, S. L. (1986). Formative evaluation of individual student programs: A new role for school psychologists. School Psychology Review, 15, 358–374. Google Scholar | ISI | |
|
Deno, S. L. (2002). Problem solving as best practices. In Thomas, A., Grimes, J. (Eds.), Best practices in school psychology IV (pp. 37–56). Bethesda, MD: National Association of School Psychologists. Google Scholar | |
|
Deno, S. L. (2003). Developments in curriculum-based measurement. Journal of Special Education, 37, 184–192. Google Scholar | SAGE Journals | ISI | |
|
Deno, S. L., Fuchs, L. S., Marston, D., Shin, J. (2001). Using curriculum-based measurement to establish growth standards for students with learning disabilities. School Psychology Review, 30, 507–524. Google Scholar | ISI | |
|
Deno, S. L., Marston, D., Tindal, G. (1985). Direct and frequent curriculum-based measurement: An alternative for educational decision making. Special Services in the Schools, 2(2), 5–27. Google Scholar | |
|
Deno, S. L., Mirkin, P. K. (1977). Data-based program modification: A manual. Reston, VA: Council for Exceptional Children. Google Scholar | |
|
Derr, T. F., Shapiro, E. S. (1989). A behavioral evaluation of curriculum-based assessment of reading. Journal of Psychoeducational Assessment, 7, 148–160. Google Scholar | SAGE Journals | |
|
Derr-Minneci, T. F., Shapiro, E. S. (1992). Validating curriculum-based measurement in reading from a behavioral perspective. School Psychology Quarterly, 7, 2–16. Google Scholar | Crossref | |
|
Fitzmaurice, G. M., Laird, N. M., Ware, J. H. (2004). Applied longitudinal analysis. Hoboken, New Jersey: John Wiley & Sons. Google Scholar | |
|
Francis, D. J., Santi, K. L., Barr, C., Fletcher, J. M., Varisco, A., Foorman, B. R. (2008). Form effects on the estimation of students’ oral reading fluency using DIBELS. Journal of School Psychology, 46, 315–342. Google Scholar | Crossref | Medline | ISI | |
|
Fuchs, D., Fuchs, L. S., McMaster, K. N., Al Otaiba, S. (2003). Identifying children at risk for reading failure: Curriculum-based measurement and the dual-discrepancy approach. In Swanson, H. L., Harris, K. R., Graham, S. (Eds.), Handbook of learning disabilities (pp. 431–449). New York, NY: Guilford. Google Scholar | |
|
Fuchs, L. S., Deno, S. L., Mirkin, P. K. (1984). The effects of frequent curriculum-based measurement and evaluation on pedagogy, student achievement, and student awareness of learning. American Educational Research Journal, 21, 449–460. Google Scholar | SAGE Journals | ISI | |
|
Fuchs, L. S., Fuchs, D. (1986). Effects of systematic formative evaluation: A meta-analysis. Exceptional Children, 53, 3–14. Google Scholar | SAGE Journals | ISI | |
|
Fuchs, L. S., Fuchs, D., Hamlett, C. L. (1989). Effects of instrumental use of curriculum-based measurement to enhance instructional programs. Remedial and Special Education, 10(2), 43–52. Google Scholar | SAGE Journals | ISI | |
|
Fuchs, L. S., Fuchs, D., Hamlett, C. L., Whinnery, K. (1991). Effects of goal line feedback on level, slope, and stability of performance within curriculum-based measurement. Learning Disabilities Research & Practice, 6, 66–74. Google Scholar | |
|
Fuchs, L. S., Fuchs, D., Hosp, M. K., Jenkins, J. R. (2001). Oral reading fluency as an indicator of reading competence: A theoretical, empirical, and historical analysis. Scientific Studies of Reading, 5, 239–256. Google Scholar | Crossref | |
|
Good, R. H., Shinn, M. R. (1990). Forecasting accuracy of slope estimates for reading curriculum-based measurement: Empirical evidence. Behavioral Assessment, 12, 179–193. Google Scholar | |
|
Harwell, M., Stone, C. A., Hsu, T. C., Kirisci, L. (1996). Monte Carlo studies in item response theory. Applied Psychological Measurement, 20, 101–125. Google Scholar | SAGE Journals | ISI | |
|
Hintze, J. M., Christ, T. J. (2004). An examination of variability as a function of passage variance in CBM progress monitoring. School Psychology Review, 33, 204–217. Google Scholar | ISI | |
|
Jenkins, J. R., Graff, J. J., Miglioretti, D. L. (2009). Estimating reading growth using intermittent CBM progress monitoring. Exceptional Children, 75, 151–163. Google Scholar | SAGE Journals | ISI | |
|
Jenkins, J. R., Terjeson, K. J. (2011). Monitoring reading growth: Goal setting, measurement frequency, and methods of evaluation. Learning Disabilities Research & Practice, 26, 28–35. Google Scholar | Crossref | ISI | |
|
Jenkins, J. R., Zumeta, R., Dupree, O., Johnson, K. (2005). Measuring gains in reading ability with passage reading fluency. Learning Disabilities Research & Practice, 20, 245–253. Google Scholar | Crossref | |
|
Kazdin, A. E. (1982). Single-case research designs: Methods for clinical and applied settings. New York, NY: Oxford University Press. Google Scholar | |
|
National Center for Response to Intervention . (2009). Classification Accuracy. Retrieved from http://rti4success.org/chart/screeningTools/scoring_rubrics/classification.html Google Scholar | |
|
Nunnally, J. C. (1970). Introduction to psychological measurement. New York, NY: McGraw-Hill. Google Scholar | |
|
Poncy, B. C., Skinner, C. H., Axtell, P. K. (2005). An investigation of the reliability and standard error of measurement of words read correctly per minute using curriculum-based measurement. Journal of Psychoeducational Assessment, 23, 326–338. Google Scholar | SAGE Journals | ISI | |
|
R Development Core Team . (2009). R: A language and environment for statistical computing. Available from http://www.R-project.org Google Scholar | |
|
Shinn, M. R. (Ed.). (1989). Curriculum-based measurement: Assessing special children. New York, NY: Guildford. Google Scholar | |
|
Shinn, M. R. (2008). Best practices in using curriculum-based measurement in a problem-solving model. In Thomas, A., Grimes, J. (Eds.), Best practices in school psychology (pp. 243–262). Bethesda, MD: National Association of School Psychologists. Google Scholar | |
|
Shinn, M. R., Good, R. H., Knutson, N., Tilly, W. D., Collins, V. L. (1992). Curriculum-based measurement of oral reading fluency: A confirmatory analysis of its relation to reading. School Psychology Review, 21, 459–479. Google Scholar | ISI | |
|
Shinn, M. R., Good, R. H., Stein, S. (1989). Summarizing trend in student achievement: A comparison of methods. School Psychology Review, 18, 356–370. Google Scholar | ISI | |
|
Shinn, M. R., Shinn, M. M. (2002). AIMSweb training workbook: Administration and scoring of Reading Curriculum Based Measurement (R-CBM) for use in general outcomes measurement. Available from www.aimsweb.com Google Scholar | |
|
Silberglitt, B., Hintze, J. M. (2005). Formative assessment using CBM-R cut scores to track progress toward success on state mandated achievement tests: A comparison of methods. Journal of Psychoeducational Assessment, 23, 304–325. Google Scholar | SAGE Journals | ISI | |
|
Stecker, P. M., Fuchs, L. S., Fuchs, D. (2005). Using curriculum-based measurement to improve student achievement: Review of research. Psychology in the Schools, 42, 795–819. Google Scholar | Crossref | ISI | |
|
Swets, J. A. (1988). Measuring the accuracy of diagnostic systems. Science, 240(4857), 1285–1293. Google Scholar | Crossref | Medline | ISI | |
|
Swets, J. A., Dawes, R. M., Monahan, J. (2000). Psychological science can improve diagnostic decisions. Psychological Science in the Public Interest, 1, 1–26. Google Scholar | SAGE Journals | |
|
Verbeke, G., Molenberghs, G. (2000). Linear mixed models for longitudinal data. New York, NY: Springer-Verlag. Google Scholar | |
|
Wayman, M. M., Wallace, T., Wiley, H. I., Ticha, R., Espin, C. A. (2007). Literature synthesis on curriculum-based measurement in reading. Journal of Special Education, 41, 85–120. Google Scholar | SAGE Journals | ISI | |
|
Wesson, C., Deno, S., Mirkin, P., Mirkin, G., Skiba, R., King, R., Sevcik, B. (1988). A causal analysis of the relationship among ongoing curriculum-based measurement and evaluation, the structure of instruction and student achievement. Journal of Special Education, 22, 330–343. Google Scholar | SAGE Journals | ISI | |
|
White, O. R., Haring, N. G. (1980). Exceptional teaching (2nd ed.). Columbus, OH: Merrill. Google Scholar |
