![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
Although ordinary least-squares (OLS) regression has been identified as a preferred method to calculate rates of improvement for individual students during curriculum-based measurement (CBM) progress monitoring, OLS slope estimates are sensitive to the presence of extreme values. Robust estimators have been developed that are less biased by extreme values; however, the performance of robust estimators in the short data streams typical of CBM progress monitoring is unknown. The purpose of the current study was to investigate bias and efficiency relative to OLS for several robust slope estimators on simulated CBM progress monitoring data. Data were generated at several combinations of series lengths (i.e., 7, 12, and 24 data points) and percentages of extreme value contamination (i.e., 0%, 15%, and 30% of data points). Results indicated that the robust slope estimates were substantially more efficient than OLS in the presence of extreme values. Potential uses of robust slope estimates for calculating students’ rates of improvement in CBM progress monitoring are discussed.
References
Section:
|
Andersen, R. (2008). Modern methods for robust regression. Thousand Oaks, CA: SAGE. Google Scholar | Crossref | |
|
Anderson, C., Schumacker, R. E. (2003). A comparison of five robust regression methods with ordinary least squares regression: Relative efficiency, bias, and test of the null hypothesis. Understanding Statistics, 2, 79–103. doi:10.1207/s15328031us0202_01 Google Scholar | Crossref | |
|
Ardoin, S. P., Christ, T. J., Morena, L. S., Cormier, D. C., Klingbeil, D. A. (2013). A systematic review and summarization of the recommendations and research surrounding curriculum-based measurement of oral reading fluency (CBM-R) decision rules. Journal of School Psychology, 51, 1–18. doi:10.1016/j.jsp.2012.09.004 Google Scholar | Crossref | Medline | ISI | |
|
Beaton, A. E., Tukey, J. W. (1974). The fitting of power series, meaning polynomials, illustrated on band-spectroscopic data. Technometrics, 16, 147–185. Google Scholar | Crossref | ISI | |
|
Brossart, D., Parker, R., Castillo, L. (2011). Robust regression for single-case data analysis: How can it help? Behavior Research Methods, 43, 710–719. doi:10.3758/s13428-011-0079-7 Google Scholar | Crossref | Medline | ISI | |
|
Christ, T. J. (2006). Short-term estimates of growth using curriculum-based measurement of oral reading fluency: Estimating standard error of the slope to construct confidence intervals. School Psychology Review, 35, 128–133. Google Scholar | ISI | |
|
Christ, T. J., Ardoin, S. P. (2009). Curriculum-based measurement of oral reading: Passage equivalence and probe-set development. Journal of School Psychology, 47, 55–75. doi:10.1016/j.jsp.2008.09.004 Google Scholar | Crossref | ISI | |
|
Christ, T. J., Zopluoglu, C., Long, J. D., Monaghen, B. D. (2012). Curriculum-based measurement of oral reading: Quality of progress monitoring outcomes. Exceptional Children, 78, 356–373. Google Scholar | SAGE Journals | ISI | |
|
Christ, T. J., Zopluoglu, C., Monaghen, B. D., Van Norman, E. R. (2013). Curriculum-based measurement of oral reading: Multi-study evaluation of schedule, duration, and dataset quality on progress monitoring outcomes. Journal of School Psychology, 51, 19–57. doi:10.1016/j.jsp.2012.11.001 Google Scholar | Crossref | Medline | ISI | |
|
Cohen, J., Cohen, P., West, S. G., Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Mahwah, NJ: Lawrence Erlbaum. Google Scholar | |
|
Fox, J. (2002). Robust regression: Appendix to an R and S-PLUS companion to applied regression. Retrieved from http://cran.r-project.org/doc/contrib/Fox-Companion/appendix-robust-regression.pdf Google Scholar | |
|
Fuchs, D., Fuchs, L. S. (2006). Introduction to response to intervention: What, why, and how valid is it? Reading Research Quarterly, 41, 93–99. doi:10.1598/rrq.41.1.4 Google Scholar | Crossref | ISI | |
|
Good, R. H., Shinn, M. R. (1990). Forecasting accuracy of slope estimates for reading curriculum-based measurement: Empirical evidence. Behavioral Assessment, 12, 179–193. Google Scholar | |
|
Hosp, M. K., Hosp, J. L., Howell, K. W. (2006). The ABCs of CBM: A practical guide to curriculum-based measurement. New York, NY: Guilford Press. Google Scholar | |
|
Huber, P. J. (1973). Robust regression: Asymptotics, conjectures and Monte Carlo. The Annals of Statistics, 1, 799–821. Google Scholar | Crossref | ISI | |
|
Jenkins, J. R., Graff, J. J., Miglioretti, D. L. (2009). Estimating reading growth using intermittent CBM progress monitoring. Exceptional Children, 75, 151–163. Google Scholar | SAGE Journals | ISI | |
|
Koller, M., Stahel, W. A. (2011). Sharpening Wald-type inference in robust regression for small samples. Computational Statistics & Data Analysis, 55, 2504–2515. Google Scholar | Crossref | ISI | |
|
Parker, R., Tindal, G., Stein, S. (1992). Estimating trend in progress monitoring data: A comparison of simple line-fitting methods. School Psychology Review, 21, 300–312. Google Scholar | ISI | |
|
R Core Team . (2014). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Available from http://www.R-project.org Google Scholar | |
|
Rousseeuw, P., Croux, C., Todorov, V., Ruckstuhl, A., Salibian-Barrera, M., Verbeke, T., . . . Maechler, M. (2012). robustbase: Basic robust statistics (R package version 0.9-1). Retrieved from http://CRAN.R-project.org/package=robustbase Google Scholar | |
|
Shapiro, E. S. (2011). Academic skills problems: Direct assessment and intervention (4th ed.). New York, NY: Guilford Press. Google Scholar | |
|
Shinn, M. R., Good, R. H., Stein, S. (1989). Summarizing trend in student achievement: A comparison of methods. School Psychology Review, 18, 356–370. Google Scholar | ISI | |
|
Van Norman, E. R., Nelson, P. M., Christ, T. J. (2013, February). Visual analysis of time series data: Obstacles and solutions. Paper presented at the meeting of the National Association of School Psychologists, Seattle, WA. Google Scholar | |
|
Van Norman, E. R., Nelson, P. M., Shin, J., Christ, T. J. (2013). An evaluation of the effects of graphic aids in improving decision accuracy in a continuous treatment design. Journal of Behavioral Education, 22, 283–301. doi:10.1007/s10864-013-9176-2 Google Scholar | Crossref | |
|
Venables, W. N., Ripley, B. D. (2002). Modern applied statistics with S (4th ed.). New York, NY: Springer. Google Scholar | Crossref | |
|
Wilcox, R. R. (2010). Fundamentals of modern statistical methods: Substantially improving power and accuracy (2nd ed.). New York, NY: Springer. Google Scholar | Crossref |
