![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
We used existing reading (n = 1,498) and math (n = 2,260) data to evaluate state test scores for screening middle school students. In Phase 1, state test data were used to create a research-derived cut score that was optimal for predicting state test performance the following year. In Phase 2, those cut scores were applied with future cohorts. Diagnostic accuracy of the research-derived cut scores was compared with the state’s proficiency benchmark from the previous year. Across grades and content areas, research-derived cut scores yielded higher sensitivity and lower specificity values relative to state-defined cut scores. Marked decreases in sensitivity and specificity were not observed in subsequent years. Results provide evidence for procedures in which previous state test data are repurposed for screening decisions.
Keywords universal screening, math, reading
References
Section:
|
Akobeng, A. K. (2007). Understanding diagnostic tests 2: Likelihood ratios, pre-and post-test probabilities and their use in clinical practice. Acta Paedriatrica, 96, 487-491. Google Scholar | Crossref | Medline | ISI | |
|
Fuchs, L. S., Fuchs, D., Compton, D. L. (2010). Rethinking response to intervention at middle and high school. School Psychology Review, 39, 22-28. Google Scholar | ISI | |
|
Glover, T. A., Albers, C. A. (2007). Considerations for evaluating universal screening assessments. Journal of School Psychology, 45, 117-135. Google Scholar | Crossref | ISI | |
|
Hosmer, D. W., Lemeshow, S., Sturdivant, R. X. (2013). Applied logistic regression (Vol. 398). Hoboken, New Jersey: John Wiley & Sons. Google Scholar | Crossref | |
|
Jenkins, J. R., Hudson, R. F., Johnson, E. S. (2007). Screening for at-risk readers in a response to intervention framework. School Psychology Review, 36, 582-600. Google Scholar | ISI | |
|
Keller-Margulis, M. A., Shapiro, E. S., Hintze, J. M. (2008). Long-term diagnostic accuracy of curriculum-based measures in reading and mathematics. School Psychology Review, 37, 374-390. Google Scholar | ISI | |
|
Kettler, J., Glover, T. A., Albers, A., Feeney-Kettler, K. A. (2014). Universal screening in educational settings: Evidence-based decision making for schools. School psychology book series. Washington, DC: American Psychological Association. doi:10.1037/14316-001 Google Scholar | Crossref | |
|
Kilgus, S. P., Methe, S. A., Maggin, D. M., Tomasula, J. L. (2014). Curriculum-based measurement of oral reading (R-CBM): A diagnostic test accuracy meta-analysis of evidence supporting use in universal screening. Journal of School Psychology, 52, 377-405. Google Scholar | Crossref | Medline | ISI | |
|
Kovaleski, J. F., VanDerHeyden, A. M., Shapiro, E. S. (2013). The RTI approach to evaluating learning disabilities. New York, NY: Guilford. Google Scholar | |
|
Lopez-Raton, M., Rodriguez-Alvarez, M. X., Cadarso-Suarez, C., Gude-Sampedro, F. (2014). OptimalCutpoints: An R Package for Selecting Optimal Cutpoints in Diagnostic Tests. Journal of Statistical Software, 61, 1-36. Google Scholar | Crossref | ISI | |
|
Mellard, D. F., McKnight, M., Woods, K. (2009). Response to intervention screening and progress-monitoring practices in 41 local schools. Learning Disabilities Research & Practice, 24, 186-195. Google Scholar | Crossref | |
|
Minnesota Department of Education . (2013). Minnesota Comprehensive Assessments Summer 2013 Standard Setting Technical Report. Retrieved from http://education.state.mn.us/MDE/SchSup/TestAdmin/MNTests/TechRep/ Google Scholar | |
|
Minnesota Department of Education . (2014). 2013-2014 Technical Manual for Minnesota’s Title I and Title III Assessments. Retrieved from http://education.state.mn.us/MDE/SchSup/TestAdmin/MNTests/TechRep/ Google Scholar | |
|
Nelson, P.M., Van Norman, E.R., Lackner, S. (2016). Comparison of methods to screen middle school students for reading and math difficulties. School Psychology Review, 45(1). Google Scholar | Medline | ISI | |
|
Peng, C. Y. J., So, T. S. H. (2002). Logistic regression analysis and reporting: A primer. Understanding Statistics: Statistical Issues in Psychology, Education, and the Social Sciences, 1, 31-70. Google Scholar | |
|
Pyle, N., Vaughn, S. (2012). Remediating reading difficulties in a response to intervention model with secondary students. Psychology in the Schools, 49, 273-284. doi:10.1002/pits.21593 Google Scholar | Crossref | Medline | ISI | |
|
Renaissance Learning . (2014). STAR Math: Technical manual. Wisconsin Rapids: Author. Google Scholar | |
|
VanDerHeyden, A. M. (2011). Technical adequacy of response to intervention decisions. Exceptional Children, 77, 335-350. Google Scholar | SAGE Journals | ISI | |
|
VanDerHeyden, A. M. (2013). Universal screening may not be for everyone: Using a threshold model as a smarter way to determine risk. School Psychology Review, 42, 402-414. Google Scholar | ISI | |
|
Vaughn, S., Solís, M., Miciak, J., Taylor, W. P., Fletcher, J. M. (2015). Effects from a randomized control trial comparing researcher and school implemented treatments with fourth graders with significant reading difficulties. Journal of Research on Educational Effectiveness. Advanced online publication. doi: 10.1080/19345747.2015.1126386 Google Scholar | Crossref | Medline | ISI |
