![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
Receiver operating characteristic curve (ROC) analysis was used to investigate the ability of early numeracy curriculum-based measures (EN-CBM) administered in preschool to predict performance below the 25th and 40th percentiles on a quantity discrimination measure in kindergarten. Areas under the curve derived from a sample of 279 students ranged from .65 to .82. Optimal cut scores were associated with sensitivity ranging from .44 to .79, specificity ranging from .49 to .91, and classification accuracy ranging from .60 to .79. Among a validation sample of 140 students, sensitivity ranged from .36 to .83, specificity ranged from .46 to .89, and classification accuracy ranged from .57 to .79. Results indicate that EN-CBM administered in preschool predicts math performance in kindergarten and can be a valuable component of an evidence-based decision-making process.
Keywords early numeracy, curriculum-based measurement
References
Section:
|
Baglici, S. P., Codding, R., Tryon, G. (2010). Extending the research on the Tests of Early Numeracy: Longitudinal analyses over two school years. Assessment for Effective Intervention, 35, 89–102. doi:10.1177/1534508409346053 Google Scholar | SAGE Journals | |
|
Barnett, D. W., VanDerHeyden, A. M., Witt, J. C. (2007). Achieving science-based practice through response to intervention: What it might look like in preschools. Journal of Educational and Psychological Consultation, 17, 31–54. doi:10.1080/10474410709336589 Google Scholar | Crossref | ISI | |
|
Betts, J., Pickart, M., Heistad, D. (2009). Construct and predictive validity evidence for curriculum-based measures of early literacy and numeracy skills in kindergarten. Journal of Psychoeducational Assessment, 27, 83–95. doi:10.1177/0734282908323398 Google Scholar | SAGE Journals | ISI | |
|
Black, P., Wiliam, D. (1998). Inside the black box: Raising standards through classroom assessment. Phi Delta Kappan, 80, 139–144. Google Scholar | ISI | |
|
Chard, D. J., Clarke, B., Baker, S., Otterstedt, J., Braun, D., Katz, R. (2005). Using measures of number sense to screen for difficulties in mathematics: Preliminary findings. Assessment for Effective Intervention, 30, 3–14. doi:10.1177/073724770503000202 Google Scholar | Crossref | |
|
Clarke, B., Baker, S., Smolkowski, K., Chard, D. J. (2008). An analysis of early numeracy curriculum-based measurement: Examining the role of growth in student outcomes. Remedial and Special Education, 29, 46–57. doi:10.1177/0741932507309694 Google Scholar | SAGE Journals | ISI | |
|
Clarke, B., Nese, J. F. T., Alonzo, J., Smith, J. L. M., Tindal, G., Kame’enui, E. J., Baker, S. K. (2011). Classification accuracy of easyCBM first-grade mathematics measures: Findings and implications for the field. Assessment for Effective Intervention, 36, 243–255. doi:10.1177/1534508411414153 Google Scholar | SAGE Journals | |
|
Clarke, B., Shinn, M. R. (2002). Test of Early Numeracy (TEN): Administration and scoring of AIMSweb early numeracy measures for use with AIMSweb. Eden Prairie, MN: AIMSweb. Google Scholar | |
|
Clarke, B., Shinn, M. R. (2004). A preliminary investigation into the identification and development of early mathematics curriculum-based measurement. School Psychology Review, 33, 234–248. Google Scholar | ISI | |
|
Clements, D. H., Sarama, J. (2009). Learning and teaching early math: The learning trajectories approach. New York, NY: Routledge. Google Scholar | |
|
Compton, D. L., Fuchs, D., Fuchs, L. S., Bryant, J. D. (2006). Selecting at-risk readers in first grade for early intervention: A two-year longitudinal study of decision rules and procedures. Journal of Educational Psychology, 98, 394–409. doi:10.1037/0022-0663.98.2.394 Google Scholar | Crossref | ISI | |
|
Duncan, G. J., Dowsett, C. J., Claessens, A., Magnuson, K., Huston, A. C., Klebanov, P., . . . Japel, C. (2007). School readiness and later achievement. Developmental Psychology, 43, 1428–1446. doi:10.1037/0012-1649.43.6.1428 Google Scholar | Crossref | Medline | ISI | |
|
Floyd, R. G., Hojnoski, R., Key, J. (2006). Preliminary evidence of the technical adequacy of the preschool numeracy indicators. School Psychology Review, 35, 627–644. Google Scholar | ISI | |
|
Foegen, A., Jiban, C., Deno, S. (2007). Progress monitoring measures in mathematics: A review of the literature. The Journal of Special Education, 41, 121–139. doi:10.1177/00224669070410020101 Google Scholar | SAGE Journals | ISI | |
|
Fuchs, L. S., Fuchs, D., Compton, D. L., Bryant, J. D., Hamlett, C. L., Seethaler, P. M. (2007). Mathematics screening and progress monitoring at first grade: Implications for responsiveness to intervention. Exceptional Children, 73, 311–330. Google Scholar | SAGE Journals | ISI | |
|
Gersten, R., Chard, D. (1999). Number sense: Rethinking arithmetic instruction for students with mathematical disabilities. The Journal of Special Education, 33, 18–28. doi:10.1177/002246699903300102 Google Scholar | SAGE Journals | ISI | |
|
Ginsburg, H., Baroody, A. (2003). Test of early mathematics ability: Third edition. Austin, TX: Pro-Ed. Google Scholar | |
|
Greenwood, C. R., Carta, J. J., McConnell, S. (2011). Advances in measurement for universal screening and individual progress monitoring of young children. Journal of Early Intervention, 33, 254–267. doi:10.1177/1053815111428467 Google Scholar | SAGE Journals | ISI | |
|
Greenwood, C. R., Carta, J. J., Walker, D., Hughes, K., Weathers, M. (2006). Preliminary investigations of the application of the Early Communication Indicator (ECI) for infants and toddlers. Journal of Early Intervention, 28, 178–196. doi:10.1177/105381510602800306 Google Scholar | SAGE Journals | ISI | |
|
Greenwood, C. R., Walker, D., Buzhardt, J. (2010). The early communication indicator for infants and toddlers: Early Head Start growth norms from two states. Journal of Early Intervention, 32, 310–334. doi:10.1177/1053815110392335 Google Scholar | SAGE Journals | ISI | |
|
Hanley, J. A., McNeil, B. J. (1982). The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology, 143, 29–36. Google Scholar | Crossref | Medline | ISI | |
|
Hintze, J. M., Ryan, A. L., Stoner, G. (2003). Concurrent validity and diagnostic accuracy of the Dynamic Indicators of Basic Early Literacy Skills and the Comprehensive Test of Phonological Processing. School Psychology Review, 32, 541–556. Google Scholar | ISI | |
|
Hintze, J. M., Silberglitt, B. (2005). A longitudinal examination of the diagnostic accuracy and predictive validity of R-CBM and high-stakes testing. School Psychology Review, 34, 372–386. Google Scholar | ISI | |
|
Hojnoski, R. L., Floyd, R. G. (2013). Individual growth and development indicators of early numeracy (IGDIs-EN). Minneapolis, MN: Early Learning Labs. Available from http://www.myigdis.com Google Scholar | |
|
Hojnoski, R. L., Silberglitt, B., Floyd, R. G. (2009). Sensitivity to growth over time of the preschool numeracy indicators with a sample of preschoolers in head start. School Psychology Review, 38, 402–418. Google Scholar | ISI | |
|
Howell, S. C., Kemp, C. R. (2010). Assessing preschool number sense: Skills demonstrated by children prior to school entry. Educational Psychology, 30, 411–429. doi:10.1080/01443411003695410 Google Scholar | Crossref | ISI | |
|
IBM Corp . (2013). IBM SPSS Statistics for Windows (Version 22.0). Armonk, NY: Author. Google Scholar | |
|
Jenkins, J. R., Hudson, R. F., Johnson, E. S. (2007). Screening for at-risk readers in a response to intervention framework. School Psychology Review, 36, 582–600. Google Scholar | ISI | |
|
Johnson, E. S., Jenkins, J. R., Petscher, Y. (2010). Improving the accuracy of a direct route screening process. Assessment for Effective Intervention, 35, 131–140. doi:10.1177/1534508409348375. Google Scholar | SAGE Journals | |
|
Jordan, N. C., Kaplan, D., Ramineni, C., Locuniak, M. N. (2009). Early math matters: Kindergarten number competence and later mathematics outcomes. Developmental Psychology, 45, 850–867. doi:10.1037/a0014939 Google Scholar | Crossref | Medline | ISI | |
|
Kettler, R. J., Albers, C. A. (2013). Predictive validity of curriculum-based measurement and teacher ratings of academic achievement. Journal of School Psychology, 51, 499–515. doi:10.1016/j.jsp.2013.02.004 Google Scholar | Crossref | Medline | ISI | |
|
Lei, P., Wu, Q., DiPerna, J. C., Morgan, P. L. (2009). Developing short forms of the EARLI numeracy measures: Comparison of item selection methods. Educational and Psychological Measurement, 69, 825–842. doi:10.1177/0013164409332215 Google Scholar | SAGE Journals | ISI | |
|
Lembke, E., Foegen, A. (2009). Identifying early numeracy indicators for kindergarten and first-grade students. Learning Disabilities Research & Practice, 24, 12–20. doi:10.1111/j.1540-5826.2008.01273.x Google Scholar | Crossref | |
|
McConnell, S., Bradfield, T., Wackerle-Hollman, A., Rodriguez, M. (2012). Individual growth and development indicators of early literacy (IGDIs-EL) (2nd ed.). St. Paul, MN: Early Learning Labs. Google Scholar | |
|
McFall, R. M., Treat, T. A. (1999). Quantifying the information value of clinical assessments with signal detection theory. Annual Review of Psychology, 50, 215–241. doi:10.1146/annurev.psych.50.1.215 Google Scholar | Crossref | Medline | ISI | |
|
Methe, S. A., Begeny, J. C., Leary, L. L. (2011). Development of conceptually focused early numeracy skill indicators. Assessment for Effective Intervention, 36, 230–242. doi:10.1177/1534508411414150 Google Scholar | SAGE Journals | |
|
Methe, S. A., Hintze, J. M., Floyd, R. G. (2008). Validation and decision accuracy of early numeracy skill indicators. School Psychology Review, 37, 359–373. Google Scholar | ISI | |
|
Methe, S. A., Hojnoski, R., Clarke, B., Owens, B. B., Lilley, P. K., Politylo, B. C., . . . Marcotte, A. M. (2011). Innovations and future directions for early numeracy curriculum-based measurement: Commentary on the special series. Assessment for Effective Intervention, 36, 200–209. doi:10.1177/1534508411414154 Google Scholar | SAGE Journals | |
|
Missall, K. N., Mercer, S. H., Martinez, R. S., Casebeer, D. (2012). Concurrent and longitudinal patterns and trends in performance on early numeracy curriculum-based measures in kindergarten through third grade. Assessment for Effective Intervention, 37, 95–106. doi:10.1177/1534508411430322 Google Scholar | SAGE Journals | |
|
National Mathematics Advisory Panel . (2008). Foundations for success: The final report of the National Mathematics Advisory Panel. Washington, DC: U.S. Department of Education. Google Scholar | |
|
Obuchowski, N. A. (2005). Fundamentals of clinical research for radiologists: ROC analysis. American Journal of Roentgenology, 184, 364–372. doi:10.2214/ajr.184.2.01840364 Google Scholar | Crossref | Medline | ISI | |
|
Polignano, J. C., Hojnoski, R. L. (2012). Preliminary evidence of the technical adequacy of additional curriculum-based measures for preschool mathematics. Assessment for Effective Intervention, 37, 70–83. doi:10.1177/1534508411430323 Google Scholar | SAGE Journals | |
|
Purpura, D. J., Hume, L. E., Sims, D. M., Lonigan, C. J. (2011). Early literacy and early numeracy: The value of including early literacy skills in the prediction of numeracy development. Journal of Experimental Child Psychology, 110, 647–658. doi:10.1016/j.jecp.2011.07.004 Google Scholar | Crossref | Medline | ISI | |
|
Purpura, D. J., Reid, E. E., Eiland, M. D., Baroody, A. J. (2015). Using a brief preschool early numeracy skills screener to identify young children with mathematics difficulties. School Psychology Review, 44, 41–59. Google Scholar | Crossref | ISI | |
|
Reid, E. E., Morgan, P. L., DiPerna, J. C., Lei, P. W. (2006). Development of measures to assess young children’s early academic skills: Preliminary findings from a Head Start-university partnership. Insights on Learning Disabilities, 3(2), 25–38. Google Scholar | |
|
Speece, D., Mills, C., Ritchey, K., Hillman, E. (2003). Initial evidence that letter fluency tasks are valid indicators of early reading skill. The Journal of Special Education, 36, 223–233. doi:10.1177/002246690303600403 Google Scholar | SAGE Journals | ISI | |
|
VanDerHeyden, A. M., Broussard, C., Cooley, A. (2006). Further development of measures of early math performance for preschoolers. Journal of School Psychology, 44, 533–553. doi:10.1016/j.jsp.2006.07.003 Google Scholar | Crossref | ISI | |
|
VanDerHeyden, A. M., Broussard, C., Fabre, M., Stanley, J., Legendre, J., Creppell, R. (2004). Development and validation of curriculum-based measures of math performance for preschool children. Journal of Early Intervention, 27, 27–41. doi:10.1177/105381510402700103 Google Scholar | SAGE Journals | ISI | |
|
VanDerHeyden, A. M., Snyder, P. (2006). Integrating frameworks from early childhood intervention and school psychology to accelerate growth for all young children. School Psychology Review, 35, 519–534. Google Scholar | ISI | |
|
Woodcock, R. W., Johnson, M. B. (1989). Woodcock Johnson Psychoeducational Battery-Revised. Allen, TX: DLM Teaching Resources. Google Scholar | |
|
Woodcock, R. W., McGrew, K. S., Mather, N. (2001). Woodcock-Johnson III tests of achievement. Itasca, IL: Riverside. Google Scholar | |
|
Wu, Q., Lei, P., DiPerna, J. C., Morgan, P. L., Reid, E. E. (2015). Identifying differences in early mathematical skills among children in Head Start. International Journal of Science and Mathematics Education, 13, 1403–1423. doi:10.1007/s10763-014-9552-y Google Scholar | Crossref | ISI | |
|
Youngstrom, E. A. (2014). A primer on receiver operating characteristic analysis and diagnostic efficiency statistics for pediatric psychology: We are ready to ROC. Journal of Pediatric Psychology, 39, 204–221. doi:10.1093/jpepsy/jst062 Google Scholar | Crossref | Medline | ISI |
