Abstract
Despite research demonstrating the importance of language comprehension to later reading abilities, curriculum-based measures to assess language comprehension abilities in preschoolers remain lacking. The Assessment of Story Comprehension (ASC) features brief, child-relevant stories and a series of literal and inferential questions with a focus on causal and predictive inference skills surrounding the main story grammar components and a novel vocabulary word. Following an overview of the iterative development process and pilot studies, this article presents preliminary evidence of the fidelity of administration, reliability of scoring, alternate form reliability, and validity of the ASC. In all, 237 preschoolers, ages 3 to 5 years old, participated in this study. Fidelity of administration and scoring reliability averaged over 90%. Concurrent validity with two established language measures revealed correlations ranging from .67 to .81. Test–retest reliability and internal consistency also indicated high levels of reliability for this new tool; however, alternate form reliability results suggest further work is needed. Preliminary results indicate that the ASC holds promise as a viable curriculum-based measure that early childhood educators can use for monitoring preschoolers’ progress in language comprehension.
|
Bagnato, S. J., Neisworth, J. T. (2005). Recommended practices in assessment. In Sandall, S., McLean, M. E., Smith, B. J. (Eds.), DEC recommended practices in early intervention/early childhood special education (pp. 17–28). Longmont, CO: Sopris West. Google Scholar | |
|
Bailet, L. L., Repper, K., Murphy, S., Piasta, S., Zettler-Greeley, C. (2013). Emergent literacy intervention for prekindergarteners at risk for reading failure: Years 2 and 3 of a multiyear study. Journal of Learning Disabilities, 46, 133–153. doi:10.1177/0022219411407925 Google Scholar | SAGE Journals | ISI | |
|
Bishop, D. V. M., Adams, C. (1992). Comprehension problems in children with specific language impairment: Literal and inferential meaning. Journal of Speech and Hearing Research, 35, 119–129. doi:10.1044/jshr.3501.119 Google Scholar | Crossref | Medline | |
|
Bishop, D. V. M., Edmundson, A. (1987). Language impaired 4-year-olds: Distinguishing transient from persistent impairment. Journal of Speech and Hearing Disorders, 52, 156–173. doi:10.1044/jshd.5202.156 Google Scholar | Crossref | Medline | |
|
Blank, M., Rose, S. A., Berlin, L. J. (2003). Preschool language assessment instrument (2nd ed.). Austin, TX: Pro-Ed. Google Scholar | |
|
Bradfield, T. A., Besner, A. C., Wackerle-Hollman, A. K., Albano, A. D., Rodriguez, M. C., McConnell, S. R. (2014). Redefining individual growth and development indicators: Oral language. Assessment for Effective Intervention, 39, 233–244. doi:10.1177/1534508413496837 Google Scholar | SAGE Journals | |
|
Cain, K., Oakhill, J. V. (1999). Inference making ability and its relation to comprehension failure in young children. Reading and Writing, 11, 489–503. doi:10.1023/A:1008084120205 Google Scholar | Crossref | |
|
Cain, K., Oakhill, J. V., Barnes, M. A., Bryant, P. E. (2001). Comprehension skill, inference-making ability, and their relation to knowledge. Memory & Cognition, 29, 850–859. doi:10.3758/BF03196414 Google Scholar | Crossref | Medline | ISI | |
|
Cain, K., Oakhill, J. V., Elbro, C. (2003). The ability to learn new word meanings from context by school-age children with and without language comprehension difficulties. Journal of Child Language, 30, 681–694. Google Scholar | Crossref | Medline | ISI | |
|
Cain, K., Oakhill, J. V., Lemmon, K. (2004). Individual differences in the inference of word meanings from context: The influence of reading comprehension, vocabulary knowledge, and memory capacity. Journal of Educational Psychology, 96, 671–681. doi:10.1037/0022-0663.96.4.671 Google Scholar | Crossref | ISI | |
|
Catts, H. W., Fey, M. E., Tomblin, J. B., Zhang, X. (2002). A longitudinal investigation of reading outcomes in children with language impairments. Journal of Speech, Language, and Hearing Research, 45, 1142–1157. doi:10.1044/1092-4388(2002/093) Google Scholar | Crossref | Medline | ISI | |
|
Christ, T. J., Zopluoglu, C., Long, J. D., Monaghen, B. D. (2012). Curriculum-based measurement of reading: Quality of progress monitoring outcomes. Exceptional Children, 78, 356–373. doi:10.1177/001440291207800306 Google Scholar | SAGE Journals | |
|
Cunningham, A. E., Stanovich, K. E. (1997). Early reading acquisition and its relation to reading experience and ability 10 years later. Developmental Psychology, 33, 934–945. Google Scholar | Crossref | Medline | ISI | |
|
Daneman, M., Green, I. (1986). Individual differences in comprehending and producing words in context. Journal of Memory and Language, 25, 1–18. Google Scholar | Crossref | ISI | |
|
Deno, S. L. (2003). Developments in curriculum-based measurement. The Journal of Special Education, 37, 184–192. doi:10.1177/00224669030370030801 Google Scholar | SAGE Journals | ISI | |
|
Deno, S. L., Mirkin, P. K., Chiang, B. (1982). Identifying valid measures of reading. Exceptional Children, 49, 36–45. Google Scholar | Medline | ISI | |
|
Diamond, K. E., Powell, D. R. (2011). An iterative approach to the development of a professional development intervention for Head Start teachers. Journal of Early Intervention, 33, 75–93. doi:10.1177/1053815111400416 Google Scholar | SAGE Journals | ISI | |
|
Dickinson, D. K., Golinkoff, R. M., Hirsh-Pasek, K. (2010). Speaking out for language: Why language is central to reading development. Educational Researcher, 39, 305–310. doi:10.3102/0013189X10370204 Google Scholar | SAGE Journals | ISI | |
|
Dickinson, D. K., McCabe, A. (2001). Bringing it all together: The multiple origins, skills, and environmental supports of early literacy. Learning Disabilities Research & Practice, 16, 186–202. Google Scholar | Crossref | |
|
Dooley, C. M., Matthews, M. W. (2009). Emergent comprehension: Understanding comprehension development among young literacy learners. Journal of Early Childhood Literacy, 9, 269–294. doi:10.1177/1468798409345110 Google Scholar | SAGE Journals | |
|
Fazio, B. B., Naremore, R. C., Connell, P. J. (1996). Tracking children from poverty at risk for specific language impairment: A 3-year longitudinal study. Journal of Speech, Language and Hearing Research, 39, 611–624. doi:10.1044/jshr.3903.611 Google Scholar | Crossref | |
|
Feagans, L., Appelbaum, M. I. (1986). Validation of language subtypes in learning disabled children. Journal of Experimental Psychology, 78, 358–364. doi:10.1037/0022-0663.78.5.358 Google Scholar | Crossref | |
|
Foegen, A., Jiban, C., Deno, S. (2007). Progress monitoring measures in mathematics: A review of the literature. The Journal of Special Education, 41, 121–139. doi:10.1177/00224669070410020101 Google Scholar | SAGE Journals | ISI | |
|
Ford, J. A., Milsoky, L. M. (2003). Inferring emotional reactions in social situations: Differences in children with language impairment. Journal of Speech, Language, and Hearing Research, 46, 21–30. doi:10.1044/1092-4388(2003/002) Google Scholar | Crossref | Medline | ISI | |
|
Fuchs, L. S., Deno, S. L., Mirkin, P. K. (1984). The effects of frequent curriculum-based measurement and evaluation on pedagogy, student achievement, and student awareness of learning. American Educational Research Journal, 21, 449–460. doi:10.3102/00028312021002449 Google Scholar | SAGE Journals | ISI | |
|
Fuchs, L. S., Fuchs, D. (2007). A model for implementing responsiveness to intervention. Teaching Exceptional Children, 39(5), 14–20. doi:10.1177/004005990703900503 Google Scholar | SAGE Journals | |
|
Fuchs, L. S., Fuchs, D., Hamlett, C. L., Phillips, N. B. (1994). Classwide curriculum-based instruction: Helping general educators meet the challenge of student diversity. Exceptional Children, 60, 518–537. doi:10.1177/001440299406000605 Google Scholar | SAGE Journals | |
|
Gough, P. B., Tunmer, W. E. (1986). Decoding, reading, and reading disability. Remedial and Special Education, 7, 6–10. doi:10.1177/074193258600700104 Google Scholar | SAGE Journals | |
|
Greenwood, C. R., Bradfield, T., Kaminski, R., Linas, M., Carta, J. J., Nylander, D. (2011). The Response to Intervention (RTI) approach in early childhood. Focus on Exceptional Children, 43(9), 1–22. Google Scholar | Crossref | |
|
Greenwood, C. R., Carta, J. J., Atwater, J., Goldstein, H., Kaminski, R., McConnell, S. (2013). Is a Response to Intervention (RTI) approach to preschool language and early literacy instruction needed? Topics in Early Childhood Special Education, 33, 48–64. doi:10.1177/0271121412455438 Google Scholar | SAGE Journals | ISI | |
|
Griffin, T. M., Hemphill, L., Camp, L., Wolf, D. P. (2004). Oral discourse in the preschool years and later literacy skills. First Language, 24, 123–147. doi:10.1177/0142723704042369 Google Scholar | SAGE Journals | |
|
Haager, D. E., Klingner, J. E., Vaughn, S. E. (Eds.). (2007). Evidence-based reading practices for response to intervention. Baltimore, MD: Paul H. Brooks. Google Scholar | |
|
Hammett, L. A., Van Kleeck, A., Huberty, C. J. (2003). Patterns of parents’ extratextual interactions during book sharing with preschool children: A cluster analysis study. Reading Research Quarterly, 38, 442–468. doi:10.1598/RRQ.38.4.2 Google Scholar | Crossref | ISI | |
|
Hargrave, A. C., Sénéchal, M. (2000). A book reading intervention with preschool children who have limited vocabularies: The benefits of regular reading and dialogic reading. Early Childhood Research Quarterly, 15, 75–90. doi:10.1016/S0885-2006(99)00038-1 Google Scholar | Crossref | ISI | |
|
Hoover, W. A., Gough, P. B. (1990). The simple view of reading. Reading and Writing, 2, 127–160. Google Scholar | Crossref | ISI | |
|
Hurry, J., Sylva, K. (2007). Long-term outcomes of early reading intervention. Journal of Research in Reading, 30, 227–248. doi:10.1111/j.1467-9817.2007.00338.x Google Scholar | Crossref | |
|
Kelley, E. S., Goldstein, H., Spencer, T. D., Sherman, A. (2015). Effects of automated Tier 2 storybook intervention on vocabulary and comprehension intervention for preschool children with limited oral language skills. Early Childhood Research Quarterly, 31, 47–61. Google Scholar | Crossref | |
|
Kendeou, P., Bohn-Gettler, C., White, M. J., Van Den Broek, P. (2008). Children’s inference generation across different media. Journal of Research in Reading, 31, 259–272. Google Scholar | Crossref | ISI | |
|
Kern, L., Evans, S., Lewis, T. J. (2011). Description of an iterative process for intervention development. Education and Treatment of Children, 34, 593–617. doi:10.1353/etc.2011.0037 Google Scholar | Crossref | |
|
Koutsoftas, A. D., Harmon, M. T., Gray, S. (2009). The effect of Tier 2 intervention for phonemic awareness in a response-to-intervention model in low-income preschool classrooms. Language, Speech, and Hearing Services in Schools, 40, 116–130. doi:10.1044/0161-1461(2008/07-0101) Google Scholar | Crossref | Medline | ISI | |
|
Lepola, J., Lynch, J., Laakkonen, E., Silvén, M., Niemi, P. (2012). The role of inference making and other language skills in the development of narrative listening comprehension in 4-6-year-old children. Reading Research Quarterly, 47, 259–282. Google Scholar | Crossref | |
|
McMaster, K., Espin, C. (2007). Technical features of curriculum-based measurement in writing a literature review. The Journal of Special Education, 41, 68–84. doi:10.1177/00224669070410020301 Google Scholar | SAGE Journals | |
|
Missall, K. N., McConnell, S. R. (2004). Psychometric characteristics of individual growth and development indicators: Picture naming, rhyming & alliteration (Technical report). Minneapolis, MN: Center for Early Education and Development. Google Scholar | |
|
National Center for Education Statistics . (2015). Reading assessment. Washington, DC: National Center for Education Statistics, Institute of Education Sciences, U.S. Department of Education. Retrieved from http://nces.ed.gov/nationsreportcard/reading Google Scholar | |
|
Nippold, M. A. (2002). Lexical learning in school-age children, adolescents, and adults: A process where language and literacy converge. Journal of Child Language, 29, 474–478. doi:10.1017/S0305000902275340 Google Scholar | Crossref | Medline | |
|
Paris, A. H., Paris, S. G. (2003). Assessing narrative comprehension in young children. Reading Research Quarterly, 38, 36–76. doi:10.1598/RRQ.38.1.3 Google Scholar | Crossref | |
|
Petersen, D. B., Spencer, T. D. (2012). The narrative language measures: Tools for language screening, progress monitoring, and intervention planning. Perspectives on Language Learning and Education, 19(4), 119–129. doi:10.1044/lle19.4.119 Google Scholar | Crossref | |
|
Scarborough, H. S. (2001). Connecting early language and literacy to later reading (dis)abilities: Evidence, theory, and practice. In Neuman, S., Dickinson, D. (Eds.), Handbook for research in early literacy (pp. 97–110). New York, NY: Guilford Press. Google Scholar | |
|
Serpell, R., Baker, L., Sonnenschein, S. (2005). Becoming literate in the city: The Baltimore early childhood project. Oxford, UK: Cambridge University Press. Google Scholar | |
|
Spencer, E. J., Goldstein, H., Sherman, A., Noe, S., Tabbah, R., Ziolkowski, R., Schneider, N. (2012). Effects of an automated vocabulary and comprehension intervention: An early efficacy study. Journal of Early Intervention, 34, 195–221. Google Scholar | SAGE Journals | ISI | |
|
Spencer, T. D., Goldstein, H. (2011, July). The Assessment of Story Comprehension (ASC): A preliminary investigation of reliability and validity. In Piasta, S. (Chair), New measures for investigating emergent literacy environments and skill development. Symposium presented at the annual meeting of the Society for the Scientific Study of Reading, Fort Lauderdale, FL. Google Scholar | |
|
Spencer, T. D., Petersen, D. B. (2011). The test of narrative retell. Available from www.LanguageDynamicsGroup.com Google Scholar | |
|
Spencer, T. D., Petersen, D. B. (2016). Reliability and validity of the Narrative Language Measures. Unpublished manuscript. Google Scholar | |
|
Spencer, T. D., Petersen, D. B., Slocum, T. A., Allen, M. M. (2015). Large group narrative intervention in Head Start preschools: Implications for response to intervention. Journal of Early Childhood Research, 13, 196–217. Google Scholar | SAGE Journals | |
|
Spencer, T. D., Slocum, T. A. (2010). The effect of a narrative intervention on story retelling and personal story generation skills of preschoolers with risk factors and narrative language delays. Journal of Early Intervention, 32, 178–199. doi:10.1177/1053815110379124 Google Scholar | SAGE Journals | ISI | |
|
Storch, S. A., Whitehurst, G. J. (2002). Oral language and code-related precursors to reading: Evidence from a longitudinal structural model. Developmental Psychology, 38, 934–947. doi:10.1037/0012-1649.38.6.934 Google Scholar | Crossref | Medline | ISI | |
|
Tompkins, V., Guo, Y., Justice, L. M. (2013). Inference generation, story comprehension, and language skills in the preschool years. Reading and Writing, 26, 403–429. doi:10.1007/s11145-012-9374-7 Google Scholar | Crossref | |
|
Tunmer, W. E., Chapman, J. W. (2012). The simple view of reading redux: Vocabulary knowledge and the independent components hypothesis. Journal of Learning Disabilities, 45, 453–466. Google Scholar | SAGE Journals | ISI | |
|
Tunmer, W. E., Hoover, W. A. (1992). Cognitive and linguistic factors in learning to read. In Gough, P. B., Ehri, L. C., Treiman, R. (Eds.), Reading acquisition (pp. 175–214). Hillsdale, NJ: Lawrence Erlbaum. Google Scholar | |
|
Van den Broek, P. D., Kendeou, P., Kremer, K., Lynch, J., Butler, J., White, M. J., Lorch, E. P. (2005). Assessment of comprehension abilities in young children. In Paris, S. G., Stahl, S. A. (Eds.), Children’s reading comprehension and assessment (pp. 107–130). Mahwah, NJ: Lawrence Erlbaum. Google Scholar | |
|
VanDerHeyden, A. M., Snyder, P. A., Broussard, C., Ramsdell, K. (2008). Measuring response to early literacy intervention with preschoolers at risk. Topics in Early Childhood Special Education, 27, 232–249. doi:10.1177/0271121407311240 Google Scholar | SAGE Journals | |
|
van Kleeck, A . (2008). Providing preschool foundations for later reading comprehension: The importance of and ideas for targeting inferencing in storybook-sharing interventions. Psychology in the Schools, 45, 627–643. doi:10.1002/pits.20314 Google Scholar | Crossref | |
|
van Kleeck, A., Gillam, R. B., Hamilton, L., Cassandra, M. (1997). The relationship between middle-class parents’ book-sharing discussion and their preschoolers’ abstract language development. Journal of Speech, Language, and Hearing Research, 40, 1261–1271. doi:10.1044/jslhr.4006.1261 Google Scholar | Crossref | Medline | ISI | |
|
van Kleeck, A., Vander Woude, J., Hammett, L. (2006). Fostering literal and inferential language skills in Head Start preschoolers with language impairment using scripted book-sharing discussions. American Journal of Speech-Language Pathology, 15, 85–95. doi:10.1044/jslhr.4006.1261 Google Scholar | Crossref | Medline | |
|
Wackerle-Hollman, A. K., Rodriguez, M. I., Bradfield, T. A., Rodriguez, M. C., McConnell, S. R. (2014). Development of early measures of comprehension innovation in individual growth and development indicators. Assessment for Effective Intervention, 40, 81–95. doi:10.1177/1534508414551404 Google Scholar | SAGE Journals | |
|
Whitehurst, G. J., Arnold, D. S., Epstein, J. N., Angell, A. L., Smith, M., Fischel, J. E. (1994). A picture book reading intervention in day care and home for children from low-income families. Developmental Psychology, 30, 679–689. Google Scholar | Crossref | ISI | |
|
Whitehurst, G. J., Lonigan, C. J. (1998). Child development and emergent literacy. Child Development, 69, 848–872. doi:10.1111/j.1467-8624.1998.tb06247.x Google Scholar | Crossref | Medline | ISI | |
|
Wiig, E. H., Secord, W., Semel, E. M. (2004). Clinical evaluation of language fundamentals–preschool 2. San Antonio, TX: Psychological Corporation. Google Scholar | |
|
Zucker, T. A., Solari, E. J., Landry, S. H., Swank, P. R. (2013). Effects of a brief tiered language intervention for prekindergartners at risk. Early Education and Development, 24, 366–392. doi:10.1080/10409289.2012.664763 Google Scholar | Crossref | ISI |

