Educators, policymakers, families, and students find themselves in uncharted territory during the COVID-19 crisis. School districts in particular are on the front lines to help ensure that all students have access to academic materials, instruction, and digital resources, among other basic needs such as food for students from low-income backgrounds and support for students with disabilities, English learners, and students in temporary housing (
Education Trust, 2020a). Despite these efforts, a majority of parents with children in K–12 schools are concerned that their children have fallen behind academically due to the disruptions of COVID-19 school closures (
Horowitz, 2020). In this study, we produced a set of possible scenarios for learning loss rates during the extended period when schools were physically closed and students were not receiving normal face-to-face instruction. These projections can help prepare educators and parents for the degree of variability in student achievement to expect as school resumes, and over the course of this school year.
First, we show that, compared with a typical academic year, students will likely (a) not have grown as much during the truncated 2019–2020 academic year and (b) will likely lose more of those gains due to extended time out of school. Based on our COVID Slide projections, students who did not receive remote instruction in the spring would begin this fall with approximately 63% to 68% of the learning gains in reading relative to a typical school year and with 37% to 50% of the learning gains in mathematics. In some grades, students who did not have access to remote instruction may be starting this school year close to a full year behind in mathematics. Under the Partial Absenteeism scenario, where we assumed that students received approximately half of their typical instruction during the school closures, returning students would begin this fall with approximately 60% to 87% of their typical learning gains.
Second, we also examined variability in possible learning outcomes during the school closures and in the fall of 2020. We found that losing ground over the summer would not be universal, with the top third of students in reading making gains during a typical summer. As a result of this variability, we projected that the range of students’ academic achievement will be more spread out in the fall of 2020 relative to a normal fall term, particularly in reading. In presenting these projections, we assumed that the variability in typical summer loss can act as a proxy for the variability in learning that is expected during the COVID-19 school closures. In all likelihood, differential access to parent and teacher supports for learning during the school closure months produced greater variability than would be generated in a typical summer break.
Third, although some of the projections are dire, our models also suggest that students who lose the most while out of school would gain the most the following year (at least under typical summer loss conditions). Thus, there is hope that students most affected by the additional average achievement losses under COVID-19 may also be the ones who rebound the most by the end of the 2020–2021 academic school year. At the same time, one cannot be sure how financial uncertainty, health issues related to the virus, and psychological stresses may affect the association between summer loss and subsequent academic growth. Given the ongoing health crisis and the fact that many school districts are opening remotely for the fall 2020 semester, it is likely that the 2020–2021 school year will not resemble “business as usual.” Therefore, this finding should be taken with an abundance of caution.
Finally, we demonstrated that differential access to technology and remote instruction during the COVID-19 school closures could widen school SES achievement gaps. We found that under the COVID Slide scenario (where all students in both low- and high-SES schools are expected to show COVID Slide), achievement gaps would not significantly differ compared with a typical fall. A likely explanation for this result is that school SES did not appear to be strongly related to summer learning loss in most grades/subjects, so students in low-SES schools were not projected to show substantially larger COVID Slide on average than students in high-SES schools. However, when differential rates of access to instruction by school SES were accounted for in the projections, achievement gaps widened significantly in math and modestly in reading. Results included in the
online supplemental materials (available on the journal website) that accounted for differential likelihoods of exposure to parental unemployment by school SES indicate a more substantial widening of the achievement gap in both math and reading.
Limitations of Our Projections
While we provide three sets of projections in this study—one based on growth rates calculated from MAP Growth data and the other two based on prior literature on student absenteeism—we acknowledge that it is impossible to accurately weigh the complex range of supports and challenges that students are facing during this period. The school closures caused by COVID-19 have additional aspects of trauma to students, loss of resources, and loss of opportunity to learn that go well beyond a traditional summer break or individual school absence for many families. In other words, families with financial resources, stable employment, and flexible work from home and childcare arrangements will likely weather this storm more easily than families who are renting their housing, working in low-paying fields that are hardest hit by the economic impacts, and experiencing higher rates of food insecurity, family instability, and other shocks from this disruption. Furthermore, the summer of 2020 was very different from typical summers, with many summer camps and programs closed or held online only. As a result, we could be underestimating summer loss between the 2019–2020 and 2020–2021 school years in our projections by relying on data from a prior summer.
A major limitation of our study is that we do not differentially project the impact of COVID-19 on the basis of race. The COVID-19 pandemic simultaneously occurred alongside social unrest and protests about the mistreatment and killings of Black people by police. Moreover, there are higher rates of unemployment among Black households, and COVID-19 infection and death rates are higher in the Black communities than in the White communities (
Cerullo, 2020;
Krogstad et al., 2020). We decided against providing race-based projections due to a fundamental concern that we might understate just how significant the impact of COVID-19 will be on schooling and learning for Black communities.
There are three primary reasons why we worry that projections might understate the effects of COVID-19 on students of color. First, there is very little information at this stage about how COVID-19 is affecting students of color specifically that we could use as the basis for projections. Projecting SES-based gaps is possible because there are at least emergent data on how COVID-19 might differentially affect instruction on the basis of school SES (
Herold, 2020). For example, national teacher and principal surveys have provided insights on the rates of synchronous instruction, virtual attendance, and technology access disaggregated by school SES (see
Appendix Table A4 available on the
journal website). To our knowledge, there is no such national information disaggregated by student race/ethnicity.
Second, projecting race-based gaps would require knowledge of how factors like trauma and job loss would affect racial minority groups differentially. These heterogenous impacts are likely since there are higher rates of COVID-19 infections and deaths in the African American community (
Bouie, 2020). Furthermore, the economic downturn has been particularly damaging for Black and Hispanic parents, who are less likely to be able to work from home during the pandemic (
Cerullo, 2020;
Krogstad et al., 2020). Additionally, the trauma caused by police shootings of African Americans and the subsequent nationwide protests might themselves interact with any COVID-19-induced trauma to affect students’ achievement in complicated ways. Projecting these vital differences by race/ethnicity and their impact on achievement would have involved unwarranted conjecture.
Third, most research on summer loss found that race-based and SES-based achievement gaps do not typically grow much during the summer (
Kuhfeld et al., 2019;
von Hippel et al., 2018). Thus, an approach of using gaps in summer learning loss as the basis for any additional race- or SES-based projections could understate the effect of COVID-19 on achievement gaps in profound ways given how extended COVID-19-related school closures may fundamentally differ from typical summer closures. As
von Hippel (2020) has argued, parents with resources are not routinely using those resources to build their children’s math and reading advantage during a typical summer vacation, but during the pandemic, those same parents likely were channeling available resources to support student learning through accessing online learning materials, hiring tutors, or forming “learning pods” with other families (
Moyer, 2020). This unequal scenario is likely exacerbated by the so-called “digital divide” in technology and internet access by race/ethnicity and SES (
Musu, 2018), which contributes to greater inequalities during the COVID-19 pandemic than during a typical summer.
In short, forecasting is inherently speculative, and we feel that the question of how COVID-19 will affect race-based gaps is too important to speculate on given our current moment, especially since projections would have relied on more assumptions than the other projections in our study and summer loss may be a less appropriate model when examining race-based difference in achievement. When data are available for achievement in fall of 2020, estimating the effect of COVID-19 on those gaps should be a foremost priority.
Another limitation directly related to projections on the basis of race is that our SES-based projections may also be conservative. For example, while
Figure 3 shows that achievement gaps on the basis of SES may increase by a third for certain subjects and grades, our projections also indicate that gaps may not widen substantively in other subject-grade combinations. Our school SES projections could very well understate the magnitude of COVID-19’s impact on gaps because our forecasts could not adequately model factors unique to this moment like the trauma associated with illness and sudden job loss (though
Figure C2 in the
online supplemental materials, available on the journal website, attempts to factor in additional impacts of parental job loss). Furthermore, we are unable to account for the likely heterogeneity in the impacts of trauma that may lead to increased variability in student learning patterns, which likely implies that our projections are an underestimation of the impacts of COVID-19 on achievement variability. These limitations should be kept in mind as educators and policymakers take actions to address the potential impacts of COVID-19 on U.S. schools and school systems.
Beyond impacts on race and SES, there are also potential technical limitations that bear mention. In calculating the projected impact of out-of-school time on learning in this study, we assumed that it is appropriate to linearly extrapolate learning loss from research on absenteeism and summer loss across the 3 months of school closure. However, one could plausibly argue that impacts may actually be nonlinear.
Campbell and Frey (1970) hypothesize that forgetting learned material may occur nonlinearly, with rapid initial deceleration of knowledge followed by slower drop offs as time passes.
Liu et al. (2020) found that additional absences had an approximately linear impact on student learning, though the number of absences assumed in this study (approximately 60 school days) far exceeds the average number of absences observed in their study. We are unaware of any studies that have examined this phenomenon in the context of summer break. If the true effect of being out of school accelerates the longer duration students are out of school, we could be underestimating the impact on learning. But if summer loss simply reflects a process of forgetting and re-remembering that is not directly linked to the amount of time out of school, we could be greatly overestimating the potential impacts on learning. Future research could explore the nonlinearity of summer learning using variation in when schools start and end, though given most U.S. public schools follow mostly standard schedules, it is unclear how much variation in the length of summer break exists across school districts.
Where Do We Go From Here?
Our results indicate that students may be substantially behind, especially in mathematics. Thus, teachers of different grade levels may wish to coordinate in order to determine where to start instruction. Educators will also need to find ways to assess students early, either formally or informally, in order to understand exactly where students are academically.
4 Second, students are likely to enter school with more variability in their academic skills than under normal circumstances. Prior research suggests that greater heterogeneity in student achievement affects a classroom teacher’s ability to adapt instruction in order to meet the instructional needs of all students (
Connor et al., 2009;
Evertson et al., 1981). Experts recommend that teaching grade-level content to all students in the fall, while identifying students in need of special support, is likely to help students remain on track (
Lynch & Hill, 2020).
Third, under typical schooling conditions, the students who lose the most during the summer tend to gain the most when back in school. Nonetheless, the ground that students have to make up during the 2020–2021 academic year will probably be greater due to COVID-19. Therefore, educators may want to work with students to determine the growth rates needed to catch up and set learning goals for the year that are ambitious but obtainable. These strategies might include establishing out-of-school learning supports during the 2020–2021 school year for the students most affected by school closures.
Finally, the effects of COVID-19 to which our study cannot speak may be the ones most worthy of addressing. Districts are rushing to support educators who are attempting to teach academic content remotely while also caring for their students’ social-emotional well-being. Prior research on students displaced by Hurricane Katrina indicated that students had difficulty concentrating and often manifested symptoms of depression in the months following the hurricane (
Picou & Marshall, 2007). Understanding these impacts will be essential to supporting students’ social and emotional needs after this huge disruption of COVID-19. Many students may face greater food insecurity, loss of family income, loss of family members to the coronavirus, and fear of catching the virus themselves (
National Association for the Advancement of Colored People, 2020). While the scale of the COVID-19 school closures is novel, the inequalities in our school systems are unfortunately anything but new. Our models cannot account for the reality that the crisis is having an unequal impact on our most underserved communities. Nonetheless, we hope that these analyses, which synthesize what we know from existing bodies of research, will inform tomorrow’s decision making.
Strategies for Recovering From COVID Slide
Researchers, district leaders, and policy makers are offering research-based program and policy recommendations designed to make up academic ground from COVID-19 school closures (e.g.,
Allensworth & Schwartz, 2020;
Hill & Loeb, 2020). For example,
Kraft and Goldstein (2020) point to High-Dosage Tutoring (HDT) as a promising way to aid schools’ efforts facilitate additional instruction as well as an avenue to stimulate the economy. Several Senate bills seek to expand national service programs such as AmeriCorps (
Phillips, 2020). At the state level, former Tennessee Governor Bill Haslam’s Foundation is teaming up with Boys and Girls Clubs and other youth-serving organizations in a pilot program called Tennessee Tutoring Corps which aims to recruit more than 1,000 college students to provide essential employment to recent college graduates who otherwise may be unable to enter the job market. These tutors will offer students in grades K-6 critical one-on-one academic support to help them catch up on content they may have missed due to lost instruction time in the classroom during COVID-19 closures (
Blad, 2020;
Slavin, 2020).
During summer 2020 many school-based summer programs, designed to increase year-round learning opportunities and compensate for typical summer learning loss, pivoted to home-based summer options (
Borman, 2020). Such programs have been particularly helpful in boosting reading performance when targeted at low-income (K–8) children (
Kim & Quinn, 2013). Home-based summer reading programs (e.g., Kids Read Now, Harvard Graduate School of Education’s READS LAB, etc.) provide students with additional access to reading materials matched to individual interests and students’ reading levels. Moreover, the programs provide parents and teachers guidance to help improve comprehension, and employ gentle nudges (e.g., texts, emails, etc.) to encourage continued reading throughout the summer (
Borman, 2020). Additionally, free book distribution programs are also a good way to get quality books to underserved families who have access to fewer literacy supports. Various extended learning time interventions, including week-long “acceleration” academies and summer programs, will likely need to be considered to help struggling students during the 2020–2021 school year and subsequent summer (
Allensworth & Schwartz, 2020).
Finally, research and experts have offered strategies to help address students’ emotional needs and build on teacher-student relationships, which will be crucial as districts work through intermittent school closures heading into this academic year. For example, prior research suggests looping, when an educator continues teaching her/his/their current class into the next year, as a promising practice that schools may want to scale in 2020–2021 (
Hill & Jones, 2018). Additional recommendations stress the importance of having teachers work together to uncover missed learning and to provide effective responses to trauma in school settings. Using administrative data from online learning platforms, in particular, can equip teachers and support staff with information that can help identify students who have disengaged from instruction and/or who are at risk of dropping out entirely (
Hill & Loeb, 2020). For additional recommendations on supporting students’ recovery from the COVID-19 school closures, a series of evidence briefs covering a wide range of topics are available from the
EdResearch for Recovery (2020).