Still, the findings were somewhat predicted by researchers at Georgia State University who tracked scores on non-mandatory tests that some metro Atlanta school districts were using in 2021. They found that students who attended online tended to do worse.
A new working paper from Georgia State provides further evidence. But the researchers note that family decisions about virtual versus classroom attendance were “highly associated with school-level infection rates” during the 2020-21 school year.
Tim Sass, a GSU economist who has co-authored the reports but was not involved with Oster’s analysis, noted that decisions about whether to return to classrooms were influenced by numerous factors, from broadband access to the local COVID fatality rate.
“So there are other factors in play here that are important to keep in mind that could be associated with the decision about learning mode,” Sass said. “But with that said I think the overall conclusion is correct, that kids that stayed remote longer in general had a greater reduction in their achievement growth.”
Both Sass and Oster said the important thing now is to determine which students learned the least and focus on interventions that are most effective to support them.
For example, said Oster, Mississippi’s English scores are back to pre-pandemic levels, unlike Georgia’s. She suggested it’s something the Georgia Department of Education should investigate.
“It seems like the DOE should ask what’s Mississippi doing differently in reading than Georgia’s doing,” she said.
The Georgia Department of Education questioned the use of exam scores as an interstate comparison, since each state has unique standards and tests. An agency spokeswoman noted that the recent Milestones scores improved over 2021, a year when the results were unreliable because so few students entered their school to sit for tests. She also said Oster’s research underscores the work that remains to address the learning loss.