The Evidence on Teaching

Virtual Illusion: Comparing Student Achievement and Teacher and Classroom Characteristics in Online and Brick-and-Mortar Charter Schools

Fitzpatrick BR, Berends M, Ferrare JJ, Waddington RJ · 2020

grade Bquasi-experimentindependentreplicated
Sample
Indiana statewide student-level administrative data on charter and traditional public school students
Population
Indiana students, including those who switched into virtual charter schools
Design
Matching-cell fixed-effect design exploiting students who SWITCH into virtual charters, so each student is partly their own control — the feature that makes this the strongest identification available for moving a child's schooling into the home. Teacher and classroom characteristics were measured and tested as mediators.
Key findings
Students who switched to virtual charter schools experienced large negative effects on mathematics and English/language arts achievement, and the effects persisted over time rather than reflecting a transition dip. The negative effects could not be explained by observed teacher or classroom characteristics. Point estimates were not recoverable from the abstract and are recorded here as direction and persistence only.
Genetic confound
Low for the within-student comparison — a child's genotype does not change when they switch schools. The residual threat is time-varying: families switch to virtual schooling in response to something (illness, bullying, a bad year), and that something also predicts a decline. This is the standard switcher-design confound and it is not addressed.
Replication notes
Same sign and magnitude class as Cordes 2024 (Pennsylvania) and the CREDO online-charter studies, on independent data with a different design.

Effects

OutcomeMetricValueMeasureTimingVsHorizonClass
Mathematics and ELA achievement after switching into a virtual charterdirection and persistence (magnitudes not extractable from the abstract)large negative in both subjects, persisting over time; not explained by observed teacher or classroom characteristicsstandardizedpost-switch, multiple yearsactive-alternativeover-2yrdomain-skill

Cited by