The Evidence on Teaching

Urban Charter School Study Report on 41 Regions

Center for Research on Education Outcomes (CREDO), Stanford University · 2015

grade Cquasi-experimentindependentreplicated
Sample
41 urban regions across 22 states
Population
Urban charter-school students matched to traditional-public-school students.
Design
Matched-observational 'virtual control record' design: each charter student is compared to a synthetic twin built from demographically similar students in the schools charter students left. Not a lottery. Graded C: the matching is on observed demographics and prior scores only, so selection on unobserved (and partly heritable) student and family traits is not addressed. Widely criticised on exactly this point. No DOI.
Key findings
The broadest description of the urban charter sector: on average urban charters outscore matched traditional-school peers, most for disadvantaged subgroups. Its value here is coverage (41 regions) rather than identification — where lotteries exist, use them.
Genetic confound
HIGH for this design. Matching on demographics and prior scores does not remove selection on family traits that are both heritable and predictive of choosing a charter. Read as descriptive coverage of the sector, not as a causal estimate — the lottery studies are what carry causal weight here.
Replication notes
Directionally consistent with the urban lottery estimates, which is the main reason to keep it; the magnitudes are not independently trustworthy.

Effects

OutcomeMetricValueMeasureTimingVsHorizonClass
Urban charter students, mathdays of learning+40 additional days per year vs matched traditional-school peersstandardizedannualbusiness-as-usualend-of-treatmentdomain-skill
Urban charter students, readingdays of learning+28 additional days per yearstandardizedannualbusiness-as-usualend-of-treatmentdomain-skill
Subgroupspatternlargest gains for Black, Hispanic, low-income and English-learner studentsstandardizedannualbusiness-as-usualend-of-treatmentdomain-skill

Cited by