The Evidence on Teaching

The Long-Term Effects of Universal Preschool in Boston

Gray-Lobe, G., Pathak, P. A., & Walters, C. R. · 2023

grade Anatural-experimentindependentreplicatednumbers spot-checked
Sample
~4,215 randomised applicants (working-paper figure; verify against published QJE version)
Population
Boston Public Schools preschool lottery applicants, cohorts 1997-2003.
Design
Admissions-lottery instrument — grade A identification, modern, at scale, in a public program.
Key findings
The most important modern pre-K result and the cleanest demonstration that ATTAINMENT can move while TEST SCORES do not: a precisely-estimated zero on achievement across grades 3-10, alongside real gains in high-school graduation and college enrolment. Crucially, its counterfactual was mostly OTHER preschool, which should have shrunk effects — so the substitution story cannot explain why other scaled programs fail. Read the attainment result with care: on-time college enrolment is solid, but ever-enrolling is marginal and GRADUATION is null.
Counterfactual
NOT 'no preschool': roughly 33% of new BPS preschool students were drawn from Head Start and ~29% from private preschool; only ~38% from no preschool.
Genetic confound
Lottery randomisation defeats family selection — its central strength.
Replication notes
Weiland et al. (2020, n=3,182) independently confirms the grade-3 test-score null for the same program. Effects are larger for BOYS. Note that college graduation — arguably the outcome that matters most — is not significant.
DOI / URL
10.1093/qje/qjac036

Effects

OutcomeMetricValueMeasureTimingVsHorizonClass
MCAS achievement, grades 3-102SLS SD (SE)stacked math +0.005 (0.057); ELA +0.029 (0.056) — a PRECISE ZERO, ruling out effects above ~0.12 SDstandardizedgrade-6+active-alternativeover-2yrdomain-skill
On-time college enrolmentpp (SE)+8.3pp (3.0), p<.01, against a 45.9% basestandardizedadultactive-alternativeadulthoodattainment
Ever enrol in any collegepp (SE)+5.4pp (3.0), p<.10 onlystandardizedadultactive-alternativeadulthoodattainment
College GRADUATIONpp+5.2pp — NOT statistically significantstandardizedadultactive-alternativeadulthoodattainment
High school graduationpp (SE)+6.0pp (3.0), p<.05standardizedgrade-6+active-alternativeover-2yrattainment
Juvenile incarcerationpp-0.8pp, p<.10, against a 0.7% basestandardizedgrade-6+active-alternativeover-2yrbehaviour

Cited by