The Evidence on Teaching

The Long-Run Impacts of a Universal Child Care Program

Baker, M., Gruber, J., & Milligan, K. · 2019

grade Bnatural-experimentindependentmixednumbers spot-checked
Sample
Four separate datasets, all Quebec vs rest of Canada. NLSCY/SYC for child behaviour (ages 2-3 and 5-9); SAIP/PCAP and PISA 2000-2015 for test scores at 13-16; CCHS 2001-2015 for self-reported health at ages 12-20 (~130k obs per biannual wave, ~65k per annual wave); Statistics Canada UCR crime rates 2006-2014 aggregated into age x sex x province x year cells, ages 12-20.
Population
Children exposed to Quebec's universal $5/day childcare expansion introduced in 1997 for ages 0-4.
Design
Difference-in-differences on a large-scale universal childcare rollout — one of the few evaluations of universal (not targeted) provision at national scale. Caveats that matter for how much weight the crime result can bear: there is only ONE treated province, so inference rests on Bester-Conley-Hansen standard errors using four regional groups and a t-distribution with three degrees of freedom; the crime analysis is on aggregated cells (age x sex x province x year), not individuals; and p-values are adjusted for multiple testing following Anderson (2008). Figure 3 shows Quebec accusation rates remain BELOW the rest of Canada throughout — the estimated "increase" is a narrowing of Quebec's crime advantage with exposure, not an absolute excess. First stage: exposure raised childcare use at ages 0-4 by 14.3 pp (early cycles) to 19.7 pp (all cycles) on a base of 46%, about a 40% rise.
Key findings
The most important cautionary case for UNIVERSAL childcare expansion, but narrower than it is usually quoted. Verified negatives: non-cognitive deficits at ages 2-3 (anxiety +0.12 SD, aggression +0.12-0.17 SD) that do NOT fade and in the case of anxiety more than double by ages 5-9 (+0.28 SD); self-reported health +0.073 SD worse and life satisfaction +0.043 SD worse at ages 12-20; youth crime accusations +19% and convictions +22% at ages 12-20. Three important qualifications the usual citation drops: (1) the paper finds NO consistent long-run cognitive harm — PISA math is significantly POSITIVE (+0.20 to +0.31 SD) and the authors conclude "no consistent impact on their cognitive skills"; (2) self-reported mental health, pro-social behaviour and science scores are all nulls; (3) the outcomes are measured at ages 12-20, i.e. adolescence, NOT adulthood — the oldest exposed cohorts were only in their early 20s at writing. Combined with Tennessee, it shows scaling early-childhood provision can produce harm, not merely disappointing nulls — most plausibly when it displaces better care.
Counterfactual
Comparable cohorts in other Canadian provinces (difference-in-differences).
Genetic confound
Policy-driven cohort variation rather than family selection.
Replication notes
Split record. The contemporaneous negative non-cognitive result is replicated: this paper reproduces Baker-Gruber-Milligan (2008) on a wider sample, Kottelenberg and Lehrer (2013) confirm it persisted as the programme matured, and Haeck-Lefebvre-Merrigan (2015) agree on the PPVT decline. But Kottelenberg and Lehrer (2017) find the sign REVERSES for disadvantaged single-parent families, with the negative mean driven by two-parent families, and the long-run health/crime results in this paper are novel and not independently replicated. Within the paper itself the cognitive results are self-contradictory (SAIP/PCAP negative-insignificant vs PISA positive-significant on math).
DOI / URL
10.1257/pol.20170603

Effects

OutcomeMetricValueMeasureTimingVsHorizonClass
Anxiety, ages 2-3 (Table 1; higher = worse)SD+0.115 to +0.119 SD (worse), adjusted p 0.002-0.003self-reportages 2-3business-as-usualend-of-treatmentnon-cognitive
Aggression, ages 2-3 (Table 1; higher = worse)SD+0.117 to +0.172 SD (worse), adjusted p 0.001-0.016self-reportages 2-3business-as-usualend-of-treatmentnon-cognitive
Hyperactivity, ages 2-3 (Table 1; higher = worse)SD+0.065 to +0.070 SD (worse), adjusted p 0.026-0.038self-reportages 2-3business-as-usualend-of-treatmentnon-cognitive
PPVT vocabulary, ages 4-5 (Table 1)SD-0.109 to -0.139 SD (worse); the one contemporaneous COGNITIVE lossstandardizedages 4-5business-as-usualend-of-treatmentdomain-skill
Anxiety, ages 5-9 (Table 2; higher = worse)SD+0.278 SD (worse), adjusted p 0.001 — more than twice the size of the age 2-3 effectself-reportages 5-9business-as-usualover-2yrnon-cognitive
Aggression, ages 5-9 (Table 2; higher = worse)SD+0.169 SD (worse), adjusted p 0.001; concentrated in the upper deciles and in boysself-reportages 5-9business-as-usualover-2yrnon-cognitive
Indirect aggression, ages 5-9 (Table 2; higher = worse)SD+0.190 SD (worse), adjusted p 0.001self-reportages 5-9business-as-usualover-2yrnon-cognitive
Hyperactivity, ages 5-9 (Table 2; higher = worse)SD+0.130 SD (worse), adjusted p 0.001self-reportages 5-9business-as-usualover-2yrnon-cognitive
Pro-social behaviour, ages 5-9 (Table 2)SD+0.006 SD — NULL (adjusted p 0.876)self-reportages 5-9business-as-usualover-2yrnon-cognitive
Math test scores, ages 13-16 (Table 3)SDCONTRADICTORY: SAIP/PCAP -0.181 SD (n.s., adjusted p 0.263) but PISA +0.199 to +0.312 SD, statistically SIGNIFICANT and POSITIVE (adjusted p 0.001-0.002)standardizedages 13-16business-as-usualover-2yrdomain-skill
Reading test scores, ages 13-16 (Table 3)SDSAIP/PCAP -0.237 SD (n.s., adjusted p 0.235); PISA +0.054 (n.s.) to +0.106 SD (adjusted p 0.015, positive). No evidence the PPVT loss persists.standardizedages 13-16business-as-usualover-2yrdomain-skill
Science test scores, ages 13-16 (Table 3)SD-0.062 SD (SAIP/PCAP, n.s.) to +0.021/+0.043 SD (PISA, n.s.) — NULLstandardizedages 13-16business-as-usualover-2yrdomain-skill
Self-reported health, ages 12-20 (Table 4; higher = worse)SD+0.073 SD worse, adjusted p 0.001self-reportages 12-20business-as-usualover-2yrhealth
Life satisfaction, ages 12-20 (Table 4; higher = worse)SD+0.043 SD worse, adjusted p 0.003self-reportages 12-20business-as-usualover-2yrhealth
Self-reported mental health, ages 12-20 (Table 4)SD-0.011 SD — NULL and in the BETTER direction (adjusted p 0.086)self-reportages 12-20business-as-usualover-2yrhealth
All-crime accusation rate, ages 12-20 (Table 5, richest specification)rate per 100,000+353 per 100,000 on a mean of 1,872 = +19% (simple DiD gives +514 = +27%)administrativeages 12-20business-as-usualover-2yrbehaviour
All-crime conviction rate, ages 12-20 (Table 5, richest specification)rate per 100,000+212 per 100,000 on a mean of 963 = +22%; largest for property crime (+342 convictions, +25%); effects concentrated in boysadministrativeages 12-20business-as-usualover-2yrbehaviour

Cited by