The Long-Run Impacts of a Universal Child Care Program
Baker, M., Gruber, J., & Milligan, K. · 2019
grade Bnatural-experimentindependentmixednumbers spot-checked
Sample
Four separate datasets, all Quebec vs rest of Canada. NLSCY/SYC for child behaviour (ages 2-3 and 5-9); SAIP/PCAP and PISA 2000-2015 for test scores at 13-16; CCHS 2001-2015 for self-reported health at ages 12-20 (~130k obs per biannual wave, ~65k per annual wave); Statistics Canada UCR crime rates 2006-2014 aggregated into age x sex x province x year cells, ages 12-20.
Population
Children exposed to Quebec's universal $5/day childcare expansion introduced in 1997 for ages 0-4.
Design
Difference-in-differences on a large-scale universal childcare rollout — one of the few evaluations of universal (not targeted) provision at national scale. Caveats that matter for how much weight the crime result can bear: there is only ONE treated province, so inference rests on Bester-Conley-Hansen standard errors using four regional groups and a t-distribution with three degrees of freedom; the crime analysis is on aggregated cells (age x sex x province x year), not individuals; and p-values are adjusted for multiple testing following Anderson (2008). Figure 3 shows Quebec accusation rates remain BELOW the rest of Canada throughout — the estimated "increase" is a narrowing of Quebec's crime advantage with exposure, not an absolute excess. First stage: exposure raised childcare use at ages 0-4 by 14.3 pp (early cycles) to 19.7 pp (all cycles) on a base of 46%, about a 40% rise.
Key findings
The most important cautionary case for UNIVERSAL childcare expansion, but narrower than it is usually quoted. Verified negatives: non-cognitive deficits at ages 2-3 (anxiety +0.12 SD, aggression +0.12-0.17 SD) that do NOT fade and in the case of anxiety more than double by ages 5-9 (+0.28 SD); self-reported health +0.073 SD worse and life satisfaction +0.043 SD worse at ages 12-20; youth crime accusations +19% and convictions +22% at ages 12-20. Three important qualifications the usual citation drops: (1) the paper finds NO consistent long-run cognitive harm — PISA math is significantly POSITIVE (+0.20 to +0.31 SD) and the authors conclude "no consistent impact on their cognitive skills"; (2) self-reported mental health, pro-social behaviour and science scores are all nulls; (3) the outcomes are measured at ages 12-20, i.e. adolescence, NOT adulthood — the oldest exposed cohorts were only in their early 20s at writing. Combined with Tennessee, it shows scaling early-childhood provision can produce harm, not merely disappointing nulls — most plausibly when it displaces better care.
Counterfactual
Comparable cohorts in other Canadian provinces (difference-in-differences).
Genetic confound
Policy-driven cohort variation rather than family selection.
Replication notes
Split record. The contemporaneous negative non-cognitive result is replicated: this paper reproduces Baker-Gruber-Milligan (2008) on a wider sample, Kottelenberg and Lehrer (2013) confirm it persisted as the programme matured, and Haeck-Lefebvre-Merrigan (2015) agree on the PPVT decline. But Kottelenberg and Lehrer (2017) find the sign REVERSES for disadvantaged single-parent families, with the negative mean driven by two-parent families, and the long-run health/crime results in this paper are novel and not independently replicated. Within the paper itself the cognitive results are self-contradictory (SAIP/PCAP negative-insignificant vs PISA positive-significant on math).
DOI / URL
10.1257/pol.20170603
Effects
| Outcome | Metric | Value | Measure | Timing | Vs | Horizon | Class |
|---|---|---|---|---|---|---|---|
| Anxiety, ages 2-3 (Table 1; higher = worse) | SD | +0.115 to +0.119 SD (worse), adjusted p 0.002-0.003 | self-report | ages 2-3 | business-as-usual | end-of-treatment | non-cognitive |
| Aggression, ages 2-3 (Table 1; higher = worse) | SD | +0.117 to +0.172 SD (worse), adjusted p 0.001-0.016 | self-report | ages 2-3 | business-as-usual | end-of-treatment | non-cognitive |
| Hyperactivity, ages 2-3 (Table 1; higher = worse) | SD | +0.065 to +0.070 SD (worse), adjusted p 0.026-0.038 | self-report | ages 2-3 | business-as-usual | end-of-treatment | non-cognitive |
| PPVT vocabulary, ages 4-5 (Table 1) | SD | -0.109 to -0.139 SD (worse); the one contemporaneous COGNITIVE loss | standardized | ages 4-5 | business-as-usual | end-of-treatment | domain-skill |
| Anxiety, ages 5-9 (Table 2; higher = worse) | SD | +0.278 SD (worse), adjusted p 0.001 — more than twice the size of the age 2-3 effect | self-report | ages 5-9 | business-as-usual | over-2yr | non-cognitive |
| Aggression, ages 5-9 (Table 2; higher = worse) | SD | +0.169 SD (worse), adjusted p 0.001; concentrated in the upper deciles and in boys | self-report | ages 5-9 | business-as-usual | over-2yr | non-cognitive |
| Indirect aggression, ages 5-9 (Table 2; higher = worse) | SD | +0.190 SD (worse), adjusted p 0.001 | self-report | ages 5-9 | business-as-usual | over-2yr | non-cognitive |
| Hyperactivity, ages 5-9 (Table 2; higher = worse) | SD | +0.130 SD (worse), adjusted p 0.001 | self-report | ages 5-9 | business-as-usual | over-2yr | non-cognitive |
| Pro-social behaviour, ages 5-9 (Table 2) | SD | +0.006 SD — NULL (adjusted p 0.876) | self-report | ages 5-9 | business-as-usual | over-2yr | non-cognitive |
| Math test scores, ages 13-16 (Table 3) | SD | CONTRADICTORY: SAIP/PCAP -0.181 SD (n.s., adjusted p 0.263) but PISA +0.199 to +0.312 SD, statistically SIGNIFICANT and POSITIVE (adjusted p 0.001-0.002) | standardized | ages 13-16 | business-as-usual | over-2yr | domain-skill |
| Reading test scores, ages 13-16 (Table 3) | SD | SAIP/PCAP -0.237 SD (n.s., adjusted p 0.235); PISA +0.054 (n.s.) to +0.106 SD (adjusted p 0.015, positive). No evidence the PPVT loss persists. | standardized | ages 13-16 | business-as-usual | over-2yr | domain-skill |
| Science test scores, ages 13-16 (Table 3) | SD | -0.062 SD (SAIP/PCAP, n.s.) to +0.021/+0.043 SD (PISA, n.s.) — NULL | standardized | ages 13-16 | business-as-usual | over-2yr | domain-skill |
| Self-reported health, ages 12-20 (Table 4; higher = worse) | SD | +0.073 SD worse, adjusted p 0.001 | self-report | ages 12-20 | business-as-usual | over-2yr | health |
| Life satisfaction, ages 12-20 (Table 4; higher = worse) | SD | +0.043 SD worse, adjusted p 0.003 | self-report | ages 12-20 | business-as-usual | over-2yr | health |
| Self-reported mental health, ages 12-20 (Table 4) | SD | -0.011 SD — NULL and in the BETTER direction (adjusted p 0.086) | self-report | ages 12-20 | business-as-usual | over-2yr | health |
| All-crime accusation rate, ages 12-20 (Table 5, richest specification) | rate per 100,000 | +353 per 100,000 on a mean of 1,872 = +19% (simple DiD gives +514 = +27%) | administrative | ages 12-20 | business-as-usual | over-2yr | behaviour |
| All-crime conviction rate, ages 12-20 (Table 5, richest specification) | rate per 100,000 | +212 per 100,000 on a mean of 963 = +22%; largest for property crime (+342 convictions, +25%); effects concentrated in boys | administrative | ages 12-20 | business-as-usual | over-2yr | behaviour |
Cited by
- Preschool at scale — Head Start, state pre-K, and what universal provision deliversmixedconf: highgc: low