Long-Term Impacts of Reading Recovery through 3rd and 4th Grade: A Regression Discontinuity Study
May, H., Blakeney, A., Shrestha, P., Mazal, M., & Kennedy, N. · 2023
grade Cquasi-experimentindependentunreplicatednumbers spot-checked
Sample
Grade 3 N=9,879; Grade 4 N=6,345 (73-83% student attrition)
Population
Lowest grade-1 readers who received Reading Recovery, followed to grades 3-4; US.
Design
Multisite fuzzy regression-discontinuity on the Observation Survey eligibility cutoff. CONTESTED: the What Works Clearinghouse (2023) ruled the study INELIGIBLE as an RDD (it analyzed a forcing variable not used to assign students), reviewed it as a QED, and rated it 'Does Not Meet WWC Standards' for baseline equivalence. Independent critic Jon Baron (Evidence-Based Policy) calls the negative finding 'not a reliable finding' (73-83% attrition; ~0.85 SD baseline gap). Downgraded B->C.
Key findings
The same cohorts that showed large positive grade-1 gains scored ~0.19-0.43 SD BELOW comparison children on grade 3-4 state tests - a fadeout-to-reversal. But the study is design-contested (WWC ruled it ineligible as an RDD; 73-83% attrition), so it supports 'no credible evidence of durable benefit' rather than a confident 'RR harms.'
Genetic confound
RD would control selection if valid, but the design's validity is disputed by WWC and independent critics.
Replication notes
No independent long-term RCT of Reading Recovery exists. This is the only US long-term estimate; its negative sign is real in-sample but the causal read is contested.
DOI / URL
10.1080/19345747.2023.2209092
Effects
| Outcome | Metric | Value | Measure | Timing | Vs | Horizon | Class |
|---|---|---|---|---|---|---|---|
| Grade 3-4 state reading/ELA (TOT range) | SD | -0.19 to -0.43 (negative; contested identification) | standardized | 2yr+ follow-up | business-as-usual | over-2yr | domain-skill |
| Grade 3-4 state reading/ELA (ITT) | SD | -0.11 to -0.16 | standardized | 2yr+ follow-up | business-as-usual | over-2yr | domain-skill |
Cited by
- Reading Recovery and Tier-2 1:1 early-literacy tutoringmixedconf: mediumgc: low
- Tutoring — the honest effect, the Bloom 2-sigma myth, and what survives scalestrong supportconf: highgc: low