The Evidence on Teaching

School Nutrition and Student Discipline: Effects of Schoolwide Free Meals

Gordon N, Ruffini KJ · 2018

grade Bquasi-experimentindependentmixednumbers spot-checked
Sample
National school-level panel from the Civil Rights Data Collection (biennial, 2010-2016) linked to CEP participation data, using state-by-state timing of Community Eligibility Provision pilot rollout (2012-2015). Matched sample about 49,074 elementary and 15,150 middle schools; the preferred elementary specification uses 34,437 observations across 11,430 schools and the preferred middle specification 7,138 observations across 2,625 schools.
Population
US public elementary, middle and high school students in high-poverty schools adopting schoolwide free meals. CEP-eligible schools are a disadvantaged subset of all US schools, so heterogeneity contrasts within this sample are compressed relative to the national distribution.
Design
Difference-in-differences with school and year fixed effects on within-school changes in suspension rates as states phased in the CEP pilot; treatment is defined as being in a state ELIGIBLE to participate in year t, which leverages only immutable state-level timing rather than school-level selection into the programme. Standard errors clustered by district. Credible identification, and the authors explicitly reject regression discontinuity (reported categorical-eligibility shares bunch at the 40% and 62.5% thresholds) and instrumental variables (estimates are unstable across instrument choices because the suspension distribution is highly skewed). THE HEADLINE IS SPECIFICATION-DEPENDENT and our original extraction did not say so. In the full sample with school and year fixed effects the effect on multiple out-of-school suspensions is NULL for elementary schools (-0.0905, se 0.0642) and marginal for middle (-0.263, se 0.157); restricted to CEP-eligible schools it is null for both (elementary -0.0633; middle +0.0673). Significance appears only after two further restrictions: limiting the sample to schools that ever participated in CEP, and dropping 17 large districts (Chicago, Los Angeles, Philadelphia, Miami- Dade and others) that changed formal discipline policy during the study window. The main outcome is also narrower than "suspensions": it is the rate of students with MULTIPLE out-of-school suspensions, a severe and rare event. On any out-of-school suspension the middle-school effect disappears entirely. The authors are explicit that they cannot observe dietary intake, so any nutritional interpretation is inference, not measurement; stigma reduction and household income relief are equally consistent mechanisms, and they say they cannot distinguish them.
Key findings
In the preferred (twice-restricted) specification, modest reductions in the rate of students with multiple out-of-school suspensions for elementary students (-0.32 per 100, about a 15% reduction from a 2.17 baseline, p < 0.01) and middle-school students (-0.48 per 100, about 6% from a 7.65 baseline, p < 0.1), with no effect at high school - and, on the broader "any out-of-school suspension" measure, a marginally significant INCREASE for high school students (+0.72 per 100 on a 14.78 baseline, about +5%, p < 0.1) that our original extraction missed and that contradicts Kho 2018 finding of the largest reductions in high schools. For elementary students the reductions concentrate in counties with above- median predicted child food insecurity (-0.54 v -0.16 per 100; interaction -0.379, p < 0.01); the equivalent middle-school contrast is similar in magnitude but imprecise (F-test p = 0.087). Race subgroups show no significant effects on their own. The authors frame this as evidence that school nutrition services matter beyond test scores.
Genetic confound
Low for selection into treatment (state pilot timing, and treatment defined by state eligibility rather than school choice). But as with all programme-level designs the treatment bundles food, household income relief and stigma reduction, and the paper cannot separate them.
Replication notes
Two prior single-state studies of the same policy on the same outcome disagree with each other, and this paper reproduces BOTH depending on the sample. Kho (2018), comparative interrupted time series in Tennessee, found a 1.2 percentage-point (about 10%) reduction in students ever suspended or expelled, LARGEST IN HIGH SCHOOLS. Comperatore and Fuller (2018), difference-in-differences in North Carolina, found NO effect on the share of students suspended at any level, in aggregate or in high-poverty or urban subsets. Gordon and Ruffini find modest elementary and middle-school reductions in their preferred restricted sample, a marginally significant INCREASE for high schools (contradicting Kho), and the North Carolina null when they broaden to all eligible schools. So: mixed, not unreplicated.

Effects

OutcomeMetricValueMeasureTimingVsHorizonClass
Multiple out-of-school suspensions, ELEMENTARY, preferred specification (behaviour)students per 100 with more than one out-of-school suspension, DiD coefficient-0.321 (se 0.0894), p < 0.01, on a 2.172 baseline - about a 15% reduction. Log specification -0.0685 (se 0.0292), p < 0.05standardizedpost-CEP adoption, 2012-2016 biennial panelbusiness-as-usualend-of-treatmentbehaviour
Multiple out-of-school suspensions, MIDDLE, preferred specification (behaviour)students per 100 with more than one out-of-school suspension, DiD coefficient-0.477 (se 0.274), p < 0.1, on a 7.649 baseline - about a 6% reduction; -0.679 (se 0.331), p < 0.05 when enrolment-weighted; log specification -0.0945, not significantstandardizedpost-CEP adoption, 2012-2016 biennial panelbusiness-as-usualend-of-treatmentbehaviour
Multiple out-of-school suspensions, UNRESTRICTED samples - where the effect is not there (behaviour)same DiD coefficient, full sample and CEP-eligible sample, school and year fixed effectsfull sample elementary -0.0905 (se 0.0642) NS, middle -0.263 (se 0.157) p < 0.1; CEP-eligible sample elementary -0.0633 (se 0.0716) NS, middle +0.0673 (se 0.200) NS. The headline requires restricting to ever-participating schools AND dropping 17 districts that changed discipline policystandardizedpost-CEP adoptionbusiness-as-usualend-of-treatmentbehaviour
ANY out-of-school suspension - the broader and less severe measure (behaviour)students per 100 with one or more out-of-school suspensions, DiD coefficientelementary -0.252 (se 0.150), p < 0.1 on a 5.176 baseline; middle -0.366 (se 0.402), NOT significant on a 15.46 baseline - the middle-school reduction in multiple suspensions is offset by an insignificant rise in single suspensions (+0.111, se 0.195)standardizedpost-CEP adoptionbusiness-as-usualend-of-treatmentbehaviour
HIGH SCHOOL suspensions - a result cutting against the headline (behaviour)DiD coefficient on multiple OSS and on any OSSmultiple OSS: no significant change in any specification once school and year fixed effects are included (Appendix Table 1). Any OSS: +0.720 (se 0.399), p < 0.1, on a 14.78 baseline - a marginally significant INCREASE of about 5%, opposite in sign to Kho 2018 Tennessee estimatestandardizedpost-CEP adoptionbusiness-as-usualend-of-treatmentbehaviour
In-school suspensions (behaviour)students per 100 with any in-school suspension, DiD coefficientelementary -0.157 (se 0.131), NS on a 2.759 baseline; middle -0.839 (se 0.499), p < 0.1 on a 14.67 baselinestandardizedpost-CEP adoptionbusiness-as-usualend-of-treatmentbehaviour
Heterogeneity by predicted child food insecurity - the strongest evidence for a nutritional channel (behaviour)DiD with interaction, high vs low predicted county child food insecurity (median 22%)elementary main effect -0.161 (se 0.101) plus interaction -0.379 (se 0.141), p < 0.01: about -0.54 per 100 in high-food-insecurity counties versus -0.16 in low, difference significant (F-test p = 2.08e-05). Middle: -0.332 main and -0.332 interaction, imprecise (F-test p = 0.087)standardizedpost-CEP adoptionbusiness-as-usualend-of-treatmentbehaviour
Effects by student race - no significant subgroup differences (behaviour)race-specific suspension rates, DiD coefficient, middle schoolswhite -0.47 on a 4.02 baseline; black -0.55 on an 8.2 baseline; NEITHER significant, and neither significantly different from the pooled estimate. Elementary similar in percentage points but a smaller proportional reduction for black students. No significant differences by Hispanic ethnicity, limited English proficiency, poverty, urbanicity, or school racial compositionstandardizedpost-CEP adoptionbusiness-as-usualend-of-treatmentbehaviour