The Evidence on Teaching

Effects of a school-based physical activity intervention on academic performance in 14-year old adolescents: a cluster randomized controlled trial - the School in Motion study

Solberg RB, Steene-Johannessen J, Anderssen SA, Ekelund U, Safvenbom R, Haugen T, Berntsen S, Avitsland A, Lerum O, Resaland GK, Kolle E · 2021

grade Brctdeveloper-ledmixednumbers spot-checked
Sample
30 Norwegian lower-secondary schools cluster-randomized into 3 arms of 10, but one control school withdrew before baseline (29 schools, 9 control) and one DWBH school withdrew at 3 months; 2,084 consenting students (76% consent rate), mean age 14; ~2,000 with valid baseline data and only 1,682 with valid follow-up on both tests
Population
14-year-old Norwegian lower-secondary students
Design
Nine-month three-arm cluster RCT (NCT03817047, RETROSPECTIVELY registered in 2019 after the 2017-18 trial period). Arms: Physically Active Learning (PAL), "Don't Worry - Be Happy" (DWBH), and control. Both intervention arms targeted 120 min/week of additional in-school physical activity. Outcomes were Norwegian standardized national tests in reading and numeracy. Only 10 clusters per arm, which is thin for a cluster design; retrospective registration weakens the preregistration claim; and the authors report that estimates attenuated and some lost significance under intention-to-treat analysis with imputed data. Sex modified the effect in every academic model (p<0.001 for interaction), so the headline pooled estimates average over two very different subgroups. Adherence was 83% (PAL) and 78% (DWBH), i.e. ~100 and ~94 min/week actually delivered against the 120 min/week target, and only 10 of 19 intervention schools cleared 80% delivery.
Key findings
This is the strongest positive cluster RCT in the school-PA literature and it is the steelman against a flat null verdict — but the effect sizes are at or below the noise floor of the field: numeracy d=0.12 (PAL) and d=0.23 (DWBH), reading d=0.06 (PAL) and d=0.18 (DWBH). Two features cut against the aerobic-dose mechanism. First, the non-aerobic-framed DWBH arm outperformed the physically-active-learning arm on every outcome. Second, and decisively, the DWBH arm produced its academic effect with NO measured change in physical activity at all (Kolle et al. 2020 companion paper); only the PAL arm moved PA. An academic gain in an arm whose PA did not move cannot be a physical-activity effect. Third, the estimates attenuate under ITT with imputation — PAL reading falls to d=0.03 (0.5 points, 95% CI -0.4 to 1.3), and PAL numeracy in girls and DWBH reading in boys also lose significance. Reading is null in three of the four arm-by-sex cells. Against four larger or longer null trials (A+PAAC, ASK, LCoMotion, Fit to Study) this is a single positive result at d<=0.23 with 10 clusters per arm and retrospective registration.
Genetic confound
Randomization removes genetic confounding of the arm contrast. With only 10 clusters per arm, chance imbalance in school-level composition (which is itself heritability-loaded through parental sorting) is a live threat that randomization does not eliminate at this cluster count.
Replication notes
The ScIM result itself has not been directly replicated, but the hypothesis it tests has been tested repeatedly and mostly failed - LCoMotion (Tarp 2016), ASK (Resaland 2016), A+PAAC (Donnelly 2017) and Fit to Study (Wassenaar 2021) are null on achievement or cognition. Recorded as `mixed` rather than `unreplicated` because the literature is not silent on this question, it disagrees.

Effects

OutcomeMetricValueMeasureTimingVsHorizonClass
Numeracy, Physically Active Learning armCohen's d (mean difference in change, national test points)d = 0.12; 1.7 points (95% CI 0.9 to 2.5)standardizedend of 9-month interventionbusiness-as-usualend-of-treatmentfar-transfer
Numeracy, Don't Worry Be Happy armCohen's dd = 0.23; 2.0 points (95% CI 1.4 to 2.7)standardizedend of 9-month interventionbusiness-as-usualend-of-treatmentfar-transfer
Reading, Physically Active Learning armCohen's dd = 0.06; 0.9 points (95% CI 0.2 to 1.6)standardizedend of 9-month interventionbusiness-as-usualend-of-treatmentfar-transfer
Reading, Don't Worry Be Happy armCohen's dd = 0.18; 1.1 points (95% CI 0.3 to 1.9)standardizedend of 9-month interventionbusiness-as-usualend-of-treatmentfar-transfer
All outcomes under intention-to-treat with imputationattenuationestimates attenuated; some no longer statistically significant. PAL reading falls from d=0.06 to d=0.03 (0.5 points, 95% CI -0.4 to 1.3, non-significant); PAL numeracy in girls and DWBH reading in boys also lose significancestandardizedend of 9-month interventionbusiness-as-usualend-of-treatmentfar-transfer
Reading, stratified by sex (all four arm-by-sex cells)significance of mean difference in changeonly boys in the DWBH arm show a significant reading effect; the other three arm-by-sex cells are null. Sex x group x time interaction p<0.001 in every academic modelstandardizedend of 9-month interventionbusiness-as-usualend-of-treatmentfar-transfer
Numeracy, girls in the DWBH arm, per-protocol (schools >80% delivery)mean difference in change, national test points0.9 points (95% CI -0.2 to 2.0) — non-significant; the only per-protocol result that differed from the main analysis, and it went the wrong waystandardizedend of 9-month interventionbusiness-as-usualend-of-treatmentfar-transfer
Physical activity level, DWBH arm (the arm with the LARGER academic effect)between-group change in device-measured PAno effect on PA levels (per the Kolle et al. 2020 companion trial paper); only the PAL arm improved daily PA. The academic effect is therefore not attributable to the physical-activity dosestandardizedend of 9-month intervention; hip accelerometrybusiness-as-usualend-of-treatmentbehaviour

Cited by