The Evidence on Teaching

First Thing Music: Evaluation Report

Bohling G, Barnard M, Crouch T, Whitefield C, Murphy L, Gunzinger H, Anders J, Shure D, Wyse D (Behavioural Insights Team and UCL Institute of Education, for the Education Endowment Foundation) · 2021

grade Brctindependentunreplicated
Sample
3,004 pupils randomised (1,492 treatment, 1,512 control) across 121 classes in 64 schools; 2,150 analysed (1,116 / 1,034), i.e. 28% attrition
Population
English Year 1 pupils, aged 5-6, in state primary schools
Design
The largest randomised trial of music instruction in existence and, structurally, the best test anyone has run of whether classroom music raises reading. Class-level cluster randomisation, a full school year of Kodály-inspired music for 15 minutes EVERY school day, independent evaluators, and a published standardised primary outcome (Progress in Reading Assessment). Grade B rather than A for two reasons the report states itself: the control was business-as-usual rather than an active alternative, and 28% attrition with free-school-meal status significantly predicting missingness means the estimate "may be biased." EEF security rating 2 of 5 padlocks. The trial also sits inside the wider Learning About Culture programme, so do not count it twice with that source.
Key findings
Reading attainment Hedges g = 0.07 (95% CI -0.02 to 0.16), p = 0.13 - equivalent to one month's additional progress and not statistically distinguishable from zero. In the free-school-meal subgroup, which is where arts advocacy usually locates its effects, the estimate is exactly 0.00 (95% CI -0.20 to 0.19), p = 0.97, n = 451: zero months. Secondary outcomes were null-to-negative: social skills -0.09 and creative self-efficacy -0.03. The dose is the point - this is not a token exposure but daily music for a whole school year in a programme designed by specialists, delivered to 3,004 five- and six-year-olds, and the reading effect is a month of progress that the evaluators decline to call real.
Genetic confound
Low. Class-level randomisation within schools removes selection into music. The live threat is differential attrition by free-school-meal status, which the report flags.
Replication notes
No replication. Its null is consistent with Sala & Gobet (2020) - whom the evaluators cite in the report as the prior reason to doubt music-to-cognition transfer - and with the EEF Act, Sing, Play trial, where music workshops did not outperform drama workshops on maths or literacy. It is in tension with Román-Caballero et al. (2022) only under their own distinction: this is classroom vocal music, not instrumental tuition, and that meta-analysis argues the null belongs to exactly this kind of programme.

Effects

OutcomeMetricValueMeasureTimingVsHorizonClass
Reading attainment (Progress in Reading Assessment)Hedges g0.07 (95% CI -0.02 to 0.16), p = 0.13, n = 2,150; EEF gloss "one month's additional progress", security 2/5standardizedend of the school yearbusiness-as-usualend-of-treatmentfar-transfer
Reading attainment, free-school-meal subgroupHedges g0.00 (95% CI -0.20 to 0.19), p = 0.97, n = 451 - zero months' progress in the subgroup where the effect is usually claimed to concentratestandardizedend of the school yearbusiness-as-usualend-of-treatmentfar-transfer
Social skills and creative self-efficacyeffect size (SD)social skills -0.09; creative self-efficacy -0.03 - both null-to-negativestandardizedend of the school yearbusiness-as-usualend-of-treatmentnon-cognitive
Dose deliveredminutes and duration15 minutes of Kodály-inspired music every school day for a full academic year, to 3,004 randomised Year 1 pupils in 121 classes across 64 schoolsstandardizedone academic yearbusiness-as-usualend-of-treatmentunclear

Cited by