The Evidence on Teaching

Embedding Formative Assessment: Evaluation report and executive summary

Speckesser S, Runge J, Foliano F, Bursnall M, Hudson-Sharp N, Rolfe H, Anders J · 2018

grade Arctindependentunreplicatednumbers spot-checked
Sample
140 English secondary schools / 25,393 pupils (FSM subgroup n = 7,470)
Population
Year 10-11 pupils in English secondary schools; outcome is GCSE Attainment 8, an independent national examination.
Design
Dylan Wiliam and Siobhan Leahy's own programme tested at scale: two years of whole-school professional development via monthly Teacher Learning Community workshops plus peer observation. Pre-registered, 5/5 EEF security padlocks, 1.9% attrition. An EEF evaluation report with no DOI — the stable copy is the DERA deposit; the peer-reviewed publication of the same trial is Anders et al. 2022.
Key findings
The decisive test of formative assessment: Wiliam's own programme, at scale, on independent national exams — +0.09 and marginal, i.e. 4-7x below the 1998 headline claim. At ~£1.20 per pupil per year even 0.09 would be exceptional value if real. The honest statement is that formative assessment is a cheap, small, uncertain positive rather than a transformation.
Genetic confound
Minimal — school-level randomization with a national-register outcome.
Replication notes
Single large trial, unreplicated. The developer's own earlier KMOFAP quasi-experiment gave ~0.32, a ~3x hothouse-to-scale shrinkage within the same programme lineage.

Effects

OutcomeMetricValueMeasureTimingVsHorizonClass
Attainment 8 (GCSE), all pupilsES+0.09 (pre-registered primary analysis; CI -0.01 to 0.21, p = .09)standardizedend of 2-year treatmentbusiness-as-usualend-of-treatmentattainment
Pupils eligible for free school mealsES+0.07 (not significant)standardizedend of treatmentbusiness-as-usualend-of-treatmentattainment
Schools without prior TEEP exposure (exploratory subgroup)ES+0.13 (p < .05)standardizedend of treatmentbusiness-as-usualend-of-treatmentattainment

Cited by