The Evidence on Teaching

A Quantitative Synthesis of Research on Writing Approaches in Grades 2 to 12. Best Evidence Encyclopedia (BEE)

Slavin RE, Lake C, Inns A, Baye A, Dachet D, Haslam J · 2019

grade Bmeta-analysisindependentreplicated
Sample
14 studies of 12 programmes met the inclusion standards; 12 randomised, 2 matched
Population
Students in Grades 2-12 (roughly ages 7-18)
Design
The single most important methodological contrast in this subject. Where the Graham- family meta-analyses admit any experimental or quasi-experimental study with a reliably scored writing-quality measure, the Best Evidence Encyclopedia standards require randomised or well-matched control groups, ADEQUATE SAMPLE SIZE AND DURATION, and - decisively - "measures independent of the program developers, researchers, and teachers". Applying those filters to the same literature leaves 14 studies of 12 programmes. The resulting effect sizes are therefore the closest thing this subject has to an independent-measure estimate, and they are roughly a quarter to a fifth the size of the researcher-scored headline numbers.
Key findings
Average effect on writing achievement across all categories ES = +0.18. By category: programmes focused on the writing process +0.17; programmes using cooperative learning +0.16; programmes focused on interactions between reading and writing +0.19. All three categories are positive, consistent, and small. Set this against Graham & Perin's +0.82 for strategy instruction, Graham et al.'s +1.02 in the elementary grades, and Koster et al.'s +0.96, all on researcher-scored quality measures. The size of the gap is larger than METHODOLOGY's nominal 2x measure-type inflation, which is itself the finding: the writing literature is unusually dependent on treatment-aligned scoring. The authors also note how thin the qualifying evidence base is - fourteen studies for an entire school subject across eleven year groups.
Genetic confound
Low. Twelve of the fourteen qualifying studies are randomised; the two matched designs are the residual exposure.

Effects

OutcomeMetricValueMeasureTimingVsHorizonClass
Writing achievement, all writing programmesmean effect size, independent measures only0.18standardizedpost-treatmentbusiness-as-usualend-of-treatmentdomain-skill
Writing achievement, writing-process programmesmean effect size0.17standardizedpost-treatmentbusiness-as-usualend-of-treatmentdomain-skill
Writing achievement, cooperative-learning programmesmean effect size0.16standardizedpost-treatmentbusiness-as-usualend-of-treatmentdomain-skill
Writing achievement, reading-writing integration programmesmean effect size0.19standardizedpost-treatmentbusiness-as-usualend-of-treatmentdomain-skill

Cited by