A Historical Writing Apprenticeship for Adolescents: Integrating Disciplinary Learning With Cognitive Strategies
De La Paz S, Monte-Sano C, Felton M, Croninger R, Jackson C, Piantedosi KW · 2017
grade Cquasi-experimentdeveloper-ledmixed
Sample
Eighth-grade US history classes across multiple schools in one US district; exact analytic n not obtained from the sources read
Population
Culturally and academically diverse eighth graders, including students reading at or below basic proficiency, in a district where 15-30% of students were significantly below grade level in reading
Design
An 18-day source-based history and writing curriculum taught over one school year, using cognitive apprenticeship to integrate historical reading strategies (sourcing, contextualisation, corroboration) with explicit argument-writing strategies, plus a year-long professional development course. Assignment was NOT random: a companion paper from the same project states that the PD course was created "for teachers who elected to implement the curriculum", so treatment teachers are volunteers and the comparison condition is composed of non-volunteers - the same selection problem as Reisman 2012, with the same consequence for the grade. Implementation fidelity was reported as high, and dose-response (more of the curriculum completed, better outcomes) was reported, which is suggestive but is itself confounded with teacher quality and class pace. All outcomes are researcher-scored writing rubrics applied to student essays - historical writing quality, overall writing quality, essay length - so the archive's ~2x discount on researcher-designed, treatment-aligned measures applies in full. No standardized achievement measure of any kind was administered, so this study cannot speak to whether source-based history writing instruction moves anything a district would measure.
Key findings
Positive and significant on every writing outcome after controlling for incoming ability, with moderate to large effects overall. The reported subgroup numbers are for basic readers relative to basic readers in the control condition: historical writing quality d = 0.45, overall writing quality d = 0.32, essay length d = 0.60. The largest effect is on essay LENGTH, which is the least interesting and most easily manipulated of the three - a strategy intervention that teaches students a writing structure will predictably produce longer essays, and length correlates mechanically with rubric scores. The companion study in the same research programme (De La Paz et al. 2014) reports growth of about 0.5 SD in historical argument writing and essay length for all participants including struggling readers.
Genetic confound
Medium-high. Teachers self-selected into the treatment condition, so the treated classrooms are not a random draw of the district; incoming ability was controlled statistically but that controls measured prior attainment only.
Replication notes
Mixed. Within its own programme the finding recurs (De La Paz et al. 2014 in the same district reports ~0.5 SD on historical argument writing), and De La Paz's earlier 2005 SRSD study with eighth graders and 2010 work with Felton point the same way - but every one of these is the same author team using the same rubrics, and the outcome that repeats is always a researcher-scored essay. No independent group has evaluated this curriculum, and the archive's own writing-subject evidence (EEF Grammar for Writing, Torgerson 2014) shows that writing-instruction effects on researcher-built measures routinely vanish on national tests.
DOI / URL
10.1002/rrq.147
Effects
| Outcome | Metric | Value | Measure | Timing | Vs | Horizon | Class |
|---|---|---|---|---|---|---|---|
| Historical argument writing quality (basic readers) | effect size vs basic readers in the control condition | 0.45 | researcher-designed | end of the school year in which the 18-day curriculum was taught | business-as-usual | end-of-treatment | domain-skill |
| Overall writing quality (basic readers) | effect size vs control | 0.32 | researcher-designed | end of school year | business-as-usual | end-of-treatment | domain-skill |
| Essay length (basic readers) | effect size vs control | 0.60 - the largest of the three outcomes, and the least meaningful | researcher-designed | end of school year | business-as-usual | end-of-treatment | domain-skill |
| Standardized reading or history achievement | not measured | no standardized outcome was administered in this study | standardized | not measured | none | not-applicable | unclear |
Cited by
- Does document-based source work move history knowledge, reading comprehension, or neither?mixedconf: mediumgc: low