The Evidence on Teaching

Developing Historical Reading and Writing With Adolescent Readers: Effects on Student Learning

De La Paz S, Felton M, Monte-Sano C, Croninger R, Jackson C, Deogracias JS, Hoffman BP · 2014

grade Dquasi-experimentdeveloper-ledunreplicated
Sample
13 treatment teachers and 5 control teachers, eighth-grade US history
Population
Eighth-graders including students reading at or below basic proficiency, US
Design
The most-cited impact study of the disciplinary-literacy-in-history approach, and it is graded D because of its design, not its execution. The authors state that their funder's requirements prevented them from randomly assigning teachers or students; the comparison is 13 self-selected treatment teachers against 5 control teachers, with the headline result reported as pre-post GROWTH rather than as a treatment-control contrast. The intervention couples historical reading strategies with an evidence-based argument-writing curriculum plus professional development. The outcome is researcher-scored historical argument writing - fully aligned to what was taught, which is the measure type this archive discounts roughly 2x. Read at abstract/secondary depth; the article was not accessible in full.
Key findings
Reported growth of about 0.5 SD in students' ability to write historical arguments and in essay length, for all participants including struggling readers - but growth in historical argumentation did NOT come with growth in holistic writing quality, which is the most honest number in the study and the one usually left out of citations. Because the design has no credible counterfactual, 0.5 SD of pre-post growth on a taught, researcher-scored task is not separable from a year of ordinary schooling plus practice at the exact task being scored. Teachers most faithful to the curriculum's underlying constructs also adapted materials most successfully - a qualitative observation, not an impact estimate. Recorded as INCLUDED rather than excluded because it is the strongest positive result the historical-thinking side of this argument has, and a topic that omits it will look like it did not look.
Genetic confound
High for any causal claim. Teachers self-selected into the intervention; no randomisation; the reported estimate is pre-post growth without a matched contrast, so student and teacher composition, maturation and practice effects are all inside the number.
Replication notes
Unreplicated with an adequate control. Steiss et al. (2026) ran the closest thing to a proper test of the same approach at larger scale, with randomly selected treatment teachers, and found no significant difference from control - which is the outcome this design could not have detected.
DOI / URL
10.1080/00933104.2014.908754

Effects

OutcomeMetricValueMeasureTimingVsHorizonClass
Historical argument writing qualitypre-post growth (no randomised control contrast)~0.5 SD growth, including for struggling readersresearcher-designedacross the intervention yearnoneend-of-treatmentdomain-skill
Holistic writing qualitypre-post growthgrowth in historical argumentation but NOT in holistic qualityresearcher-designedacross the intervention yearnoneend-of-treatmentdomain-skill
Essay lengthpre-post growthsignificant growth for all participantsresearcher-designedacross the intervention yearnoneend-of-treatmentdomain-skill

Cited by