The Evidence on Teaching

A Randomized Controlled Trial of Professional Development for Interdisciplinary Civic Education: Impacts on Humanities Teachers and Their Students

Barr DJ, Boulay B, Selman RL, McCormick R, Lowenstein E, Gamse B, Fine M, Leonard MB · 2015

grade Crctdeveloper-involvedunreplicated
Sample
60 high schools (32 intervention, 30 comparison), 113 teachers, 1,371 grade 9-10 students
Population
Grade 9 and 10 humanities students and their teachers in 60 high schools across eight US metropolitan regions.
Design
School-level cluster-randomized trial of Facing History and Ourselves - a five-day summer seminar for teachers plus curricular materials plus follow-up coaching and workshops, supporting an interdisciplinary historical case-study unit taught with student-centred pedagogy. INDEPENDENCE PROBLEM: this is not an arm's-length evaluation. The lead author was Facing History's own director of research, Facing History's evaluation staff sat on the research team, and the trial was funded by a foundation, with Abt Associates and Harvard Graduate School of Education collaborating. Under this archive's efficacy-to-effectiveness decay rule that is a material discount, and it is why the grade is C rather than B despite the cluster-randomized design. MEASUREMENT PROBLEM: essentially all student outcomes are researcher-designed self-report scales (civic efficacy, tolerance for differing views, perceived classroom climate) rather than standardized instruments or observed behaviour, and no behavioural outcome - not volunteering, not registration, not turnout - was measured at all. IMPLEMENTATION PROBLEM: roughly half of intervention teachers only partially implemented the programme. READ DEPTH CAVEAT: read via the ERIC record, the Harvard Graduate School of Education write-up and the Evidence for ESSA entry; effect sizes other than the reported prosocial-behaviour composite were not extracted.
Key findings
Positive but small, self-reported, and confined to attitudes. Students of Facing History teachers showed significantly greater historical thinking and evidence-analysis skill, greater civic efficacy, greater tolerance for people with different social or political views, and perceived a more open and respectful classroom climate; across measures of prosocial behaviours the reported effect size was about +0.12. There were NO effects on racial attitudes, on convictions about deliberation, or on sense of civic responsibility. Teacher effects were larger than student effects: significantly greater self-efficacy across all eight assessed domains, better perceptions of professional support and growth, less burnout. The honest summary is that the most rigorously evaluated named civics programme in the US moved teachers a lot, moved student attitudes a little on researcher-built scales, and was never tested against any civic behaviour.
Genetic confound
Low for internal validity - schools were randomized, so heritable ability and family political disposition are balanced. The threat here is not confounding but developer involvement, researcher-designed self-report outcomes, and partial implementation, all of which bias toward finding effects.
Replication notes
No independent replication of the civic outcomes. A later Journal of Youth and Adolescence study (2022) reports social-and-emotional-learning effects of Facing History in middle school, but that is a different sample and different outcomes, not a replication of this trial. Given the developer involvement and the unreplicated status, METHODOLOGY's replication rule caps what this source can support at mixed.
DOI / URL
10.1177/016146811511700202

Effects

OutcomeMetricValueMeasureTimingVsHorizonClass
Prosocial behaviours (composite)effect size+0.12 across measuresresearcher-designed self-reportend of intervention yearbusiness-as-usualend-of-treatmentnon-cognitive
Historical thinking and evidence analysistreatment-control differencesignificantly greater in intervention schoolsresearcher-designedend of intervention yearbusiness-as-usualend-of-treatmentdomain-skill
Civic efficacytreatment-control differencesignificantly greaterresearcher-designed self-reportend of intervention yearbusiness-as-usualend-of-treatmentnon-cognitive
Tolerance for people with differing social or political viewstreatment-control differencesignificantly greaterresearcher-designed self-reportend of intervention yearbusiness-as-usualend-of-treatmentnon-cognitive
Racial attitudes, convictions about deliberation, sense of civic responsibilitytreatment-control differenceno effectsresearcher-designed self-reportend of intervention yearbusiness-as-usualend-of-treatmentnon-cognitive
Any civic BEHAVIOUR (voting, registration, volunteering)not measurednot measured - the trial has no behavioural endpointnonenot applicablebusiness-as-usualnot-applicablebehaviour
Teacher self-efficacy for civic, historical and ethical teachingtreatment-control differencesignificantly greater in all eight assessed domains; also less burnout, higher professional satisfactionresearcher-designed self-reportend of intervention yearbusiness-as-usualend-of-treatmentnon-cognitive

Cited by