A Randomized Controlled Trial of Professional Development for Interdisciplinary Civic Education: Impacts on Humanities Teachers and Their Students
Barr DJ, Boulay B, Selman RL, McCormick R, Lowenstein E, Gamse B, Fine M, Leonard MB · 2015
grade Crctdeveloper-involvedunreplicated
Sample
60 high schools (32 intervention, 30 comparison), 113 teachers, 1,371 grade 9-10 students
Population
Grade 9 and 10 humanities students and their teachers in 60 high schools across eight US metropolitan regions.
Design
School-level cluster-randomized trial of Facing History and Ourselves - a five-day summer seminar for teachers plus curricular materials plus follow-up coaching and workshops, supporting an interdisciplinary historical case-study unit taught with student-centred pedagogy. INDEPENDENCE PROBLEM: this is not an arm's-length evaluation. The lead author was Facing History's own director of research, Facing History's evaluation staff sat on the research team, and the trial was funded by a foundation, with Abt Associates and Harvard Graduate School of Education collaborating. Under this archive's efficacy-to-effectiveness decay rule that is a material discount, and it is why the grade is C rather than B despite the cluster-randomized design. MEASUREMENT PROBLEM: essentially all student outcomes are researcher-designed self-report scales (civic efficacy, tolerance for differing views, perceived classroom climate) rather than standardized instruments or observed behaviour, and no behavioural outcome - not volunteering, not registration, not turnout - was measured at all. IMPLEMENTATION PROBLEM: roughly half of intervention teachers only partially implemented the programme. READ DEPTH CAVEAT: read via the ERIC record, the Harvard Graduate School of Education write-up and the Evidence for ESSA entry; effect sizes other than the reported prosocial-behaviour composite were not extracted.
Key findings
Positive but small, self-reported, and confined to attitudes. Students of Facing History teachers showed significantly greater historical thinking and evidence-analysis skill, greater civic efficacy, greater tolerance for people with different social or political views, and perceived a more open and respectful classroom climate; across measures of prosocial behaviours the reported effect size was about +0.12. There were NO effects on racial attitudes, on convictions about deliberation, or on sense of civic responsibility. Teacher effects were larger than student effects: significantly greater self-efficacy across all eight assessed domains, better perceptions of professional support and growth, less burnout. The honest summary is that the most rigorously evaluated named civics programme in the US moved teachers a lot, moved student attitudes a little on researcher-built scales, and was never tested against any civic behaviour.
Genetic confound
Low for internal validity - schools were randomized, so heritable ability and family political disposition are balanced. The threat here is not confounding but developer involvement, researcher-designed self-report outcomes, and partial implementation, all of which bias toward finding effects.
Replication notes
No independent replication of the civic outcomes. A later Journal of Youth and Adolescence study (2022) reports social-and-emotional-learning effects of Facing History in middle school, but that is a different sample and different outcomes, not a replication of this trial. Given the developer involvement and the unreplicated status, METHODOLOGY's replication rule caps what this source can support at mixed.
DOI / URL
10.1177/016146811511700202
Effects
| Outcome | Metric | Value | Measure | Timing | Vs | Horizon | Class |
|---|---|---|---|---|---|---|---|
| Prosocial behaviours (composite) | effect size | +0.12 across measures | researcher-designed self-report | end of intervention year | business-as-usual | end-of-treatment | non-cognitive |
| Historical thinking and evidence analysis | treatment-control difference | significantly greater in intervention schools | researcher-designed | end of intervention year | business-as-usual | end-of-treatment | domain-skill |
| Civic efficacy | treatment-control difference | significantly greater | researcher-designed self-report | end of intervention year | business-as-usual | end-of-treatment | non-cognitive |
| Tolerance for people with differing social or political views | treatment-control difference | significantly greater | researcher-designed self-report | end of intervention year | business-as-usual | end-of-treatment | non-cognitive |
| Racial attitudes, convictions about deliberation, sense of civic responsibility | treatment-control difference | no effects | researcher-designed self-report | end of intervention year | business-as-usual | end-of-treatment | non-cognitive |
| Any civic BEHAVIOUR (voting, registration, volunteering) | not measured | not measured - the trial has no behavioural endpoint | none | not applicable | business-as-usual | not-applicable | behaviour |
| Teacher self-efficacy for civic, historical and ethical teaching | treatment-control difference | significantly greater in all eight assessed domains; also less burnout, higher professional satisfaction | researcher-designed self-report | end of intervention year | business-as-usual | end-of-treatment | non-cognitive |
Cited by
- Does civic education produce civic knowledge, and does civic knowledge produce civic behaviour?mixedconf: mediumgc: low