The state of evidence for social and emotional learning: A contemporary meta-analysis of universal school-based SEL interventions
Cipriano C, Strambler MJ, Naples LH, Ha C, Kirk M, Wood M, Sehgal K, Zieher AK, Eveleigh A, McCarthy M, Funaro M, Ponnock A, Chow JC, Durlak J · 2023
grade Bmeta-analysisdeveloper-involvedmixed
Sample
424 studies, 575,361 students, 53 countries, ages 5-17, published 2008-2020, covering 252 distinct interventions
Population
School students aged 5-17, international.
Design
A Registered Report, which is the strongest design feature available to a meta-analysis, using correlated-hierarchical-effects models with robust variance estimation. 237 of 424 studies were randomised. Nearly 73% used education-as-usual or waitlist controls. Only 44.6% reported any implementation data and of those only 21% reached moderate or high fidelity. Only 55% of studies were conducted in the intervention's country of origin. Independence is developer-involved at field level - Durlak is a co-author of the 2011 meta-analysis this one revises, and the lead author directs a SEL research and advocacy centre. The tone is nonetheless self-critical; this is the field auditing itself.
Key findings
Overall g = 0.194 (0.166 to 0.221) across 1,865 outcomes, with I-squared of 93.7%. By domain - school climate 0.293, civic outcomes 0.255, peer relationships 0.222, SEL SKILLS 0.219 (against 0.57 in Durlak), attitudes 0.209, prosocial 0.178, externalising 0.162, emotional distress 0.140, school functioning 0.122. ACADEMIC ACHIEVEMENT g = 0.109 (0.037 to 0.182), roughly 60% below Durlak's 0.27. Null results on discipline (0.183, CI -0.237 to 0.602, p = .328), family relationships and physical health. Follow-up, available for 11% of studies at a mean of 53 weeks, gave 0.167 overall with 6 of 12 domains still significant. PUBLICATION BIAS IS SIGNIFICANT - Egger t = 3.59 overall (p < .001), with published studies at 0.220 against unpublished at 0.164. On measurement, 53.5% of outcomes are child-reported and 58.7% are rating scales, checklists or questionnaires.
Genetic confound
Medium - 44% of the pool is quasi-experimental.
Replication notes
Partial and attenuating. It reproduces a positive overall signal at about two thirds the size on skills and 40% the size on achievement, and its own publication-bias tests are significant.
DOI / URL
10.1111/cdev.13968
Effects
| Outcome | Metric | Value | Measure | Timing | Vs | Horizon | Class |
|---|---|---|---|---|---|---|---|
| Academic achievement | Hedges g | 0.109 (95% CI 0.037 to 0.182) — versus 0.27 in Durlak 2011 | mixed | post-intervention | business-as-usual | end-of-treatment | domain-skill |
| Overall effect across all outcomes | Hedges g | 0.194 (0.166 to 0.221), k = 1,865 outcomes, I-squared 93.7% | mixed | post-intervention | business-as-usual | end-of-treatment | non-cognitive |
| SEL skills | Hedges g | 0.219 — versus 0.57 in Durlak 2011 | researcher-designed | post-intervention | business-as-usual | end-of-treatment | non-cognitive |
| School discipline outcomes | Hedges g | 0.183 (95% CI -0.237 to 0.602), p = .328 — null | standardized | post-intervention | business-as-usual | end-of-treatment | behaviour |
| Publication bias | Egger test / published versus unpublished | t = 3.59, p < .001; published 0.220 versus unpublished 0.164 | mixed | not applicable | none | not-applicable | non-cognitive |
| Follow-up effects | Hedges g | 0.167 (0.103 to 0.230), available for 11% of studies at a mean of 53 weeks | mixed | about 1 year | business-as-usual | 1-2yr | non-cognitive |
Cited by
- Should a school buy a social and emotional learning programme?mixedconf: highgc: low