Promoting Alternative Thinking Strategies (PATHS): Evaluation report and Executive summary
Berry V, Axford N, Blower S, Bywater T, Humphrey N, Barlow J, Wigelsworth M, Lendrum A, Pert K, Joyce C, Stephens E, Wo L, Squires G, Woods K, Calam R, Harrison R, Turner R · 2015
grade Arctindependentfailed
Sample
45 schools in Greater Manchester; 1,705 Year 5 pupils (aged 9-10) and 1,631 Year 6 pupils (aged 10-11); two years of implementation, 2012-14
Population
England; primary-school pupils.
Design
The direct test of the SEL achievement claim on externally marked national tests, and it is an EFFICACY trial run under developer-optimised conditions - training was led by Penn State's Evidence-Based Prevention and Intervention Support Centre, teachers received coaching, and materials came from Barnardo's. School dropout was under 20% in Year 5 and ZERO in Year 6. Outcomes are Key Stage 2 SATs for Year 6 and standardised InCAS testing for Year 5. EEF rated security high for Year 6 and moderate-to-high for Year 5.
Key findings
PATHS did not raise attainment. Year 5 maths +0.026, Year 5 reading -0.029, Year 6 maths -0.025, and Year 6 English -0.106, which EEF translates as minus two months' progress and describes as attributable to the intervention rather than to chance. Free-school-meal subgroup estimates were Year 5 maths -0.036, Year 5 reading +0.017, Year 6 maths +0.016 and Year 6 English +0.120. On average only half the lessons were delivered. EEF's verdict is that the lack of impact can be attributed to the lack of success of the PATHS programme itself, and it notes that the American study underwriting PATHS's reputation had an attrition rate of nearly 50%.
Genetic confound
Low. School-level randomisation.
Replication notes
A failed replication of the US PATHS evidence base, conducted under conditions maximally favourable to the programme, with the one secure signal running negative.
Effects
| Outcome | Metric | Value | Measure | Timing | Vs | Horizon | Class |
|---|---|---|---|---|---|---|---|
| Year 6 English (Key Stage 2 SATs, externally marked) | effect size | -0.106, about minus 2 months progress; EEF attributes it to the intervention | standardized | end of 2-year programme | business-as-usual | end-of-treatment | domain-skill |
| Year 6 mathematics (Key Stage 2 SATs) | effect size | -0.025, about 0 to -1 month | standardized | end of programme | business-as-usual | end-of-treatment | domain-skill |
| Year 5 mathematics and reading (InCAS standardised) | effect size | +0.026 and -0.029 | standardized | end of programme | business-as-usual | end-of-treatment | domain-skill |
| Lessons delivered | proportion | on average only half | researcher-designed | 2 years | business-as-usual | end-of-treatment | behaviour |
Cited by
- Should a school buy a social and emotional learning programme?mixedconf: highgc: low