Accelerating the development of formal thinking in middle and high school students
Adey, P., & Shayer, M. · 1990
grade Dquasi-experimentdeveloper-ledfailed
Sample
8 schools plus 1 laboratory school; ~24 classes split between intervention and control (per the EEF 2016 report's description of the same dataset)
Population
England; average-attaining 11-12 and 12-13 year-olds in comprehensive secondary schools.
Design
The founding CASE study. Up to 30 hour-long "Thinking Science" intervention lessons delivered by science teachers over two years, displacing normal science lessons. Classes were matched, not randomised. The outcome measure is the tell: Piagetian Reasoning Tasks (NFER 1979) — the same Piagetian construct the intervention was built from, so the headline 0.89 SD is a gain on the trained task, not transfer. Shayer (1999) defends this explicitly. Analysis excluded two schools that dropped out or failed to implement, which the independent EEF evaluators later flagged as a potential false-positive bias. Effects appear only in specific age-by-sex cells; the 12+ girls and the middle-school students showed no gain over controls.
Key findings
Boys who started aged 12+ showed a pre-post effect of 0.89 SD on Piagetian tests versus control classes — a shift from the 51st to the 74th British percentile. Neither the middle-school students nor the 12+ girls beat controls; gains appeared for girls only in one 11+ class and in two laboratory-school classes. Critically, the paper reports NO effect on science achievement tests during the intervention. So at end of treatment CASE moved only the Piagetian measure it was designed around; the science, maths and English claims all came later, from delayed GCSE analyses (Shayer & Adey 1993).
Genetic confound
Medium-to-high: matched, non-randomised classes in self-selecting schools, with two non-implementing schools dropped from analysis. Intake differences between arms cannot be excluded.
Replication notes
The immediate cognitive-development finding has been reproduced repeatedly (Iqbal & Shayer 2000; Choi et al. 2002; McCormack et al. 2014) but always on Piagetian-based tasks, which the EEF evaluators note gives CASE participants an in-built advantage. The independent randomised effectiveness trial of the scaled programme (EEF/Hanley et al. 2016) found no effect on science and negative point estimates on standardised English and maths.
DOI / URL
10.1002/tea.3660270309
Effects
| Outcome | Metric | Value | Measure | Timing | Vs | Horizon | Class |
|---|---|---|---|---|---|---|---|
| Piagetian Reasoning Tasks, boys starting aged 12+, CASE vs matched control classes | d | 0.89 | researcher-designed | end of two-year intervention | business-as-usual | end-of-treatment | domain-skill |
| Piagetian Reasoning Tasks, 12+ girls and middle-school students | d | null (no gain over controls) | researcher-designed | end of two-year intervention | business-as-usual | end-of-treatment | domain-skill |
| Science achievement tests during the intervention | d | null ("There was no effect on tests of science achievement during the intervention") | unclear | during and at end of intervention | business-as-usual | end-of-treatment | domain-skill |
| Piagetian formal operations, laboratory-school classes, delayed post-test | d | gains over controls maintained (magnitude not stated in abstract) | researcher-designed | one year after cessation of the programme | business-as-usual | under-1yr | domain-skill |
Cited by
- Teaching students to think scientifically — does it transfer?no effectconf: mediumgc: low