The cognitive effects of computational thinking: A systematic review and meta-analytic study
Montuori, C., Gambarota, F., Altoé, G., & Arfé, B. · 2023
grade Cmeta-analysisdeveloper-involvedmixed
Sample
Review of 19 studies with 1,527 participants; meta-analysis of 11 studies with 862 participants (433 experimental, 429 control)
Population
Preschool to grade 10; studies published 2006-2022.
Design
A multivariate FIXED-effect model with three imputed correlations and a multiverse sensitivity analysis. Grey literature was explicitly EXCLUDED, and the authors concede they were not able to robustly assess publication bias; Egger's test was run for one outcome only. Moderator analyses by age and intervention type were impossible for lack of studies. Only 4 of the 19 reviewed studies had an ACTIVE control group, and of those the two reporting the primary outcome were null. Independence is recorded as developer-involved because the three largest effects in the pool come from the meta-analysts' own laboratory.
Key findings
The near/far gradient reappears cleanly. Problem solving d = 0.890 (95% CI 0.764-1.016) — but the review itself labels the largest problem-solving effects NEAR transfer, meaning coding problems. Planning 0.364 (0.222-0.505). Working memory 0.199 (0.045-0.353). Inhibition 0.168 (0.057-0.279). Cognitive flexibility 0.118 (-0.07 to 0.306), NOT significant. The authors themselves note that transfer appears to be typically narrow and more pronounced for abilities similar to those trained, and cite the same working-memory-training sources the archive uses to reach a no-effect verdict on brain training.
Genetic confound
Low for the experimental core; the pooled studies are mostly randomised or quasi-randomised. The threat here is measure alignment and author-lab concentration, not heredity.
Replication notes
The three largest effects in the pool come from the meta-analysts' own lab and have no independent replication. The core executive-function findings sit alongside null executive-function results the same review tabulates.
DOI / URL
10.1016/j.compedu.2023.104961
Effects
| Outcome | Metric | Value | Measure | Timing | Vs | Horizon | Class |
|---|---|---|---|---|---|---|---|
| Problem solving (labelled near transfer by the review itself) | d_ppc2 | 0.890 (95% CI 0.764-1.016), z = 13.8, p < .001 | mixed | post-test | business-as-usual | end-of-treatment | near-transfer |
| Planning | d_ppc2 | 0.364 (95% CI 0.222-0.505), p < .001 | standardized | post-test | business-as-usual | end-of-treatment | far-transfer |
| Working memory (accuracy) | d_ppc2 | 0.199 (95% CI 0.045-0.353), p = .011 | standardized | post-test | business-as-usual | end-of-treatment | far-transfer |
| Response inhibition (accuracy) | d_ppc2 | 0.168 (95% CI 0.057-0.279), p = .003 | standardized | post-test | business-as-usual | end-of-treatment | far-transfer |
| Cognitive flexibility (accuracy) | d_ppc2 | 0.118 (95% CI -0.07 to 0.306), p = .22 — not significant | standardized | post-test | business-as-usual | end-of-treatment | far-transfer |
Cited by
- Does learning to code improve general thinking?no effectconf: mediumgc: low