The Evidence on Teaching

The cognitive effects of computational thinking: A systematic review and meta-analytic study

Montuori, C., Gambarota, F., Altoé, G., & Arfé, B. · 2023

grade Cmeta-analysisdeveloper-involvedmixed
Sample
Review of 19 studies with 1,527 participants; meta-analysis of 11 studies with 862 participants (433 experimental, 429 control)
Population
Preschool to grade 10; studies published 2006-2022.
Design
A multivariate FIXED-effect model with three imputed correlations and a multiverse sensitivity analysis. Grey literature was explicitly EXCLUDED, and the authors concede they were not able to robustly assess publication bias; Egger's test was run for one outcome only. Moderator analyses by age and intervention type were impossible for lack of studies. Only 4 of the 19 reviewed studies had an ACTIVE control group, and of those the two reporting the primary outcome were null. Independence is recorded as developer-involved because the three largest effects in the pool come from the meta-analysts' own laboratory.
Key findings
The near/far gradient reappears cleanly. Problem solving d = 0.890 (95% CI 0.764-1.016) — but the review itself labels the largest problem-solving effects NEAR transfer, meaning coding problems. Planning 0.364 (0.222-0.505). Working memory 0.199 (0.045-0.353). Inhibition 0.168 (0.057-0.279). Cognitive flexibility 0.118 (-0.07 to 0.306), NOT significant. The authors themselves note that transfer appears to be typically narrow and more pronounced for abilities similar to those trained, and cite the same working-memory-training sources the archive uses to reach a no-effect verdict on brain training.
Genetic confound
Low for the experimental core; the pooled studies are mostly randomised or quasi-randomised. The threat here is measure alignment and author-lab concentration, not heredity.
Replication notes
The three largest effects in the pool come from the meta-analysts' own lab and have no independent replication. The core executive-function findings sit alongside null executive-function results the same review tabulates.
DOI / URL
10.1016/j.compedu.2023.104961

Effects

OutcomeMetricValueMeasureTimingVsHorizonClass
Problem solving (labelled near transfer by the review itself)d_ppc20.890 (95% CI 0.764-1.016), z = 13.8, p < .001mixedpost-testbusiness-as-usualend-of-treatmentnear-transfer
Planningd_ppc20.364 (95% CI 0.222-0.505), p < .001standardizedpost-testbusiness-as-usualend-of-treatmentfar-transfer
Working memory (accuracy)d_ppc20.199 (95% CI 0.045-0.353), p = .011standardizedpost-testbusiness-as-usualend-of-treatmentfar-transfer
Response inhibition (accuracy)d_ppc20.168 (95% CI 0.057-0.279), p = .003standardizedpost-testbusiness-as-usualend-of-treatmentfar-transfer
Cognitive flexibility (accuracy)d_ppc20.118 (95% CI -0.07 to 0.306), p = .22 — not significantstandardizedpost-testbusiness-as-usualend-of-treatmentfar-transfer

Cited by