The transfer effect of computational thinking (CT)-STEM: a systematic literature review and meta-analysis
Li, Z., & Oon, P. T. · 2024
grade Cmeta-analysisindependentmixed
Sample
37 studies, 7,832 students, 96 effect sizes
Population
Kindergarten through university, with computational thinking integrated into STEM subjects.
Design
A random-effects meta-analysis of computational-thinking-STEM integration studies, with a fatal gap for this topic: no active-versus-passive control moderator was coded or tested, which is the one variable that collapses the estimate in the best meta in the field. Six other moderators were tested. The outcome taxonomy is also not the archive's — the near-transfer bucket includes STEM achievement and the far-transfer bucket is creativity, critical thinking and problem solving.
Key findings
Overall transfer g = 0.601 (95% CI 0.510-0.691), I-squared = 88.9%. Near transfer g = 0.645 (0.536-0.753); far transfer g = 0.444 (0.312-0.576). The far-transfer funnel plot is asymmetric and Egger's test is t(24) = 3.90, p < .001 — clear publication bias on exactly the estimate the policy claim depends on, which the authors report and then headline the uncorrected number anyway. The sample-size moderator is the other tell: studies with n under 50 give g = 0.826 while studies with n over 150 give g = 0.233 (Q_B = 48.0, p < .001), a textbook small-study effect the authors interpret as a substantive class-size finding. Effects also shrink with longer interventions, which no dose-response account of transfer predicts.
Genetic confound
Medium. A mixed-design pool with no control-type moderation.
Replication notes
Its overall estimate is consistent with the uncorrected headline of Scherer et al. (2019), but it lacks the control-type moderator that collapses that estimate, so it does not independently confirm anything about far transfer.
DOI / URL
10.1186/s40594-024-00498-z
Effects
| Outcome | Metric | Value | Measure | Timing | Vs | Horizon | Class |
|---|---|---|---|---|---|---|---|
| Overall computational-thinking-STEM transfer | Hedges g | 0.601 (95% CI 0.510-0.691), I-squared = 88.9% | mixed | post-test | unclear | end-of-treatment | near-transfer |
| Near transfer (CT skills, programming, algorithmic thinking, STEM achievement) | Hedges g | 0.645 (95% CI 0.536-0.753); Egger t(70) = 0.85, p = .40 | mixed | post-test | unclear | end-of-treatment | domain-skill |
| Far transfer (creativity, critical thinking, problem solving) | Hedges g | 0.444 (95% CI 0.312-0.576); Egger t(24) = 3.90, p < .001 — publication bias present | mixed | post-test | unclear | end-of-treatment | far-transfer |
| Effect by study sample size | Hedges g | n under 50 gives 0.826; n over 150 gives 0.233 (Q_B = 48.0, p < .001) | mixed | post-test | unclear | end-of-treatment | far-transfer |
Cited by
- Does learning to code improve general thinking?no effectconf: mediumgc: low