Effective instruction conditions for educational robotics to develop programming ability of K-12 students: A meta-analysis
Sun, L., & Zhou, D. · 2022
grade Cmeta-analysisindependentmixed
Sample
36 studies, 4,180 K-12 students, 85 effect sizes
Population
K-12 including kindergarten, international, with heavy Asian representation.
Design
The authors invented the "essential versus generative ability" outcome split themselves for this meta-analysis, so the outcome construct is not independently defined. The moderator profile is a textbook inflation signature: the largest effects appear at kindergarten, for interventions of one to five weeks, for samples under 50, and depend on the choice of measurement scale. Every one of those points the same direction — small, short, self-measured studies drive the estimate. Read at abstract depth.
Key findings
Educational robotics moved "essential" programming ability g = 0.539 (95% CI 0.327-0.752) and "generative" ability g = 0.535 (0.426-0.643). Individual programming favoured essential ability and cooperative programming favoured generative ability. Effects were largest in kindergarten, largest for one-to-five-week interventions, and largest for samples under 50.
Genetic confound
Medium. Mixed experimental and quasi-experimental base.
Replication notes
Robotics meta-analyses cluster around g = 0.5-0.9 but with wildly different inclusion rules and outcome constructs, so the apparent agreement is not replication — the construct being pooled is not the same across them.
DOI / URL
10.1111/jcal.12750
Effects
| Outcome | Metric | Value | Measure | Timing | Vs | Horizon | Class |
|---|---|---|---|---|---|---|---|
| Essential programming ability | Hedges g | 0.539 (95% CI 0.327-0.752), p < 0.001 | researcher-designed | end of intervention | unclear | end-of-treatment | domain-skill |
| Generative programming ability | Hedges g | 0.535 (95% CI 0.426-0.643), p < 0.001 | researcher-designed | end of intervention | unclear | end-of-treatment | domain-skill |
| Moderators — age, duration, sample size | moderator tests | largest effects at kindergarten, at 1-5 weeks, and for samples under 50 | researcher-designed | end of intervention | unclear | end-of-treatment | domain-skill |
Cited by
- Does teaching programming actually teach programming — and does the method matter?moderate supportconf: mediumgc: low