Block-based versus text-based programming environments on novice student learning outcomes: a meta-analysis study
Xu, Z., Ritzhaupt, A. D., Tian, F., & Umapathy, K. · 2019
grade Cmeta-analysisindependentunreplicated
Sample
13 publications, 52 effect-size comparisons
Population
Novice programmers across K-12 and undergraduate education.
Design
Small k. Both pooled estimates are non-significant under random effects, and the authors detected publication bias. Moderator analyses by education level, learning environment and duration are underpowered at k = 13, and hybrid block/text environments could not be handled by the coding scheme. Read at abstract depth. This is the only independent meta-analytic test of the single design principle the entire K-12 computing movement is built on.
Key findings
Blocks beat text on cognitive outcomes by g = 0.245, 95% CI -0.078 to 0.567, p = .137 — a confidence interval straddling zero. Affective outcomes g = 0.195, 95% CI -0.289 to 0.678, p = .429. Publication bias was detected. The field's most confidently asserted design principle, that blocks are a gentler on-ramp, is not supported by the pooled evidence.
Genetic confound
Low. The comparison is between two environments delivered to comparable novices; the threat is design quality, not heredity.
Replication notes
No competing meta-analysis of the same contrast was located. Descriptive and behavioural comparisons of block, text and hybrid modalities exist but neither confirm nor refute the null, and a 2025 systematic review of the block-to-text transition could not be obtained.
DOI / URL
10.1080/08993408.2019.1565233
Effects
| Outcome | Metric | Value | Measure | Timing | Vs | Horizon | Class |
|---|---|---|---|---|---|---|---|
| Cognitive learning outcomes, block-based versus text-based environment | Hedges g | 0.245 (95% CI -0.078 to 0.567), p = .137 | researcher-designed | end of intervention | active-alternative | end-of-treatment | domain-skill |
| Affective outcomes, block-based versus text-based | Hedges g | 0.195 (95% CI -0.289 to 0.678), p = .429 | researcher-designed | end of intervention | active-alternative | end-of-treatment | non-cognitive |
Cited by
- Does teaching programming actually teach programming — and does the method matter?moderate supportconf: mediumgc: low