The Evidence on Teaching

An exploratory meta-analytic review on the empirical evidence of differential learning as an enhanced motor learning method

Tassignon B, Verschueren J, Baeyens J-P, Benjaminse A, Gokeler A, Serrien B, Clijsen R · 2021

grade Dmeta-analysisindependentunreplicatednumbers spot-checked
Sample
897 (DL 453 / control 446) across 27 studies
Population
University sports classes, club athletes, rehab patients; soccer, tennis, basketball, shot put, high jump, balance, fine motor tasks
Design
27 studies / 31 experiments, 897 participants (DL 453, control 446). Acquisition pool = 23 studies / 27 experiments; retention pool = 12 studies / 12 experiments; transfer reported too rarely to meta-analyse. Differential learning = deliberately high, non-repeating movement variability, the strongest form of variability-of-practice. Risk of bias rated high for nearly all studies (only 15/31 low risk on randomisation; allocation concealment unclear in all but six; selective reporting high risk in 9/31); funnel plots show moderate rightward asymmetry; I²=77-78% acquisition, 79% retention. Retention intervals ranged 1 h to 1 year, most 1-2 weeks. The paper is internally inconsistent on the headline acquisition estimate: abstract says d=0.26 [0.10, 0.42], results section and part of the discussion say d=0.27 [0.12, 0.42]. THE EVIDENCE BASE IS DEVELOPER-CONCENTRATED even though the meta-analysts are not: the retention technical-skills subgroup "mainly encompassed studies from one research group" (Schöllhorn's, DL's originator), Schöllhorn-lab experiments make up a large share of the pool, and the authors cite the developer's own institutional publication list of unpublished abstracts as evidence that publication bias "is present and affected the results of the meta-analysis". Three of seven retention subgroups rest on a single study each.
Key findings
The only meta-analytic evidence on high-variability practice, and it is weak. Differential learning shows a small acquisition effect (d=0.26) growing to medium at retention (0.61) — directionally consistent with the story that variability pays off later, not sooner. But the authors themselves say 'inferences about the effectiveness of DL would be premature': high risk of bias in nearly all studies, funnel asymmetry indicating publication bias, I² ~78-79%, small underpowered samples, and no transfer analysis at all. DECISIVE AND PREVIOUSLY UNRECORDED: the whole DL advantage is against TRADITIONAL REPETITIVE practice. Head-to-head against other variability-based methods it disappears — vs structural learning d=-0.19 at acquisition and -0.18 at retention, vs contextual interference d=-0.04 (technical skills) and +0.13 at retention. The authors' own abstract concedes: "For robust comparisons on the relative effectiveness of DL to different variability-based motor learning methods, scarce and inconclusive evidence was found." Two whole acquisition subgroups are null or negative: fine motor skills d=-0.12 and tactical behaviour d=0.20 (ns). Related primary work (Caballero et al. 2024, PeerJ 12:e17575, 'more is not better') finds variability is not monotonically beneficial.
Genetic confound
Not addressed. Baseline skill and intrinsic movement variability differ substantially between learners and are plausibly heritable; DL studies do not model who benefits.
Replication notes
No preregistered replication. The classic schema-theory variability-of-practice prediction remains inconsistently supported; no modern meta-analysis isolates variable vs constant practice on delayed transfer.

Effects

OutcomeMetricValueMeasureTimingVsHorizonClass
Differential (high-variability) vs traditional repetitive practice, acquisitionCohen's d (post-pre)0.26 (95% CI 0.10-0.42) — small; 27 experiments, p=0.0006. (Results section and part of the discussion report this same estimate as 0.27 [0.12, 0.42] — the paper is internally inconsistent.)mixedacquisition; immediate; lab+field mixedactive-alternativeend-of-treatmentdomain-skill
Differential vs traditional practice, retentionCohen's d (retention-pre)0.61 (95% CI 0.30-0.91, p<0.0001) — medium; only 12 experiments; subgroup differences significant (chi2=20.29, p=0.001, I2=75%)mixedretention; delayed; lab+field mixedactive-alternativeunder-1yrdomain-skill
Retention, sport technical skills subgroupCohen's d0.63 (95% CI 0.34-0.91); only 4 experiments, and the authors note this subgroup "mainly encompassed studies from one research group" (the DL developer's)researcher-designedretention; delayed; field/applied sportactive-alternativeunder-1yrdomain-skill
Retention, sport performance outcomes subgroupCohen's d1.00 (95% CI -0.27 to 2.28, I2=89%) — non-significant, very wide CI; 4 experiments, one of which (Beckmann & Schöllhorn 2006) is a whole-analysis outlier with an effect 27x larger than a same-design studyresearcher-designedretention; delayed; field/applied sportactive-alternativeunder-1yrdomain-skill
DL vs OTHER VARIABILITY-BASED methods, acquisition (cuts against the DL story)Cohen's dvs structural learning d = -0.19 (-1.00 to 0.62); vs contextual interference, technical skills d = -0.04 (-0.48 to 0.39); vs contextual interference, sport performance d = +0.98 (0.56-1.40). Each rests on a single experimentresearcher-designedacquisition; immediate; field/applied sportactive-alternativeend-of-treatmentdomain-skill
DL vs OTHER VARIABILITY-BASED methods, retention (cuts against the DL story)Cohen's dvs structural learning d = -0.18 (-0.99 to 0.63); vs contextual interference d = +0.13 (-0.27 to 0.54). Both negligible, both single studies — the authors conclude evidence here is "scarce and inconclusive"researcher-designedretention; delayed; field/applied sportactive-alternativeunder-1yrdomain-skill
Acquisition, fine motor skills subgroup (null/negative)Cohen's d-0.12 (95% CI -1.04 to 0.79, I2=97%) — DL slightly WORSE than traditional practice on toothbrushing and dental-surgery tasksresearcher-designedacquisition; immediate; lab/clinicalactive-alternativeend-of-treatmentdomain-skill
Acquisition, tactical behaviour in sport subgroup (null)Cohen's d0.20 (95% CI -0.03 to 0.44, I2=77%), non-significant; 4 experiments; no experiment at all measured tactical behaviour at retentionresearcher-designedacquisition; immediate; field/applied sportactive-alternativeend-of-treatmentdomain-skill
Transfernot analysableReported in too few studies to meta-analyse — the outcome that matters most is simply absentunknowntransfer; not assessedunclearnot-applicablenear-transfer

Cited by