An exploratory meta-analytic review on the empirical evidence of differential learning as an enhanced motor learning method
Tassignon B, Verschueren J, Baeyens J-P, Benjaminse A, Gokeler A, Serrien B, Clijsen R · 2021
grade Dmeta-analysisindependentunreplicatednumbers spot-checked
Sample
897 (DL 453 / control 446) across 27 studies
Population
University sports classes, club athletes, rehab patients; soccer, tennis, basketball, shot put, high jump, balance, fine motor tasks
Design
27 studies / 31 experiments, 897 participants (DL 453, control 446). Acquisition pool = 23 studies / 27 experiments; retention pool = 12 studies / 12 experiments; transfer reported too rarely to meta-analyse. Differential learning = deliberately high, non-repeating movement variability, the strongest form of variability-of-practice. Risk of bias rated high for nearly all studies (only 15/31 low risk on randomisation; allocation concealment unclear in all but six; selective reporting high risk in 9/31); funnel plots show moderate rightward asymmetry; I²=77-78% acquisition, 79% retention. Retention intervals ranged 1 h to 1 year, most 1-2 weeks. The paper is internally inconsistent on the headline acquisition estimate: abstract says d=0.26 [0.10, 0.42], results section and part of the discussion say d=0.27 [0.12, 0.42]. THE EVIDENCE BASE IS DEVELOPER-CONCENTRATED even though the meta-analysts are not: the retention technical-skills subgroup "mainly encompassed studies from one research group" (Schöllhorn's, DL's originator), Schöllhorn-lab experiments make up a large share of the pool, and the authors cite the developer's own institutional publication list of unpublished abstracts as evidence that publication bias "is present and affected the results of the meta-analysis". Three of seven retention subgroups rest on a single study each.
Key findings
The only meta-analytic evidence on high-variability practice, and it is weak. Differential learning shows a small acquisition effect (d=0.26) growing to medium at retention (0.61) — directionally consistent with the story that variability pays off later, not sooner. But the authors themselves say 'inferences about the effectiveness of DL would be premature': high risk of bias in nearly all studies, funnel asymmetry indicating publication bias, I² ~78-79%, small underpowered samples, and no transfer analysis at all. DECISIVE AND PREVIOUSLY UNRECORDED: the whole DL advantage is against TRADITIONAL REPETITIVE practice. Head-to-head against other variability-based methods it disappears — vs structural learning d=-0.19 at acquisition and -0.18 at retention, vs contextual interference d=-0.04 (technical skills) and +0.13 at retention. The authors' own abstract concedes: "For robust comparisons on the relative effectiveness of DL to different variability-based motor learning methods, scarce and inconclusive evidence was found." Two whole acquisition subgroups are null or negative: fine motor skills d=-0.12 and tactical behaviour d=0.20 (ns). Related primary work (Caballero et al. 2024, PeerJ 12:e17575, 'more is not better') finds variability is not monotonically beneficial.
Genetic confound
Not addressed. Baseline skill and intrinsic movement variability differ substantially between learners and are plausibly heritable; DL studies do not model who benefits.
Replication notes
No preregistered replication. The classic schema-theory variability-of-practice prediction remains inconsistently supported; no modern meta-analysis isolates variable vs constant practice on delayed transfer.
Effects
| Outcome | Metric | Value | Measure | Timing | Vs | Horizon | Class |
|---|---|---|---|---|---|---|---|
| Differential (high-variability) vs traditional repetitive practice, acquisition | Cohen's d (post-pre) | 0.26 (95% CI 0.10-0.42) — small; 27 experiments, p=0.0006. (Results section and part of the discussion report this same estimate as 0.27 [0.12, 0.42] — the paper is internally inconsistent.) | mixed | acquisition; immediate; lab+field mixed | active-alternative | end-of-treatment | domain-skill |
| Differential vs traditional practice, retention | Cohen's d (retention-pre) | 0.61 (95% CI 0.30-0.91, p<0.0001) — medium; only 12 experiments; subgroup differences significant (chi2=20.29, p=0.001, I2=75%) | mixed | retention; delayed; lab+field mixed | active-alternative | under-1yr | domain-skill |
| Retention, sport technical skills subgroup | Cohen's d | 0.63 (95% CI 0.34-0.91); only 4 experiments, and the authors note this subgroup "mainly encompassed studies from one research group" (the DL developer's) | researcher-designed | retention; delayed; field/applied sport | active-alternative | under-1yr | domain-skill |
| Retention, sport performance outcomes subgroup | Cohen's d | 1.00 (95% CI -0.27 to 2.28, I2=89%) — non-significant, very wide CI; 4 experiments, one of which (Beckmann & Schöllhorn 2006) is a whole-analysis outlier with an effect 27x larger than a same-design study | researcher-designed | retention; delayed; field/applied sport | active-alternative | under-1yr | domain-skill |
| DL vs OTHER VARIABILITY-BASED methods, acquisition (cuts against the DL story) | Cohen's d | vs structural learning d = -0.19 (-1.00 to 0.62); vs contextual interference, technical skills d = -0.04 (-0.48 to 0.39); vs contextual interference, sport performance d = +0.98 (0.56-1.40). Each rests on a single experiment | researcher-designed | acquisition; immediate; field/applied sport | active-alternative | end-of-treatment | domain-skill |
| DL vs OTHER VARIABILITY-BASED methods, retention (cuts against the DL story) | Cohen's d | vs structural learning d = -0.18 (-0.99 to 0.63); vs contextual interference d = +0.13 (-0.27 to 0.54). Both negligible, both single studies — the authors conclude evidence here is "scarce and inconclusive" | researcher-designed | retention; delayed; field/applied sport | active-alternative | under-1yr | domain-skill |
| Acquisition, fine motor skills subgroup (null/negative) | Cohen's d | -0.12 (95% CI -1.04 to 0.79, I2=97%) — DL slightly WORSE than traditional practice on toothbrushing and dental-surgery tasks | researcher-designed | acquisition; immediate; lab/clinical | active-alternative | end-of-treatment | domain-skill |
| Acquisition, tactical behaviour in sport subgroup (null) | Cohen's d | 0.20 (95% CI -0.03 to 0.44, I2=77%), non-significant; 4 experiments; no experiment at all measured tactical behaviour at retention | researcher-designed | acquisition; immediate; field/applied sport | active-alternative | end-of-treatment | domain-skill |
| Transfer | not analysable | Reported in too few studies to meta-analyse — the outcome that matters most is simply absent | unknown | transfer; not assessed | unclear | not-applicable | near-transfer |
Cited by
- Practice scheduling for motor skills — varied vs blocked, spaced vs massedmixedconf: highgc: low