The Evidence on Teaching

Comparing Burnout in Sport-Specializing Versus Sport-Sampling Adolescent Athletes: A Systematic Review and Meta-analysis

Giusti NE, Carder SL, Vopat L, Baker J, Tarakemeh A, Vopat B, Mulcahey MK · 2020

grade Dmeta-analysisindependentmixednumbers spot-checked
Sample
1,429 athletes (1,371 specializers / 58 samplers; 1,422 completed the ABQ); 8 studies, of which only TWO contained any samplers at all
Population
Adolescent athletes, mean age 15.59 y (range 12.5-17.2); 825 male / 528 female in the 7 studies reporting sex
Design
8 studies pooled — 7 cross-sectional (level-of-evidence 4) plus 1 longitudinal prospective survey (LOE 3) — all self-report on Athlete Burnout Questionnaire (ABQ) subscales, scored 1-5. THE DESIGN FLAW IS WORSE THAN A SAMPLING IMBALANCE, and this is the thing full-text reading turns up: SIX of the eight studies contain ZERO samplers. All 58 samplers come from just two studies — Russell 2018 (24) and Strachan 2009 (34) — while the 1,371-strong specializer mean is pooled across all eight. The headline contrast is therefore a BETWEEN-STUDY comparison dressed as a within-study one, and the two arms are drawn from different populations: five of the eight specializer samples were recruited from elite academies of excellence, national talent programmes or Olympic sport classes (Appleton, Gustafsson, Isoard-Gautheur, Hill, Gerber), whereas both sampler-containing studies are small non-elite community samples. The authors concede it — "only 2 studies appropriately identified a sport sampler" — and also that "athlete specialization status had to be determined by our coauthors" post hoc, since the source studies were mostly built to study perfectionism, motivation or fear of failure rather than specialization. Reported as raw differences of ABQ means via z test, not standardized effect sizes. There is NO publication-bias assessment, NO heterogeneity statistic, and no formal quality appraisal beyond level-of-evidence labels. No adjustment for training volume, competitive level, sex, sport or age; causal direction untestable, and the authors state "no research is available showing whether burnout or reduced sport performance occurs first". Of the samplers, 24 are female and 34 have no sex reported.
Key findings
The pooled result says specializers score higher on all three ABQ burnout subscales, largest on reduced accomplishment (delta 0.87 on a 1-5 scale). The two studies that actually compared specializers with samplers INSIDE one sample say something close to the opposite, and this is the finding that governs how much the pooled number is worth. Russell & Molina 2018 (24 samplers vs 53 specializers) "found no significant differences between sport specializers and sport samplers across all 3 dimensions" — and its sport-devaluation means run the wrong way (samplers 1.48 vs specializers 1.40). Strachan 2009 (34 vs 40) found specializers higher on exhaustion only (p<0.05), explicitly "not in reduced sense of accomplishment or sport devaluation". So across the only 6 within-study subscale contrasts available, 5 are null, and the one significant one is exhaustion — while the pooled headline effect is on reduced accomplishment, the subscale that was null in BOTH within-study tests. The arithmetic shows why: reduced-accomplishment means in the elite-academy specializer samples run 2.31-3.07, whereas in the two studies that also measured samplers the specializers score 1.73 and 1.82, essentially level with their own samplers (1.62, 1.65). The pooled delta of 0.87 is therefore mostly an elite-academy-versus-community-club contrast, not a specialization contrast. It cannot distinguish "specialization causes burnout" from "athletes already disengaging report both fewer sports and more burnout" (reverse causation), from a pure training-load effect, or from a between-sample selection artifact. Suggestive at best, and the archive should not cite the 0.87 without the within-study nulls beside it.
Genetic confound
Trait negative affectivity/neuroticism and conscientiousness — substantially heritable — predict both burnout scores and sport persistence, so the specializer-sampler contrast is partly a personality contrast. Nothing in the corpus is genetically informative, and five of the eight studies were designed to study heritable personality traits (perfectionism, fear of failure, motivation) rather than specialization.
Replication notes
Coded `mixed` on the strength of the paper's own contents: the only two studies that directly compared specializers with samplers within a single sample disagree with each other and with the pooled result — Russell 2018 null on all three subscales, Strachan 2009 positive on exhaustion only. Later reviews and a 6-year 7th-12th grade longitudinal cohort (Valenzuela-Moss 2024) are reported to echo the headline, but that claim is not verifiable from this paper, and no prospective study has randomized or cleanly de-confounded specialization from volume, competitive level and dropout.

Effects

OutcomeMetricValueMeasureTimingVsHorizonClass
Reduced sense of accomplishment (ABQ subscale) — POOLED, between-studydifference of means, specializers − samplers, on a 1-5 Likert scaleΔ = 0.87 (95% CI 0.67-1.08), P<.01; specializers 2.51 ± 0.66 (n=1,364) vs samplers 1.64 ± 0.60 (n=58). The sampler mean comes from only 2 of the 8 studiesstandardizedretention (concurrent psychological state); self-report; fieldnonenot-applicablenon-cognitive
Emotional/physical exhaustion (ABQ subscale) — POOLED, between-studydifference of meansΔ = 0.46 (95% CI 0.24-0.68), P<.01; specializers 2.44 ± 0.79 vs samplers 1.99 ± 0.71standardizedretention; self-report; fieldnonenot-applicablenon-cognitive
Sport devaluation (ABQ subscale) — POOLED, between-studydifference of meansΔ = 0.41 (95% CI 0.22-0.60), P<.01; specializers 1.82 ± 0.54 vs samplers 1.40 ± 0.54standardizedretention; self-report; fieldnonenot-applicablenon-cognitive
WITHIN-STUDY specializer vs sampler comparisons (the only two that exist)significance of within-sample group difference on each ABQ subscaleRussell & Molina 2018 (24 samplers / 53 specializers, female non-elite) — NO significant difference on any of the three subscales; reduced accomplishment 1.73 vs 1.62, exhaustion 1.93 vs 1.92, devaluation 1.40 vs 1.48 (devaluation runs the wrong way). Strachan 2009 (34 / 40) — specializers significantly higher on EXHAUSTION only (p<0.05), explicitly not on reduced accomplishment or sport devaluation (1.82 vs 1.65 and 1.83 vs 1.35). Net: 5 of 6 within-study subscale contrasts are null, including both tests of the subscale carrying the largest pooled effectstandardizedretention; self-report; fieldnonenot-applicablenon-cognitive
Composition of the pooled comparisondistribution of samplers across the 8 studies; recruitment setting6 of 8 studies contain ZERO samplers (Larson, Appleton, Gustafsson, Isoard-Gautheur, Hill, Gerber); all 58 samplers come from Russell (24) and Strachan (34). Five specializer samples were recruited from elite academies, national talent programmes or Olympic sport classes, and their reduced-accomplishment means run 2.31-3.07 against 1.73-1.82 in the two non-elite studies that also supplied the samplersstandardizednot applicablenonenot-applicableunclear
Publication-bias and heterogeneity assessmentpresence of anynone — no funnel plot, no Egger test, no trim-and-fill, no I2 or other heterogeneity statistic, and no formal quality appraisal beyond level-of-evidence labels (7 studies LOE 4, 1 LOE 3)unknownnot applicablenonenot-applicableunclear

Cited by