Review of the Evidence on, and Fundamental Questions About, Efforts to Improve Executive Functions, Including Working Memory
Diamond A, Ling DS · 2019
grade Breviewdeveloper-involvednot-applicable
Sample
403 articles screened, 179 studies (193 papers) included, all ages, published in English peer-reviewed journals through 2015
Population
All ages; every method claiming to improve executive functions.
Design
A systematic review with eleven explicit inclusion criteria, including a requirement for an objective behavioural EF measure, a control group, at least eight participants per condition, and outcomes beyond the trained task. It separates active-control from no-treatment-control studies explicitly, describing the latter as a lower bar. Its importance to this archive is that it is the field's leading advocate conceding the transfer limit in her own systematic review.
Key findings
Two stated principles carry the review. First, executive functions can be improved across the lifespan and by different methods. Second - and this is the concession - transfer of training is narrow, benefits are fairly specific rather than general, and they rarely transfer to untrained skills; the authors describe this as the nearly universal conclusion of reviews for the past 25 years. On Cogmed, 79% of the 15 studies examining NEAR transfer found at least suggestive evidence, but only 33% of the 12 studies examining FAR transfer did. For n-back the figures are 40% of 10 near-transfer studies and 30% of 11 far-transfer studies. Their summary is that there is only extremely spotty evidence for far transfer to untrained cognitive skills for any training method, and that the rare claims of far transfer have not held up to scrutiny. They also note that no study has tested transfer from working-memory training to reasoning while controlling for the working-memory components of the reasoning test.
Genetic confound
Not applicable as a review.
Replication notes
Not applicable. Notable as the authors' own partial retraction of their 2016 optimism.
DOI / URL
10.1093/oso/9780199974467.003.0008
Effects
| Outcome | Metric | Value | Measure | Timing | Vs | Horizon | Class |
|---|---|---|---|---|---|---|---|
| Far transfer from any EF training method | proportion of studies with suggestive evidence | Cogmed 33% of 12 far-transfer studies; n-back 30% of 11 | standardized | post-training | unclear | end-of-treatment | far-transfer |
| Near transfer | proportion of studies with suggestive evidence | Cogmed 79% of 15; n-back 40% of 10 | standardized | post-training | unclear | end-of-treatment | near-transfer |
| Overall verdict on transfer | statement | transfer of training is narrow; rare claims of far transfer have not held up to scrutiny | mixed | post-training | unclear | unclear | far-transfer |
Cited by
- Can executive function be trained, and does it transfer to learning?no effectconf: highgc: low