Financial education affects financial knowledge and downstream behaviors
Kaiser, T., Lusardi, A., Menkhoff, L., & Urban, C. · 2022
grade Bmeta-analysisdeveloper-involvedmixed
Sample
76 randomised experiments, total sample > 160,000; 673 effect estimates (458 on behaviour from 64 studies, 215 on knowledge from 50 studies). Average study n = 2,136, median 840.
Population
All ages: only 7.5% of estimates concern children under 14, 20% youth aged 14-25, and 72.4% adults over 25. 60.8% of estimates come from developing economies; 72.4% target below-median-income individuals. This is NOT primarily a school literature.
Design
The intended rebuttal to Fernandes et al. (2014), and the strongest evidence financial education has. Restricted to randomised experiments only — an explicit refusal of the quasi-experimental degrees of freedom — and estimated with robust variance estimation under a random-effects model. Numbers here are read from NBER Working Paper 27057 (April 2020); the published Journal of Financial Economics version reports the same design and headline figures. Three things a school builder must hold onto. First, the population: this is an adult, developing-country, low-income literature, and the school-age cell is small. Second, the DOSE is tiny — mean 11.71 hours of instruction, median 7 — so the effects are what seven hours buys, not what a year-long course buys. Third, the authors are the field's principal advocates (Lusardi directs a financial-literacy research centre) and the meta includes their own trials; they report robustness to excluding their own papers, which is the right check, and the estimate survives publication-bias correction, restriction to top economics journals, and restriction to adequately powered studies. Independence is recorded as developer-involved for that reason, not because they built any programme.
Key findings
In 76 RCTs the random-effects mean treatment effect on financial BEHAVIOUR is 0.1003 SD (95% CI 0.071-0.129) and on financial KNOWLEDGE 0.204 SD (95% CI 0.152-0.255). Under the common-true-effect assumption Fernandes et al. used, the behaviour estimate is 0.065 SD (CI 0.043-0.089) against their 0.018 SD (CI -0.004 to 0.022) from 15 observations in 13 RCTs — so the null is not confirmed on the larger sample. The age split is the school-relevant number and it cuts against schools: behaviour effects are SMALLEST for children under 14 (0.064 SD) versus youth 14-25 (0.1203) and adults (0.1068), while knowledge effects are largest for children (0.2763, but on 15 observations in seven studies, CI 0.0076-0.545). Decay is modest, not catastrophic: 0.0991 SD under six months, 0.071 at six-plus months, 0.0878 at one year, 0.0653 at 1.5 years, 0.0574 at two-plus years (seven studies), none statistically distinguishable from each other. Mean cost $60.40 per participant (median $22.90) for roughly a fifth of an SD.
Genetic confound
Low. Randomised assignment throughout; genes cannot differ between arms. The residual concern is generalisation rather than confounding — the samples are volunteers into financial-education studies, largely adults, and 60.8% are in developing economies.
Replication notes
This IS the replication attempt on Fernandes, Lynch & Netemeyer (2014), and it partly fails to reproduce them: the authors could not exactly replicate the original RCT estimate and document four coding errors in it. Direction agrees with Fernandes (knowledge moves more than behaviour; behaviour effects are small); magnitude does not (3.6x under the original modelling assumption, 5.5x under random effects). Kaiser & Menkhoff (2017, 2020) are the same team's earlier passes and agree. No independent team has re-run the coding, which is the outstanding gap: both sides of this dispute have now been adjudicated only by one of the two disputants.
DOI / URL
10.1016/j.jfineco.2021.09.022
Effects
| Outcome | Metric | Value | Measure | Timing | Vs | Horizon | Class |
|---|---|---|---|---|---|---|---|
| Financial behaviour, all ages, financial education vs control | mean of distribution of true effects (RVE random effects), SD units | 0.1003 (95% CI 0.071-0.129) | mixed | median 25.8 weeks after treatment | business-as-usual | under-1yr | behaviour |
| Financial knowledge, all ages | mean of distribution of true effects, SD units | 0.204 (95% CI 0.152-0.255) | mixed | median 25.8 weeks after treatment | business-as-usual | under-1yr | domain-skill |
| Financial behaviour, CHILDREN under 14 — the school-age cell | SD units | 0.064 | mixed | post-treatment | business-as-usual | unclear | behaviour |
| Financial behaviour, youth aged 14-25 | SD units | 0.1203 | mixed | post-treatment | business-as-usual | unclear | behaviour |
| Financial knowledge, children under 14 (15 observations in seven studies) | SD units | 0.2763 (95% CI 0.0076-0.545) | mixed | post-treatment | business-as-usual | unclear | domain-skill |
| Financial behaviour measured two or more years after treatment (seven RCTs) | SD units | 0.0574 — not statistically different from the short-run estimate | mixed | 2+ years post-treatment | business-as-usual | over-2yr | behaviour |
| Re-estimation of Fernandes et al. (2014) under their own common-true-effect assumption | SD units | 0.065 (95% CI 0.043-0.089) vs their 0.018 (CI -0.004 to 0.022) | mixed | pooled | business-as-usual | unclear | behaviour |
Cited by
- Do life-skills courses — money, cooking, driving, health — change what students actually do?mixedconf: mediumgc: low