Learning in One-to-One Laptop Environments: A Meta-Analysis and Research Synthesis
Zheng, B., Warschauer, M., Lin, C.-H., & Chang, C. · 2016
grade Cmeta-analysisunclearmixed
Sample
96 sources screened (65 journal articles and 31 doctoral dissertations, January 2001 - May 2015); 10 studies pooled in the quantitative meta-analysis; the remaining 85 were synthesized narratively because they lacked an experimental design and/or quantitative results
Population
K-12 students in one-to-one laptop programmes, overwhelmingly in the United States
Design
READ-DEPTH DEBT: the full text is paywalled (Review of Educational Research; no open repository copy exists per OpenAlex/Unpaywall/Semantic Scholar) and this record was built from the verbatim published abstract plus press coverage of the paper, principally Education Week (May 2016), which reported the subject-level effect sizes. The individual pooled studies, their designs, their outcome measures and any publication-bias analysis WERE NOT INSPECTED. Every judgement about the pool below is therefore an inference from what is verifiable, and is flagged as such. What is verifiable and already damning for the pooled estimate: of 96 sources screened over fourteen years, only 10 contained a quantitative comparison usable in a meta-analysis at all. The authors themselves note that "a disproportionate amount of the research to date on this topic consists of small case studies in one or a handful of schools". A literature that yields ten comparable effect sizes in fourteen years is not one in which the pooled average carries much information about causation, and the base rate for what fills that gap in ed-tech is school- or district-level comparisons of places that CHOSE to go one-to-one against places that did not — the exact selection problem this archive's premise predicts, since districts that adopt one-to-one differ in funding, leadership, parental composition and everything else that also predicts test scores. ALSO: this meta pools four different subjects, mixed grade levels, and — on the evidence of the base literature — a mix of state-test and locally-administered outcomes, which is the incommensurability problem METHODOLOGY.md rejects in Hattie-style aggregation. It is not a like-for-like average. GRADE: C is the METHODOLOGY.md row for "meta-analyses of mixed-quality designs" and is where this sits on what can be confirmed. It should be revisited on a full read, and the plausible direction is down to D, not up: if the ten pooled studies turn out to be uncontrolled or adopter-versus- non-adopter comparisons, the meta inherits that confounding and belongs in the D row. It should never be cited alongside the randomized nulls as though the two were commensurable evidence. INDEPENDENCE: recorded as `unclear` rather than `independent`. The authors are university researchers with no product to sell, but funding and any vendor or district-programme relationships could not be checked from the abstract, and the pooled primary studies (several of them dissertations evaluating their own districts' programmes) may not be independent of the programmes they evaluate.
Key findings
Reviews 65 journal articles and 31 dissertations on K-12 one-to-one laptop programmes (2001-2015) and pools 10 of them, reporting a small positive overall effect on achievement — about +0.16 SD, with significant positive averages in English/language arts, writing, mathematics and science, and a non-significant effect on reading. The number is small on its own terms (well under the archive's benchmark for a year of schooling) and the pool is thin: only 10 of 96 sources contained a usable quantitative comparison, and the authors describe the base literature as dominated by small case studies of one or a handful of schools. Set against four randomized trials of the same intervention class that all return nulls, the most economical reading of +0.16 is not that one-to-one laptops work, but that schools which adopt them differ from schools which do not.
Genetic confound
High for the pooled estimate. Where the comparison is between schools or districts that adopted one-to-one and those that did not, the families in adopting districts differ in every heritable and selected respect that also predicts achievement, and the meta-analysis inherits that confounding regardless of how carefully the pooling was done. Note the contrast with the four randomized studies of the same intervention, where genetic confounding is minimal by construction and the effect is zero.
Replication notes
The pooled positive is contradicted by every well-identified randomized trial of the same intervention class in this archive. Fairlie & Robinson (2013) randomly gave 1,123 US schoolchildren home computers and found nothing, with 95% CIs tight enough to exclude 0.16 SD. Cristia et al. (2017) randomized one-to-one laptops across 318 rural Peruvian schools and found +0.046 SD in math and -0.039 in language. Beuermann et al. (2015) randomized laptops to ~1,000 Lima children and found no achievement effect. Cueto et al. (2025) followed 531 randomized Peruvian schools for ten years on national examinations and ruled out effects above 0.04-0.05 SD. Four randomized designs, three countries, all null; one meta-analysis of ten mostly non-randomized US school comparisons, +0.16. When a pooled non-randomized estimate and a set of RCTs on the same intervention disagree by that margin, this archive sides with the RCTs and treats the gap as the size of the selection effect.
DOI / URL
10.3102/0034654316628645
Effects
| Outcome | Metric | Value | Measure | Timing | Vs | Horizon | Class |
|---|---|---|---|---|---|---|---|
| Overall academic achievement across pooled subjects | SD | +0.16 (as reported in Education Week's coverage of the paper, May 2016; the published abstract states only "significantly positive average effect sizes"). NOT independently verified against the paper. For scale, this is below the low end of a year of schooling (d ~ 0.2-0.4) and is excluded by the 95% confidence interval of Fairlie & Robinson's randomized trial of the same intervention. | mixed | end of programme in the pooled primary studies (durations not verified) | unclear | unclear | domain-skill |
| English / language arts | SD | +0.15, reported as statistically significant (secondary source; not verified against the paper) | mixed | not verified | unclear | unclear | domain-skill |
| Writing | SD | +0.20, reported as statistically significant (secondary source; not verified). The largest of the pooled subject effects apart from science, and also the one most likely to be measured on locally-scored, non-standardized instruments — which METHODOLOGY.md discounts roughly twofold. | mixed | not verified | unclear | unclear | domain-skill |
| Mathematics | SD | +0.17, reported as statistically significant (secondary source; not verified). Compare the randomized estimates for the same intervention class — +0.046 SD (Cristia et al. 2017, n=318 schools) and a 95% CI of [-0.16, +0.04] SD (Fairlie & Robinson 2013). | mixed | not verified | unclear | unclear | domain-skill |
| Science | SD | +0.25, reported as statistically significant (secondary source; not verified). The largest pooled effect, on the subject with the fewest contributing studies in this literature — the classic small-study-inflation signature, which could not be checked without the funnel plots. | mixed | not verified | unclear | unclear | domain-skill |
| Reading | SD | +0.12, NOT statistically significant (secondary source; not verified). The one subject where the pooled estimate fails to clear significance, and the only one for which this archive holds independent randomized evidence of active displacement — laptops reduced daily reading in Romania (Malamud & Pop-Eleches 2011) and Lima (Beuermann et al. 2015). | mixed | not verified | unclear | unclear | domain-skill |
| Number of studies contributing quantitative evidence | count | 10 of 96 screened sources (65 articles, 31 dissertations, 2001-2015). The other 85 "did not include an experimental design and/or quantitative results". This ratio is the most informative number in the paper. | mixed | not-applicable | none | not-applicable | domain-skill |
| Displacement / time use | none | not measured. No one-to-one meta-analysis in this literature reports what laptop time replaced, even though the randomized primary studies that bothered to look (Malamud & Pop-Eleches 2011; Beuermann et al. 2015) found reductions in reading. | mixed | not-applicable | none | not-applicable | behaviour |