The Evidence on Teaching

The Big Picture: A Meta-Analysis of Program Effectiveness Research on English Language Learners

Rolstad K, Mahoney K, Glass GV · 2005

grade Dmeta-analysisindependentmixed
Sample
17 studies
Population
English language learners in the United States
Design
The authors state explicitly that they follow the Glass strategy of INCLUDING AS MANY STUDIES AS POSSIBLE rather than excluding any on a priori study-quality criteria. That is a defensible position in meta-analytic methodology and it is fatal for this archive's purposes: a pooled estimate that deliberately declines to weight by design quality inherits every confound in the underlying literature, which here is mostly non-randomised programme comparison. Graded D on that basis, not on the topic.
Key findings
Bilingual education is reported as consistently superior to all-English approaches, and developmental bilingual superior to transitional bilingual. Positive effect for bilingual education of +0.23 SD on English-language outcomes, and +0.86 SD on outcomes measured in the NATIVE LANGUAGE. The +0.86 figure is regularly quoted without the qualifier; it is the effect of teaching children in a language on tests administered in that language.
Genetic confound
High. Family and district selection into programme type is uncontrolled across most included studies and the meta-analysis makes no attempt to weight it out.
Replication notes
Directionally consistent with Slavin & Cheung on English outcomes but at a much lower evidential standard, and its headline +0.86 is not comparable to the English-outcome estimates it is usually quoted alongside.

Effects

OutcomeMetricValueMeasureTimingVsHorizonClass
ENGLISH-language outcomes, bilingual vs all-English programmespooled effect size+0.23mixedend of programmeactive-alternativeend-of-treatmentdomain-skill
NATIVE-LANGUAGE outcomes, bilingual vs all-English programmespooled effect size+0.86mixedend of programmeactive-alternativeend-of-treatmentdomain-skill

Cited by