Effectiveness of Four Instructional Programs Designed to Serve English Learners
Valentino RA, Reardon SF · 2015
grade Cquasi-experimentindependentunreplicated
Sample
English-learner students in a large district followed from elementary through middle school
Population
English-learner students in English Immersion, Transitional Bilingual, Developmental Bilingual and Dual Immersion programmes
Design
The identification strategy is the interesting part: the authors compare students whose PARENTS EXPRESSED THE SAME PROGRAMME PREFERENCE but who ended up in different programmes, which absorbs a large share of the usual family-selection confound without being a lottery. It remains observational, and the residual threat is whatever determined which preferring family got which programme. Outcomes are English Language Arts and mathematics test scores in ENGLISH, tracked as growth trajectories rather than levels.
Key findings
English Language Arts scores of English learners in ALL bilingual programme types grow at least as fast as, and sometimes faster than, those in English Immersion. The same generally holds in mathematics, with the exception of Developmental Bilingual programmes, where average scores grow more slowly than in English Immersion. Latino English learners do better longitudinally in bilingual programmes than their Chinese counterparts. No differences in programme effectiveness by initial English proficiency.
Genetic confound
Medium. Matching on expressed parental preference removes the largest and most obvious selection channel, which is why this sits above the rest of the observational literature; but programme assignment among equally-preferring families is still not random.
Replication notes
Converges with the Portland lottery on the key practical point - bilingual instruction does not cost English achievement - using an entirely different identification strategy on a different population. That convergence is the strongest thing this cluster has.
Effects
| Outcome | Metric | Value | Measure | Timing | Vs | Horizon | Class |
|---|---|---|---|---|---|---|---|
| ENGLISH Language Arts growth, bilingual programmes vs English Immersion | growth-trajectory difference | at least as fast, sometimes faster | standardized | elementary through middle school | active-alternative | over-2yr | domain-skill |
| Mathematics growth, Developmental Bilingual vs English Immersion | growth-trajectory difference | slower in Developmental Bilingual | standardized | elementary through middle school | active-alternative | over-2yr | domain-skill |
| Moderation by initial English proficiency | interaction | none detected | standardized | elementary through middle school | active-alternative | over-2yr | domain-skill |
Cited by
- Does dual-language immersion work, and is the gain in the second language or in English?moderate supportconf: mediumgc: low