The Mirage: Confronting the Hard Truth about Our Quest for Teacher Development
Jacob A, McGovern K (TNTP) · 2015
grade Dreviewdeveloper-involvednot-applicablenumbers spot-checked
Sample
10,507 teachers and 566 school leaders surveyed, plus 127 interviews, across three large districts and one midsize charter network
Population
Teachers in three large, geographically diverse US public school districts (together >20,000 teachers, ~400,000 students, 69% low-income) plus one midsize charter management organisation. Districts are anonymised.
Design
Practitioner report by an advocacy organisation, not a peer-reviewed study and not a causal design - grade D is right. Method, in TNTP's own words: "our method was not to implement a particular development strategy and then track its results. Instead, we identified teachers whose performance appeared to improve substantially and worked backward to find any experiences, mindsets or environments they had in common." That is retrospective correlational contrast on observational data - 2 to 4 years of district evaluation ratings, observation scores and value-added, joined to a self-report survey of development time. Its value is the denominator (what is actually spent and delivered), not an effect estimate. Two caveats the numbers need. First, the $18,000 figure is the MID-RANGE of a three-tier sliding-scale estimate that TNTP constructed itself, and 77-87% of it is teacher and staff TIME and salaries rather than professional-development line items - it is an imputed opportunity cost, not a budget line. Second, `independence: developer-involved` is set from the report's own disclosure page: "The districts studied for this report are among the more than 60 school systems with which TNTP is currently engaged as a consultant and/or service provider." TNTP is itself a teacher-training provider (50,000+ teachers recruited or trained) publishing on the effectiveness of teacher development, and its recommendations advance its standing policy platform. The report states no district held editorial control and that it was independently funded. Advocacy-organisation report with no DOI; ERIC ED558206.
Key findings
The cost side of the professional-development question, plus a null pattern. Districts spend ~$18k per teacher per year (mostly imputed staff time) and teachers give ~19 days a year, and no variety, dose or combination of development separates the 19-30% of teachers who improved from those who did not. Read as an audit of the spend, not as causal evidence that development cannot work - TNTP is explicit that it did not test any strategy and that it opposes cutting the investment. The honest counterweight, which the headline usually drops: one of the four systems studied (the charter network) did produce substantial growth in ~7 of 10 teachers, at nearly double the per-teacher spend - and even there, TNTP could not identify which development activities caused it.
Genetic confound
Not applicable - a teacher-level descriptive audit, not a student-outcome study.
Replication notes
Descriptive and not designed to be replicable; districts are anonymised, so the spending and improver figures cannot be independently recomputed. The "nothing distinguishes improvers" claim is correlational and rests on comparing self-reported development time against district evaluation data. The report itself points at the relevant experimental literature - two federally funded experimental studies of sustained, content-focused, job-embedded PD that found no lasting significant change in teacher practice or student outcomes.
Effects
| Outcome | Metric | Value | Measure | Timing | Vs | Horizon | Class |
|---|---|---|---|---|---|---|---|
| Professional-development spending | cost | ~$18,000 per teacher per year (mid-range estimate), equal to 6-9% of district operating budgets; roughly $73m-$181m per district per year; projected $8bn/year across the 50 largest US districts | mixed | annual | none | not-applicable | unclear |
| Teacher time spent on development | time | ~19 full school days per year (~150 hours), nearly 10% of a school year, by teacher self-report | mixed | annual | none | not-applicable | unclear |
| Share of teachers who improved substantially | proportion | between 19% and 30% of teachers met the most rigorous "improver" definition; evaluation ratings of nearly 7 in 10 teachers stayed constant or declined over 2-3 years | mixed | over 2-3 years | none | over-2yr | unclear |
| What distinguishes teachers who improve | pattern | no development type, amount or combination distinguished improvers from non-improvers; improvers reported ~17 hours/month on development vs ~18 for non-improvers, and improvers were present in 95% of schools studied | mixed | multi-year | none | not-applicable | unclear |
| Improvement trajectory across a career | pattern | concentrated in the early years then flat - the gap between an average 1st-year and 5th-year teacher was more than nine times the gap between an average 5th-year and 20th-year teacher; nearly half of teachers in year 10+ were rated below effective on developing critical thinking | mixed | career | none | not-applicable | unclear |
| The charter-network exception (cuts against the headline) | pattern | in the CMO ~7 in 10 teachers showed substantial growth vs ~3 in 10 in the districts, with observation growth of 0.61 SD/year vs 0.09, 0.11 and 0.02 in districts A, B and C - but the CMO spent ~$33,000 per teacher (15% of budget) and 22 hrs/month, and even inside the CMO improvers and non-improvers showed "very few distinguishing features". TNTP flags small sample size and possible teacher self-selection into the CMO. | mixed | over 3 years | business-as-usual | over-2yr | unclear |
Cited by
- Teacher quality — selection over credentials and workshopsstrong supportconf: highgc: low