The Evidence on Teaching

Good Practical Science

Holman, J. (Gatsby Charitable Foundation) · 2017

grade Dreviewindependentnot-applicablenumbers spot-checked
Sample
10% sample of English secondary schools surveyed (Pye Tait Consulting); 6 country visits; PwC costing exercise
Population
English secondary school science, ages 11-18, benchmarked against the Netherlands, Germany, Finland, Singapore, Australia and the USA.
Design
Grey literature, not research: an expert-led benchmarking report commissioned by the Gatsby Charitable Foundation and written by Sir John Holman. Three evidence strands: (1) international country visits; (2) a Pye Tait survey of a 10% sample of English schools against 10 proposed benchmarks; (3) an activity-based costing exercise by PricewaterhouseCoopers using the Standard Cost Model. NO causal evidence of any kind — the report's premise is that practical science is valuable and its question is how to do it well and what it costs. Recorded here for the COST data and for the frequency baseline, not as evidence of effectiveness.
Key findings
THE COST FILE, and it substantially qualifies the 'enormous cost' half of the thesis. PwC's activity-based costing found that by far the greatest part of the cost of practical science is STAFF TIME, the large majority of it teachers' time; the capital costs of laboratories and equipment are small by comparison. And the report makes the marginal-cost point explicitly: the school is already paying teacher salaries, and if the teachers were not doing practical science they would be doing some other learning activity. So the true economic cost of practical work is not the microscopes and the technicians — it is the OPPORTUNITY COST of the lesson time, which is the correct denominator for any effectiveness estimate and which almost no study in this literature uses (nearly every comparison is against no teaching rather than against the next-best use of the same hour). Other figures worth keeping: the report's frequency benchmark is a practical activity in at least half of all science lessons, which only 40% of English schools currently meet; UK technician provision is among the best in the world and three of the six comparison countries (USA, Germany, Finland) employ no school laboratory technicians at all — which is itself a natural experiment nobody has exploited.
Genetic confound
Not applicable — descriptive and costing data, no outcome claim.
Replication notes
Complements the SCORE resourcing surveys (consumables and equipment spend) which measure a different and much smaller slice of the same cost base.

Effects

OutcomeMetricValueMeasureTimingVsHorizonClass
Where the cost of practical science actually sits (PwC activity-based costing)qualitativeby far the greatest part is staff time, the large majority teachers' time; capital cost of laboratories and equipment is small by comparisonmixedannual school costsnonenot-applicableunclear
Marginal cost of practical science relative to the alternative use of the same lessonqualitativethe school is already paying teacher salaries; if not doing practical science they would be doing some other learning activitymixedannual school costsactive-alternativenot-applicableunclear
Frequency benchmark and current attainment against itpercentbenchmark = practical activity in at least half of science lessons; 40% of English schools currently achieve itmixed2017 surveynonenot-applicableunclear

Cited by

Good Practical Science · The Evidence on Teaching