The Evidence on Teaching

Views of nature of science questionnaire: Toward valid and meaningful assessment of learners' conceptions of nature of science

Lederman, N. G., Abd-El-Khalick, F., Bell, R. L., & Schwartz, R. S. · 2002

grade Dreviewdeveloper-lednot-applicable
Sample
not applicable (instrument development and validation paper)
Population
K-12 students and science teachers.
Design
Recorded not as evidence of an effect but as evidence about the measurement floor of the nature-of-science (NOS) strand of science education. The VNOS is the field's dominant instrument for "does the student understand how science works", and it is an OPEN-ENDED questionnaire that the authors insist must be paired with individual interviews to be interpreted. They argue explicitly against the calls within their own community to build standardised forced-choice NOS instruments for mass administration, and say the field should focus on individual classroom interventions rather than mass assessment. The consequence for this archive is structural: NOS outcomes are scored by the researchers who taught the unit, from prose the researchers interpret, with no independent standardised alternative in existence. There is therefore no way, at present, for a NOS intervention to demonstrate an effect on an independent measure — and no evidence was found that explicit NOS instruction changes attainment, reasoning on an untaught task, or any behaviour outside the classroom.
Key findings
The flagship NOS assessment is by design open-ended and interview-dependent, and its authors reject standardised mass assessment of NOS conceptions. Explicit-reflective NOS teaching does reliably shift what students write on the VNOS relative to implicit approaches (later synthesised meta-analytically), but the measure moved is the taught construct, scored by the teaching team, on an instrument with no independent standardised counterpart. Nothing in this literature demonstrates that NOS instruction changes anything a school, an examination board or an employer measures.
Genetic confound
not applicable — an instrument paper, no causal estimate.
Replication notes
not applicable. The downstream question — whether explicit NOS instruction moves any independent outcome — remains untested rather than answered.
DOI / URL
10.1002/tea.10034

Effects

OutcomeMetricValueMeasureTimingVsHorizonClass
Students' expressed conceptions of nature of science (the construct the VNOS measures)not-applicableinstrument development; no treatment effect estimatedresearcher-designednot applicablenonenot-applicabledomain-skill
Any independent standardised measure of NOS understandingnot-applicablenone exists — the authors argue against building onestandardizednot applicablenonenot-applicableunclear

Cited by

Views of nature of science questionnaire: Toward valid and meaningful assessment of learners' conceptions of nature of science · The Evidence on Teaching