The Evidence on Teaching

Point and Click or Grab and Heft: Comparing the Influence of Physical and Virtual Instructional Materials on Elementary School Students' Ability to Design Experiments

Triona, L. M., & Klahr, D. · 2003

grade Brctindependentreplicated
Sample
4th- and 5th-grade students (two experiments)
Population
US elementary school students, grades 4-5 (ages ~9-11); springs domain, control-of-variables strategy.
Design
Random assignment to physical vs virtual instructional materials, with the instructional procedure (explicit direct instruction in the control-of-variables strategy, CVS), time on task and outcome measures held constant. Students designed unconfounded experiments with springs. Two outcomes were separated: the domain-GENERAL procedure (CVS: can you design an unconfounded comparison?) and the domain-SPECIFIC knowledge (what actually determines how far a spring stretches). Outcomes are researcher-designed and immediate. Note the treatment is direct instruction plus materials — this is not a discovery-learning study, and both arms receive the same guidance.
Key findings
Elementary students (grades 4-5) taught the control-of-variables strategy with real springs and with an on-screen simulation made equally large gains on BOTH the general experimental-design procedure and the specific domain knowledge about springs. Physicality — actually holding and hefting the apparatus — contributed nothing measurable over pointing and clicking. Because the instructional procedure was identical in both arms, this isolates the material substrate itself, which is exactly the component that costs money. The result is the load-bearing evidence for the claim that in a large class of school science tasks the hands are not where the learning happens. Limits: single session, immediate researcher-designed outcomes, a narrow and highly simulable domain (springs), and no test of whether physical apparatus matters for messier phenomena (smell, taste, failure of equipment, hazards) that simulations elide.
Genetic confound
Low — random assignment of individuals.
Replication notes
The founding result of the physical-vs-virtual null; replicated upward by Klahr, Triona & Williams 2007 (grades 7-8), downward by Zacharia, Loizou & Papaevripidou 2012 (kindergarten), and into higher education by Zacharia & Olympiou 2011. Reviewed as robust by de Jong, Linn & Zacharia 2013 (Science).
DOI / URL
10.1207/s1532690xci2102_02

Effects

OutcomeMetricValueMeasureTimingVsHorizonClass
Control-of-variables strategy (designing unconfounded experiments), physical vs virtual materialsdirectionequally large gains; no significant differenceresearcher-designedimmediate post-testactive-alternativeend-of-treatmentnear-transfer
Domain knowledge about springs, physical vs virtual materialsdirectionequally large gains; no significant differenceresearcher-designedimmediate post-testactive-alternativeend-of-treatmentdomain-skill

Cited by

Point and Click or Grab and Heft: Comparing the Influence of Physical and Virtual Instructional Materials on Elementary School Students' Ability to Design Experiments · The Evidence on Teaching