The Evidence on Teaching

Rapid-Guessing Behavior: Its Identification, Interpretation, and Implications

Wise SL · 2017

grade Dreviewindependentnot-applicable
Sample
none - conceptual and methodological review of the response-time literature
Population
Computer-based testing, school-age through adult, high- and low-stakes contexts
Design
Review article rather than a study; grade D. Its scope limit matters for this archive - rapid guessing is identified from item RESPONSE TIMES, which only computer-based testing records. A paper-and-pencil achievement battery of the kind homeschooling families use produces no response-time data at all, so the diagnosis this literature offers is unavailable exactly where it would be most useful, and only the score pattern remains.
Key findings
Very short response times - rapid guessing - reliably indicate disengaged test taking, in high-stakes as well as low-stakes settings. The interpretive move is the one this archive needs: "a rapid guess to an item represents a choice by the test taker to momentarily opt out of being measured." Because rapid guesses do not reflect what a test taker knows and can do, they negatively distort scores and diminish validity, and Wise argues they should be excluded from scoring rather than counted as wrong answers. A score built partly from opted-out items is not a low score; it is a partly absent measurement.
Genetic confound
Not applicable - a claim about measurement validity, not about a trait.
Replication notes
The underlying response-time-effort findings are reproduced across many testing programmes; this review synthesises them rather than adding a new estimate.

Effects

OutcomeMetricValueMeasureTimingVsHorizonClass
Interpretation of rapid-guessed itemsruledoes not reflect knowledge; represents opting out of measurement, and should not be scoredstandardizeditem levelnonenot-applicabledomain-skill
Effect of rapid guessing on total score validitydirectionnegatively distorts scores and diminishes validity, in high- and low-stakes settings alikestandardizedtest levelnonenot-applicabledomain-skill

Cited by

Rapid-Guessing Behavior: Its Identification, Interpretation, and Implications · The Evidence on Teaching