The Evidence on Teaching

Review of measurements used in computing education research and suggestions for increasing standardization

Margulieux, L. E., Ketenci, T., & Decker, A. · 2019

grade Dreviewindependentnot-applicable
Sample
197 papers published 2013-2017 in computing education research venues
Population
The computing education research literature.
Design
A systematic literature review of measurement practice; descriptive only. The specific proportion of studies using validated instruments could not be extracted at abstract depth, so no percentage should be quoted from this record.
Key findings
A census of what computing education research measures and how. The finding that matters for grading: the review lists the standardized measurements that were used and highlights commonly used variables for which NO standardized measures exist — so for many constructs the researcher-designed instrument is not a shortcut, it is the only option researchers had.
Genetic confound
Not applicable.
Replication notes
A descriptive census of a literature; nothing to replicate.
DOI / URL
10.1080/08993408.2018.1562145

Effects

OutcomeMetricValueMeasureTimingVsHorizonClass
Prevalence of standardized versus researcher-made measuresdescriptive censusmany core constructs have no standardized measure available; exact proportion not extractedmixednot applicablenonenot-applicableunclear
Review of measurements used in computing education research and suggestions for increasing standardization · The Evidence on Teaching