Effects of Technology in Mathematics on Achievement, Motivation, and Attitude: A Meta-Analysis
Higgins, K., Huscroft-D'Angelo, J., & Crawford, L. · 2019
grade Cmeta-analysisunclearunclear
Sample
24 articles, 4,522 subjects
Population
Mathematics learners; grade span not recoverable from the abstract or the ERIC record.
Design
Journal of Educational Computing Research 57(2) 283-319; first published online 28 December 2017, issue dated April 2019 - the 2019 date is the issue year and is the one recorded here. ASSESSED AT ABSTRACT LEVEL ONLY: the SAGE full text is paywalled and no OA copy exists (unpaywall reports is_oa false; ERIC has metadata only; SAGE, ResearchGate and Semantic Scholar all refused). The abstract and the ERIC record report NO effect size of any kind - only that there is "a significant overall impact of technology on student achievement, motivation, and attitudes" that "varies based on the different aspect of the intervention examined". The declared moderators are intervention type, treatment type, duration, mathematical content area and learning-environment context; conspicuously NOT study design, randomization, sample size, or outcome-measure type, which are the four moderators that this archive has established determine the answer in ed-tech. The quality_grade C is the methodology default for a meta-analysis of mixed designs and is provisional - it has not been earned by inspection.
Key findings
24 articles and 4,522 subjects, reported as showing "a significant overall impact of technology on student achievement, motivation, and attitudes", with no effect size stated anywhere in the publicly available record. On the achievement question it is a small-pool restatement of ground covered by Cheung & Slavin (2013) with 74 studies and 56,886 K-12 students, which additionally reports the design-quality, sample-size, publication and implementation moderators this review does not appear to code. Its distinctive contribution - motivation and attitude outcomes - is a different outcome class (non-cognitive, largely self-report) and would not bear on the achievement verdict even if the numbers were recoverable. Recorded as an exclusion rather than dropped, so the reader can see what was considered and why it was set aside.
Genetic confound
Unknown - the study designs in the pool could not be inspected. If the pool is mostly quasi-experimental, as is typical in this journal, selection into technology-using classrooms is uncontrolled.
Replication notes
We could not read the study pool or any effect size, so we cannot say whether its findings replicate. Recorded as `unclear` rather than `unreplicated`, which would assert something about the literature we have not checked. Its subject matter is fully covered, on a study pool an order of magnitude larger, by Cheung & Slavin (2013).
DOI / URL
10.1177/0735633117748416
Effects
| Outcome | Metric | Value | Measure | Timing | Vs | Horizon | Class |
|---|---|---|---|---|---|---|---|
| Mathematics achievement | not recoverable | reported as a "significant overall impact" with no magnitude given in the abstract or the ERIC record; the full text is paywalled and no open-access copy could be located, so no number can be propagated from this source | mixed | unknown | unclear | unclear | domain-skill |
| Motivation and attitude toward mathematics | not recoverable | reported as significantly affected, magnitude not given; these are self-report constructs and are pooled with achievement in the headline claim, which is itself a reason not to use the headline | self-report survey | unknown | unclear | unclear | non-cognitive |