The IQWST Experience: Using Coherence as a Design Principle for a Middle School Science Curriculum

Not an outcome study. Formative field-test data from IQWST development; no comparison group and no reported sample for any impact estimate.

US middle school science (grades 6-8), IQWST development sites.

A design narrative written by the IQWST development team itself (Krajcik and Reiser were the NSF project PIs; Fortus and Shwartz were core design-team members). It articulates five kinds of coherence the curriculum was built to satisfy — learning-goal coherence, intra-unit coherence between content goals/practices/activities, inter-unit multidisciplinary coherence, coherence between PD and materials, and coherence between science-literacy and general-literacy expectations. The abstract promises 'preliminary results regarding the effectiveness' of the approach; what is presented is developmental/formative field-test data used to justify design decisions. There is no comparison group, no effect size, and no controlled outcome evaluation anywhere in the paper.

This is the canonical statement of coherence-as-a-design-principle in US science curriculum, and it is an argument, not evidence. It is included in the archive because the coherence design principle it names went on to structure the NRC Framework, NGSS, IQWST, OpenSciEd and the whole 'storyline' movement — so a founder is being sold a design philosophy whose foundational paper contains zero controlled outcome data. IQWST's own subsequent evaluation record is thin: one non-randomized comparison-group study by a co-PI (Shin et al. 2019), uncontrolled pre/post field-test gains marketed as 'effect size 2.5', and a WWC review of its predecessor curriculum (LeTUS, WWC report ED531792, 2012) in which FIVE studies were screened and ZERO met WWC evidence standards.

No controlled outcome data; the question does not arise.

No RCT of IQWST exists. Shin, Choi, Stevens & Krajcik (2019, IJSME, 10.1007/s10763-017-9861-z) is the only comparison-group test and is quasi-experimental and developer-involved. Fortus et al. (2015, JRST 10.1002/tea.21261) reports structural-equation path coefficients across IQWST units with no comparison group — variance explained, not treatment effects.