Do Concept Inventories Actually Measure Anything?

Wallace, Colin S. and Bailey, Janelle M. (2010) Do Concept Inventories Actually Measure Anything? Astronomy Education Review, 9 (1). ISSN 15391515


Download (1MB) | Preview
Official URL:


Although concept inventories are among the most frequently used tools in the physics and astronomy education communities, they are rarely evaluated using item response theory (IRT). When IRT models fit the data, they offer sample-independent estimates of item and person parameters. IRT may also provide a way to measure students’ learning gains that circumvents some known issues with Hake’s normalized gain. In this paper, we review the essentials of IRT while simultaneously applying it to the Star Properties Concept Inventory. We also use IRT to explore an important psychometrics debate that has received too little attention from physics and astronomy education researchers: What do we mean when we say we “measure” a mental process? This question leads us to use IRT to address the provocative question that constitutes the title of this paper: Do concept inventories actually measure anything?

Item Type: Article
Subjects: Astronomy Education Research
Depositing User: Mr Saeed Salimpour
Date Deposited: 06 Jul 2017 12:01
Last Modified: 19 Aug 2018 09:25

Actions (login required)

View Item View Item