Position of Correct Option and Distractors Impacts Responses to Multiple-Choice Items: Evidence From a National Test.
| Autor: | Lions S; Universidad de Chile, Santiago de Chile, Chile., Dartnell P; Universidad de Chile, Santiago de Chile, Chile., Toledo G; Universidad de Chile, Santiago de Chile, Chile., Godoy MI; Universidad de Chile, Santiago de Chile, Chile., Córdova N; Universidad de Chile, Santiago de Chile, Chile., Jiménez D; Universidad de Chile, Santiago de Chile, Chile., Lemarié J; University of Toulouse, France. |
|---|---|
| Jazyk: | angličtina |
| Zdroj: | Educational and psychological measurement [Educ Psychol Meas] 2023 Oct; Vol. 83 (5), pp. 861-884. Date of Electronic Publication: 2022 Nov 12. |
| DOI: | 10.1177/00131644221132335 |
| Abstrakt: | Even though the impact of the position of response options on answers to multiple-choice items has been investigated for decades, it remains debated. Research on this topic is inconclusive, perhaps because too few studies have obtained experimental data from large-sized samples in a real-world context and have manipulated the position of both correct response and distractors. Since multiple-choice tests' outcomes can be strikingly consequential and option position effects constitute a potential source of measurement error, these effects should be clarified. In this study, two experiments in which the position of correct response and distractors was carefully manipulated were performed within a Chilean national high-stakes standardized test, responded by 195,715 examinees. Results show small but clear and systematic effects of options position on examinees' responses in both experiments. They consistently indicate that a five-option item is slightly easier when the correct response is in A rather than E and when the most attractive distractor is after and far away from the correct response. They clarify and extend previous findings, showing that the appeal of all options is influenced by position. The existence and nature of a potential interference phenomenon between the options' processing are discussed, and implications for test development are considered. Competing Interests: The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article. (© The Author(s) 2022.) |
| Databáze: | MEDLINE |
| Externí odkaz: |
|