C-Test construct validity: Evidence from nonparametric item response theory

Autor: Roya Shoahosseini, Purya Baghaei, Hossein Khodabakhshzadeh, Hamid Ashraf
Jazyk: angličtina
Rok vydání: 2024
Předmět:
Zdroj: Language Testing in Asia, Vol 14, Iss 1, Pp 1-15 (2024)
Druh dokumentu: article
ISSN: 2229-0443
DOI: 10.1186/s40468-024-00279-z
Popis: Abstract C-Test is a gap-filling test designed to measure first and second language proficiency. Over the past four decades, researchers have shown the fit of C-Test data to parametric item response theory (IRT) models, but no study so far has shown the fit of C-Tests to nonparametric IRT models. The purpose of this study is to contribute to the ongoing C-Test validation project by providing evidence of fit to the Mokken scale analysis as a widely used nonparametric IRT model. A six-passage C-Test battery was analyzed using the monotone homogeneity model and the double monotonicity model of Mokken. Unidimensionality was evaluated using the automatic item selection procedure. Findings showed that the C-Test passages form a strong unidimensional scale, fit well to the monotone homogeneity model, and, after deleting one item, have a sufficient fit to the double monotonicity model. The findings also indicated that the items form a hierarchy, and persons can be located on an ordinal scale using their C-Test sum scores. Implications of the study for C-Test validity and application are discussed.
Databáze: Directory of Open Access Journals