Validation as Evaluating Desired and Undesired Effects: Insights from Cross‐Classified Mixed Effects Model

Autor: Xuejun Ryan Ji, Amery D. Wu
Rok vydání: 2023
Předmět:
Zdroj: Educational Measurement: Issues and Practice.
ISSN: 1745-3992
0731-1745
DOI: 10.1111/emip.12553
Popis: Cross-Classified Mixed Effects Model (CCMEM) has been demonstrated to be a flexible framework for evaluating reliability by measurement specialists. Reliability can be estimated based on the variance components of the test scores. Built upon their accomplishment, this study extends the CCMEM to be used for evaluating validity. Validity is conceptualized as the coherence among the elements of a measurement system. As such, validity can be evaluated by the user-reasoned desired or undesired fixed and random effects in the measurement system. Based on the data of ePIRLS 2016 Reading Assessment, we demonstrate how to obtain evidence for reliability and validity evidence by CCMEM. We conclude with a discussion on the practicality and benefits of this integrated validation method.
Databáze: OpenAIRE
Externí odkaz: