A Practical Procedure for the Construction and Reliability Analysis of Fixed-Length Tests with Randomly Drawn Test Items

Autor: Draaijer, S., Klinkenberg, S., Ras, E., Joosten-ten Brinke, D.
Přispěvatelé: Onderwijsinstituut Psychologie (FMG), Psychology Other Research (FMG), Research and Theory in Education, LEARN! - Personalized learning, differentiated teaching, Educational Studies
Jazyk: angličtina
Rok vydání: 2015
Předmět:
Zdroj: Computer Assisted Assessment : Research into E-Assessment: 18th international conference, CAA 2015, Zeist, The Netherlands, June 22-23, 2015 : proceedings, 47-60
STARTPAGE=47;ENDPAGE=60;TITLE=Computer Assisted Assessment : Research into E-Assessment
Computer Assisted Assessment. Research into E-Assessment ISBN: 9783319277035
CAA
Computer assisted assessment: research into e-assessment, 47-60
STARTPAGE=47;ENDPAGE=60;TITLE=Computer assisted assessment: research into e-assessment
Popis: A procedure to construct valid and fair fixed-length tests with randomly drawn items from an item bank is described. The procedure provides guidelines for the set-up of a typical achievement test with regard to the number of items in the bank and the number of items for each position in a test. Further, a procedure is proposed to calculate the relative difficulty for individual tests and to correct the obtained score for each student based on the mean difficulty for all students and the particular test of a student. Also, two procedures are proposed for the problem to calculate the reliability of tests with randomly drawn items. The procedures use specific interpretations of regularly used methods to calculate Cronbach’s alpha and KR20 and the Spearman-Brown prediction formula. A simulation with R is presented to illustrate the accuracy of the calculation procedures and the effects on pass-fail decisions.
Databáze: OpenAIRE