Effect of Test Item Analysis of Summative Exams on Quality of Test Designing

Autor: Shaban M, Ramezani Badr F
Jazyk: perština
Rok vydání: 2007
Předmět:
Zdroj: حیات, Vol 13, Iss 1, Pp 5-16 (2007)
Druh dokumentu: article
ISSN: 1735-2215
2008-188X
Popis: Background & Aim: Item analysis is a process in which both test items (questions) and students' answers are examined in order to assess the quality and quantity of the items and test as a whole. The purpose of this study was to investigate the effect of analysis of multiple choice test items of summative exams on quality of the test design by faculty members of Tehran Nursing and Midwifery School. Methods & Materials: A quasi experimental method (pre-test and post-test) without control group was used in this study. After a pilot study, 33 nursing faculty members of school of nursing and midwifery at Tehran University of Medical Sciences were chosen through census sampling. Then one of their exams designed in the second semester (83-84) were chosen to be analyzed. The analysis results were reported to the faculty members. Then their designed tests for the next semester were analyzed again. The analysis was carried out using a checklist which included item structure, whole structure of exam, content validity, and levels of thinking skills reflected in questions and criteria for holding an exam. Moreover, for the quantitative analysis of questions, item difficulty and discrimination index were calculated. Item distracter analysis was examined by calculating the percentage of examinees who selected incorrect alternatives. Integrated t-test, Pearson and Spearman correlation coefficients, and Fisher's exact test were used for the statistical analysis.Results: 1056 questions before presenting the feedback and 803 questions at the end were analyzed and then the results were compared. According to the results, there was a significant difference between before and after intervention in variables item structure (P
Databáze: Directory of Open Access Journals