Problematizing the concept of the 'borderline' group in performance assessments
| Autor: | Richard Fuller, Matt Homer, Godfrey Pell |
|---|---|
| Rok vydání: | 2017 |
| Předmět: |
020205 medical informatics
Group (mathematics) Decision Making education MEDLINE 02 engineering and technology General Medicine Education Undergraduate methods 03 medical and health sciences 0302 clinical medicine Consistency (negotiation) Degree program 0202 electrical engineering electronic engineering information engineering Humans Clinical Competence Educational Measurement 030212 general & internal medicine Students Psychology Education Medical Undergraduate Clinical psychology |
| Zdroj: | Medical Teacher. 39:469-475 |
| ISSN: | 1466-187X 0142-159X |
| DOI: | 10.1080/0142159x.2017.1296563 |
| Popis: | Many standard setting procedures focus on the performance of the "borderline" group, defined through expert judgments by assessors. In performance assessments such as Objective Structured Clinical Examinations (OSCEs), these judgments usually apply at the station level.Using largely descriptive approaches, we analyze the assessment profile of OSCE candidates at the end of a five year undergraduate medical degree program to investigate the consistency of the borderline group across stations. We look specifically at those candidates who are borderline in individual stations, and in the overall assessment. While the borderline group can be clearly defined at the individual station level, our key finding is that the membership of this group varies considerably across stations.These findings pose challenges for some standard setting methods, particularly the borderline group and objective borderline methods. They also suggest that institutions should ensure appropriate conjunctive rules to limit compensation in performance between stations to maximize "diagnostic accuracy". In addition, this work highlights a key benefit of sequential testing formats in OSCEs. In comparison with a traditional, single-test format, sequential models allow assessment of "borderline" candidates across a wider range of content areas with concomitant improvements in pass/fail decision-making. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
| Nepřihlášeným uživatelům se plný text nezobrazuje | K zobrazení výsledku je třeba se přihlásit. |