Examiner training: A study of examiners making sense of norm-referenced feedback.

Autor: Crossley JGM; a Department of Medical Education, The Medical School , University of Sheffield , Sheffield , United Kingdom of Great Britain and Northern Ireland., Groves J; b Department of Surgery and Critical Care , Chesterfield Royal Hospital NHS Foundation Trust , Chesterfield , United Kingdom of Great Britain and Northern Ireland., Croke D; c Quality Enhancement Office , Royal College of Surgeons of Ireland , Dublin , Ireland., Brennan PA; d Department of Surgery , Queen Alexandra Hospital , Portsmouth , United Kingdom of Great Britain and Northern Ireland.
Jazyk: angličtina
Zdroj: Medical teacher [Med Teach] 2019 Jul; Vol. 41 (7), pp. 787-794. Date of Electronic Publication: 2019 Mar 26.
DOI: 10.1080/0142159X.2019.1579902
Abstrakt: Purpose: Examiner training has an inconsistent impact on subsequent performance. To understand this variation, we explored how examiners think about changing the way they assess. Method: We provided comparative data to 17 experienced examiners about their assessments, captured their sense-making processes using a modified think-aloud protocol, and identified patterns by inductive thematic analysis. Results: We observed five sense-making processes: (1) testing personal relevance (2) interpretation (3) attribution (4) considering the need for change , and (5) considering the nature of change . Three observed meta-themes describe the manner of examiners' thinking: Guarded curiosity - where examiners expressed curiosity over how their judgments compared with others', but they also expressed guardedness about the relevance of the comparisons; Dysfunctional assimilation - where examiners' interpretation and attribution exhibited cognitive anchoring, personalization, and affective bias; Moderated conservatism - where examiners expressed openness to change, but also loyalty to their judgment-framing values and aphorisms. Conclusions: Our examiners engaged in complex processes as they considered changing their assessments. The 'stabilising' mechanisms some used resembled learners assimilating educational feedback. If these are typical examiner responses, they may well explain the variable impact of examiner training, and have significant implications for the pursuit of meaningful and defensible judgment-based assessment.
Databáze: MEDLINE
Nepřihlášeným uživatelům se plný text nezobrazuje