A surgery oral examination: interrater agreement and the influence of rater characteristics
| Autor: | Nicholas P. W. Coe, Pamela A. Rowland-Morin, Kenneth W. Burchard, Jane Garb |
|---|---|
| Rok vydání: | 1995 |
| Předmět: |
Male
medicine.medical_specialty Canada Higher education Education Clothing Medicine Humans Interpersonal Relations Observer Variation Analysis of Variance business.industry Verbal Behavior Age Factors Reproducibility of Results Videotape Recording Professional Practice General Medicine Middle Aged United States Inter-rater reliability General Surgery Physical therapy Oral examination Female Educational Measurement business |
| Zdroj: | Academic medicine : journal of the Association of American Medical Colleges. 70(11) |
| ISSN: | 1040-2446 |
| Popis: | Poor interrater reliability is a common objection to the use of oral examinations.In 1990 the authors measured the agreement of 140 U.S. and Canadian surgical raters and the influences, if any, of age, years in practice, and experience as an examiner on individual oral examination scores. Eight actor examinees memorized transcripts of actual oral examinations and were videotaped using a single examiner. Examinee verbal style, dress, content of answers, and gender were purposefully adjusted. A repeated-measures analysis of variance was used for data analysis.Three aspects of examinee performance influenced scores (verbal style, dress, and content of answers). No rater characteristic significantly affected scores. Raters showed high agreement (86%) when rating "good" performances but less agreement (67%) when rating "poor" performances.The oral examination scores were not influenced by rater selection. The raters ranked good performances more consistently than poor performances. Therefore, more than one examiner appears necessary to confirm a poor performance during an examination. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|