A Not So Perfect Score: Factors Associated with the Rate of Straight Line Scoring in Oncology Training Programs
| Autor: | Annette Eakes Ponnie, Diana L. Urbauer, Emily Hinchcliff, Amir A. Jazaeri, Aaron Shafer, Jillian R. Gunther, Brian K. Bednarski, Michaela Onstad, Michael Frumovitz, Diane C. Bodurka |
|---|---|
| Rok vydání: | 2020 |
| Předmět: |
Oncology
medicine.medical_specialty Pharmacology toxicology Graduate medical education Medical Oncology Perfect score Subspecialty Article Accreditation Formative assessment 03 medical and health sciences 0302 clinical medicine Internal medicine medicine Milestone (project management) Humans 030212 general & internal medicine integumentary system business.industry Multilevel model Public Health Environmental and Occupational Health Internship and Residency Summative assessment Education Medical Graduate 030220 oncology & carcinogenesis Clinical Competence business |
| Zdroj: | J Cancer Educ |
| ISSN: | 1543-0154 0885-8195 |
| DOI: | 10.1007/s13187-020-01855-6 |
| Popis: | OBJECTIVE: Straight line scoring (SLS), defined as trainee assessments with the same score for all evaluation items, is statistically improbable and potentially indicates inaccurate assessment. Factors contributing to higher SLS rates are unknown, and knowledge of SLS prevalence within oncologic training is lacking. DESIGN: SLS frequency was measured for evaluations from all Accreditation Council for Graduate Medical Education (ACGME)-accredited programs at a single cancer care institution between 2014-2018. SLS prevalence was estimated using hierarchical linear models (HLM) that considered characteristics of evaluator, trainee, and evaluation potentially related to SLS. Results were compared to national SLS rates. RESULTS: 6,160 evaluations were included from 476 evaluators. Overall prevalence of SLS was 12.1% (95% CI: 4.5-28.8). Residents (vs fellows) were less likely to have SLS evaluations (OR 0.5, 95% CI 0.4-0.8), though for all trainees increasing training year corresponded with increasing SLS frequency (OR 1.5, 95% CI 1.3-1.7). SLS was more common in procedural specialties compared to medical specialties (OR 2.1, 95% CI 1.1-3.8). Formative evaluations had lower SLS rates (OR 0.6, 95% CI 0.5-0.9) than summative evaluations, while milestone-based evaluations had higher rates than those that were not milestone-based (OR 1.5, 95% CI 1.03-2.2). CONCLUSIONS: Features of evaluators, such as subspecialty within oncology, and of trainees, such as seniority or trainee type, were related to SLS. Summative intent and milestones-based evaluations were more likely to be straight line scored. Specific evaluation scenarios at higher risk of SLS should be further examined. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Full text from SpringerLink