Usability of ENTRUST as an Assessment Tool for Entrustable Professional Activities (EPAs): A Mixed Methods Analysis.

Autor: Lee MC; Stanford University School of Medicine, Stanford, California., Melcer EF; Department of Computational Media, University of California-Santa Cruz, Baskin School of Engineering, Santa Cruz, California., Merrell SB; Department of Pediatrics, Stanford University School of Medicine, Stanford, California., Wong LY; Department of Cardiothoracic Surgery, Stanford University School of Medicine, Stanford, California., Shields S; Department of Computational Media, University of California-Santa Cruz, Baskin School of Engineering, Santa Cruz, California., Eddington H; Stanford-Surgery Policy Improvement Research and Education Center (S-SPIRE), Palo Alto, California., Trickey AW; Stanford-Surgery Policy Improvement Research and Education Center (S-SPIRE), Palo Alto, California., Tsai J; Department of Computational Media, University of California-Santa Cruz, Baskin School of Engineering, Santa Cruz, California; Department of Surgery, Stanford University School of Medicine, Stanford, California., Korndorffer JR Jr; Department of Surgery, Stanford University School of Medicine, Stanford, California; VA Palo Alto Health Care System, Surgical Services, Palo Alto, California., Lin DT; Department of Surgery, Stanford University School of Medicine, Stanford, California., Liebert CA; Department of Surgery, Stanford University School of Medicine, Stanford, California; VA Palo Alto Health Care System, Surgical Services, Palo Alto, California. Electronic address: cara.liebert@stanford.edu.
Jazyk: angličtina
Zdroj: Journal of surgical education [J Surg Educ] 2023 Nov; Vol. 80 (11), pp. 1693-1702. Date of Electronic Publication: 2023 Oct 09.
DOI: 10.1016/j.jsurg.2023.09.001
Abstrakt: Objective: As the American Board of Surgery transitions to a competency-based model of surgical education centered upon entrustable professional activities (EPAs), there is a growing need for objective tools to determine readiness for entrustment. This study evaluates the usability of ENTRUST, an innovative virtual patient simulation platform to assess surgical trainees' decision-making skills in preoperative, intra-operative, and post-operative settings.
Design: This is a mixed-methods analysis of the usability of the ENTRUST platform. Quantitative data was collected using the system usability scale (SUS) and Likert responses. Analysis was performed with descriptive statistics, bivariate analysis, and multivariable linear regression. Qualitative analysis of open-ended responses was performed using the Nielsen-Shneiderman Heuristics framework.
Setting: This study was conducted at an academic institution in a proctored exam setting.
Participants: The analysis includes n = 47 (PGY 1-5) surgical residents who completed an online usability survey following the ENTRUST Inguinal Hernia EPA Assessment.
Results: The ENTRUST platform had a median SUS score of 82.5. On bivariate and multivariate analyses, there were no significant differences between usability based on demographic characteristics (all p > 0.05), and SUS score was independent of ENTRUST performance (r = 0.198, p = 0.18). Most participants agreed that the clinical workup of the patient was engaging (91.5%) and felt realistic (85.1%). The most frequent heuristics represented in the qualitative analysis included feedback, visibility, match, and control. Additional themes of educational value, enjoyment, and ease-of-use highlighted participants' perspectives on the usability of ENTRUST.
Conclusions: ENTRUST demonstrates high usability in this population. Usability was independent of ENTRUST score performance and there were no differences in usability identified in this analysis based on demographic subgroups. Qualitative analysis highlighted the acceptability of ENTRUST and will inform ongoing development of the platform. The ENTRUST platform holds potential as a tool for the assessment of EPAs in surgical residency programs.
(Published by Elsevier Inc.)
Databáze: MEDLINE
Externí odkaz: