Are three methods better than one? A comparative assessment of usability evaluation methods in an EHR

Autor: Oluwabunmi Tokede, Mark Piotrowski, Duong T. Tran, Vimla L. Patel, Ram Vaderhobli, Paul Stark, Joel M. White, Elsbeth Kalenderian, Nicole S. Kimmes, Krishna Kumar Kookal, Rachel L. Ramoni, Muhammad F. Walji, M.D. Lagerweij
Přispěvatelé: Cariology, Oral and Maxillofacial Surgery / Oral Pathology
Jazyk: angličtina
Rok vydání: 2014
Předmět:
Zdroj: International journal of medical informatics, 83(5), 361-367. Elsevier Ireland Ltd
Walji, M F, Kalenderian, E, Piotrowski, M, Tran, D, Kookal, K K, Tokede, O, White, J M, Vaderhobli, R, Ramoni, R, Stark, P C, Kimmes, N S, Lagerweij, M & Patel, V L 2014, ' Are three methods better than one? A comparative assessment of usability evaluation methods in an EHR ', International Journal of Medical Informatics, vol. 83, no. 5, pp. 361-367 . https://doi.org/10.1016/j.ijmedinf.2014.01.010
Walji, M F, Kalenderian, E, Piotrowski, M, Tran, D, Kookal, K K, Tokede, O, White, J M, Vaderhobli, R, Ramoni, R, Stark, P C, Kimmes, N S, Lagerweij, M & Patel, V L 2014, ' Are three methods better than one? A comparative assessment of usability evaluation methods in an EHR ', International journal of medical informatics, vol. 83, no. 5, pp. 361-367 . https://doi.org/10.1016/j.ijmedinf.2014.01.010
International Journal of Medical Informatics, 83(5), 361-367. Elsevier Ireland Ltd
International journal of medical informatics, vol 83, iss 5
ISSN: 1386-5056
Popis: Objective: To comparatively evaluate the effectiveness of three different methods involving end-users for detecting usability problems in an EHR: user testing, semi-structured interviews and surveys. Materials and methods: Data were collected at two major urban dental schools from faculty, residents and dental students to assess the usability of a dental EHR for developing a treatment plan. These included user testing (N= 32), semi-structured interviews (N= 36), and surveys (N= 35). Results: The three methods together identified a total of 187 usability violations: 54% via user testing, 28% via the semi-structured interview and 18% from the survey method, with modest overlap. These usability problems were classified into 24 problem themes in 3 broad categories. User testing covered the broadest range of themes (83%), followed by the interview (63%) and survey (29%) methods. Discussion: Multiple evaluation methods provide a comprehensive approach to identifying EHR usability challenges and specific problems. The three methods were found to be complementary, and thus each can provide unique insights for software enhancement. Interview and survey methods were found not to be sufficient by themselves, but when used in conjunction with the user testing method, they provided a comprehensive evaluation of the EHR. Conclusion: We recommend using a multi-method approach when testing the usability of health information technology because it provides a more comprehensive picture of usability challenges.
Databáze: OpenAIRE