Automated Video Debriefing Using Computer Vision Techniques.
| Autor: | VanVoorst BR; From the Raytheon BBN Technologies (B.R.V.V., N.R.W., J.P.S., J.S.F.), Cambridge, MA; and SFC Paul Ray Smith Simulation and Training Technology Center (M.G.H., J.E.N.), US Army DEVCOM-SC-SED-STTC, Orlando, FL., Walczak NR, Hackett MG, Norfleet JE, Schewe JP, Fasching JS |
|---|---|
| Jazyk: | angličtina |
| Zdroj: | Simulation in healthcare : journal of the Society for Simulation in Healthcare [Simul Healthc] 2023 Oct 01; Vol. 18 (5), pp. 326-332. Date of Electronic Publication: 2022 Oct 15. |
| DOI: | 10.1097/SIH.0000000000000692 |
| Abstrakt: | Introduction: Within any training event, debriefing is a vital component that highlights areas of proficiency and deficiency, enables reflection, and ultimately provides opportunity for remediation. Video-based debriefing is desirable to capture performance and replay events, but the reality is rife with challenges, principally lengthy video and occlusions that block line of sight from camera equipment to participants. Methods: To address this issue, researchers automated the editing of a video debrief, using a system of person-worn cameras and computer vision techniques. The cameras record a simulation event, and the video is processed using computer vision. Researchers investigated a variety of computer vision techniques, ultimately focusing on the scale invariant feature transform detection method and a convolutional neural network. The system was trained to detect and tag medically relevant segments of video and assess a single exemplar medical intervention, in this case the application of a tourniquet. Results: The system tagged medically relevant video segments with 92% recall and 66% precision, resulting in an F1 (harmonic mean of precision and recall) of 72% (N = 23). The exemplar medical intervention was successfully assessed in 39.5% of videos (N = 39). Conclusion: The system showed suitable accuracy tagging medically relevant video segments, but requires additional research to improve medical intervention assessment accuracy. Computer vision has the potential to automate video debrief creation to augment existing debriefing strategies. Competing Interests: The authors declare no conflict of interest. (Copyright © 2022 Written work prepared by employees of the Federal Government as part of their official duties is, under the U.S. Copyright Act, a “work of the United States Government” for which copyright protection under Title 17 of the United States Code is not available. As such, copyright does not extend to the contributions of employees of the Federal Government.) |
| Databáze: | MEDLINE |
| Externí odkaz: |
|