Gesture-Controlled Interactive Three Dimensional Anatomy: A Novel Teaching Tool in Neurotology.

Autor: Hochman, Jordan B., Unger, Bertram, Kraut, Jay, Pisa, Justyn, Hombach-Klonisch, Sabine
Předmět:
Zdroj: Journal of Otolaryngology -- Head & Neck Surgery; 2014, Vol. 43 Issue 1, p38-51, 14p, 12 Color Photographs, 1 Diagram
Abstrakt: There is a need for innovative anatomic teaching tools. This paper describes a three dimensional (3D) tool employing the Microsoft Kinect. Using this instrument, 3D temporal bone anatomy can be manipulated with the use of hand gestures, in the absence of mouse or keyboard. CT Temporal bone data is imported into an image processing program and segmented. This information is then exported in polygonal mesh format to an in-house designed 3D graphics engine with an integrated Microsoft KinectTM. Motion in the virtual environment is controlled by tracking hand position relative to the user’s left shoulder. Results The tool successfully tracked scene depth and user joint locations. This permitted gesture-based control over the entire 3D environment. Stereoscopy was deemed appropriate with significant object projection, while still maintaining the operator’s ability to resolve image details. Specific anatomical structures can be selected from within the larger virtual environment. These structures can be extracted and rotated at the discretion of the user. Voice command employing the Kinect’sTM intrinsic speech library was also implemented, but is easily confounded by environmental noise. Conclusion There is a need for the development of virtual anatomy models to complement traditional education. Initial development is time intensive. Nonetheless, our novel gesture-controlled interactive 3D model of the temporal bone represents a promising interactive teaching tool utilizing a novel interface. [ABSTRACT FROM AUTHOR]
Databáze: Complementary Index