Can Natural Language Processing and Artificial Intelligence Automate The Generation of Billing Codes From Operative Note Dictations?
Autor: | Kim JS; Department of Orthopedics, Icahn School of Medicine at Mount Sinai, New York, NY, USA., Vivas A; Department of Neurological Surgery, UCLA Medical Center, Los Angeles, CA, USA., Arvind V; Department of Orthopedics, Icahn School of Medicine at Mount Sinai, New York, NY, USA., Lombardi J; Department of Orthopedics, Columbia University Irving Medical Center- Och SpineHospital, New York, NY, USA., Reidler J; Department of Orthopedics, University of Pennsylvania, Philadelphia, PA, USA., Zuckerman SL; Department of Orthopedics, Columbia University Irving Medical Center- Och SpineHospital, New York, NY, USA., Lee NJ; Department of Orthopedics, Columbia University Irving Medical Center- Och SpineHospital, New York, NY, USA., Vulapalli M; Department of Neurological Surgery, Weill Cornell Medical Center- Och Spine Hospital, New York, NY, USA., Geng EA; Department of Orthopedics, Icahn School of Medicine at Mount Sinai, New York, NY, USA., Cho BH; Department of Orthopedics, Icahn School of Medicine at Mount Sinai, New York, NY, USA., Morizane K; Department of Orthopedics, Hayashi Hospital, Echizen, Japan., Cho SK; Department of Orthopedics, Icahn School of Medicine at Mount Sinai, New York, NY, USA., Lehman RA; Department of Orthopedics, Columbia University Irving Medical Center- Och SpineHospital, New York, NY, USA., Lenke LG; Department of Orthopedics, Columbia University Irving Medical Center- Och SpineHospital, New York, NY, USA., Riew KD; Department of Neurological Surgery, Weill Cornell Medical Center- Och Spine Hospital, New York, NY, USA. |
---|---|
Jazyk: | angličtina |
Zdroj: | Global spine journal [Global Spine J] 2023 Sep; Vol. 13 (7), pp. 1946-1955. Date of Electronic Publication: 2022 Feb 28. |
DOI: | 10.1177/21925682211062831 |
Abstrakt: | Study Design: Retrospective Cohort Study. Objectives: Using natural language processing (NLP) in combination with machine learning on standard operative notes may allow for efficient billing, maximization of collections, and minimization of coder error. This study was conducted as a pilot study to determine if a machine learning algorithm can accurately identify billing Current Procedural Terminology (CPT) codes on patient operative notes. Methods: This was a retrospective analysis of operative notes from patients who underwent elective spine surgery by a single senior surgeon from 9/2015 to 1/2020. Algorithm performance was measured by performing receiver operating characteristic (ROC) analysis, calculating the area under the ROC curve (AUC) and the area under the precision-recall curve (AUPRC). A deep learning NLP algorithm and a Random Forest algorithm were both trained and tested on operative notes to predict CPT codes. CPT codes generated by the billing department were compared to those generated by our model. Results: The random forest machine learning model had an AUC of .94 and an AUPRC of .85. The deep learning model had a final AUC of .72 and an AUPRC of .44. The random forest model had a weighted average, class-by-class accuracy of 87%. The LSTM deep learning model had a weighted average, class-by-class accuracy 0f 59%. Conclusions: Combining natural language processing with machine learning is a valid approach for automatic generation of CPT billing codes. The random forest machine learning model outperformed the LSTM deep learning model in this case. These models can be used by orthopedic or neurosurgery departments to allow for efficient billing. |
Databáze: | MEDLINE |
Externí odkaz: |