Continuous Improvement of Medical Diagnostic Systems with Large Scale Patient Vignette Simulation
| Autor: | Nick Fletcher, Suhrid Satyal, Shameek Ghosh |
|---|---|
| Rok vydání: | 2020 |
| Předmět: |
Medical diagnostic
Computer science business.industry Benchmarking 030204 cardiovascular system & hematology Machine learning computer.software_genre Clinical decision support system 03 medical and health sciences 0302 clinical medicine Vignette Knowledge base Software deployment Scale (social sciences) Scalability 030212 general & internal medicine Artificial intelligence business computer |
| Zdroj: | CIKM |
| DOI: | 10.1145/3340531.3412693 |
| Popis: | Differential diagnostic systems provide a ranked list of highly prob-able diseases given a patient's profile and symptoms. Evaluation of diagnostic algorithms in literature has been limited to a small set of hand-crafted patient vignettes. Testing with high coverage and gaining insights for improvements are challenging because of thesize and complexity of the knowledge base. Furthermore, scalable practical methodologies for evaluation and deployment of such systems are missing in the literature. Here, we address this challenge using a novel patient vignette simulation algorithm within an iterative clinician-in-the-loop methodology for semi-automatically evaluating and deploying medical diagnostic systems in production.We evaluate our algorithms and methodology through a case study of a real product and knowledge base curated by medical experts.We conduct multiple iterations of the methodology, report novel accuracy measures, and discuss insights from our experience in applying this method to production |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|