Medical transformer for multimodal survival prediction in intensive care: integration of imaging and non-imaging data

Autor: Firas Khader, Jakob Nikolas Kather, Gustav Müller-Franzes, Tianci Wang, Tianyu Han, Soroosh Tayebi Arasteh, Karim Hamesch, Keno Bressem, Christoph Haarburger, Johannes Stegmaier, Christiane Kuhl, Sven Nebelung, Daniel Truhn
Jazyk: angličtina
Rok vydání: 2023
Předmět:
Zdroj: Scientific Reports, Vol 13, Iss 1, Pp 1-11 (2023)
Druh dokumentu: article
ISSN: 2045-2322
DOI: 10.1038/s41598-023-37835-1
Popis: Abstract When clinicians assess the prognosis of patients in intensive care, they take imaging and non-imaging data into account. In contrast, many traditional machine learning models rely on only one of these modalities, limiting their potential in medical applications. This work proposes and evaluates a transformer-based neural network as a novel AI architecture that integrates multimodal patient data, i.e., imaging data (chest radiographs) and non-imaging data (clinical data). We evaluate the performance of our model in a retrospective study with 6,125 patients in intensive care. We show that the combined model (area under the receiver operating characteristic curve [AUROC] of 0.863) is superior to the radiographs-only model (AUROC = 0.811, p
Databáze: Directory of Open Access Journals
Nepřihlášeným uživatelům se plný text nezobrazuje