Potential of ChatGPT in facilitating research in radiation oncology?

Autor: Guckenberger M; Department of Radiation Oncology, University Hospital of Zurich, University of Zurich, Zurich, Switzerland., Andratschke N; Department of Radiation Oncology, University Hospital of Zurich, University of Zurich, Zurich, Switzerland., Ahmadsei M; Department of Radiation Oncology, University Hospital of Zurich, University of Zurich, Zurich, Switzerland., Christ SM; Department of Radiation Oncology, University Hospital of Zurich, University of Zurich, Zurich, Switzerland., Heusel AE; Department of Radiation Oncology, University Hospital of Zurich, University of Zurich, Zurich, Switzerland., Kamal S; Department of Radiation Oncology, University Hospital of Zurich, University of Zurich, Zurich, Switzerland., Kroese TE; Department of Radiation Oncology, University Hospital of Zurich, University of Zurich, Zurich, Switzerland., Looman EL; Department of Radiation Oncology, University Hospital of Zurich, University of Zurich, Zurich, Switzerland., Reichl S; Department of Radiation Oncology, University Hospital of Zurich, University of Zurich, Zurich, Switzerland., Vlaskou Badra E; Department of Radiation Oncology, University Hospital of Zurich, University of Zurich, Zurich, Switzerland., von der Grün J; Department of Radiation Oncology, University Hospital of Zurich, University of Zurich, Zurich, Switzerland., Willmann J; Department of Radiation Oncology, University Hospital of Zurich, University of Zurich, Zurich, Switzerland., Tanadini-Lang S; Department of Radiation Oncology, University Hospital of Zurich, University of Zurich, Zurich, Switzerland., Mayinger M; Department of Radiation Oncology, University Hospital of Zurich, University of Zurich, Zurich, Switzerland. Electronic address: michael.mayinger@usz.ch.
Jazyk: angličtina
Zdroj: Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology [Radiother Oncol] 2023 Nov; Vol. 188, pp. 109894. Date of Electronic Publication: 2023 Sep 01.
DOI: 10.1016/j.radonc.2023.109894
Abstrakt: Purpose: To evaluate the potential of the artificial intelligence (AI) chatbot ChatGPT in supporting young clinical scientists with scientific tasks in radio oncological research.
Materials and Methods: Seven scientific tasks were to be completed in 3 h by 8 radiation oncologists with different scientific experience working at a university hospital: creation of a scientific synopsis, creation of a research question and corresponding clinical trial hypotheses, writing of the first paragraph of a manuscript introduction, clinical trial sample size calculation, and clinical data analyses (multivariate analysis, boxplot and survival curve). No participant had prior experience with an AI chatbot. All participants were instructed in ChatGPT v3.5 and its use was provided for all tasks. Answers were scored independently by two blinded experts. The subjective value of ChatGPT was rated by each participant. Data were analyzed with regression-, t-test and Spearman correlation (p < 0.05).
Results: Participants completed tasks 1-3 with an average score of 50% and 4-7 with 56%. Scientific experience, number of original publications and of first/last authorships showed a positive correlation with overall scoring (p = 0.01-0.04). Participants with little to moderate scientific experience scored ChatGPT to be more helpful in solving tasks 4-7 compared to more experienced participants (p = 0.04), with simultaneously presenting lower scorings (p = 0.03).
Conclusions: ChatGPT did not compensate for differences in scientific experience of young clinical scientists, with less experienced researchers believing false AI-generated scientific results.
Competing Interests: Declaration of Competing Interest The authors declare the following financial interests/personal relationships which may be considered as potential competing interests: [Dr. Andratschke reports personal fees from AstraZeneca, personal fees from Debiopharm, grants, personal fees and nonfinancial support from ViewRay, grants and personal fees from Brainlab, outside the submitted work. Dr. Tanadini-Lang reports that her husband works at Varian Medical Systems. The other authors report no conflicts of interest.].
(Copyright © 2023 The Authors. Published by Elsevier B.V. All rights reserved.)
Databáze: MEDLINE
Externí odkaz: