Measuring performance in the interpretation of chest radiographs: a pilot study
Autor: | Leng Dong, Alastair G. Gale, Jonathan James, Yan Chen |
---|---|
Rok vydání: | 2016 |
Předmět: |
medicine.medical_specialty
Lung Neoplasms Radiography Pilot Projects Sensitivity and Specificity 030218 nuclear medicine & medical imaging 03 medical and health sciences 0302 clinical medicine Clinical information Radiologists medicine Humans Radiology Nuclear Medicine and imaging Referral and Consultation Work Performance Receiver operating characteristic business.industry Reproducibility of Results General Medicine United Kingdom Test (assessment) 030220 oncology & carcinogenesis Expert opinion Radiography Thoracic Radiology Clinical Competence Abnormality business Area under the roc curve |
Zdroj: | Clinical radiology. 72(3) |
ISSN: | 1365-229X |
Popis: | Aim To develop a system to assess the image interpretation performance of radiologists in identifying signs of malignancy on chest radiographs. Materials and methods A test set of 30 chest radiographs was chosen by an experienced radiologist consisting of 11 normal and 19 abnormal cases. The malignant cases all had biopsy-proven pathology; the normal and benign cases all had at least 2 years of imaging follow-up. Fourteen radiologists with a range of experiences were recruited. Participants individually read the test set displayed on a standard reporting workstation, with their findings entered directly into a laptop running specially designed reporting software. For each case, relevant clinical information was given and the reader was asked to mark any perceived abnormality and rate their level of suspicion on a five-point scale (normal, benign, indeterminate, suspicious, or malignant). On completion, participants were given instant feedback with performance parameters including sensitivity and specificity automatically calculated. An opportunity was then given to review the cases together with an expert opinion and pathology. The time each participant took to complete the test was recorded. Results Six consultant radiologists who took part showed significantly better performance as determined by receiver operating characteristic (ROC) analysis compared to eight specialist registrars (area under the ROC curve [AUC]=0.9297 and 0.7648 respectively, p =0.003). There was a significant correlation with years of experience in the interpretation of chest radiographs and performance on the test set ( r =0.573, p =0.032). Consultant radiologists completed the test significantly more quickly that the specialist registrars: mean time 19.65 minutes compared to 26.51 minutes ( p =0.033). Conclusion It is possible to use a test set to measure individual differences in the interpretation of chest radiographs. This has the potential to be a useful tool in performance testing. |
Databáze: | OpenAIRE |
Externí odkaz: |