| Popis: |
One way to increase the efficiency of large-scale observer performance studies that utilize receiver-operator- characteristic (ROC) analysis would be to identify a group of observers whose ROC results consistently reflect a strong sensitivity to imaging mode differences. We reviewed the data of four large ROC studies performed by our group. The primary index used to classify observers was defined as the absolute difference between readers' Azs for two modes divided by the standard deviation, appropriately corrected for correlation. Using this index, observers were ranked as to their ability to detect differences between modes. We performed four different analyses on data that included 119,550 observations in four studies and 14 different modes performed by 20 readers. With the exception of one data set, there was no correlation between the level of performance of observers, as measured by Az, and their ability to discriminate between modes. Analyses designed to identify observers who were consistent in their rankings as to their ability to discriminated between modes was also unsuccessful in showing differences. This study suggests that without the use of special procedures or training, it is not likely that most research facilities will be able to select a group of highly experienced observers who consistently detect small differences among modes.© (2002) COPYRIGHT SPIE--The International Society for Optical Engineering. Downloading of the abstract is permitted for personal use only. |
