Sensitivity and specificity in signal detection with the reporting odds ratio and the information component.

Autor: Trillenberg P; University Hospital of Schleswig-Holstein, Campus Lübeck, Dept. of Neurology, Ratzeburger Allee, 160, Lübeck, Germany., Sprenger A; University Hospital of Schleswig-Holstein, Campus Lübeck, Dept. of Neurology, Ratzeburger Allee, 160, Lübeck, Germany.; Institute of Psychology II, University of Lübeck, Marie-Curie-Straße, 23562, Lübeck, Germany., Machner B; University Hospital of Schleswig-Holstein, Campus Lübeck, Dept. of Neurology, Ratzeburger Allee, 160, Lübeck, Germany.
Jazyk: angličtina
Zdroj: Pharmacoepidemiology and drug safety [Pharmacoepidemiol Drug Saf] 2023 Aug; Vol. 32 (8), pp. 910-917. Date of Electronic Publication: 2023 Apr 07.
DOI: 10.1002/pds.5624
Abstrakt: Purpose: As measures of association between an adverse drug reaction (ADR) and exposure to a drug the reporting odds ratio (ROR) and the information component (IC) can be used. We sought to test the reliability of signal detection with these.
Methods: We simulated ADR counts as binomially distributed random numbers for different expected ADR frequencies and theoretical reporting odds ratios (RORs). We then calculated the empirical IC and the empirical ROR and their confidence intervals. The rate of signals that was detected despite a theoretical ROR of 1 represented the false positive rate, and represented the sensitivity if the ROR was >1.
Results: For expected case counts below 1 the false positive rate oscillates from 0.01 to 0.1 even though 0.025 were intended. Even beyond expected case counts of 5 oscillations can cover a range of 0.018 to 0.035. The first n oscillations with the largest amplitude are eliminated if a minimum case count of n is required. To detect an ROR of 2 with a sensitivity of 0.8, a minimum of 12 expected ADRs are required. In contrast, 2 expected ADRs suffice to detect an ROR of 4.
Conclusion: Summaries of measures for disproportionality should include the expected number of cases in the group of interest if a signal was detected. If no signal was detected the sensitivity for the detection of a representative ROR or the minimum ROR that could be detected with probability 0.8 should be reported.
(© 2023 The Authors. Pharmacoepidemiology and Drug Safety published by John Wiley & Sons Ltd.)
Databáze: MEDLINE