Comparison of statistical signal detection methods within and across spontaneous reporting databases
| Autor: | Suzie Seabroke, Naashika Quarcoo, Kristina Juhlin, Bharat Thakrar, Antoni Wisniewski, Katrin Manlik, Jim Slattery, Gianmario Candore |
|---|---|
| Rok vydání: | 2015 |
| Předmět: |
Pharmacology
Database Databases Factual Drug-Related Side Effects and Adverse Reactions business.industry Pharmacology toxicology MEDLINE Toxicology computer.software_genre Sensitivity and Specificity Pharmacovigilance Spontaneous reporting Medicine Adverse Drug Reaction Reporting Systems Humans Pharmacology (medical) Detection theory Drug reaction business computer Algorithms |
| Zdroj: | Drug safety. 38(6) |
| ISSN: | 1179-1942 |
| Popis: | Most pharmacovigilance departments maintain a system to identify adverse drug reactions (ADRs) through analysis of spontaneous reports. The signal detection algorithms (SDAs) and the nature of the reporting databases vary between operators and it is unclear whether any algorithm can be expected to provide good performance in a wide range of environments.The objective of this study was to compare the performance of commonly used algorithms across spontaneous reporting databases operated by pharmaceutical companies and national and international pharmacovigilance organisations.220 products were chosen and a reference set of ADRs was compiled. Within four company, one national and two international databases, 15 SDAs based on five disproportionality methods were tested. Signals of disproportionate reporting (SDRs) were calculated at monthly intervals and classified by comparison with the reference set. These results were summarised as sensitivity and precision for each algorithm in each database.Different algorithms performed differently between databases but no method dominated all others. Performance was strongly dependent on the thresholds used to define a statistical signal. However, the different disproportionality statistics did not influence the achievable performance. The relative performance of two algorithms was similar in different databases. Over the lifetime of a product there is a reduction in precision for any method.In designing signal detection systems, careful consideration should be given to the criteria that are used to define an SDR. The choice of disproportionality statistic does not appreciably affect the achievable range of signal detection performance and so this can primarily be based on ease of implementation, interpretation and minimisation of computing resources. The changes in sensitivity and precision obtainable by replacing one algorithm with another are predictable. However, the absolute performance of a method is specific to the database and is best assessed directly on that database. New methods may be required to gain appreciable improvements. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Full text from SpringerLink