Quantify and control reproducibility in high-throughput experiments
Autor: | Matthew G. Sampson, Yi Zhao, Xiaoquan Wen |
---|---|
Rok vydání: | 2020 |
Předmět: |
Computer science
Control (management) Consistency criterion computer.software_genre Biochemistry Article Set (abstract data type) 03 medical and health sciences Consistency (statistics) Humans Computer Simulation Molecular Biology Throughput (business) 030304 developmental biology 0303 health sciences Reproducibility Gene Expression Profiling Reproducibility of Results Cell Biology High-Throughput Screening Assays Data mining Transcriptome computer Algorithms Software Genome-Wide Association Study Biotechnology |
Zdroj: | Nat Methods |
ISSN: | 1548-7105 1548-7091 |
DOI: | 10.1038/s41592-020-00978-4 |
Popis: | Ensuring reproducibility of results in high-throughput experiments is crucial for biomedical research. Here, we propose a set of computational methods, INTRIGUE, to evaluate and control reproducibility in high-throughput settings. Our approaches are built on a new definition of reproducibility that emphasizes directional consistency when experimental units are assessed with signed effect size estimates. The proposed methods are designed to (1) assess the overall reproducible quality of multiple studies and (2) evaluate reproducibility at the individual experimental unit levels. We demonstrate the proposed methods in detecting unobserved batch effects via simulations. We further illustrate the versatility of the proposed methods in transcriptome-wide association studies: in addition to reproducible quality control, they are also suited to investigating genuine biological heterogeneity. Finally, we discuss the potential extensions of the proposed methods in other vital areas of reproducible research (for example, publication bias and conceptual replications). INTRIGUE is a statistical framework based on the directional consistency criterion for quantifying and controlling reproducibility in high-throughput experiments. |
Databáze: | OpenAIRE |
Externí odkaz: |