Reusing Natural Experiments
Autor: | Mehrdad Samadi, Ingrid M. Werner, Davidson Heath, Matthew C. Ringgenberg |
---|---|
Rok vydání: | 2019 |
Předmět: |
History
Natural experiment Polymers and Plastics Computer science business.industry Instrumental variable Inference Reuse Machine learning computer.software_genre Industrial and Manufacturing Engineering Identification (information) Multiple comparisons problem Regression discontinuity design Artificial intelligence Business and International Management business computer Statistical hypothesis testing |
Zdroj: | SSRN Electronic Journal. |
ISSN: | 1556-5068 |
DOI: | 10.2139/ssrn.3457525 |
Popis: | After a natural experiment is first used, other researchers often reuse the setting, examining different outcome variables. We use simulations based on real data to illustrate the multiple hypothesis testing problem that arises when researchers reuse natural experiments. We then provide guidance for future inference based on popular empirical settings including difference-in-differences regressions, instrumental variables regressions, and regression discontinuity designs. When we apply our guidance to two extensively studied natural experiments, business combination laws and the Regulation SHO pilot, we find that many results that were statistically significant using single hypothesis testing do not survive corrections for multiple hypothesis testing. |
Databáze: | OpenAIRE |
Externí odkaz: |