Stability of Experimental Results: Forecasts and Evidence

Autor: Stefano DellaVigna, Devin Pope
Rok vydání: 2022
Předmět:
Zdroj: American Economic Journal: Microeconomics. 14:889-925
ISSN: 1945-7685
1945-7669
Popis: How robust are experimental results to changes in design? And can researchers anticipate which changes matter most? We consider a real-effort task with multiple behavioral treatments and examine the stability along six dimensions: (i) pure replication, (ii) demographics, (iii) geography and culture, (iv) the task, (v) the output measure, and (vi) the presence of a consent form. We find near-perfect replication of the experimental results and full stability of the results across demographics, significantly higher than a group of experts expected. The results differ instead across task and output change, mostly because the task change adds noise to the findings. (JEL C90, D82, D91)
Databáze: OpenAIRE