Metascience

There is increasing concern about reproducibility in many scientific fields and to what extent statistically significant published research findings are credible.

Recent large-scale replication projects in the quantitative social sciences have found that only about 50% of the original studies replicate. In this projet, we continue and expand our work for assessing and improving reproducibility in the social sciences. The project will consist of two studies.

In the first study, we will introduce a new tool, decision markets combined with selective replications, for systematically collecting information about reproducibility and steering replication resources to the studies that are most likely to be false.

In the second study we will test if so called placebo tests in economics are reported selectively in a form of "reverse p-hacking".

To carry out this final sub-project we will collect data for all papers reporting placebo tests in a number of top journals in economics.