What setting describes best the analyzed research environment?

Please select all conditions that are plausible for the meta-analyzed research environment. Check at least one for each dimension!

Constraint on generalizability: All results covered in this app are based on two-group t-tests and assume a certain distribution of sample sizes in the primary studies, certain types of p-hacking/QRPs, and certain types of publication bias. This does not necessarily generalize to other conditions. You can dismiss this note by clicking on 'X'.

Usability note: Please be aware that, under some rare conditions, browsers may fail to update figures after you change settings. We recommend that you stay alert to this possibility and verify results with multiple browsers as needed. Generally, make sure that you select the desired settings in the focal tab! You can dismiss this note by clicking on 'X'.

<-- Slide through demo data set 1 to 10 to see some other exemplary funnel plots for this condition.

- Blue triangle is the region of non-significance; dotted black triangle is the funnel of the naive random-effects meta-analysis.
- The red dot at the bottom shows the true effect size. Blue dots show the naive random-effects estimate, and PET and PEESE estimates, if selected.

If in reality there is no effect: What is the probability that a method falsely concludes 'There is an effect'?

If in reality there is an effect: What is the probability that a method detects it?

Note: Negative estimates are set to zero.

Horizontal error bars are 95% quantiles (i.e., 95% of simulated replications were in that range).

This app provides all results for the publication:

Carter, E. C., Schönbrodt, F. D., Gervais, W. M., & Hilgard, J. (2019). Correcting for Bias in Psychology: A Comparison of Meta-Analytic Methods.Advances in Methods and Practices in Psychological Science, 2. doi:10.1177/2515245919847196 Preprint available at https://osf.io/rf3ys/

If you refer to this app, please cite this publication.

The full R code for the app is at Github.- 1.0 (2019/03/01): Version at journal's acceptance
- 0.2 (2018/02/01): Revised release (with submission of revision of the paper). Based on tagged Github version 0.2.
- 0.1 (2017/05/18): Initial release (with submission of paper / release of preprint). Based on tagged Github version 0.1.