Dice Question Streamline Icon: https://streamlinehq.com

Clarify selection functions used in specific DGMs from prior studies

Ascertain the specific selection functions employed in the data-generating mechanisms for publication bias in the simulation studies of Peters et al. (2007) and Stanley and Doucouliagos (2015), which are insufficiently specified for replication and benchmarking.

Information Square Streamline Icon: https://streamlinehq.com

Background

The prototype benchmark aggregates data-generating mechanisms from prior simulation studies to enable neutral, cumulative method comparison.

In preparing the timeline and coding of DGMs, the authors encountered insufficient documentation of the selection functions used in two influential studies, which complicates precise replication and consistent inclusion in the benchmark.

References

For \citet{peters2007performance} and \citet{stanley2015neither}, the specifics of the selection functions used in the DGM were not fully clear to us, but we nevertheless coded them as present.

— Living Synthetic Benchmarks: A Neutral and Cumulative Framework for Simulation Studies (2510.19489 - Bartoš et al., 22 Oct 2025) in Figure 'Timeline of major simulation studies on publication bias adjustment' caption note