Evaluate REPVIS2 for prospective replication planning

Determine whether using REPVIS2 during the planning of real replication studies improves design justification, comparison, and reporting consistency.

Background

REPVIS2 is presented as a framework for characterising replication designs retrospectively and for structuring prospective replication planning. The paper demonstrates its use for corpus characterisation and validates its coverage and structural stability on a separate corpus, but the authors do not evaluate whether researchers can use it effectively before data collection.

The unresolved issue is therefore whether REPVIS2 provides practical benefits during actual replication planning, particularly by improving the justification of design choices, the comparability of replication studies, and the consistency of reporting. The authors identify this as a concrete direction for future empirical evaluation.

References

The prospective planning function has also not been evaluated in practice. Future work could use REPVIS2 during real replication planning and examine whether it improves design justification, comparison, and reporting consistency.

— Replication Studies: Not Just a Copy  (2609.18181 - Liang et al., 16 Sep 2026) in Section “Future Work,” Discussion