Transferability of policy reliability beyond English mathematics

Determine whether the reliability ordering among the evaluated decontamination policies transfers to domains or languages beyond English-language competition and standardized-test mathematics.

Background

The audited corpora and benchmarks consist exclusively of English-language competition or standardized-test mathematics. Consequently, the reported comparison among exact, lexical, semantic, and judge-adjudicated policies has not been established for other subject domains or languages.

The paper explicitly identifies transfer of the observed reliability ordering as untested, leaving open whether the relative performance of the policies generalizes outside the evaluated setting.