Attribution of the cross-device performance gap in the uranium mine
Determine whether the discrepancy between the single screening-run cross-device performance and the repeated-training ensemble performance in the uranium mine is caused by training stochasticity or by an unlogged difference in the evaluation setup.
References
Whether the gap is therefore due to training stochasticity or to an unlogged difference in the evaluation set-up cannot be decided for frame B.
— Accountable and uncertainty-aware evaluation of sensor-based AI under distribution shift: devices, subjects, and nearly three years underground
(2609.09257 - Platte et al., 8 Sep 2026) in Section 8.2, 'Retrospective verdicts'