Calibration of predictive distributions in imputation methods

Determine whether the predictive distributions and prediction intervals produced by imputation methods that output uncertainty are calibrated in the sense that their nominal probabilities match empirical frequencies.

Background

The paper argues that prior work on missing-data imputation has focused primarily on point accuracy and has provided only informal or incomplete treatment of uncertainty quality. As a result, the reliability of uncertainty estimates remains insufficiently characterized across different methods and settings.

The authors emphasize the importance of calibration—whether nominal coverage agrees with empirical coverage—and note that this has not been systematically established for widely used approaches, motivating their empirical study across multiple datasets and missingness mechanisms.

References

As a result, it remains unclear whether the predictive distributions and intervals produced by these models are calibrated, whether nominal probabilities match empirical frequencies.

Beyond Accuracy: An Empirical Study of Uncertainty Estimation in Imputation (2511.21607 - Hossain et al., 26 Nov 2025) in Section 1, Introduction