Equivariant Bootstrapping for Uncertainty Quantification in Imaging Inverse Problems (2310.11838v2)
Abstract: Scientific imaging problems are often severely ill-posed, and hence have significant intrinsic uncertainty. Accurately quantifying the uncertainty in the solutions to such problems is therefore critical for the rigorous interpretation of experimental results as well as for reliably using the reconstructed images as scientific evidence. Unfortunately, existing imaging methods are unable to quantify the uncertainty in the reconstructed images in a manner that is robust to experiment replications. This paper presents a new uncertainty quantification methodology based on an equivariant formulation of the parametric bootstrap algorithm that leverages symmetries and invariance properties commonly encountered in imaging problems. Additionally, the proposed methodology is general and can be easily applied with any image reconstruction technique, including unsupervised training strategies that can be trained from observed data alone, thus enabling uncertainty quantification in situations where there is no ground truth data available. We demonstrate the proposed approach with a series of numerical experiments and through comparisons with alternative uncertainty quantification strategies from the state-of-the-art, such as Bayesian strategies involving score-based diffusion models and Langevin samplers. In all our experiments, the proposed method delivers remarkably accurate high-dimensional confidence regions and outperforms the competing approaches in terms of estimation accuracy, uncertainty quantification accuracy, and computing time.
- Ntire 2017 challenge on single image super-resolution: Dataset and study. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops.
- Wppnets and wppflows: The power of wasserstein patch priors for superresolution. SIAM Journal on Imaging Sciences, 16(3):1033–1067.
- Image-to-image regression with distribution-free uncertainty quantification and applications in imaging. In Proc. of the 39th International Conference on Machine Learning, volume 162, pages 717–730. PMLR.
- Uncertainty estimation for computed tomography with a linearised deep image prior.
- The lung image database consortium (lidc) and image database resource initiative (idri): a completed reference database of lung nodules on ct scans. Medical physics, 38(2):915–931.
- Solving inverse problems using data-driven models. Acta Numerica, 28:1–174.
- Equivariant neural networks for inverse problems. Inverse Problems, 37(8):085006.
- Imaging with equivariant deep learning: From unrolled network design to fully unsupervised learning. IEEE Signal Processing Magazine, 40(1):134–147.
- Equivariant imaging: Learning beyond the range space. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pages 4379–4388.
- Robust equivariant imaging: a fully unsupervised framework for learning to image from noisy and partial measurements. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
- ILVR: Conditioning method for denoising diffusion probabilistic models. arXiv preprint arXiv:2108.02938.
- Diffusion posterior sampling for general noisy inverse problems. arXiv preprint arXiv:2209.14687.
- An introduction to the bootstrap. CRC press.
- Eldar, Y. C. (2008). Generalized sure for exponential families: Applications to regularization. IEEE Transactions on Signal Processing, 57(2):471–481.
- Bayesian imaging with data-driven priors encoded by neural networks. SIAM Journal on Imaging Sciences, 15(2):892–924.
- Deep convolutional neural network for inverse problems in imaging. IEEE Transactions on Image Processing, 26(9):4509–4522.
- Statistical and Computational Inverse Problems. Springer New York.
- Denoising diffusion restoration models. Advances in Neural Information Processing Systems, 35:23593–23606.
- Bayesian imaging using plug & play priors: when langevin meets tweedie. SIAM Journal on Imaging Sciences, 15(2):701–737.
- Robust and interpretable blind image denoising via bias-free convolutional neural networks. arXiv preprint arXiv:1906.05478.
- Learned reconstruction methods with convergence guarantees: A survey of concepts and applications. IEEE Signal Processing Magazine, 40(1):164–182.
- Posterior-variance-based error quantification for inverse problems in imaging.
- Deep learning techniques for inverse problems in imaging. IEEE Journal on Selected Areas in Information Theory, 1(1):39–56.
- Serre, J.-P. (1977). Linear representations of finite groups, volume 42. Springer.
- Stein, C. M. (1981). Estimation of the mean of a multivariate normal distribution. The annals of Statistics, pages 1135–1151.
- Sensing theorems for learning from incomplete measurements. Journal of Machine Learning Research, 24(39):1–45.
- DeepInverse: A deep learning framework for inverse problems in imaging.
- Building firmly nonexpansive convolutional neural networks. In ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 8658–8662. IEEE.
- Conditional variational autoencoder for learned image reconstruction. Computation, 9(11).
- Beyond a gaussian denoiser: Residual learning of deep cnn for image denoising. IEEE transactions on image processing, 26(7):3142–3155.
- Learning deep cnn denoiser prior for image restoration. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 3929–3938.
- Denoising diffusion models for plug-and-play image restoration. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1219–1229.