Convergence of non-linear diagonal frame filtering for regularizing inverse problems (2308.15666v2)
Abstract: Inverse problems are key issues in several scientific areas, including signal processing and medical imaging. Since inverse problems typically suffer from instability with respect to data perturbations, a variety of regularization techniques have been proposed. In particular, the use of filtered diagonal frame decompositions has proven to be effective and computationally efficient. However, existing convergence analysis applies only to linear filters and a few non-linear filters such as soft thresholding. In this paper, we analyze filtered diagonal frame decompositions with general non-linear filters. In particular, our results generalize SVD-based spectral filtering from linear to non-linear filters as a special case. As a first approach, we establish a connection between non-linear diagonal frame filtering and variational regularization, allowing us to use results from variational regularization to derive the convergence of non-linear spectral filtering. In the second approach, as our main theoretical results, we relax the assumptions involved in the variational case while still deriving convergence. Furthermore, we discuss connections between non-linear filtering and plug-and-play regularization and explore potential benefits of this relationship.
- Regularization of wavelet approximations. Journal of the American Statistical Association, 96(455):939–955, 2001.
- Invertible residual networks in the context of regularization theory for linear inverse problems. arXiv:2306.01335, 2023.
- Convex analysis and monotone operator theory in Hilbert spaces. CMS Books in Mathematics. Springer, Cham, second edition, 2017.
- Modern regularization methods for inverse problems. Acta Numerica, 27(1):1–111, 2018.
- Regularization with non-convex separable constraints. Inverse Problems, 25(8):085011, 2009.
- Convergence rates of convex variational regularization. Inverse Problems, 20(5):1411–1421, 2004.
- Recovering edges in ill-posed inverse problems: Optimality of curvelet frames. Annals of Statistics, 30(3):784–842, 2002.
- Plug-and-Play ADMM for Image Restoration: Fixed-Point Convergence and Applications. IEEE Transactions on Computational Imaging, 3(1):84–98, 2016.
- David Donoho. Nonlinear solution of linear inverse problems by wavelet–vaguelette decomposition. Applied and Computational Harmonic Analysis, 2(2):101–126, 1995.
- Regularization of inverse problems by filtered diagonal frame decomposition. Applied and Computational Harmonic Analysis, 62:66–83, 2023.
- Plug-and-play image reconstruction is a convergent regularization method. IEEE Transactions on Image Processing, 33:1476–1486, 2024.
- Regularization of Inverse Problems. Mathematics and Its Applications. Springer Netherlands, 2000.
- Efficient regularization with wavelet sparsity constraints in photoacoustic tomography. Inverse Problems, 34(2):024006, 2018.
- Sparse regularization of inverse problems by operator-adapted frame thresholding. In Mathematics of Wave Phenomena, pages 163–178, Cham, 2020. Springer International Publishing.
- Ye Gao. Wavelet shrinkage denoising using the non-negative garrote. Journal of Computational and Graphical Statistics, 7(4):469–488, 1998.
- Translation invariant diagonal frame decomposition of inverse problems and their regularization. Inverse Problems, 39(6):065011, 2023.
- Markus Grasmair. Linear convergence rates for Tikhonov regularization with positively homogeneous functionals. Inverse Problems, 27(7):075014, 2011.
- Charles Groetsch. The theory of Tikhonov regularization for Fredholm equations. 104p, Boston Pitman Publication, 1984.
- Asymptotic theory of filtering for linear operator equations with discrete noisy data. Mathematics of Computation, 49(180):499–506, 1987.
- Peter J. Huber. Robust Estimation of a Location Parameter. The Annals of Mathematical Statistics, 35(1):73 – 101, 1964.
- Frame decompositions of bounded linear operators in Hilbert spaces with applications in tomography. Inverse Problems, 37(5):055001, 2021.
- On regularization via frame decompositions with applications in tomography. Inverse Problems, 38(5):055003, 2022.
- Stéphane Mallat. A wavelet tour of signal processing. Elsevier, 1999.
- Existence, uniqueness and stability of minimizers of generalized tikhonov–phillips functionals. Journal of Mathematical Analysis and Applications, 396(1):396–411, 2012.
- A frame decomposition of the Funk-Radon transform. In International Conference on Scale Space and Variational Methods in Computer Vision, pages 42–54. Springer, 2023.
- Andreas Rieder. Keine Probleme mit inversen Problemen: eine Einführung in ihre stabile Lösung. Springer-Verlag, 2013.
- Variational methods in imaging, volume 167. Springer, 2009.
- An Online Plug-and-Play Algorithm for Regularized Image Reconstruction. IEEE Transactions on Computational Imaging, 5(3):395–408, 2019.
- Tuning-free plug-and-play proximal algorithm for inverse imaging problems. In International Conference on Machine Learning, pages 10158–10169. PMLR, 2020.
- Plug-and-play image restoration with deep denoiser prior. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(10):6360–6376, 2021.