Re-thinking Richardson-Lucy without Iteration Cutoffs: Physically Motivated Bayesian Deconvolution (2411.00991v1)
Abstract: Richardson-Lucy deconvolution is widely used to restore images from degradation caused by the broadening effects of a point spread function and corruption by photon shot noise, in order to recover an underlying object. In practice, this is achieved by iteratively maximizing a Poisson emission likelihood. However, the RL algorithm is known to prefer sparse solutions and overfit noise, leading to high-frequency artifacts. The structure of these artifacts is sensitive to the number of RL iterations, and this parameter is typically hand-tuned to achieve reasonable perceptual quality of the inferred object. Overfitting can be mitigated by introducing tunable regularizers or other ad hoc iteration cutoffs in the optimization as otherwise incorporating fully realistic models can introduce computational bottlenecks. To resolve these problems, we present Bayesian deconvolution, a rigorous deconvolution framework that combines a physically accurate image formation model avoiding the challenges inherent to the RL approach. Our approach achieves deconvolution while satisfying the following desiderata: I deconvolution is performed in the spatial domain (as opposed to the frequency domain) where all known noise sources are accurately modeled and integrated in the spirit of providing full probability distributions over the density of the putative object recovered; II the probability distribution is estimated without making assumptions on the sparsity or continuity of the underlying object; III unsupervised inference is performed and converges to a stable solution with no user-dependent parameter tuning or iteration cutoff; IV deconvolution produces strictly positive solutions; and V implementation is amenable to fast, parallelizable computation.
- Joseph W Goodman. Introduction to Fourier optics. Roberts and Company publishers, 2005.
- William Hadley Richardson. Bayesian-based iterative method of image restoration. Journal of the Optical Society of America, 62:55, 1972.
- L.B. Lucy. An iterative technique for the rectification of observed distributions. The Astronomical Journal, 79:745, 1974.
- Real-time image denoising of mixed Poisson–Gaussian noise in fluorescence microscopy images using imagej. Optica, 9:335, 2022.
- M. Bertero and P. Boccacci. A simple method for the reduction of boundary effects in the richardson-lucy approach to image deconvolution. Astronomy & Astrophysics, 437:369, 2005.
- John Parker Burg. Maximum entropy spectral analysis. Stanford University, 1975.
- When does the richardson-lucy deconvolution converge? Astronomy and Astrophysics Supplement Series, 108:409, 1994.
- Denoising of microscopy images: A review of the state-of-the-art, and a new sparsity-based method. IEEE Transactions on Image Processing, 27:3842, 2018.
- Brief review of image denoising techniques. Visual Computing for Industry, Biomedicine, and Art, 2:7, 2019.
- Nonlinear total variation based noise removal algorithms. Physica D: Nonlinear Phenomena, 60:259, 1992.
- Fast, long-term, super-resolution imaging with hessian structured illumination microscopy. Nature Biotechnology, 36:451, 2018.
- Compressive sensing image restoration using adaptive curvelet thresholding and nonlocal sparse regularization. IEEE Transactions on Image Processing, 25:3126, 2016.
- Fast gradient-based algorithms for constrained total variation image denoising and deblurring problems. IEEE Transactions on Image Processing, 18:2419, 2009.
- Constrained total variation deblurring models and fast algorithms based on alternating direction method of multipliers. SIAM Journal on Imaging Sciences, 6:680, 2013.
- Richardson-lucy algorithm with total variation regularization for 3d confocal microscope deconvolution. Microscopy Research and Technique, 69:260, 2006.
- Compressed sensing effects on quantitative analysis of undersampled human brain sodium MRI. Magnetic resonance in Medicine, 83:1025, 2020.
- Sparse deconvolution improves the resolution of live-cell super-resolution fluorescence microscopy. Nature Biotechnology, 40:606, 2022.
- Deep image prior. In Proceedings of the IEEE conference on computer vision and pattern recognition, page 9446, 2018.
- Deblur-NeRF: Neural radiance fields from blurry images. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, page 12861, 2022.
- Pi-astrodeconv: A physics-informed unsupervised learning method for astronomical image deconvolution. arXiv:2403.01692, 2024.
- Zero-shot learning enables instant denoising and super-resolution in optical fluorescence microscopy. Nature Communications, 15:4180, 2024.
- Deep convolutional neural network for image deconvolution. Advances in Neural Information Processing Systems, 27, 2014.
- Deep learning for fast spatially varying deconvolution. Optica, 9:96, 2022.
- Incorporating the image formation process into deep learning improves network performance. Nature Methods, 19:1427, 2022.
- A structured illumination microscopy framework with spatial-domain noise propagation. bioRxiv, 2023.
- https://github.com/JuliaImages/TestImages.jl.
- Ayush Saurabh. BayesianDeconvolution, 2024. https://github.com/LabPresse/BayesianDeconvolution.
- A stochastic model for electron multiplication charge-coupled devices–from theory to practice. PloS One, 8:e53671, 2013.
- Fourier ptychography: current applications and future promises. Optics Express, 28:9603, 2020.
- DeconvOptim.jl - signal deconvolution with julia. Proceedings of the JuliaCon Conferences, 1:99, 2023.
- https://scikit-image.org/docs/stable/auto_examples/filters/plot_deconvolution.