Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
119 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Leveraging Classic Deconvolution and Feature Extraction in Zero-Shot Image Restoration (2310.02097v1)

Published 3 Oct 2023 in cs.CV and eess.IV

Abstract: Non-blind deconvolution aims to restore a sharp image from its blurred counterpart given an obtained kernel. Existing deep neural architectures are often built based on large datasets of sharp ground truth images and trained with supervision. Sharp, high quality ground truth images, however, are not always available, especially for biomedical applications. This severely hampers the applicability of current approaches in practice. In this paper, we propose a novel non-blind deconvolution method that leverages the power of deep learning and classic iterative deconvolution algorithms. Our approach combines a pre-trained network to extract deep features from the input image with iterative Richardson-Lucy deconvolution steps. Subsequently, a zero-shot optimisation process is employed to integrate the deconvolved features, resulting in a high-quality reconstructed image. By performing the preliminary reconstruction with the classic iterative deconvolution method, we can effectively utilise a smaller network to produce the final image, thus accelerating the reconstruction whilst reducing the demand for valuable computational resources. Our method demonstrates significant improvements in various real-world applications non-blind deconvolution tasks.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (54)
  1. Generation of annotated multimodal ground truth datasets for abdominal medical image registration. International Journal of Computer Assisted Radiology and Surgery, 16, 05 2021.
  2. Image restoration: total variation, wavelet frames, and beyond. Journal of the American Mathematical Society, 25(4):1033–1089, 2012.
  3. Self-supervised blind image deconvolution via deep generative ensemble learning. IEEE Transactions on Circuits and Systems for Video Technology, 2022.
  4. Lucyd: A feature-driven richardson-lucy deconvolution network. arXiv preprint arXiv:2307.07998, 2023.
  5. A modified damped richardson–lucy algorithm to reduce isotropic background effects in spherical deconvolution. Neuroimage, 49(2):1446–1458, 2010.
  6. Learning data terms for non-blind deblurring. In Proceedings of the European Conference on Computer Vision (ECCV), pages 748–763, 2018.
  7. Deep wiener deconvolution: Wiener meets deep learning for image deblurring. Advances in Neural Information Processing Systems, 33:1048–1059, 2020.
  8. Learning spatially-variant map models for non-blind image deblurring. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 4886–4895, 2021.
  9. Timothy Dozat. Incorporating nesterov momentum into adam. 2016.
  10. End-to-end interpretable learning of non-blind image deblurring. In European Conference on Computer Vision, pages 314–331. Springer, 2020.
  11. X-ray deconvolution microscopy. Biomedical Optics Express, 7(4):1227, Mar. 2016.
  12. An iterative algorithm for background removal in spectroscopy by wavelet transforms. Applied spectroscopy, 63:1370–6, 12 2009.
  13. ” double-dip”: Unsupervised image decomposition via coupled deep-image-priors. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 11026–11035, 2019.
  14. Learning deep gradient descent optimization for image deconvolution. IEEE transactions on neural networks and learning systems, 31(12):5468–5482, 2020.
  15. A new detail-preserving regularization scheme. SIAM journal on imaging sciences, 7(2):1309–1334, 2014.
  16. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 770–778, 2016.
  17. Artefact removal in ground truth deficient fluctuations-based nanoscopy images using deep learning. Biomedical Optics Express, 12(1):191, Dec. 2020.
  18. Noise-blind image deblurring. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 3510–3518, 2017.
  19. Fast image deconvolution using hyper-laplacian priors. Advances in neural information processing systems, 22, 2009.
  20. Learning to push the limits of efficient fft-based image deconvolution. In 2017 IEEE International Conference on Computer Vision (ICCV), pages 4596–4604, 2017.
  21. Tomographic image reconstruction using compressed sensing. KENBIKYO, 51(1):48–53, 2016.
  22. A comparative study for single image blind deblurring. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1701–1709, 2016.
  23. L. Landweber. An iteration formula for fredholm integral equations of the first kind. American Journal of Mathematics, 73(3):615–624, 1951.
  24. Image and depth from a conventional camera with a coded aperture. ACM transactions on graphics (TOG), 26(3):70–es, 2007.
  25. Understanding and evaluating blind deconvolution algorithms. In 2009 IEEE Conference on Computer Vision and Pattern Recognition, pages 1964–1971, 2009.
  26. Incorporating the image formation process into deep learning improves network performance. Nature Methods, pages 1–11, 2022.
  27. Waterloo exploration database: New challenges for image quality assessment models. IEEE Transactions on Image Processing, 26(2):1004–1016, 2016.
  28. A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001, volume 2, pages 416–423. IEEE, 2001.
  29. Deep multi-scale convolutional neural network for dynamic scene deblurring. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 3883–3891, 2017.
  30. Automatic differentiation in pytorch. 2017.
  31. Dmitry Pekurovsky. P3dfft: A framework for parallel computations of fourier transforms in three dimensions. SIAM Journal on Scientific Computing, 34(4):C192–C209, 2012.
  32. Neural blind deconvolution using deep priors. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 3341–3350, 2020.
  33. Deep non-blind deconvolution via generalized low-rank approximation. Advances in neural information processing systems, 31, 2018.
  34. William Hadley Richardson. Bayesian-based iterative method of image restoration∗∗\ast∗. J. Opt. Soc. Am., 62(1):55–59, Jan 1972.
  35. U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18, pages 234–241. Springer, 2015.
  36. Nonlinear total variation based noise removal algorithms. Physica D: nonlinear phenomena, 60(1-4):259–268, 1992.
  37. Deconvolution methods for 3-d fluorescence microscopy images. IEEE Signal Processing Magazine, 23(3):32–45, 2006.
  38. A machine learning approach for non-blind image deconvolution. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1067–1074, 2013.
  39. High-quality motion deblurring from a single image. Acm transactions on graphics (tog), 27(3):1–10, 2008.
  40. Jean-Baptiste Sibarita. Deconvolution microscopy. In Microscopy Techniques, pages 201–243. Springer Berlin Heidelberg, May 2005.
  41. Edge-based blur kernel estimation using patch priors. In IEEE International Conference on Computational Photography (ICCP), pages 1–8, 2013.
  42. Deep image prior. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 9446–9454, 2018.
  43. A new alternating minimization algorithm for total variation image reconstruction. SIAM Journal on Imaging Sciences, 1(3):248–272, 2008.
  44. Image quality assessment: from error visibility to structural similarity. IEEE transactions on image processing, 13(4):600–612, 2004.
  45. Deconvolution processing of haadf stem images. Ultramicroscopy, 92(3):191–199, 2002.
  46. Richard L White. Image restoration using the damped richardson-lucy method. In Instrumentation in Astronomy VIII, volume 2198, pages 1342–1348. SPIE, 1994.
  47. Extrapolation, interpolation, and smoothing of stationary time series: with engineering applications, volume 113. MIT press Cambridge, MA, 1949.
  48. Deep convolutional neural network for image deconvolution. Advances in neural information processing systems, 27, 2014.
  49. Progressive inter-scale and intra-scale non-blind image deconvolution. Acm Transactions on Graphics (TOG), 27(3):1–10, 2008.
  50. Learning fully convolutional networks for iterative non-blind deconvolution. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 3817–3825, 2017.
  51. Learning deep cnn denoiser prior for image restoration. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 3929–3938, 2017.
  52. Sparse deconvolution improves the resolution of live-cell super-resolution fluorescence microscopy. Nature Biotechnology, 40(4):606–617, 2021.
  53. Sparse deconvolution improves the resolution of live-cell super-resolution fluorescence microscopy. Nature biotechnology, 40(4):606–617, 2022.
  54. Image registration in dynamic renal mri—current status and prospects. Magnetic Resonance Materials in Physics, Biology and Medicine, 33(1):33–48, 2020.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (7)
  1. Tomáš Chobola (7 papers)
  2. Veit Dausmann (2 papers)
  3. Anton Theileis (3 papers)
  4. Jan Taucher (3 papers)
  5. Jan Huisken (8 papers)
  6. Tingying Peng (23 papers)
  7. Gesine Müller (3 papers)
Citations (1)

Summary

We haven't generated a summary for this paper yet.