Papers
Topics
Authors
Recent
Assistant
AI Research Assistant
Well-researched responses based on relevant abstracts and paper content.
Custom Instructions Pro
Preferences or requirements that you'd like Emergent Mind to consider when generating responses.
Gemini 2.5 Flash
Gemini 2.5 Flash 131 tok/s
Gemini 2.5 Pro 46 tok/s Pro
GPT-5 Medium 26 tok/s Pro
GPT-5 High 32 tok/s Pro
GPT-4o 71 tok/s Pro
Kimi K2 192 tok/s Pro
GPT OSS 120B 385 tok/s Pro
Claude Sonnet 4.5 36 tok/s Pro
2000 character limit reached

Wavelet-based Topological Loss for Low-Light Image Denoising (2309.08975v2)

Published 16 Sep 2023 in eess.IV

Abstract: Despite extensive research conducted in the field of image denoising, many algorithms still heavily depend on supervised learning and their effectiveness primarily relies on the quality and diversity of training data. It is widely assumed that digital image distortions are caused by spatially invariant Additive White Gaussian Noise (AWGN). However, the analysis of real-world data suggests that this assumption is invalid. Therefore, this paper tackles image corruption by real noise, providing a framework to capture and utilise the underlying structural information of an image along with the spatial information conventionally used for deep learning tasks. We propose a novel denoising loss function that incorporates topological invariants and is informed by textural information extracted from the image wavelet domain. The effectiveness of this proposed method was evaluated by training state-of-the-art denoising models on the BVI-Lowlight dataset, which features a wide range of real noise distortions. Adding a topological term to common loss functions leads to a significant increase in the LPIPS (Learned Perceptual Image Patch Similarity) metric, with the improvement reaching up to 25\%. The results indicate that the proposed loss function enables neural networks to learn noise characteristics better. We demonstrate that they can consequently extract the topological features of noise-free images, resulting in enhanced contrast and preserved textural information.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (44)
  1. NTIRE 2020 Challenge on Real Image Denoising: Dataset, Methods and Results, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops.
  2. K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation. IEEE Transactions on signal processing 54, 4311.
  3. Artificial intelligence in the creative industries: a review. Art. Int. Rev. .
  4. Contextual colorization and denoising for low-light ultra high resolution sequences, in: ICIP proc., pp. 1614–1618.
  5. Terrain classification from body-mounted cameras during human locomotion. IEEE Transactions on Cybernetics 45, 2249–2260. doi:10.1109/TCYB.2014.2368353.
  6. Robust texture features based on undecimated dual-tree complex wavelets and local magnitude binary patterns, in: 2015 IEEE International Conference on Image Processing (ICIP), pp. 3957–3961. doi:10.1109/ICIP.2015.7351548.
  7. Real image denoising with feature attention. IEEE International Conference on Computer Vision (ICCV-Oral) .
  8. Noise2self: Blind denoising by self-supervision, in: ICML proc., PMLR. pp. 524–533.
  9. A non-local algorithm for image denoising, in: CVPR proc., IEEE. pp. 60–65.
  10. A persistent homology-based topological loss for CNN-based multiclass segmentation of CMR. IEEE Transactions on Medical Imaging 42, 3–14. URL: https://doi.org/10.1109%2Ftmi.2022.3203309, doi:10.1109/tmi.2022.3203309.
  11. On the local behavior of spaces of natural images. Int. j. of comp. vision 76, 1–12.
  12. Clustering-based denoising with locally learned dictionaries. IEEE Transactions on Image Processing 18, 1438–1451.
  13. Adaptive bayesian wavelet shrinkage. Journal of the Amer. Stat. Assoc. 92, 1413–1421.
  14. Cubical homology-based machine learning: An application in image classification. Axioms 11, 112.
  15. Image denoising by sparse 3-d transform-domain collaborative filtering. IEEE Transactions on image processing 16, 2080–2095.
  16. A nonlocal and shape-adaptive transform-domain collaborative filtering. Proc. Int. Workshop on Local and Non-Local Approx. in Image Process., LNLA .
  17. BM3D image denoising with shape-adaptive principal component analysis, in: SPARS’09.
  18. Ideal spatial adaptation by wavelet shrinkage. biometrika 81, 425–455.
  19. Topological persistence and simplification, in: Proc. ann. symp. on found. of comp. sc., IEEE. pp. 454–463.
  20. Topological data analysis. Inverse Problems 27, 120201.
  21. Sunet: Swin transformer unet for image denoising, in: 2022 IEEE International Symposium on Circuits and Systems (ISCAS), pp. 2333–2337. doi:10.1109/ISCAS48785.2022.9937486.
  22. Pointwise shape-adaptive dct for high-quality denoising and deblocking of grayscale and color images. IEEE Trans. on Image Proc. 16, 1395–1411.
  23. A residual dense u-net neural network for image denoising. IEEE Access 9, 31742–31754. doi:10.1109/ACCESS.2021.3061062.
  24. Undecimated dual-tree complex wavelet transforms. Signal Processing: Image Communication 35, 61–70. URL: https://www.sciencedirect.com/science/article/pii/S0923596515000715, doi:https://doi.org/10.1016/j.image.2015.04.010.
  25. Perceptual losses for real-time style transfer and super-resolution. CoRR abs/1603.08155. URL: http://arxiv.org/abs/1603.08155, arXiv:1603.08155.
  26. Noise2void-learning denoising from single noisy images, in: CVPR proc., pp. 2129--2137.
  27. Noise2noise: Learning image restoration without clean data. arXiv preprint arXiv:1803.04189 .
  28. Non-local sparse models for image restoration, in: CVPR proc., IEEE. pp. 2272--2279.
  29. Bvi-lowlight. URL: https://dx.doi.org/10.21227/zp7a-0683, doi:10.21227/zp7a-0683.
  30. A topological loss function: Image denoising on a low-light dataset. URL: https://arxiv.org/abs/2208.04573, doi:10.48550/ARXIV.2208.04573.
  31. A topological loss function for image denoising on a new BVI-lowlight dataset. Signal Processing , 109081URL: https://www.sciencedirect.com/science/article/pii/S016516842300155X, doi:https://doi.org/10.1016/j.sigpro.2023.109081.
  32. Low-complexity image denoising based on statistical modeling of wavelet coefficients. IEEE Signal Processing Letters 6, 300--303.
  33. U-net: Convolutional networks for biomedical image segmentation, in: MICCAI, Springer. pp. 234--241.
  34. Zur theorie der linearen und nichtlinearen integralgleichungen. Mathematische Annalen 63, 433--476.
  35. Image denoising using 2-d separable oversampled dft modulated filter banks. IET Image processing 3, 163--173.
  36. Noise removal via bayesian wavelet coring, in: Proc. 3rd IEEE Intern. Conf. on Image Proc.
  37. Kernel regression for image processing and reconstruction .
  38. Steering kernel regression: An adaptive denoising tool to process gpr data, in: Advanced Ground Penetrating Radar (IWAGPR), 2013 7th International Workshop on, IEEE. pp. 1--4.
  39. Deep image prior, in: CVPR proc., pp. 9446--9454.
  40. Extrapolation, interpolation and smoothing of stationary time series with engineering applications .
  41. DCT image denoising: a simple and effective image denoising algorithm. Image Processing On Line 1, 292--296.
  42. Beyond a gaussian denoiser: Residual learning of deep cnn for image denoising. IEEE Transactions on Image Processing 26, 3142--3155.
  43. The unreasonable effectiveness of deep features as a perceptual metric, in: CVPR.
  44. Computing persistent homology. Disc. & Comp. Geometry 33, 249--274.

Summary

We haven't generated a summary for this paper yet.

Dice Question Streamline Icon: https://streamlinehq.com

Open Questions

We haven't generated a list of open questions mentioned in this paper yet.

Lightbulb Streamline Icon: https://streamlinehq.com

Continue Learning

We haven't generated follow-up questions for this paper yet.

List To Do Tasks Checklist Streamline Icon: https://streamlinehq.com

Collections

Sign up for free to add this paper to one or more collections.