Papers
Topics
Authors
Recent
2000 character limit reached

DGNet: Dynamic Gradient-Guided Network for Water-Related Optics Image Enhancement (2312.06999v3)

Published 12 Dec 2023 in cs.CV

Abstract: Underwater image enhancement (UIE) is a challenging task due to the complex degradation caused by underwater environments. To solve this issue, previous methods often idealize the degradation process, and neglect the impact of medium noise and object motion on the distribution of image features, limiting the generalization and adaptability of the model. Previous methods use the reference gradient that is constructed from original images and synthetic ground-truth images. This may cause the network performance to be influenced by some low-quality training data. Our approach utilizes predicted images to dynamically update pseudo-labels, adding a dynamic gradient to optimize the network's gradient space. This process improves image quality and avoids local optima. Moreover, we propose a Feature Restoration and Reconstruction module (FRR) based on a Channel Combination Inference (CCI) strategy and a Frequency Domain Smoothing module (FRS). These modules decouple other degradation features while reducing the impact of various types of noise on network performance. Experiments on multiple public datasets demonstrate the superiority of our method over existing state-of-the-art approaches, especially in achieving performance milestones: PSNR of 25.6dB and SSIM of 0.93 on the UIEB dataset. Its efficiency in terms of parameter size and inference time further attests to its broad practicality. The code will be made publicly available.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (53)
  1. Simple baselines for image restoration. In ECCV, pages 17–33. Springer, 2022.
  2. Learning a sparse transformer network for effective image deraining. In CVPR, pages 5896–5905, 2023.
  3. Pugan: Physical model-guided underwater image enhancement using gan with dual-discriminators. TIP, 2023.
  4. Dual-domain attention for image deblurring. In AAAI, pages 479–487, 2023.
  5. Uncertainty inspired underwater image enhancement. In ECCV, pages 465–482. Springer, 2022.
  6. Image dehazing transformer with transmission-aware 3d position embedding. In CVPR, pages 5812–5820, 2022.
  7. Underwater ranker: Learn which is better and how to be better. In AAAI, pages 720–709, 2023.
  8. Contrastive semi-supervised learning for underwater image restoration via reliable bank. In CVPR, pages 18145–18155, 2023a.
  9. Contrastive semi-supervised learning for underwater image restoration via reliable bank. In CVPR, pages 18145–18155, 2023b.
  10. Multi-scale progressive fusion network for single image deraining. In CVPR, pages 8346–8355, 2020.
  11. Rain-free and residue hand-in-hand: A progressive coupled network for real-time image deraining. TIP, 30:7404–7418, 2021.
  12. Lighting every darkness in two pairs: A calibration-free pipeline for raw denoising. In ICCV, pages 13275–13284, 2023.
  13. Peak signal-to-noise ratio revisited: Is simple beautiful? In 2012 Fourth International Workshop on Quality of Multimedia Experience, pages 37–38. IEEE, 2012.
  14. Underwater image enhancement by dehazing with minimum information loss and histogram distribution prior. TIP, 25(22):5664–5677, 2016.
  15. An underwater image enhancement benchmark dataset and beyond. TIP, 29:4376–4389, 2019a.
  16. Underwater scene prior inspired deep underwater image and video enhancement. PR, 98:107038, 2020.
  17. Underwater image enhancement via medium transmission-guided multi-color space embedding. TIP, 30:4985–5000, 2021a.
  18. Low-light image and video enhancement using deep learning: A survey. TPAMI, 2021b.
  19. Learning to enhance low-light image via zero-reference deep curve estimation. TPAMI, 2021c.
  20. A fusion adversarial underwater image enhancement network with a public test dataset. arXiv preprint arXiv:1906.06819, 2019b.
  21. Watergan: Unsupervised generative network to enable real-time color correction of monocular underwater images. IEEE Robotics and Automation letters, 3(1):387–394, 2017.
  22. LightGlue: Local Feature Matching at Light Speed. In ICCV, 2023.
  23. Real-world underwater enhancement: Challenges, benchmarks, and solutions under natural light. TCSVT, 30(12):4861–4875, 2020.
  24. Nighthazeformer: Single nighttime haze removal using prior query transformer. In ACMMM, pages 4119–4128, 2023.
  25. Local light field fusion: Practical view synthesis with prescriptive sampling guidelines. TOG, 2019.
  26. Human-visual-system-inspired underwater image quality measures. IEEE Journal of Oceanic Engineering, 41(3):541–551, 2015.
  27. U-shape transformer for underwater image enhancement. TIP, 2023.
  28. Generalization of the dark channel prior for single image restoration. TIP, 27(6):2856–2868, 2018.
  29. Image desnowing via deep invertible separation. TCSVT, 2023.
  30. Automatic color correction for 3d reconstruction of underwater scenes. In IEEE International Conference on Robotics and Automation, 2017.
  31. Enhancement of underwater images with statistical model of background light and optimization of transmission map. IEEE Transactions on Broadcasting, 66(1):153–169, 2020a.
  32. Enhancement of underwater images with statistical model of background light and optimization of transmission map. IEEE Transactions on Broadcasting, 66(1):153–169, 2020b.
  33. Rethinking image restoration for object detection. Advances in Neural Information Processing Systems, 35:4461–4474, 2022.
  34. Uiec^ 2-net: Cnn-based underwater image enhancement using two color space. Signal Processing: Image Communication, 96:116250, 2021.
  35. Smartassign: Learning a smart knowledge assignment strategy for deraining and desnowing. In CVPR, pages 3677–3686, 2023.
  36. Image quality assessment: from error visibility to structural similarity. TIP, 13(4):600–612, 2004.
  37. Ridcp: Revitalizing real image dehazing via high-quality codebook priors. In CVPR, pages 22282–22291, 2023a.
  38. Learning semantic-aware knowledge guidance for low-light image enhancement. In CVPR, pages 1662–1671, 2023b.
  39. An underwater color image quality evaluation metric. TIP, 24(12):6062–6071, 2015.
  40. Treat noise as domain shift: Noise feature disentanglement for underwater perception and maritime surveys in side-scan sonar images. IEEE Transactions on Geoscience and Remote Sensing, 61:1–15, 2023.
  41. Restormer: Efficient transformer for high-resolution image restoration. In CVPR, pages 5728–5739, 2022.
  42. Underwater image enhancement via multi-scale fusion and adaptive color-gamma correction in low-light conditions. Engineering Applications of Artificial Intelligence, 126:106972, 2023a.
  43. Hierarchical attention aggregation with multi-resolution feature learning for gan-based underwater image enhancement. Engineering Applications of Artificial Intelligence, 125:106743, 2023b.
  44. Rex-net: A reflectance-guided underwater image enhancement network for extreme scenarios. Expert Systems with Applications, page 120842, 2023c.
  45. Mc-blur: A comprehensive benchmark for image deblurring. TCSVT, 2023d.
  46. Underwater image enhancement via minimal color loss and locally adaptive contrast enhancement. TIP, 31:3997–4010, 2022.
  47. Empowering low-light image enhancer through customized learnable priors. In ICCV, pages 12559–12569, 2023.
  48. Auto color correction of underwater images utilizing depth information. IEEE Geoscience and Remote Sensing Letters, 19:1–5, 2022a.
  49. Ugif-net: An efficient fully guided information flow network for underwater image enhancement. IEEE Transactions on Geoscience and Remote Sensing, 61:1–17, 2023a.
  50. Underwater camera: improving visual perception via adaptive dark pixel prior and color correction. IJCV, pages 1–19, 2023b.
  51. Multi-view underwater image enhancement method via embedded fusion mechanism. Engineering Applications of Artificial Intelligence, 121:105946, 2023c.
  52. Lednet: Joint low-light enhancement and deblurring in the dark. In ECCV, pages 1–17, 2022b.
  53. Exploring temporal frequency spectrum in deep video deblurring. In ICCV, pages 12428–12437, 2023.

Summary

We haven't generated a summary for this paper yet.

Whiteboard

Paper to Video (Beta)

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.