Papers
Topics
Authors
Recent
Assistant
AI Research Assistant
Well-researched responses based on relevant abstracts and paper content.
Custom Instructions Pro
Preferences or requirements that you'd like Emergent Mind to consider when generating responses.
GPT-5.1
GPT-5.1 96 tok/s
Gemini 3.0 Pro 48 tok/s Pro
Gemini 2.5 Flash 155 tok/s Pro
Kimi K2 197 tok/s Pro
Claude Sonnet 4.5 36 tok/s Pro
2000 character limit reached

Bracketing Image Restoration and Enhancement with High-Low Frequency Decomposition (2404.13537v2)

Published 21 Apr 2024 in eess.IV and cs.CV

Abstract: In real-world scenarios, due to a series of image degradations, obtaining high-quality, clear content photos is challenging. While significant progress has been made in synthesizing high-quality images, previous methods for image restoration and enhancement often overlooked the characteristics of different degradations. They applied the same structure to address various types of degradation, resulting in less-than-ideal restoration outcomes. Inspired by the notion that high/low frequency information is applicable to different degradations, we introduce HLNet, a Bracketing Image Restoration and Enhancement method based on high-low frequency decomposition. Specifically, we employ two modules for feature extraction: shared weight modules and non-shared weight modules. In the shared weight modules, we use SCConv to extract common features from different degradations. In the non-shared weight modules, we introduce the High-Low Frequency Decomposition Block (HLFDB), which employs different methods to handle high-low frequency information, enabling the model to address different degradations more effectively. Compared to other networks, our method takes into account the characteristics of different degradations, thus achieving higher-quality image restoration.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (56)
  1. Ntire 2020 challenge on real image denoising: Dataset, methods and results. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pages 496–497, 2020.
  2. Deep burst super-resolution. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 9209–9218, 2021a.
  3. Deep burst super-resolution. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 9209–9218, 2021b.
  4. Luca Bogoni. Extending dynamic range of monochrome and color images through fusion. In Proceedings 15th International Conference on Pattern Recognition. ICPR-2000, pages 7–12. IEEE, 2000.
  5. Unprocessing images for learned raw denoising. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 11036–11045, 2019.
  6. A comparative study of image restoration networks for general backbone network design. arXiv preprint arXiv:2310.11881, 2023.
  7. Rethinking coarse-to-fine approach in single image deblurring. In Proceedings of the IEEE/CVF international conference on computer vision, pages 4641–4650, 2021.
  8. Deformable convolutional networks. In Proceedings of the IEEE international conference on computer vision, pages 764–773, 2017.
  9. Recovering high dynamic range radiance maps from photographs. In Seminal Graphics Papers: Pushing the Boundaries, Volume 2, pages 643–652. 2023.
  10. Image super-resolution using deep convolutional networks. IEEE transactions on pattern analysis and machine intelligence, 38(2):295–307, 2015.
  11. Multi-scale residual low-pass filter network for image deblurring. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 12345–12354, 2023.
  12. Burst image restoration and enhancement. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 5759–5768, 2022a.
  13. Burst image restoration and enhancement. In Proceedings of the ieee/cvf Conference on Computer Vision and Pattern Recognition, pages 5759–5768, 2022b.
  14. Burstormer: Burst image restoration and enhancement transformer. In 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 5703–5712. IEEE, 2023.
  15. Hdr image reconstruction from a single exposure using deep cnns. ACM transactions on graphics (TOG), 36(6):1–15, 2017.
  16. Deep burst denoising, 2017.
  17. Toward convolutional blind denoising of real photographs. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 1712–1722, 2019.
  18. Joint denoising and demosaicking with green channel prior for real-world burst images. IEEE Transactions on Image Processing, 30:6930–6942, 2021.
  19. A differentiable two-stage alignment scheme for burst image reconstruction with large shift, 2022.
  20. Generating content for hdr deghosting from frequency view. arXiv preprint arXiv:2404.00849, 2024.
  21. Winnet: Wavelet-inspired invertible network for image denoising. IEEE Transactions on Image Processing, 31:4377–4392, 2022.
  22. Deep high dynamic range imaging of dynamic scenes. ACM Trans. Graph., 36(4):144–1, 2017.
  23. Joint demosaicing and deghosting of time-varying exposures for single-shot hdr imaging. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 12292–12301, 2023.
  24. Accurate image super-resolution using very deep convolutional networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1646–1654, 2016.
  25. High dynamic range and super-resolution from raw image bursts. arXiv preprint arXiv:2207.14671, 2022.
  26. Photo-realistic single image super-resolution using a generative adversarial network. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 4681–4690, 2017.
  27. Scconv: spatial and channel reconstruction convolution for feature redundancy. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 6153–6162, 2023a.
  28. Ntire 2023 challenge on image denoising: Methods and results. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1904–1920, 2023b.
  29. Swinir: Image restoration using swin transformer. In Proceedings of the IEEE/CVF international conference on computer vision, pages 1833–1844, 2021.
  30. Ghost-free high dynamic range imaging with context-aware transformer. In European Conference on Computer Vision, pages 344–360. Springer, 2022.
  31. Transformer for single image super-resolution. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 457–466, 2022.
  32. Intriguing findings of frequency selection for image deblurring. In Proceedings of the AAAI Conference on Artificial Intelligence, pages 1905–1913, 2023.
  33. Multi-kernel prediction networks for denoising of burst images. In 2019 IEEE International Conference on Image Processing (ICIP). IEEE, 2019.
  34. Adaptive feature consolidation network for burst super-resolution. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, pages 1279–1286, 2022.
  35. Burst denoising with kernel prediction networks, 2018.
  36. Deep multi-scale convolutional neural network for dynamic scene deblurring. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 3883–3891, 2017.
  37. Hdr-gan: Hdr image reconstruction from multi-exposed ldr images with large motions. IEEE Transactions on Image Processing, 30:3885–3896, 2021.
  38. Towards practical and efficient high-resolution hdr deghosting with cnn. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XXI 16, pages 497–513. Springer, 2020.
  39. Robust patch-based hdr reconstruction of dynamic scenes. ACM Trans. Graph., 31(6):203–1, 2012.
  40. Scale-recurrent network for deep image deblurring. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 8174–8182, 2018.
  41. Alignment-free hdr deghosting with semantics consistent transformer. arXiv preprint arXiv:2305.18135, 2023.
  42. Towards real-world burst image super-resolution: Benchmark and method. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 13233–13242, 2023.
  43. Basis prediction networks for effective burst denoising with large kernels, 2020.
  44. Learning deformable kernels for image and video denoising, 2019.
  45. Attention-guided network for ghost-free high dynamic range imaging. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1751–1760, 2019.
  46. Deep hdr imaging via a non-local network. IEEE Transactions on Image Processing, 29:4308–4322, 2020.
  47. Dual-attention-guided network for ghost-free high dynamic range imaging. International Journal of Computer Vision, pages 1–19, 2022.
  48. A unified hdr imaging method with pixel and patch level. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 22211–22220, 2023a.
  49. Towards high-quality hdr deghosting with conditional diffusion models. IEEE Transactions on Circuits and Systems for Video Technology, 2023b.
  50. Smae: Few-shot learning for hdr deghosting with saturation-aware masked autoencoders. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 5775–5784, 2023c.
  51. Cycleisp: Real image restoration via improved data synthesis. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 2696–2705, 2020.
  52. Restormer: Efficient transformer for high-resolution image restoration. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 5728–5739, 2022.
  53. Beyond a gaussian denoiser: Residual learning of deep cnn for image denoising. IEEE transactions on image processing, 26(7):3142–3155, 2017.
  54. Gradient-directed multiexposure composition. IEEE Transactions on Image Processing, 21(4):2318–2323, 2011.
  55. Bracketing is all you need: Unifying image restoration and enhancement tasks with multi-exposure images. arXiv preprint arXiv:2401.00766, 2024a.
  56. Ntire 2024 challenge on bracketing image restoration and enhancement: Datasets, methods and results. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2024b.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
Dice Question Streamline Icon: https://streamlinehq.com

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now
Lightbulb Streamline Icon: https://streamlinehq.com

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now
List To Do Tasks Checklist Streamline Icon: https://streamlinehq.com

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up