Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
121 tokens/sec
GPT-4o
9 tokens/sec
Gemini 2.5 Pro Pro
47 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Improving Bracket Image Restoration and Enhancement with Flow-guided Alignment and Enhanced Feature Aggregation (2404.10358v1)

Published 16 Apr 2024 in cs.CV

Abstract: In this paper, we address the Bracket Image Restoration and Enhancement (BracketIRE) task using a novel framework, which requires restoring a high-quality high dynamic range (HDR) image from a sequence of noisy, blurred, and low dynamic range (LDR) multi-exposure RAW inputs. To overcome this challenge, we present the IREANet, which improves the multiple exposure alignment and aggregation with a Flow-guide Feature Alignment Module (FFAM) and an Enhanced Feature Aggregation Module (EFAM). Specifically, the proposed FFAM incorporates the inter-frame optical flow as guidance to facilitate the deformable alignment and spatial attention modules for better feature alignment. The EFAM further employs the proposed Enhanced Residual Block (ERB) as a foundational component, wherein a unidirectional recurrent network aggregates the aligned temporal features to better reconstruct the results. To improve model generalization and performance, we additionally employ the Bayer preserving augmentation (BayerAug) strategy to augment the multi-exposure RAW inputs. Our experimental evaluations demonstrate that the proposed IREANet shows state-of-the-art performance compared with previous methods.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (46)
  1. Burst image deblurring using permutation invariant convolutional neural networks. In ECCV, pages 731–747, 2018.
  2. Ntire 2021 challenge on burst super-resolution: Methods and results. In CVPRW, pages 613–626, 2021a.
  3. Deep burst super-resolution. In CVPR, pages 9209–9218, 2021b.
  4. Deep reparametrization of multi-frame super-resolution and denoising. In ICCV, pages 2460–2470, 2021c.
  5. Ntire 2022 burst super-resolution challenge. In CVPRW, pages 1041–1061, 2022.
  6. Self-supervised burst super-resolution. In ICCV, pages 10605–10614, 2023.
  7. Basicvsr++: Improving video super-resolution with enhanced propagation and alignment. In CVPR, pages 5972–5981, 2022.
  8. Improving dynamic hdr imaging with fusion transformer. In AAAI, pages 340–349, 2023.
  9. Hdr imaging with spatially varying signal-to-noise ratios. In CVPR, pages 5724–5734, 2023.
  10. Burst deblurring: Removing camera shake through fourier burst accumulation. In CVPR, pages 2385–2393, 2015.
  11. Burst image restoration and enhancement. In CVPR, pages 5759–5768, 2022.
  12. Burstormer: Burst image restoration and enhancement transformer. In CVPR, pages 5703–5712. IEEE, 2023.
  13. Hdr image reconstruction from a single exposure using deep cnns. ACM TOG, 36(6):1–15, 2017.
  14. Deep burst denoising. In ECCV, pages 538–554, 2018.
  15. Burst photography for high dynamic range and low-light imaging on mobile cameras. ACM TOG, 35(6):1–12, 2016.
  16. Low-light image enhancement with wavelet-based diffusion models. ACM TOG, 42(6):1–14, 2023.
  17. Deep high dynamic range imaging of dynamic scenes. ACM TOG, 36(4):144, 2017.
  18. Joint demosaicing and deghosting of time-varying exposures for single-shot hdr imaging. In ICCV, pages 12292–12301, 2023.
  19. Learning raw image denoising with bayer pattern unification and bayer preserving augmentation. In CVPRW, pages 0–0, 2019.
  20. Joint hdr denoising and fusion: A real-world mobile hdr image dataset. In CVPR, pages 13966–13975, 2023.
  21. Single-image hdr reconstruction by learning to reverse the camera pipeline. In CVPR, pages 1651–1660, 2020.
  22. Adnet: Attention-guided deformable convolutional network for high dynamic range imaging. In CVPRW, pages 463–470, 2021.
  23. Ghost-free high dynamic range imaging with context-aware transformer. In ECCV, pages 344–360. Springer, 2022.
  24. Ebsr: Feature enhanced burst super-resolution with deformable alignment. In CVPRW, pages 471–478, 2021.
  25. Bsrt: Improving burst super-resolution with swin transformer and flow-guided deformable alignment. In CVPRW, pages 998–1008, 2022.
  26. Burst denoising with kernel prediction networks. In CVPR, pages 2502–2510, 2018.
  27. Deep multi-scale convolutional neural network for dynamic scene deblurring. In CVPR, pages 3883–3891, 2017.
  28. Hdr-gan: Hdr image reconstruction from multi-exposed ldr images with large motions. IEEE TIP, 30:3885–3896, 2021.
  29. Ntire 2021 challenge on high dynamic range imaging: Dataset, methods and results. In CVPRW, pages 691–700, 2021.
  30. Towards practical and efficient high-resolution hdr deghosting with cnn. In ECCV, pages 497–513. Springer, 2020.
  31. Labeled from unlabeled: Exploiting unlabeled data for few-shot deep hdr deghosting. In CVPR, pages 4875–4885, 2021.
  32. Burst denoising via temporally shifted wavelet transforms. In ECCV, pages 240–256. Springer, 2020.
  33. Selective transhdr: Transformer-based selective hdr imaging using ghost region mask. In ECCV, pages 288–304. Springer, 2022.
  34. Deep sr-hdr: Joint learning of super-resolution and high dynamic range imaging for dynamic scenes. IEEE TMM, 25:750–763, 2021.
  35. Alignment-free hdr deghosting with semantics consistent transformer. In ICCV, 2023.
  36. Deep learning for hdr imaging: State-of-the-art and future trends. IEEE TPAMI, 44(12):8874–8895, 2021.
  37. End-to-end learning for image burst deblurring. In ACCV, pages 35–51. Springer, 2017.
  38. Deep high dynamic range imaging with large foreground motions. In ECCV, pages 117–132, 2018.
  39. Basis prediction networks for effective burst denoising with large kernels. In CVPR, pages 11844–11853, 2020.
  40. Attention-guided network for ghost-free high dynamic range imaging. In CVPR, pages 1751–1760, 2019.
  41. Cycleisp: Real image restoration via improved data synthesis. In CVPR, pages 2696–2705, 2020.
  42. Multi-stage progressive image restoration. In CVPR, pages 14821–14831, 2021.
  43. Beyond a gaussian denoiser: Residual learning of deep cnn for image denoising. IEEE TIP, 26(7):3142–3155, 2017.
  44. Bracketing is all you need: Unifying image restoration and enhancement tasks with multi-exposure images. arXiv preprint arXiv:2401.00766, 2024a.
  45. NTIRE 2024 challenge on bracketing image restoration and enhancement: Datasets, methods and results. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2024b.
  46. Rawhdr: High dynamic range image reconstruction from a single raw image. In ICCV, pages 12334–12344, 2023.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now