Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
162 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Single Image Reflection Removal with Reflection Intensity Prior Knowledge (2312.03798v1)

Published 6 Dec 2023 in cs.CV

Abstract: Single Image Reflection Removal (SIRR) in real-world images is a challenging task due to diverse image degradations occurring on the glass surface during light transmission and reflection. Many existing methods rely on specific prior assumptions to resolve the problem. In this paper, we propose a general reflection intensity prior that captures the intensity of the reflection phenomenon and demonstrate its effectiveness. To learn the reflection intensity prior, we introduce the Reflection Prior Extraction Network (RPEN). By segmenting images into regional patches, RPEN learns non-uniform reflection prior in an image. We propose Prior-based Reflection Removal Network (PRRN) using a simple transformer U-Net architecture that adapts reflection prior fed from RPEN. Experimental results on real-world benchmarks demonstrate the effectiveness of our approach achieving state-of-the-art accuracy in SIRR.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (35)
  1. Single image reflection suppression. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 4498–4506, 2017.
  2. Cold diffusion: Inverting arbitrary image transforms without noise. arXiv preprint arXiv:2208.09392, 2022.
  3. Reverse attention for salient object detection. In Proceedings of the European conference on computer vision (ECCV), pages 234–250, 2018.
  4. Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition, pages 248–255. Ieee, 2009.
  5. Location-aware single image reflection removal. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 5017–5026, 2021.
  6. The pascal visual object classes (voc) challenge. International journal of computer vision, 88:303–338, 2010.
  7. A generic deep architecture for single image reflection removal and image smoothing. In Proceedings of the IEEE International Conference on Computer Vision, pages 3238–3247, 2017.
  8. Learning semantic associations for mirror detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 5941–5950, 2022.
  9. Long short-term memory. Neural computation, 9(8):1735–1780, 1997.
  10. Blurring diffusion models. arXiv preprint arXiv:2209.05557, 2022.
  11. Trash or treasure? an interactive dual-stream strategy for single image reflection separation. Advances in Neural Information Processing Systems, 34:24683–24694, 2021.
  12. Layercam: Exploring hierarchical class activation maps for localization. IEEE Transactions on Image Processing, 30:5875–5888, 2021.
  13. Single image reflection removal with physically-based training images. In CVPR, 2020.
  14. A categorized reflection removal dataset with diverse real-world scenes. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 3040–3048, 2022.
  15. Polarized reflection removal with perfect alignment in the wild. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1750–1758, 2020.
  16. User assisted separation of reflections from a single image using a sparsity prior. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(9):1647–1654, 2007.
  17. Learning to perceive transparency from the statistics of natural scenes. Advances in Neural Information Processing Systems, 15, 2002.
  18. Single image reflection removal through cascaded refinement. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 3565–3574, 2020.
  19. Yu Li and Michael S Brown. Single image layer separation using relative smoothness. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 2752–2759, 2014.
  20. Exploiting semantic relations for glass surface detection. Advances in Neural Information Processing Systems, 35:22490–22504, 2022.
  21. Don’t hit me! glass detection in real-world scenes. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 3687–3696, 2020.
  22. Image super-resolution via iterative refinement. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022.
  23. Reflection removal using ghosting cues. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 3193–3201, 2015.
  24. Region-aware reflection removal with unified content and gradient priors. IEEE Transactions on Image Processing, 27(6):2927–2941, 2018.
  25. Benchmarking single-image reflection removal algorithms. In Proceedings of the IEEE International Conference on Computer Vision, pages 3922–3930, 2017.
  26. Depth of field guided reflection removal. In 2016 IEEE International Conference on Image Processing (ICIP), pages 21–25. IEEE, 2016.
  27. Corrn: Cooperative reflection removal network. IEEE transactions on pattern analysis and machine intelligence, 42(12):2969–2982, 2019.
  28. Single image reflection removal exploiting misaligned training data and network enhancements. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 8178–8187, 2019.
  29. Single image reflection removal exploiting misaligned training data and network enhancements. In CVPR, 2019.
  30. Single image reflection removal beyond linearity. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 3771–3779, 2019.
  31. Seeing deeply and bidirectionally: a deep learning approach for single image reflection removal. In ECCV, 2018.
  32. Unsupervised deraining: Where contrastive learning meets self-similarity. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 5821–5830, 2022.
  33. Depth-guided camouflaged object detection. arXiv preprint arXiv:2106.13217, 2021.
  34. Single image reflection separation with perceptual losses. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 4786–4794, 2018.
  35. Single image reflection removal with absorption effect. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 13395–13404, 2021.

Summary

We haven't generated a summary for this paper yet.