Reflection Removal Using Recurrent Polarization-to-Polarization Network (2402.18178v1)
Abstract: This paper addresses reflection removal, which is the task of separating reflection components from a captured image and deriving the image with only transmission components. Considering that the existence of the reflection changes the polarization state of a scene, some existing methods have exploited polarized images for reflection removal. While these methods apply polarized images as the inputs, they predict the reflection and the transmission directly as non-polarized intensity images. In contrast, we propose a polarization-to-polarization approach that applies polarized images as the inputs and predicts "polarized" reflection and transmission images using two sequential networks to facilitate the separation task by utilizing the interrelated polarization information between the reflection and the transmission. We further adopt a recurrent framework, where the predicted reflection and transmission images are used to iteratively refine each other. Experimental results on a public dataset demonstrate that our method outperforms other state-of-the-art methods.
- “A generic deep architecture for single image reflection removal and image smoothing,” in Proceedings of IEEE International Conference on Computer Vision (ICCV), 2017, pp. 3238–3247.
- “Single image reflection separation with perceptual losses,” in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018, pp. 4786–4794.
- “Seeing deeply and bidirectionally: A deep learning approach for single image reflection removal,” in Proceedings of European Conference on Computer Vision (ECCV), 2018, pp. 654–669.
- “Single image reflection removal exploiting misaligned training data and network enhancements,” in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 8170–8179.
- “Single image reflection removal through cascaded refinement,” in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 3565–3574.
- “Location-aware single image reflection removal,” in Proceedings of IEEE International Conference on Computer Vision (ICCV), 2021, pp. 5017–5026.
- “Robust separation of reflection from multiple images,” in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014, pp. 2187–2194.
- “Reflection removal using low-rank matrix completion,” in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 5438–5446.
- “Neural transmitted radiance fields,” in Proceedings of Advances in Neural Information Processing Systems (NeurIPS), 2022, vol. 35, pp. 38994–39006.
- “3.2-MP back-illuminated polarization image sensor with four-directional air-gap wire grid and 2.5-μ𝜇\muitalic_μm pixels,” IEEE Transactions on Electron Devices, vol. 65, no. 6, pp. 2544–2551, 2018.
- “Monochrome and color polarization demosaicking based on intensity-guided residual interpolation,” IEEE Sensors Journal, vol. 21, no. 23, pp. 26985–26996, 2021.
- “Separating reflections and lighting using independent components analysis,” in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 1999, vol. 1, pp. 262–267.
- “Polarization and statistical analysis of scenes containing a semireflector,” Journal of the Optical Society of America. A, vol. 17, no. 2, pp. 276–284, 2000.
- “A physically-based approach to reflection separation: From physical modeling to constrained optimization,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 36, no. 2, pp. 209–221, 2013.
- “Reflection removal using multiple polarized images with different exposure times,” in Proceedings of European Signal Processing Conference (EUSIPCO), 2022, pp. 498–502.
- “Separating reflection and transmission images in the wild,” in Proceedings of the European Conference on Computer Vision (ECCV), 2018, pp. 90–105.
- “Reflection separation using a pair of unpolarized and polarized images,” in Proceedings of Advances in Neural Information Processing Systems (NeurIPS), 2019, pp. 14559–14569.
- “Polarized reflection removal with perfect alignment in the wild,” in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 1747–1755.
- “Very deep convolutional networks for large-scale image recognition,” arXiv preprint:1409.1556, 2014.
- “U-net: Convolutional networks for biomedical image segmentation,” in Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2015, pp. 234–241.
- “Perceptual losses for real-time style transfer and super-resolution,” in Proceedings of the European Conference on Computer Vision (ECCV), 2016, pp. 694–711.