DarkShot: Lighting Dark Images with Low-Compute and High-Quality (2312.16805v3)
Abstract: Nighttime photography encounters escalating challenges in extremely low-light conditions, primarily attributable to the ultra-low signal-to-noise ratio. For real-world deployment, a practical solution must not only produce visually appealing results but also require minimal computation. However, most existing methods are either focused on improving restoration performance or employ lightweight models at the cost of quality. This paper proposes a lightweight network that outperforms existing state-of-the-art (SOTA) methods in low-light enhancement tasks while minimizing computation. The proposed network incorporates Siamese Self-Attention Block (SSAB) and Skip-Channel Attention (SCA) modules, which enhance the model's capacity to aggregate global information and are well-suited for high-resolution images. Additionally, based on our analysis of the low-light image restoration process, we propose a Two-Stage Framework that achieves superior results. Our model can restore a UHD 4K resolution image with minimal computation while keeping SOTA restoration quality.
- “Learning to see in the dark,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 3291–3300.
- “Improving extreme low-light image denoising via residual learning,” in 2019 IEEE International Conference on Multimedia and Expo (ICME). IEEE, 2019, pp. 916–921.
- “Learning to restore low-light images via decomposition-and-enhancement,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 2281–2290.
- “Abandoning the bayer-filter to see in the dark,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 17431–17440.
- “Self-guided network for fast image denoising,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2019, pp. 2511–2520.
- “Towards fast and light-weight restoration of dark images,” BMVC, 2020.
- “Restoring extremely dark images in real time,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 3487–3497.
- “An image is worth 16x16 words: Transformers for image recognition at scale,” arXiv preprint arXiv:2010.11929, 2020.
- “End-to-end object detection with transformers,” in Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part I 16. Springer, 2020, pp. 213–229.
- “Swinir: Image restoration using swin transformer,” in Proceedings of the IEEE/CVF international conference on computer vision, 2021, pp. 1833–1844.
- “Swin transformer: Hierarchical vision transformer using shifted windows,” in Proceedings of the IEEE/CVF international conference on computer vision, 2021, pp. 10012–10022.
- “Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 1874–1883.
- “Hdr image reconstruction from a single exposure using deep cnns,” ACM transactions on graphics (TOG), vol. 36, no. 6, pp. 1–15, 2017.
- “Hdrunet: Single image hdr reconstruction with denoising and dequantization,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 354–363.
- “Squeeze-and-excitation networks,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 7132–7141.
- Pengfei Zhu Peihua Li Wangmeng Zuo Qilong Wang, Banggu Wu and Qinghua Hu, “Eca-net: Efficient channel attention for deep convolutional neural networks,” in The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
- “Practical deep raw image denoising on mobile devices,” in Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part VI. Springer, 2020, pp. 1–16.
- Jiazhang Zheng (1 paper)
- Lei Li (1293 papers)
- Qiuping Liao (1 paper)
- Cheng Li (1094 papers)
- Li Li (657 papers)
- Yangxing Liu (1 paper)