ITRE: Low-light Image Enhancement Based on Illumination Transmission Ratio Estimation (2310.05158v1)
Abstract: Noise, artifacts, and over-exposure are significant challenges in the field of low-light image enhancement. Existing methods often struggle to address these issues simultaneously. In this paper, we propose a novel Retinex-based method, called ITRE, which suppresses noise and artifacts from the origin of the model, prevents over-exposure throughout the enhancement process. Specifically, we assume that there must exist a pixel which is least disturbed by low light within pixels of same color. First, clustering the pixels on the RGB color space to find the Illumination Transmission Ratio (ITR) matrix of the whole image, which determines that noise is not over-amplified easily. Next, we consider ITR of the image as the initial illumination transmission map to construct a base model for refined transmission map, which prevents artifacts. Additionally, we design an over-exposure module that captures the fundamental characteristics of pixel over-exposure and seamlessly integrate it into the base model. Finally, there is a possibility of weak enhancement when inter-class distance of pixels with same color is too small. To counteract this, we design a Robust-Guard module that safeguards the robustness of the image enhancement process. Extensive experiments demonstrate the effectiveness of our approach in suppressing noise, preventing artifacts, and controlling over-exposure level simultaneously. Our method performs superiority in qualitative and quantitative performance evaluations by comparing with state-of-the-art methods.
- X. Ren, W. Yang, W.-H. Cheng, and J. Liu, “Lr3m: Robust low-light enhancement via low-rank regularized retinex model,” IEEE Transactions on Image Processing, vol. 29, pp. 5862–5876, 2020.
- M. Li, J. Liu, W. Yang, X. Sun, and Z. Guo, “Structure-revealing low-light image enhancement via robust retinex model,” IEEE Transactions on Image Processing, vol. 27, no. 6, pp. 2828–2841, 2018.
- D. Coltuc, P. Bolon, and J.-M. Chassery, “Exact histogram specification,” IEEE Transactions on Image processing, vol. 15, no. 5, pp. 1143–1152, 2006.
- M. Abdullah-Al-Wadud, M. H. Kabir, M. A. A. Dewan, and O. Chae, “A dynamic histogram equalization for image contrast enhancement,” IEEE transactions on consumer electronics, vol. 53, no. 2, pp. 593–600, 2007.
- S. M. Pizer, “Contrast-limited adaptive histogram equalization: Speed and effectiveness stephen m. pizer, r. eugene johnston, james p. ericksen, bonnie c. yankaskas, keith e. muller medical image display research group,” in Proceedings of the first conference on visualization in biomedical computing, Atlanta, Georgia, vol. 337, 1990, p. 1.
- Y.-T. Kim, “Contrast enhancement using brightness preserving bi-histogram equalization,” IEEE transactions on Consumer Electronics, vol. 43, no. 1, pp. 1–8, 1997.
- C. Liu, X. Sui, Y. Liu, X. Kuang, G. Gu, and Q. Chen, “Adaptive contrast enhancement based on histogram modification framework,” Journal of Modern Optics, vol. 66, no. 15, pp. 1590–1601, 2019.
- D. J. Jobson, Z.-u. Rahman, and G. A. Woodell, “Properties and performance of a center/surround retinex,” IEEE transactions on image processing, vol. 6, no. 3, pp. 451–462, 1997.
- ——, “A multiscale retinex for bridging the gap between color images and the human observation of scenes,” IEEE Transactions on Image processing, vol. 6, no. 7, pp. 965–976, 1997.
- M. Herscovitz and O. Yadid-Pecht, “A modified multi scale retinex algorithm with an improved global impressionof brightness for wide dynamic range pictures,” Machine Vision and Applications, vol. 15, pp. 220–228, 2004.
- C. Xiao and Z. Shi, “Adaptive bilateral filtering and its application in retinex image enhancement,” in 2013 Seventh International Conference on Image and Graphics. IEEE, 2013, pp. 45–49.
- S. Wang, J. Zheng, H.-M. Hu, and B. Li, “Naturalness preserved enhancement algorithm for non-uniform illumination images,” IEEE transactions on image processing, vol. 22, no. 9, pp. 3538–3548, 2013.
- X. Fu, D. Zeng, Y. Huang, X.-P. Zhang, and X. Ding, “A weighted variational model for simultaneous reflectance and illumination estimation,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 2782–2790.
- X. Guo, Y. Li, and H. Ling, “Lime: Low-light image enhancement via illumination map estimation,” IEEE Transactions on image processing, vol. 26, no. 2, pp. 982–993, 2016.
- X. Fu, D. Zeng, Y. Huang, Y. Liao, X. Ding, and J. Paisley, “A fusion-based enhancing method for weakly illuminated images,” Signal Processing, vol. 129, pp. 82–96, 2016.
- S. Hao, X. Han, Y. Guo, X. Xu, and M. Wang, “Low-light image enhancement with semi-decoupled decomposition,” IEEE transactions on multimedia, vol. 22, no. 12, pp. 3025–3038, 2020.
- Y. Ren, Z. Ying, T. H. Li, and G. Li, “Lecarm: Low-light image enhancement using the camera response model,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 29, no. 4, pp. 968–981, 2018.
- X. Wang, K. Chen, Z. Wang, and W. Huang, “Pmsnet: Parallel multi-scale network for accurate low-light light-field image enhancement,” IEEE Transactions on Multimedia, 2023.
- C. Li, C. Guo, and C. C. Loy, “Learning to enhance low-light image via zero-reference deep curve estimation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 44, no. 8, pp. 4225–4238, 2021.
- K. Wu, J. Huang, Y. Ma, F. Fan, and J. Ma, “Cycle-retinex: Unpaired low-light image enhancement via retinex-inline cyclegan,” IEEE Transactions on Multimedia, 2023.
- L. Ma, T. Ma, R. Liu, X. Fan, and Z. Luo, “Toward fast, flexible, and robust low-light image enhancement,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 5637–5646.
- Y. Jiang, X. Gong, D. Liu, Y. Cheng, C. Fang, X. Shen, J. Yang, P. Zhou, and Z. Wang, “Enlightengan: Deep light enhancement without paired supervision,” IEEE transactions on image processing, vol. 30, pp. 2340–2349, 2021.
- C. Wei, W. Wang, W. Yang, and J. Liu, “Deep retinex decomposition for low-light enhancement,” arXiv preprint arXiv:1808.04560, 2018.
- R. Liu, L. Ma, J. Zhang, X. Fan, and Z. Luo, “Retinex-inspired unrolling with cooperative prior architecture search for low-light image enhancement,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 10 561–10 570.
- H. Xu, G. Zhai, X. Wu, and X. Yang, “Generalized equalization model for image enhancement,” IEEE Transactions on Multimedia, vol. 16, no. 1, pp. 68–82, 2013.
- L. Xu, Q. Yan, Y. Xia, and J. Jia, “Structure extraction from texture via relative total variation,” ACM transactions on graphics (TOG), vol. 31, no. 6, pp. 1–10, 2012.
- D. Berman, T. Treibitz, and S. Avidan, “Non-local image dehazing,” in IEEE Conf. CVPR, 2016.
- ——, “Air-light estimation using haze-lines,” in IEEE Conf. ICCP, 2017.
- Z. Farbman, R. Fattal, D. Lischinski, and R. Szeliski, “Edge-preserving decompositions for multi-scale tone and detail manipulation,” ACM transactions on graphics (TOG), vol. 27, no. 3, pp. 1–10, 2008.
- L. Wang, L. Xiao, H. Liu, and Z. Wei, “Variational bayesian method for retinex,” IEEE Transactions on Image Processing, vol. 23, no. 8, pp. 3381–3396, 2014.
- M. K. Ng and W. Wang, “A total variation model for retinex,” SIAM Journal on Imaging Sciences, vol. 4, no. 1, pp. 345–365, 2011.
- Z. Liang, J. Xu, D. Zhang, Z. Cao, and L. Zhang, “A hybrid l1-l0 layer decomposition model for tone mapping,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 4758–4766.
- Z. Lin, R. Liu, and Z. Su, “Linearized alternating direction method with adaptive penalty for low-rank representation,” Advances in neural information processing systems, vol. 24, 2011.
- M. Hong and Z.-Q. Luo, “On the linear convergence of the alternating direction method of multipliers,” Mathematical Programming, vol. 162, no. 1-2, pp. 165–199, 2017.
- V. Bychkovsky, S. Paris, E. Chan, and F. Durand, “Learning photographic global tonal adjustment with a database of input/output image pairs,” in CVPR 2011. IEEE, 2011, pp. 97–104.
- G. Thomas, D. Flores-Tapia, and S. Pistorius, “Histogram specification: a fast and flexible method to process digital images,” IEEE Transactions on Instrumentation and Measurement, vol. 60, no. 5, pp. 1565–1578, 2011.
- W. Yang, Y. Yuan, W. Ren, J. Liu, W. J. Scheirer, Z. Wang, T. Zhang, Q. Zhong, D. Xie, S. Pu et al., “Advancing image understanding in poor visibility environments: A collective benchmark study,” IEEE Transactions on Image Processing, vol. 29, pp. 5737–5752, 2020.
- C. Lee, C. Lee, and C.-S. Kim, “Contrast enhancement based on layered difference representation,” in 2012 19th IEEE international conference on image processing. IEEE, 2012, pp. 965–968.
- S. S. Agaian, B. Silver, and K. A. Panetta, “Transform coefficient histogram-based image enhancement algorithms using contrast entropy,” IEEE transactions on image processing, vol. 16, no. 3, pp. 741–758, 2007.
- C. E. Shannon, “A mathematical theory of communication,” The Bell system technical journal, vol. 27, no. 3, pp. 379–423, 1948.
- A. Mittal, R. Soundararajan, and A. C. Bovik, “Making a “completely blind” image quality analyzer,” IEEE Signal processing letters, vol. 20, no. 3, pp. 209–212, 2012.
- N. Venkatanath, D. Praneeth, M. C. Bh, S. S. Channappayya, and S. S. Medasani, “Blind image quality evaluation using perception based features,” in 2015 twenty first national conference on communications (NCC). IEEE, 2015, pp. 1–6.