Illumination Histogram Consistency Metric for Quantitative Assessment of Video Sequences
Abstract: The advances in deep generative models have greatly accelerate the process of video procession such as video enhancement and synthesis. Learning spatio-temporal video models requires to capture the temporal dynamics of a scene, in addition to the visual appearance of individual frames. Illumination consistency, which reflects the variations of illumination in the dynamic video sequences, play a vital role in video processing. Unfortunately, to date, no well-accepted quantitative metric has been proposed for video illumination consistency evaluation. In this paper, we propose a illumination histogram consistency (IHC) metric to quantitatively and automatically evaluate the illumination consistency of the video sequences. IHC measures the illumination variation of any video sequence based on the illumination histogram discrepancies across all the frames in the video sequence. Specifically, given a video sequence, we first estimate the illumination map of each individual frame using the Retinex model; Then, using the illumination maps, the mean illumination histogram of the video sequence is computed by the mean operation across all the frames; Next, we compute the illumination histogram discrepancy between each individual frame and the mean illumination histogram and sum up all the illumination histogram discrepancies to represent the illumination variations of the video sequence. Finally, we obtain the IHC score from the illumination histogram discrepancies via normalization and subtraction operations. Experiments are conducted to illustrate the performance of the proposed IHC metric and its capability to measure the illumination variations in video sequences. The source code is available on \url{https://github.com/LongChenCV/IHC-Metric}.
- Y. Chen, Y. Pan, T. Yao, X. Tian, and T. Mei, “Mocycle-gan: Unpaired video-to-video translation,” in Proceedings of the 27th ACM international conference on multimedia, 2019, pp. 647–655.
- X. Wei, J. Zhu, S. Feng, and H. Su, “Video-to-video translation with global temporal consistency,” in Proceedings of the 26th ACM International conference on multimedia, 2018, pp. 18–25.
- M.-Y. Liu, X. Huang, J. Yu, T.-C. Wang, and A. Mallya, “Generative adversarial networks for image and video synthesis: Algorithms and applications,” Proceedings of the IEEE, vol. 109, no. 5, pp. 839–862, 2021.
- T. Li, M. Slavcheva, M. Zollhoefer, S. Green, C. Lassner, C. Kim, T. Schmidt, S. Lovegrove, M. Goesele, R. Newcombe et al., “Neural 3d video synthesis from multi-view video,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 5521–5531.
- B. Peng, X. Zhang, J. Lei, Z. Zhang, N. Ling, and Q. Huang, “Lve-s2d: Low-light video enhancement from static to dynamic,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 32, no. 12, pp. 8342–8352, 2022.
- S. S. Andrei, N. Shapovalova, and W. Mayol-Cuevas, “Supervegan: Super resolution video enhancement gan for perceptually improving low bitrate streams,” IEEE Access, vol. 9, pp. 91 160–91 174, 2021.
- R. Hou, Y. Zhao, Y. Hu, and H. Liu, “No-reference video quality evaluation by a deep transfer cnn architecture,” Signal Processing: Image Communication, vol. 83, p. 115782, 2020.
- Z. Tu, Y. Wang, N. Birkbeck, B. Adsumilli, and A. C. Bovik, “Ugc-vqa: Benchmarking blind video quality assessment for user generated content,” IEEE Transactions on Image Processing, vol. 30, pp. 4449–4464, 2021.
- A. Bansal, S. Ma, D. Ramanan, and Y. Sheikh, “Recycle-gan: Unsupervised video retargeting,” in Proceedings of the European conference on computer vision (ECCV), 2018, pp. 119–135.
- D. Rivoir, M. Pfeiffer, R. Docea, F. Kolbinger, C. Riediger, J. Weitz, and S. Speidel, “Long-term temporally consistent unpaired video translation from simulated surgical 3d data,” in Proceedings of the IEEE/CVF international conference on computer vision, 2021, pp. 3343–3353.
- J. Gu, A. Trevithick, K.-E. Lin, J. M. Susskind, C. Theobalt, L. Liu, and R. Ramamoorthi, “Nerfdiff: Single-image view synthesis with nerf-guided distillation from 3d-aware diffusion,” in International Conference on Machine Learning. PMLR, 2023, pp. 11 808–11 826.
- E. Tretschk, A. Tewari, V. Golyanik, M. Zollhöfer, C. Lassner, and C. Theobalt, “Non-rigid neural radiance fields: Reconstruction and novel view synthesis of a dynamic scene from monocular video,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 12 959–12 970.
- M. Chaubey, L. K. Singh, and M. Gupta, “Estimation of missing video frames using kalman filter,” Multimedia Tools and Applications, pp. 1–21, 2023.
- W. Bao, W.-S. Lai, X. Zhang, Z. Gao, and M.-H. Yang, “Memc-net: Motion estimation and motion compensation driven neural network for video interpolation and enhancement,” IEEE transactions on pattern analysis and machine intelligence, vol. 43, no. 3, pp. 933–948, 2019.
- G. Hou, G. Wang, Z. Pan, B. Huang, H. Yang, and T. Yu, “Image enhancement and restoration: state of the art of variational retinex models,” IAENG International Journal of Computer Science, vol. 44, no. 4, pp. 445–455, 2017.
- R. R. Hussein, Y. I. Hamodi, and A. S. Rooa, “Retinex theory for color image enhancement: A systematic review,” International Journal of Electrical and Computer Engineering, vol. 9, no. 6, p. 5560, 2019.
- V. Bogdanova, “Image enhancement using retinex algorithms and epitomic representation,” Cybernetics and information technologies, vol. 10, no. 3, pp. 10–19, 2010.
- G. Hines, Z.-u. Rahman, D. Jobson, and G. Woodell, “Single-scale retinex using digital signal processors,” in Global signal processing conference, no. Paper 1324, 2005.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.