Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
156 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

A Comprehensive Review of Software and Hardware Energy Efficiency of Video Decoders (2402.09001v1)

Published 14 Feb 2024 in eess.IV

Abstract: Energy and compression efficiency are two essential parts of modern video decoder implementations that have to be considered. This work comprehensively studies the following six video coding formats regarding compression and decoding energy efficiency: AVC, VP9, HEVC, AV1, VVC, and AVM. We first evaluate the energy demand of reference and optimized software decoder implementations. Furthermore, we consider the influence of the usage of SIMD instructions on those decoder implementations. We find that AV1 is a sweet spot for optimized software decoder implementations with an additional energy demand of 16.55% and bitrate savings of -43.95% compared to VP9. We furthermore evaluate the hardware decoding energy demand of four video coding formats. Thereby, we show that AV1 has energy demand increases by 117.50% compared to VP9. For HEVC, we found a sweet spot in terms of energy demand with an increase of 6.06% with respect to VP9. Relative to their optimized software counterparts, hardware video decoders reduce the energy consumption to less than 9% compared to software decoders.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (34)
  1. Ericson. (2023, Jun.) Ericson mobility report. [Online]. Available: https://www.ericsson.com/49dd9d/assets/local/reports-papers/mobility-report/documents/2023/ericsson-mobility-report-june-2023.pdf
  2. M. Efoui-Hess. (2019, Jul.) Climate crisis: The unsustainable use of online video. The practical case for digital sobriety. [Online]. Available: https://theshiftproject.org/en/article/unsustainable-use-online-video/
  3. C. Herglotz, S. Coulombe, S. Vakili, and A. Kaup, “Power modeling for virtual reality video playback applications,” in Proc. IEEE International Symposium on Consumer Technology (ISCT), Ancona, Italy, Jun. 2019.
  4. T. Wiegand, G. Sullivan, G. Bjontegaard, and A. Luthra, “Overview of the h.264/AVC video coding standard,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 13, no. 7, pp. 560–576, jul 2003.
  5. G. J. Sullivan, J.-R. Ohm, W.-J. Han, and T. Wiegand, “Overview of the high efficiency video coding (HEVC) standard,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1649–1668, Dec. 2012.
  6. B. Bross, Y.-K. Wang, Y. Ye, S. Liu, J. Chen, G. J. Sullivan, and J.-R. Ohm, “Overview of the Versatile Video Coding (VVC) standard and its applications,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 31, no. 10, pp. 3736–3764, Oct. 2021.
  7. D. Mukherjee, J. Bankoski, A. Grange, J. Han, J. Koleszar, P. Wilkins, Y. Xu, and R. Bultje, “The latest open-source video codec VP9 - an overview and preliminary results,” in 2013 Picture Coding Symposium (PCS), Dec. 2013.
  8. Y. Chen, D. Mukherjee, J. Han, A. Grange, Y. Xu, S. Parker, C. Chen, H. Su, U. Joshi, C.-H. Chiang, Y. Wang, P. Wilkins, J. Bankoski, L. Trudeau, N. Egge, J.-M. Valin, T. Davies, S. Midtskogen, A. Norkin, P. de Rivaz, and Z. Liu, “An overview of coding tools in AV1: the first video codec from the alliance for open media,” APSIPA Transactions on Signal and Information Processing, vol. 9, 2020.
  9. Videolan. x264 Encoder. Accessed 2021-09. [Online]. Available: https://code.videolan.org/videolan/x264.git
  10. HHI Fraunhofer. JM Decoder. Accessed 2021-09. [Online]. Available: https://vcgit.hhi.fraunhofer.de/jvet/JM
  11. Fast Forwards MPEG (FFmpeg). Accessed 2018-11-14. [Online]. Available: http://ffmpeg.org/
  12. Videolan. x265 Encoder. Accessed 2021-09. [Online]. Available: http://hg.videolan.org/x265
  13. HHI Fraunhofer. HM Decoder. Accessed 2021-09. [Online]. Available: https://vcgit.hhi.fraunhofer.de/jvet/HM
  14. openHEVC. Accessed 2021-02-25. [Online]. Available: https://github.com/OpenHEVC/openHEVC
  15. A. Wieckowski, J. Brandenburg, T. Hinz, C. Bartnik, V. George, G. Hege, C. Helmrich, A. Henkel, C. Lehmann, C. Stoffers, I. Zupancic, B. Bross, and D. Marpe, “VVenC: An open and optimized VVC encoder implementation,” in Proc. IEEE International Conference on Multimedia Expo Workshops (ICMEW), pp. 1–2.
  16. Joint Video Exploration Team (JVET). VVC test model reference software. [Online]. Available: https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM/
  17. A. Wieckowski, G. Hege, C. Bartnik, C. Lehmann, C. Stoffers, B. Bross, and D. Marpe, “Towards a live software decoder implementation for the upcoming Versatile Video Coding (VVC) codec,” in Proc. IEEE International Conference on Image Processing (ICIP), pp. 3124–3128.
  18. Google. libvpx Codec. Accessed 2021-10. [Online]. Available: https://chromium.googlesource.com/webm/libvpx/
  19. A. for Open Media. libaom Codec. Accessed 2022-03. [Online]. Available: https://aomedia.googlesource.com/aom/
  20. DAV1D. DAV1D Software. Accessed 2022-03. [Online]. Available: https://code.videolan.org/videolan/dav1d
  21. Google. AVM Codec. Accessed 2022-07. [Online]. Available: https://gitlab.com/AOMediaCodec/avm
  22. T. Laude, Y. G. Adhisantoso, J. Voges, M. Munderloh, and J. Ostermann, “A comprehensive video codec comparison,” APSIPA Transactions on Signal and Information Processing, vol. 8, no. 1, 2019.
  23. M. Kränzler, C. Herglotz, and A. Kaup, “A comparative analysis of the time and energy demand of versatile video coding and high efficiency video coding reference decoders,” in Proc. IEEE International Workshop on Multimedia Signal Processing (MMSP), Tampere, Finland, Sep. 2020.
  24. M. B. A. Khernache, Y. Benmoussa, J. Boukhobza, and D. Menard, “HEVC hardware vs software decoding: An objective energy consumption analysis and comparison,” Journal of System Architecture, vol. 115, p. 102004, May 2021.
  25. A. Mercat, A. Makinen, J. Sainio, A. Lemmetti, M. Viitanen, and J. Vanne, “Comparative rate-distortion-complexity analysis of VVC and HEVC video codecs,” IEEE Access, vol. 9, pp. 67 813–67 828, 2021.
  26. T. Nguyen and D. Marpe, “Compression efficiency analysis of AV1, VVC, and HEVC for random access applications,” APSIPA Transactions on Signal and Information Processing, vol. 10, no. 1, 2021.
  27. A. Katsenou, J. Mao, and I. Mavromatis, “Energy-rate-quality tradeoffs of state-of-the-art video codecs,” in Proc. Picture Coding Symposium (PCS), San Jose, CA, USA, Dec. 2022.
  28. X. Zhao, Z. Lei, A. Norkin, T. Daede, and A. Tourapis, “AV2 common test conditions v1.0,” document, CWG-B005o v1, Jan. 2021.
  29. C. Herglotz, D. Springer, M. Reichenbach, B. Stabernack, and A. Kaup, “Modeling the energy consumption of the HEVC decoding process,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 28, no. 1, pp. 217–229, Jan. 2018.
  30. H. David, E. Gorbatov, U. R. Hanebutte, R. Khanna, and C. Le, “RAPL: Memory power estimation and capping,” in Proc. ACM/IEEE International Symposium on Low-Power Electronics and Design (ISLPED), Austin, TX, USA, Aug. 2010.
  31. M. Kränzler, C. Herglotz, and A. Kaup, “Decoding energy assessment of VTM-6.0,” Geneva, Switzerland, document, JVET-P0084, Oct. 2019.
  32. G. Bjøntegaard, “Calculation of average PSNR differences between RD curves,” Austin, TX, USA, document, VCEG-M33, Jan. 2001.
  33. C. Herglotz, H. Och, A. Meyer, G. Ramasubbu, L. Eichermüller, M. Kränzler, F. Brand, K. Fischer, D. T. Nguyen, A. Regensky, and A. Kaup, “The bjøntegaard bible – why your way of comparing video codecs may be wrong,” IEEE Transactions on Image Processing, vol. 33, pp. 987–1001, Jan. 2024.
  34. J. Ström, K. Andersson, R. Sjöberg, A. Segall, F. Bossen, G. Sullivan, J.-R. Ohm, and A. Tourapis, “Working practices using objective metrics for evaluation of video coding efficiency experiments,” ITU-T and ISO/IEC, JTC 1, document, ISO/IEC DTR 23002-8, Jul. 2020.
Citations (3)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now