Towards Video Codec Performance Evaluation: A Rate-Energy-Distortion Perspective (2405.17866v4)
Abstract: The Bj{\o}ntegaard Delta rate (BD-rate) objectively assesses the coding efficiency of video codecs using the rate-distortion (R-D) performance but overlooks encoding energy, which is crucial in practical applications, especially for those on handheld devices. Although R-D analysis can be extended to incorporate encoding energy as energy-distortion (E-D), it fails to integrate all three parameters seamlessly. This work proposes a novel approach to address this limitation by introducing a 3D representation of rate, encoding energy, and distortion through surface fitting. In addition, we evaluate various surface fitting techniques based on their accuracy and investigate the proposed 3D representation and its projections. The overlapping areas in projections help in encoder selection and recommend avoiding the slow presets of the older encoders (x264, x265), as the recent encoders (x265, VVenC) offer higher quality for the same bitrate-energy performance and provide a lower rate for the same energy-distortion performance.
- “Scope of validity of psnr in image/video quality assessment,” Electronics letters, vol. 44, no. 13, pp. 800–801, 2008.
- CCITT, SERIES H: AUDIOVISUAL AND MULTIMEDIA SYSTEMS, CCITT Rec. H.120, Nov 1988.
- G. Bjøntegaard, “Calculation of average PSNR differences between RD curves,” document, Austin, TX, USA, Apr 2001.
- “VVC complexity and software implementation analysis,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 31, no. 10, pp. 3765–3778, 2021.
- A. Carroll and G. Heiser, “The systems hacker’s guide to the galaxy - energy usage in a modern smartphone,” in Proc. 4th Asia-Pacific Workshop on Systems (APSys), Singapore, 2013.
- C. Herglotz and M. Kränzler and R. Schober, and A. Kaup, “Sweet streams are made of this: The system engineer’s view on energy efficiency in video communications,” 2022.
- C. Herglotz, M. Bader and K. Fischer and A. Kaup, “Decoding-energy optimal video encoding for x265,” in Proc. IEEE 22nd International Workshop on Multimedia Signal Processing (MMSP), 2020, pp. 1–6.
- “x264: H.264 / AVC video encoder application library,” https://code.videolan.org/videolan/x264, accessed 2020-08.
- “x265: H.265 / HEVC video encoder application library,” https://www.videolan.org/developers/x265.html, accessed 2020-08.
- “Vvenc: An open and optimized VVC encoder implementation,” in Proc. IEEE International Conference on Multimedia Expo Workshops (ICMEW), pp. 1–2.
- “Modeling the energy consumption of the HEVC decoding process,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 28, no. 1, pp. 217–229, Jan. 2018.
- “RAPL in action: Experiences in using RAPL for power measurements,” ACM Trans. Model. Perform. Eval. Comput. Syst., vol. 3, no. 2, mar 2018.
- Random Data: Analysis and Measurement Procedures, John Wiley & Sons, Inc., 1971.
- “Modeling the HEVC Encoding Energy Using the Encoder Processing Time,” in IEEE International Conference on Image Processing (ICIP) Bordeaux, 2022.
- “JVET common test conditions and software reference configurations for SDR video,” AHG Report, JVET-N1010, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Jan 2017.
- “Rate-complexity-distortion evaluation for hybrid video coding,” in Proc. IEEE International Conference on Multimedia and Expo (ICME), Jul 2010, pp. 685 –690.
- “The Bjøntegaard Bible Why Your Way of Comparing Video Codecs May Be Wrong,” Trans. Img. Proc., vol. 33, pp. 987–1001, jan 2024.