Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
102 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

All-intra rate control using low complexity video features for Versatile Video Coding (2306.16786v1)

Published 29 Jun 2023 in cs.MM

Abstract: Versatile Video Coding (VVC) allows for large compression efficiency gains over its predecessor, High Efficiency Video Coding (HEVC). The added efficiency comes at the cost of increased runtime complexity, especially for encoding. It is thus highly relevant to explore all available runtime reduction options. This paper proposes a novel first pass for two-pass rate control in all-intra configuration, using low-complexity video analysis and a Random Forest (RF)-based machine learning model to derive the data required for driving the second pass. The proposed method is validated using VVenC, an open and optimized VVC encoder. Compared to the default two-pass rate control algorithm in VVenC, the proposed method achieves around 32% reduction in encoding time for the preset faster, while on average only causing 2% BD-rate increase and achieving similar rate control accuracy.

PDF HTML Abstract
Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Bookmark Chat Bubble Oval Streamline Icon: https://streamlinehq.com Chat (Pro)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (20)
  1. B. Bross et al., “Overview of the Versatile Video Coding (VVC) Standard and its Applications,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 31, no. 10, pp. 3736–3764, 2021.
  2. G. J. Sullivan et al., “Overview of the High Efficiency Video Coding (HEVC) Standard,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1649–1668, 2012.
  3. A. Wieckowski et al., “VVenC: An Open And Optimized VVC Encoder Implementation,” in 2021 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), 2021, pp. 1–2.
  4. J. Brandenburg et al., “Pareto-optimized coding configurations for VVenC, a fast and efficient VVC encoder,” in 2021 IEEE 23rd International Workshop on Multimedia Signal Processing (MMSP), 2021, pp. 1–6.
  5. C. R. Helmrich et al., “Visually Optimized Two-Pass Rate Control for Video Coding Using the Low-Complexity XPSNR Model,” in 2021 International Conference on Visual Communications and Image Processing (VCIP), 2021, pp. 1–5.
  6. C. R. Helmrich et al., “A Scene Change and Noise Aware Rate Control Method for VVenC, An Open VVC Encoder Implementation,” in 2022 Picture Coding Symposium (PCS), 2022, pp. 241–245.
  7. J.-R. Ohm et al., “Comparison of the Coding Efficiency of Video Coding Standards—Including High Efficiency Video Coding (HEVC),” IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1669–1684, 2012.
  8. A. Wieckowski et al., “VVenC: an open optimized VVC encoder in versatile application scenarios,” in Applications of Digital Image Processing XLIV, A. G. Tescher and T. Ebrahimi, Eds., vol. 11842, International Society for Optics and Photonics.   SPIE, 2021, p. 118420H.
  9. V. V. Menon et al., “Green Video Complexity Analysis for Efficient Encoding in Adaptive Video Streaming,” in First International ACM Green Multimedia Systems Workshop (GMSys ’23), 2023.
  10. V. V. Menon et al., “Content-adaptive encoder preset prediction for adaptive live streaming,” in 2022 Picture Coding Symposium (PCS), 2022, pp. 253–257.
  11. V. V. Menon et al., “JND-aware Two-pass Per-title Encoding Scheme for Adaptive Live Streaming,” IEEE Transactions on Circuits and Systems for Video Technology, 2023.
  12. V. V. Menon et al., “Transcoding quality prediction for adaptive video streaming,” in Proceedings of the 2nd Mile-High Video Conference, 2023, p. 103–109.
  13. V. V. Menon, “Video Coding Enhancements for HTTP Adaptive Streaming,” in Proceedings of the 30th ACM International Conference on Multimedia, 2022, p. 6905–6909.
  14. ITU-T, “P.910 : Subjective video quality assessment methods for multimedia applications,” Nov. 2021.
  15. C. R. Helmrich et al., “Finalization of VVenC’s Screen Content Detector and Two-Pass Rate Control Using Pre-Filtering Statistics,” submitted to IEEE International Conference on Image Processing (ICIP), 2023.
  16. H. Amirpour et al., “VCD: Video Complexity Dataset,” in Proceedings of the 13th ACM Multimedia Systems Conference, 2022.
  17. S. M. Lundberg and S.-I. Lee, “A Unified Approach to Interpreting Model Predictions,” in Advances in Neural Information Processing Systems 30, 2017, pp. 4765–4774.
  18. F. Bossen et al., “VTM common test conditions and software reference configurations for SDR video,” in 20th Joint Video Experts Team on Video Coding Meeting, Virtual, Oct. 2020.
  19. B.Bross et al., “AHG4 Multiformat Berlin Test Sequences,” in JVET-Q0791, 2020.
  20. I.-T. HSTP-VID-WPOM and I. T. 23002-8, “Working practices using objective metrics for evaluation of video coding efficiency experiments,” 2021. [Online]. Available: https://www.itu.int/pub/T-TUT-ASC-2020-HSTP1
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (8)
  1. Vignesh V Menon (20 papers)
  2. Anastasia Henkel (1 paper)
  3. Christian R. Helmrich (2 papers)
  4. Adam Wieckowski (10 papers)
  5. Benjamin Bross (11 papers)
  6. Christian Timmerer (35 papers)
  7. Detlev Marpe (14 papers)
  8. Prajit T Rajendran (14 papers)
Citations (7)
View on Semantic Scholar