A Fast Encoding Scheme for High Efficiency Video Coding

Author(s): Mohammad Barr*

Journal Name: Recent Advances in Electrical & Electronic Engineering
Formerly Recent Patents on Electrical & Electronic Engineering

Volume 13 , Issue 6 , 2020

Become EABM
Become Reviewer
Call for Editor

Graphical Abstract:


Background: High-Efficiency Video Coding (HEVC) is a recent video compression standard. It provides better compression performance compared to its predecessor, H.264/AVC. However, the computational complexity of the HEVC encoder is much higher than that of H.264/AVC encoder. This makes HEVC less attractive to be used in real-time applications and in devices with limited resources (e.g., low memory, low processing power, etc.). The increased computational complexity of HEVC is partly due to its use of a variable size Transform Unit (TU) selection algorithm which successively performs transform operations using transform units of different sizes before selecting the optimal transform unit size. In this paper, a fast transform unit size selection method is proposed to reduce the computational complexity of an HEVC encoder.

Methods: Bayesian decision theory is used to predict the size of the TU during encoding. This is done by exploiting the TU size decisions at a previous temporal level and by modeling the relationship between the TU size and the Rate-Distortion (RD) cost values.

Results: Simulation results show that the proposed method achieves a reduction of the encoding time of the latest HEVC encoder by 16.21% on average without incurring any noticeable compromise on its compression efficiency. The algorithm also reduces the number of transform operations by 44.98% on average.

Conclusion: In this paper, a novel fast TU size selection scheme for HEVC is proposed. The proposed technique outperforms both the latest HEVC reference software, HM 16.0, as well as other state-of-the-art techniques in terms of time-complexity. The compression performance of the proposed technique is comparable to that of HM 16.0.

Keywords: Video compression, high efficiency video coding, transform unit, video compression standard, fast encoding technique, bayesian decision theory.

G. Sullivan, J. Ohm, W. Han, and T. Wiegand, "Overview of the high efficiency video coding (HEVC) standard", IEEE Trans. Circ. Syst. Video Tech., vol. 22, no. 12, pp. 1649-1668, 2012.
M. Wien, High efficiency video coding., Coding Tools Specificat, 2015, pp. 133-160.
T. Tan, R. Weerakkody, M. Mrak, N. Ramzan, V. Baroncini, J. Ohm, and G. Sullivan, "Video quality evaluation methodology and verification testing of HEVC compression performance", IEEE Trans. Circ. Syst. Video Tech., vol. 26, no. 1, pp. 76-90, 2016.
T. Wiegand, G. Sullivan, G. Bjontegaard, and A. Luthra, "Overview of the H. 264/AVC video coding standard", IEEE Trans. Circ. Syst. Video Tech., vol. 13, no. 7, pp. 560-576, 2003.
J. Ostermann, J. Bormans, P. List, D. Marpe, M. Narroschke, F. Pereira, T. Stockhammer, and T. Wedi, "Video coding with H. 264/AVC: tools, performance, and complexity", IEEE Circuits Syst. Mag., vol. 4, no. 1, pp. 7-28, 2004.
M. Dissanayake, and D. Abeyrathna, "Performance comparison of HEVC and H.264/AVC standards in broadcasting environments", J. Inform. Process. Syst., vol. 11, no. 3, pp. 483-494, 2015.
R. Duda, P. Hart, and D. Stork, Pattern Classification., John Wiley & Sons, 2012.
F. Pan, X. Lin, S. Rahardja, K. Lim, Z. Li, D. Wu, and S. Wu, "Fast mode decision algorithm for intraprediction in H. 264/AVC video coding", IEEE Trans. Circ. Syst. Video Tech., vol. 15, no. 7, pp. 813-822, 2005.
H. Zeng, C. Cai, and K. Ma, "Fast mode decision for H. 264/AVC based on macroblock motion activity", IEEE Trans. Circ. Syst. Video Tech., vol. 19, no. 4, pp. 491-499, 2009.
S. Khattak, R. Hamzaoui, S. Ahmad, and P. Frossard, "Low-complexity multiview video coding", In: Proc. Picture Coding Symposium (PCS), 2012, pp. 97-100.
S. Khattak, "Framework for low-complexity multiview video coding", In: Proc. 14th Annual Post Graduate Symposium on the Convergence of Telecommunications, Networking, and Broadcasting (PGNet2013), Liverpool, UK, 2013.,
S. Khattak, R. Hamzaoui, S. Ahmad, and P. Frossard, "Fast encoding techniques for Multiview Video Coding", Signal Process. Image Commun., vol. 28, no. 6, pp. 569-580, 2013.
T. Zhao, Z. Wang, and S. Kwong, "Flexible mode selection and complexity allocation in high efficiency video coding", IEEE J. Sel. Top. Signal Process., vol. 7, no. 6, pp. 1135-1144, 2013.
H. Zhang, and Z. Ma, "Fast intra mode decision for high efficiency video coding (HEVC)", IEEE Trans. Circ. Syst. Video Tech., vol. 24, no. 4, pp. 660-668, 2014.
S. Khan, and S. Khattak, "Early decision of CU splitting, using base view information, for low complexity MV-HEVC", In: Proc. Multi-Topic Conf. (INMIC), 2017, pp. 1-6.
W. Kuang, Y.L. Chan, S.H. Tsang, and W.C. Siu, "Online-learning-based Bayesian decision rule for fast intra mode and CU partitioning algorithm in HEVC screen content coding", IEEE Trans. Image Process., vol. 29, pp. 170-185, 2020.
[http://dx.doi.org/10.1109/TIP.2019.2924810] [PMID: 31265399]
I. Marzuki, J. Ma, Y. Ahn, and D. Sim, "A context Adaptive fast intra coding algorithm of high efficiency video coding", J. Real-Time Image Process., vol. 16, no. 4, pp. 883-899, 2019.
W. Mu, Y. Liang, S. Xu, W. Zhang, and Y. Liu, "Fast algorithm for HEVC intra-coding implemented by preprocessing", IET Image Process., vol. 13, no. 9, pp. 1578-1586, 2019.
C. Wang, C. Tung, and J. Wang, ""An effective transform unit size decision method for high efficiency video coding"", Proc. Mathemat. Probl. Eng., 2014, pp. 1-10., .
Y. Shi, Z. Gao, and X. Zhang, "Early TU split termination in HEVC based on quasi-zero-block", In: Proc. 3rd Inter. Conf. Electric Electron. (EEIC), 2013, pp. 450-454.
Q. Tu, J. Feng, J. Qi, A. Men, and F. Ye, "An adaptive CU mode decision mechanism based on Bayesian decision theory for H.265/HEVC", In: Proc. IEEE International Conference on Multimedia and Expo (ICME), 2014, pp. 1-6,
Q. Hu, Y. Shi, X. Zhang, and Z. Gao, "Fast coding unit size selection for HEVC based on Bayesian decision rule", In: Proc. Picture Coding Symposium (PCS), Krakow, Poland, 2012, pp. 453-456,
H. Kim, and R. Park, "Fast CU partitioning algorithm for HEVC using an online-learning-based Bayesian decision rule", IEEE Trans. Circ. Syst. Video Tech., vol. 26, no. 1, pp. 130-138, 2016.
X. Fang, X. Zhu, L. Yu, and X. Shen, "Fast HEVC intra coding unit size decision based on an improved Bayesian classification framework", Proc. Picture Coding Symposium (PCS), 2013, pp. 273-276,
Q. Hu, Z. Shi, X. Zhang, and Z. Gao, "Early SKIP mode decision based on Bayesian model for HEVC", In: Proc. IEEE VCIP, 2015, pp. 978-981.
S. Cho, and M. Kim, "Fast CU splitting and pruning for suboptimal CU partitioning in HEVC intra coding", IEEE Trans. Circ. Syst. Video Tech., vol. 23, no. 9, pp. 1555-1564, 2013.
A. Vetro, T. Wiegand, and G. Sullivan, "Overview of the stereo and multiview video coding extensions of the H. 264/MPEG-4 AVC standard", Proc. IEEE, vol. 99, no. 4, pp. 626-642, 2011.
S. Khattak, R. Hamzaoui, T. Maugey, S. Ahmad, and P. Frossard, "Bayesian early mode decision technique for view synthesis prediction-enhanced multiview video coding", IEEE Signal Process. Lett., vol. 20, no. 11, pp. 1126-1129, 2013.
L. Shen, Z. Zhang, X. Zhang, P. An, and Z. Liu, "Fast TU size decision algorithm for HEVC encoders using Bayesian theorem detection", Signal Process. Image Commun., vol. 32, pp. 121-128, 2015.
Y. Kim, D. Jun, S. Jung, J. Choi, and J. Kim, "A fast intra-prediction method in HEVC using rate-distortion estimation based on Hadamard transform", ETRI J., vol. 35, no. 2, pp. 270-280, 2013.
Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11. HM 16.0 Reference Software. Available at:, https://hevc.hhi.fraunhofer.de/svn/svn−HEVCSoftware/tags/HM-16.0/
F. Bossen, JCTVC-L1100: Common HM test conditions and software reference configurations. Joint Collaborative Team on Video Coding., JCT-VC, 2013.
A. Gul, and S. Khattak, "Bayesian early mode decision for multiview video coding", J. Graphics, Vision, Image Process., vol. 18, no. 1, pp. 15-24, 2018.
J. Fang, Y. Tsai, J. Lee, and P. Yu, "Computation reduction in transform unit of high efficiency video coding based on zerocoefficients", In: Proc. 2016 International Symposium on Computer, Consumer and Control (IS3C), 2016, pp. 797-800.,
W. Lin, Z. Liu, D. Mukherjee, J. Han, P. Wilkins, Y. Xu, and K. Rose, "Efficient AV1 video coding using a multi-layer framework", In: Proc. Data Compression Conference, 2018.,

Rights & PermissionsPrintExport Cite as

Article Details

Year: 2020
Published on: 04 November, 2020
Page: [933 - 941]
Pages: 9
DOI: 10.2174/2352096513666191227102559
Price: $25

Article Metrics

PDF: 7