SSIM-Based Fuzzy Video Rate Controller for Variable Bit Rate Applications of Scalable HEVC
محورهای موضوعی : Image Processing
Farhad Raufmehr
1
(University of Sistan and Baluchestan)
Mehdi Rezaei
2
(University of Sistan and Baluchestan)
کلید واژه: Fuzzy Control, , Quality, , Rate, , Scalable high-efficiency video coding (SHVC), , SSIM, , Variable bit rate (VBR), ,
چکیده مقاله :
Scalable High Efficiency Video Coding (SHVC) is the scalable extension of the latest video coding standard H.265/HEVC. Video rate control algorithm is out of the scope of video coding standards. Appropriate rate control algorithms are designed for various applications to overcome practical constraints such as bandwidth and buffering constraints. In most of the scalable video applications, such as video on demand (VoD) and broadcasting applications, encoded bitstreams with variable bit rates are preferred to bitstreams with constant bit rates. In variable bit rate (VBR) applications, the tolerable delay is relatively high. Therefore, we utilize a larger buffer to allow more variations in bitrate to provide smooth and high visual quality of output video. In this paper, we propose a fuzzy video rate controller appropriate for VBR applications of SHVC. A fuzzy controller is used for each layer of scalable video to minimize the fluctuation of QP at the frame level while the buffering constraint is obeyed for any number of layers received by a decoder. The proposed rate controller utilizes the well-known structural similarity index (SSIM) as a quality metric to increase the visual quality of the output video. The proposed rate control algorithm is implemented in HEVC reference software and comprehensive experiments are executed to tune the fuzzy controllers and also to evaluate the performance of the algorithm. Experimental results show a high performance for the proposed algorithm in terms of rate control, visual quality, and rate-distortion performance.
Scalable High Efficiency Video Coding (SHVC) is the scalable extension of the latest video coding standard H.265/HEVC. Video rate control algorithm is out of the scope of video coding standards. Appropriate rate control algorithms are designed for various applications to overcome practical constraints such as bandwidth and buffering constraints. In most of the scalable video applications, such as video on demand (VoD) and broadcasting applications, encoded bitstreams with variable bit rates are preferred to bitstreams with constant bit rates. In variable bit rate (VBR) applications, the tolerable delay is relatively high. Therefore, we utilize a larger buffer to allow more variations in bitrate to provide smooth and high visual quality of output video. In this paper, we propose a fuzzy video rate controller appropriate for VBR applications of SHVC. A fuzzy controller is used for each layer of scalable video to minimize the fluctuation of QP at the frame level while the buffering constraint is obeyed for any number of layers received by a decoder. The proposed rate controller utilizes the well-known structural similarity index (SSIM) as a quality metric to increase the visual quality of the output video. The proposed rate control algorithm is implemented in HEVC reference software and comprehensive experiments are executed to tune the fuzzy controllers and also to evaluate the performance of the algorithm. Experimental results show a high performance for the proposed algorithm in terms of rate control, visual quality, and rate-distortion performance.
[1] V. Sze, M. Budagavi, and G.J. Sullivan, High Efficiency Video Coding (Hevc), Integrated Circuit and Systems, Algorithms and Architectures. Springer, 2014, pp. 1-375.
[2] G.J. Sullivan, J. Ohm, W.-J. Han, and T. Wiegand, “Overview of the High Efficiency Video Coding (Hevc) Standard”, IEEE Transactions on Circuits and Systems for Video Technology. vol. 22, no. 12. 2012, pp. 1649-1668.
[3] H. Schwarz, D. Marpe, and T. Wiegand, “Overview of the Scalable Video Coding Extension of the H. 264/Avc Standard”, IEEE Transactions on Circuits and Systems for Video Technology. vol. 17, no. 9. 2007, pp. 1103-1120.
[4] J.M. Boyce, Y. Ye, J. Chen, and A.K. Ramasubramonian, “Overview of Shvc: Scalable Extensions of the High Efficiency Video Coding Standard”, IEEE Transactions on Circuits and Systems for Video Technology. vol. 26, no. 1. 2016, pp. 20-34.
[5] G.J. Sullivan, J.M. Boyce, Y. Chen, J.-R. Ohm, C.A. Segall, and A. Vetro, “Standardized Extensions of High Efficiency Video Coding (Hevc)”, IEEE Journal of Selected Topics in Signal Processing. vol. 7, no. 6. 2013, pp. 1001-1016.
[6] M. Wien, High Efficiency Video Coding, Coding Tools and specification. 2015.
[7] H. Sun, T. Chiang, and X. Chen, Digital Video Transcoding for Transmission and Storage, CRC press, 2004. [8] B. Li, H. Li, L. Li, and J. Zhang, “λ-Domain Rate Control Algorithm for High Efficiency Video Coding”, IEEE transactions on image processing. vol. 23, no. 9. 2014, pp. 3841-3854.
[9] MARZUKI, I., AHN, Y.-J. & SIM, D. 2017. Tile-level rate control for tile-parallelization HEVC encoders. Journal of Real-Time Image Processing, 1-19.
[10] S. Wang, S. Ma, S. Wang, D. Zhao, and W. Gao, “Rate-Gop Based Rate Control for High Efficiency Video Coding”, IEEE Journal of Selected Topics in Signal Processing. vol. 7, no. 6. 2013, pp. 1101-1111.
[11] H. Choi, J. Yoo, J. Nam, D. Sim, and I.V. Bajic, “Pixel-Wise Unified Rate-Quantization Model for Multi-Level Rate Control”, IEEE Journal of Selected Topics in Signal Processing. vol. 7, no. 6. 2013, pp. 1112-1123.
[12] C.-W. Seo, J.-H. Moon, and J.-K. Han, “Rate Control for Consistent Objective Quality in High Efficiency Video Coding”, IEEE transactions on image processing. vol. 22, no. 6. 2013, pp. 2442-2454.
[13] B. Lee, M. Kim, and T.Q. Nguyen, “A Frame-Level Rate Control Scheme Based on Texture and Nontexture Rate Models for High Efficiency Video Coding”, IEEE Transactions on Circuits and Systems for Video Technology. vol. 24, no. 3. 2014, pp. 465-479.
[14] M. Wang, K.N. Ngan, and H. Li, “An Efficient Frame-Content Based Intra Frame Rate Control for High Efficiency Video Coding”, IEEE Signal Processing Letters. vol. 22, no. 7. 2015, pp. 896-900.
[15] M. de-Frutos-López, J.L. González-de-Suso, S. Sanz-Rodríguez, C. Peláez-Moreno, and F. Díaz-de-María, “Two-Level Sliding-Window Vbr Control Algorithm for Video on Demand Streaming”, Signal processing: Image communication. vol. 36. 2015, pp. 1-13.
[16] M. Rezaei, M.M. Hannuksela, and M. Gabbouj, “Semi-Fuzzy Rate Controller for Variable Bit Rate Video”, IEEE Transactions on Circuits and Systems for Video Technology. vol. 18, no. 5. 2008, pp. 633-645.
[17] D. Fani and M. Rezaei, “A Gop-Level Fuzzy Rate Control Algorithm for High-Delay Applications of Hevc”, Signal, Image and Video Processing. vol. 10, no. 7. 2016, pp. 1183-1191.
[18] R. Kamran, M. Rezaei, and D. Fani, “A Frame Level Fuzzy Video Rate Controller for Variable Bit Rate Applications of Hevc”, Journal of Intelligent & Fuzzy Systems. vol. 30, no. 3. 2016, pp. 1367-1375.
[19] FANI, D. & REZAEI, M. 2017. Novel PID-Fuzzy Video Rate Controller for High-Delay Applications of the HEVC Standard. IEEE Transactions on Circuits and Systems for Video Technology, 28, 1379-1389.
[20] L. Li, B. Li, D. Liu, and H. Li, “λ-Domain Rate Control Algorithm for Hevc Scalable Extension”, IEEE Transactions on Multimedia. vol. 18, no. 10. 2016, pp. 2023-2039.
[21] L. Li, B. Li, and H. Li, Rate Control by R-Lambda Model for Shvc. vol. JCTVC-M0037. 2013.
[22] T. Biatek, W. Hamidouche, J.-F. Travers, and O. Deforges, “Adaptive Rate Control Algorithm for Shvc: Application to Hd/Uhd”, in Acoustics, Speech and Signal Processing (ICASSP), 2016 IEEE International Conference on. 2016, IEEE. p. 1382-1386.
[23] F. Raufmehr and M. Rezaei, “Fuzzy Logic-Based Scalable Video Rate Control Algorithm for High-Delay Applications of Scalable High-Efficiency Video Coding”, Journal of Electronic Imaging. vol. 27, no. 4. 2018, p. 043013.
[24] S. Akramullah, Digital Video Concepts, Methods, and Metrics: Quality, Compression, Performance, and Power Trade-Off Analysis, Apress, 2014.
[25] H. Zhao, W. Xie, Y. Zhang, L. Yu, and A. Men, “An Ssim-Motivated Lcu-Level Rate Control Algorithm for Hevc”, in Picture Coding Symposium (PCS), 2013. 2013, IEEE. p. 85-88.
[26] H. Zeng, A. Yang, K.N. Ngan, and M. Wang, “Perceptual Sensitivity-Based Rate Control Method for High Efficiency Video Coding”, Multimedia tools and applications. vol. 75, no. 17. 2016, pp. 10383-10396.
[27] GAO, W., KWONG, S., ZHOU, Y. & YUAN, H. 2016. SSIM-based game theory approach for rate-distortion optimized intra frame CTU-level bit allocation. IEEE Transactions on Multimedia, 18, 988-999.
[28] S. Wang, A. Rehman, K. Zeng, J. Wang, and Z. Wang, “Ssim-Motivated Two-Pass Vbr Coding for Hevc”, IEEE Transactions on Circuits and Systems for Video Technology. vol. 27, no. 10. 2017, pp. 2189-2203.
[29] ZUPANCIC, I., NACCARI, M., MRAK, M. & IZQUIERDO, E. 2016. Two-pass rate control for improved quality of experience in UHDTV delivery. IEEE Journal of Selected Topics in Signal Processing, 11, 167-179.
[30] L.-X. Wang, A Course in Fuzzy Systems, Prentice-Hall press, USA, 1999.
[31] Z. Wang, A.C. Bovik, H.R. Sheikh, and E.P. Simoncelli, “Image Quality Assessment: From Error Visibility to Structural Similarity”, IEEE transactions on image processing. vol. 13, no. 4. 2004, pp. 600-612.
[32] Z. Wang, L. Lu, and A.C. Bovik, “Video Quality Assessment Based on Structural Distortion Measurement”, Signal processing: Image communication. vol. 19, no. 2. 2004, pp. 121-132.
[33]Http://Hevc.Hhi.Fraunhofer.De/Svn/Svn_Shvcsoftware/Tags/Shm-11.0.
[34] V. Seregin and Y. He, Common Shm Test Conditions and Software Reference Configurations. vol. JCTVC-Q1009. 2014.
