(JBE Vol. 19, No. 2, March 2014) (Special Paper) 19 2, 2014 3 (JBE Vol. 19, No. 2, March 2014) http://dx.doi.org/10.5909/jbe.2014.19.2.158 ISSN 2287-9137 (Online) ISSN 1226-7953 (Print) Rough Mode Decision Most Probable Mode HEVC a), a), a) Fast Intra Prediction Mode Decision based on Rough Mode Decision and Most Probable Mode in HEVC Seung-ho Lee a), Sang-hyo Park a), and Euee Seon Jang a) HEVC (High Efficiency Video Coding) AVC/H.264 2., HEVC AVC/H.264.. HEVC RMD (Rough Mode Decision) MPM (Most Probable Mode). RMD MPM. All-Intra, 0.8% BD-rate 26%. Abstract High Efficiency Video Coding (HEVC), the latest video coding standard, has twice of the compression efficiency compared to AVC/H.264 under the same image quality condition. To obtain the improved efficiency, however, it was adopted for many methods which need complicated calculation, and the time complexity of HEVC was increased more than that of AVC/H.264. To solve this problem, the various fast algorithms have been researched. In this paper, we propose a fast intra prediction mode decision method which uses result of Rough Mode Decision (RMD) and Most Probable Mode (MPM). The proposed method selects a best predicted mode by comparing each predicted directions which are calculated through RMD and MPM. We applied the proposed method to HM 10.0 and conducted an comparing experiment in All-Intra environment. The experiment result showed that total encoding time is reduced by about 26% on average with about a 0.8% loss of BD-rate. Keyword : HEVC, intra prediction, rough mode decision, most probable mode a) (Digital Media Laboratory, Hanyang University) Corresponding Author : (Euee Seon Jang) E-mail: esjang@hanyang.ac.kr Tel: +82-2-2295-1086 (10047438, MPEG Type-1 ). 2013. Manuscript received January 3, 2014 Revised March 7. 2014 Accepted March 18, 2014
2 : Rough Mode Decision Most Probable Mode HEVC (Seung-ho Lee et al. : Fast Intra Prediction Mode Decision based on Rough Mode Decision and Most Probable Mode in HEVC).. ISO/IEC Moving Picture Experts Group (MPEG) ITU-T Video Coding Experts Group (VCEG) Joint Collaborative Team on Video Coding (JCT-VC) 2010 1 High Efficiency Video Coding (HEVC), 2013 1 HEVC [1]. HEVC AVC/H.264 2 [2]. HEVC [3]. AVC/H.264 9, HEVC 35.,. HEVC [4]. AVC/H.264 3 [5]. [6], RD (Rate-Distortion) cost [7][8][9]. BD-rate.. 2 HEVC Rough Mode Decision Most Probable Mode. 3 4 5.. HEVC HEVC AVC/H.264, PU (Prediction Unit). AVC/H.264 PU 16x16 HEVC PU 64x64 PU. AVC/H.264 9 HEVC 35., HEVC AVC/H.264, RDO. HEVC Rough Mode Decision (RMD) Most Probable Mode (MPM). RMD SATD (Sum of Absolute Transformed Difference) cost RMD. 35 RDO [10]. MPM PU PU. PU, DC Planar. MPM RMD HEVC MPM, RMD RDO
(JBE Vol. 19, No. 2, March 2014) [11]. 1 All-Intra HEVC. RMD RDO. 1, HEVC.. 1. All-Intra Table 1. The run time portion of intra prediction in All-Intra environment Sequence Portion [%] Kimono 65.10 BasketballDrill 64.01 RaceHorses 63.94 Overall 64.69 [7][8]. CU (Coding Unit) TU (Transform Unit) PU MPM. CU CU, 64x64 CU. RMD RMD PU MPM RDO.. 2 PU RMD RDO. 2. PU RMD Table 2. RMD subset size for each PU size PU size RMD subset size 4x4 8 8x8 8 16x16 3 32x32 3 64x64 3 MPM RDO. RDO, RDO RMD MPM. 3 RMD MPM. 3 P_A, P_B A, P_B (1), (2), (3). X X 의조건을만족하는인트라블록의수 Best intra mode. RMD MPM HEVC RMD MPM, HEVC RMD_best RMD SATD cost, P_A RMD_best MPM. P_B A A, RMD
2 : Rough Mode Decision Most Probable Mode HEVC (Seung-ho Lee et al. : Fast Intra Prediction Mode Decision based on Rough Mode Decision and Most Probable Mode in HEVC) MPM RDO RMD_best. P_B RMD_best MPM. 3 Class A 1, Class B 1, Class C 2, Class D 3. Class A Traffic, Class B Cactus, Class C PartyScene, BasketballDrill, Class D RaceHorses, BlowingBubbles, BasketballPass 7. HEVC reference model (HM) 10.0 QP 22, 27, 32, 37 All-Intra. QP, 7 P_A, P_B A, P_B. 3. RMD SATD cost MPM Table 3. Ratio of prediction mode which has the least SATD cost value through RMD and Most Probable Mode 1, RMD_ best MPM RDO., HEVC 35 RMD PU MPM. RMD RMD_best MPM, CU RDO., MPM PU DC Planar. CU CU. RMD_best MPM, HEVC RMD MPM RDO, CU. Sequence P_A [%] P_B A [%] P_B [%] Traffic 72.98 76.87 56.10 Cactus 74.13 78.83 58.43 PartyScene 57.37 71.95 41.27 BasketballDrill 70.86 80.08 56.75 RaceHorses 60.67 71.76 43.53 BlowingBubbles 52.20 68.43 35.72 BasketballPass 69.03 75.65 52.22 Overall 71.17 77.54 55.18, P_A 71% RMD_best MPM 71%. P_B A 78% RMD_best MPM, RMD_best RMD MPM RDO 78%. 1. Fig. 1. Algorithm of the proposed method
(JBE Vol. 19, No. 2, March 2014), 3 P_B 55%. HEVC 55%. P_A (100 P_B A) 16%, HEVC 16%., RMD_best 1 2 3 BD-rate., 55% 16% 2 3. 29% HEVC 84%.. HM 10.0. 4 5. 4. Table 4. Test environment CPU RAM OS Compiler Intel (R) Xeon(R) CPU E5645 @ 2.40 GHz 12.0 GB Microsoft Windows 7 64-bit Visual C++ 10.0 x86 Test model HM 10.0 Configure All intra main 5. Table 5. Test sequence Sequence Frames Frame rate Resolution Traffic 150 30 2560x1600 PeopleOnStreet 150 30 2560x1600 Kimono 240 24 1920x1080 ParkScene 240 24 1920x1080 BasketballDrive 500 50 1920x1080 BQTerrace 600 60 1920x1080 BasketballDrill 500 50 832x480 BQMall 600 60 832x480 PartyScene 500 50 832x480 RaceHorses 300 30 832x480 BasketballPass 500 50 416x240 BQSquare 600 60 416x240 BlowingBubbles 500 50 416x240 RaceHorses 300 30 416x240 HM 10.0 [8], [9] HM 10.0. HM 10.0 BD-rate. [8], RMD MPM RDO, CU. [8] RMD MPM, CU RMD_best MPM CU CU CU. QP, Class. HEVC t_hm10.0 t_fast t (4). QP 22, 27, 32, 37
2 : Rough Mode Decision Most Probable Mode HEVC (Seung-ho Lee et al. : Fast Intra Prediction Mode Decision based on Rough Mode Decision and Most Probable Mode in HEVC) 6. BD-rate Table 6. Reduction of BD-rate and encoding time Class A B C D Sequence HM 10.0 vs Ref. [8] HM 10.0 vs Ref. [9] HM 10.0 vs Proposed BD-rate Y [%] QP Time [%] BD-rate Y [%] QP Time [%] BD-rate Y [%] QP Time [%] 22-6.54 22-19.22 22-27.57 Traffic 0.2 27-7.83 27-18.99 27-29.45 0.4 0.9 32-8.25 32-16.98 32-30.43 37-9.17 37-14.45 37-31.24 22-5.31 22-20.02 22-25.40 PeopleOnStreet 0.2 27-6.40 27-18.94 27-27.54 0.4 0.7 32-7.95 32-16.83 32-29.82 37-8.88 37-14.12 37-31.57 Overall 0.2-7.55 0.4-17.47 0.8-29.16 22-6.16 22-17.76 22-23.57 Kimono 0.2 27-8.00 27-15.45 27-24.70 0.1 0.7 32-9.35 32-13.88 32-25.85 37-12.34 37-13.69 37-27.99 22-5.77 22-20.20 22-28.10 ParkScene 0.2 27-7.27 27-19.51 27-29.93 0.3 0.8 32-9.46 32-18.55 32-32.77 37-11.89 37-15.90 37-34.50 22-8.84 22-19.23 22-31.54 BasketballDrive 0.2 27-9.42 27-18.60 27-32.67 0.4 1.0 32-8.31 32-15.29 32-32.97 37-12.11 37-12.14 37-32.76 22-8.47 22-19.85 22-24.29 BQTerrace 0.1 27-8.63 27-18.86 27-26.71 0.3 0.6 32-10.36 32-16.78 32-27.50 37-12.15 37-14.35 37-27.15 Overall 0.2-9.30 0.3-16.91 0.8-29.02 22-7.25 22-18.89 22-22.86 BasketballDrill 0.2 27-6.02 27-17.54 27-23.31 0.4 0.9 32-5.60 32-16.30 32-24.54 37-8.69 37-15.73 37-26.60 22-7.87 22-19.88 22-24.29 BQMall 0.3 27-6.85 27-17.57 27-23.79 0.5 1.0 32-9.14 32-16.91 32-25.67 37-10.35 37-15.52 37-27.32 22-5.66 22-19.80 22-20.20 PartyScene 0.2 27-6.37 27-20.09 27-21.99 0.6 0.9 32-7.31 32-19.75 32-23.77 37-7.55 37-17.65 37-25.66 22-4.72 22-18.04 22-19.68 RaceHorses 0.1 27-5.14 27-17.85 27-21.88 0.3 0.7 32-6.33 32-15.91 32-24.44 37-8.82 37-15.14 37-26.75 Overall 0.2-7.12 0.4-17.68 0.9-23.95 22-4.71 22-18.58 22-21.65 BasketballPass 0.2 27-7.68 27-18.82 27-23.61 0.5 1.0 32-7.97 32-16.73 32-24.48 37-7.93 37-15.26 37-26.06 22-4.49 22-20.34 22-18.38 BQSquare 0.2 27-5.66 27-19.67 27-21.27 0.6 0.8 32-6.07 32-19.22 32-22.47 37-7.96 37-17.17 37-25.77 22-2.83 22-18.63 22-17.02 BlowingBubbles 0.2 27-5.41 27-21.10 27-21.05 0.6 1.0 32-4.08 32-18.25 32-21.56 37-5.66 37-16.42 37-23.57 22-3.47 22-18.81 22-18.55 RaceHorses 0.2 27-4.44 27-19.09 27-21.24 0.5 0.9 32-5.59 32-15.08 32-23.08 37-5.59 37-14.79 37-24.67 Overall 0.2-5.61 0.6-18.02 0.9-22.19 Overall 0.2-7.38 0.4-17.53 0.8-25.70
(JBE Vol. 19, No. 2, March 2014) 6 HM 10.0 HM 10.0 HM 10.0., HM 10.0 0.8% BD-rate 26%. Class, BD-rate, BD-rate.. [9], 8%. [9] RDO 2 5. [9] 64x64 CU, 64x64 CU [9].. HEVC RMD MPM. RDO., BD-rate 1% 26%. RMD SATD cost MPM, [9] MPM.. (References) [1] JCT-VC, High Efficiency Video Coding (HEVC) text specification draft 10 (for FDIS & Last Call), Document JCTVC-L1003, Geneva, January 2013 [2] JCT-VC, Comparison of Compression Performance of HEVC Draft 10 with AVC for UHD-1 material, Document JCTVC-M0166, Incheon, April 2013 [3] JCT-VC, Report on the evaluation of HM versus JM, Document JCTVC-D181, Daegu, January 2011 [4] F. Bossen, B. Bross, K. Suhring, D. Flynn, HEVC Complexity and Implementation Analysis, Circuits and Systems for Video Technology, IEEE Transactions on, Vol. 22, Issue 12, p1685-p1696, December 2012 [5] J. Vanne, M. Viitanen, T. Hamalainen, A. Hallpuro, Comparative Rate-Distortion-Complexity Analysis of HEVC and AVC Video Codecs, Circuits and Systems for Video Technology, IEEE Transactions on, Vol. 22, Issue 12, p1885-p1898, December 2012 [6] D. Gwon, S. Lee, H. Choi, HEVC Intra Prediction Performance Analysis and Complexity Reduction Method, Proceeding of the Korean Society of Broadcast Engineer Conference, Vol. 2012, No. 11, p176-p179, November 2012 [7] J. Kim, J. Yang, H. Lee, B. Jeon, Fast Intra Mode Decision of HEVC based on Hierarchical Structure, Information, Communications and Signal Processing (ICICS) 2011 8th International Conference on, December 2011 [8] L. Shen, Z. Zhang, P. An, Fast CU Size Decision and Mode Decision Algorithm for HEVC Intra Coding, Consumer Electronics, IEEE Transactions on, Vol. 59, Issue 1, p207-p213, February 2013 [9] M. Zhang, C. Zhao, J. Xu, An Adaptive Fast Intra Mode Decision in HEVC, Image Processing (ICIP), 2012 19th IEEE International Conference on, September 2012 [10] JCT-VC, Encoder improvement of unified intra prediction, Document JCTVC-C207, Guangzhou, October 2010 [11] L. Zhao, L. Zhang, S. Ma, D. Zhao, Fast Mode Decision Algorithm for Intra Prediction in HEVC, Visual Communications and Image Processing (VCIP) Conference, November 2011
이승호 외 인 과 에 기반을 둔 고속 인트라 예측 모드 결정 방법 2 : Rough Mode Decision Most Probable Mode HEVC (Seung-ho Lee et al. : Fast Intra Prediction Mode Decision based on Rough Mode Decision and Most Probable Mode in HEVC) 저자소개 이승호 : 한양대학교 컴퓨터공학부 학사 ~ 현재 : 한양대학교 컴퓨터ž소프트웨어학과 석사과정 주관심분야 : 영상압축, HEVC/H.265-2014 - 2014 - 박상효 : 한양대학교 컴퓨터전공 학사 ~ 현재 : 한양대학교 컴퓨터ž소프트웨어학과 석박사통합과정 주관심분야 : 영상압축, MPEG-H HEVC/H.265, MPEG IVC, MPEG VCB - 2011-2011 - 장의선 - 전북대학교 전자계산기학 학사 전기컴퓨터공학 석사 전기컴퓨터공학 박사 삼성종합기술원 책임연구원 공로상 수상 현재 한양대학교 컴퓨터공학부 교수 의장 대통령 표창 수상 현재 현재 주관심분야 영상처리 표준 그래픽스 미디어 부호화 하드웨어 소프트웨어 동시설계 1991 : 1994 : State University of New York at Buffalo, 1995 : U.S. Army Research Lab, Research Associate 1996 : State University of New York at Buffalo, 1996 ~ 2002 : 1996 ~ 2000 : MPEG-4 Project Editor 1999, 2003, 2011 : ISO/IEC Certificate of Appreciation ( ) 2002 ~ : 2004 ~ 2010 : MPEG RVC AdHoc Group 2005 : 2005 ~ : SIGNAL PROCESSING: IMAGE COMMUNICATION, Area Editor 2011 ~ : IEEE Senior member :, MPEG, 3D,, / 165