a), a), a) Motion Vector Coding Using Adaptive Motion Resolution Myung-Hun Jang a), Chan-Won Seo a), and J

Size: px

Start display at page:

Download "a), a), a) Motion Vector Coding Using Adaptive Motion Resolution Myung-Hun Jang a), Chan-Won Seo a), and J"

칠 가
3 years ago
Views:

1 a), a), a) Motion Vector Coding Using Adaptive Motion Resolution Myung-Hun Jang a), Chan-Won Seo a), and Jong-Ki Han a) MPEG-2, MPEG-4. KTA...,. Threshold. HEVC HM3.0, Random Access 0.9%, Low Delay B picture 0.6%, P picture 2.7%. Abstract In most conventional video codecs, such as MPEG-2 and MPEG-4, inter coding is performed with the fixed motion vector resolution. When KTA software was developed, resolution for MVs can be selected in each slice. Although KTA codec uses a variety of resolutions for ME, the selected resolution is applied over the entire pixels in the slice and the statistical property of the local area is not considered. In this paper, we propose an adaptive decision scheme for motion vector resolution which depends on region, where MV search area is divided to multiple regions according to the distance from PMV. In each region, the assigned resolution is used to estimate MV. Each region supports different resolution for ME from other regions. The efficiency of the proposed scheme is affected from threshold values to divide the search area and the entropy coding method to encode the estimated MV. Simulation results with HM3.0 which is the reference software of HEVC show that the proposed scheme provides bit rate gains of 0.9%, 0.6%, and 2.9% in Random Access, Low Delay with B picture, and Low Delay with P picture structures, respectively. Keyword: Motion Vector Resolution, Motion Estimation, Motion Vector Coding a) Sejong University, Dept. of Information and Comm. Engineering : (hjk@sejong.ac.kr) (). [KI002142, ] ( ),( ),( )..

2 ,.. H.261, MPEG-2 MPEG-4 [1-3]. H.264/AVC - 1/4 [4-6]. H.264/AVC, H.264/AVC ITU-T VCEG Key Technical Area (KTA) [7]., 1/8 1/4 [8]. High Efficiency Video Coding (HEVC) H.264/AVC 1/4 [9]..,,. 1/8,..,..,.,, Threshold. Threshold. Threshold -.. II. III, Threshold IV. V, VI...,.,. H.264/AVC KTA HEVC HM3.0 [5][7][10]. (1)

3 .,.. Sum of Absolute Difference (SAD).,,. (1). (3)., , 3 Exponential-Golomb code., x 3, /8, Table 2. Code number assignment according to MV resolutions 1 Exponential-Golomb code [6][7][9]. 1/8 1/4 1/2 1/1 1. Exponential-Golomb code Table 1. Exponential-Golomb code for fixed MV resolution /8 1-1/8 2 2/ / / /

4 3. Exponential-Golomb code Table 3. Exponential-Golomb code for code number [11]. HEVC HM3.0 [10]. HM3.0 1/4. HEVC ( ), HEVC [12]., 1/2 HM3.0, ,.,.,.. (1) 4. 1/2 Table 4. Performance with 1/2-pel MV resolution BD-Rate (%) ( ) BasketballPass -0.1 BQSquare 9.4 Blowing Bubbles 2.7 RaceHorses 0.9 Average /4 1/2 3.2%., BQSqure Blowing Bubbles., BasketballPass 1/2 0.1%..,

5 5 HM3.0 1/ /8 Table 5. Performance with 1/8-pel MV resolution BD-Rate (%) BasketballPass 1.9 BQSquare -5.7 Blowing Bubbles /8.. RaceHorses 2.4 Average , HM3.0 1/4 1/8,,. 4 5,,..,,.,, Fig. 1. Ranges for MV resolutions based on absolute value of MVD 1 1/8 1/4, 1/2,, Threshold. 1,. HM3.0 2.

6 2. Fig. 2. Conventional code number assignment for MVDs 3. Fig. 3. Proposed code number assignment for MVDs HM3.0, 3. 3,, S 0, 1/8, 1/4, 1/2,..,. 24, 1, ,, 17. x y. x y Fig. 4. MV resolution decision based on absolute value of MVD

7 , x y, x. 4 x 1/2.,. 3.,.,.. i f i f i f, Table 6. MV resolution and index (r) 1/8-pel 0. Threshold Threshold Threshold. Threshold. 1. 1/8.,., Prediction Unit (PU).. 1 PU 2 Threshold. Threshold {,,, } {0, max, max, max }. max. Threshold {,,, } {0, 2, 4, 8} 1/8, Threshold. Threshold, 0, 1., Threshold. 1/4-pel 1 1/2-pel 2 1-pel 3 (6) Threshold

8 1 PU., Threshold. PU, (8). 1, PU. (8) Threshold. (6)(8) 1.,,. Threshold,. arg min Threshold. (6)(11) Threshold. 5 Threshold. Th = { Th0, Th1, Th2, Th3} = { 0, SRmax, SRmax, SRmax } Th { Th0, Th1, Th2, Th3} = { 0,2,4,8} k = 0, r = 1 D = D D D D Th = D Th k r r arg min (9) Threshold. (10), 3 Threshold,, 1, Threshold. Threshold { } * m = arg min m D Thr m ³ Thr - 1 k = m * T S J k J j j= 1 ( ) = å Th ( ) r ( 1) max D Th k + > SR ( ) * k = arg min J S k Th = D Th k r r r ³ 3 5. Threshold Fig. 5. Block diagram for optimal threshold decision *

9 3 4 Threshold., Threshold. Threshold, (12). (12).. 8. DCT-IF 8 taps () Table 8. Coefficients of DCT-IF 8 taps (Chroma component) Position Filter Coefficients 1/16 { } 3/16 { } 5/16 { } 7/16 { } 9/16 { } 11/16 { } 13/16 { } 15/16 { }.. HEVC HM3.0, JCT-VC [10][12]. HM3.0 1/8, 7 8 DCT-IF 8tap [13-14]. BD-Rate,,,. 916 RA Random Access, LB Lowdelay with B picture, LP Low dealy with P picture, HE High Efficiency LC Low Complexity 7. DCT-IF 8 taps () Table 7. Coefficients of DCT-IF 8 taps (Luma component) Position Filter Coefficients 1/8 {-1, 3, -6, 62, 9, -4, 2, -1} 3/8 {-2, 5, -12, 50, 30, -10, 4, -1} 5/8 {-1, 4, -10, 30, 50, -12, 5, -2} 7/8 {-1, 2, -4, 9, 62, -6, 3, -1} 911 HM3.0. Random 9. Random Access Table 9. Performance for Random Access coding structure Class A (2560x1600) Class B (1920x1080) Class C (832x480) (416x240) RA-HE RA-LC BD-Rate (%) BD-Rate (%) Traffic PeopleOnStreet Nebuta SteamLocomotive Class A Average Kimono ParkScene Cactus BasketballDrive BQTerrace Class B Average BasketballDrill BQMall PartyScene RaceHorses Class C Average BasketballPass BQSquare Blowing Bubbles RaceHorses Average Total Average

10 10. Low delay with B picture Table 10. Performance for Low delay with B picture coding structure Class B (1920x1080) Class C (832x480) (416x240) Class E (1280x720) LB-HE LB-LC BD-Rate (%) BD-Rate (%) Kimono ParkScene Cactus BasketballDrive BQTerrace Class B Average BasketballDrill BQMall PartyScene RaceHorses Class C Average BasketballPass BQSquare Blowing Bubbles RaceHorses Average Vidyo Vidyo Vidyo Class E Average Total Average Low delay with P picture Table 11. Performance for Low delay with P picture coding structure Class B (1920x1080) Class C (832x480) (416x240) Class E (1280x720) LP-HE LP-LC BD-Rate (%) BD-Rate (%) Kimono ParkScene Cactus BasketballDrive BQTerrace Class B Average BasketballDrill BQMall PartyScene RaceHorses Class C Average BasketballPass BQSquare Blowing Bubbles RaceHorses Average Vidyo Vidyo Vidyo Class E Average Total Average Access 0.9%, Low delay with B picture 0.6%, Low delay with P picture 2.7%. Low delay with B picture HM3.0 Generalized P and B pictures (GPB). GPB. GPB Low delay with P Picture GPB.., HM3.0 1/8., 1/ HM3.0+1/8-pel HM3.0 1/8. HM3.0+1/8-pel Random Access 1.5%, Low delay with B picture 1.7%, Low delay with P picture 1.0%.

11 911. 1/8. HM Random Access Low delay with B picture HM3.0 HM3.0+1/8-pel Low delay with P picture HM3.0+ 1/8-pel HM3.0. GPB. Random Access Low delay with B picture 1/8 1/4. Low delay with P picture 1/8 1/4. Low delay with P picture 1.0%. Threshold. 12. Random Access (vs. HM3.0+1/8-pel) Table 12. Performance for Random Access coding structure (vs. HM3.0+1/8-pel) Class A (2560x1600) Class B (1920x1080) Class C (832x480) (416x240) RA-HE RA-LC BD-Rate (%) BD-Rate (%) Traffic PeopleOnStreet Nebuta SteamLocomotive Class A Average Kimono ParkScene Cactus BasketballDrive BQTerrace Class B Average BasketballDrill BQMall PartyScene RaceHorses Class C Average BasketballPass BQSquare Blowing Bubbles RaceHorses Average Total Average Low delay with B picture (vs. HM3.0+1/8-pel) Table 13. Performance for Low delay with B picture coding structure (vs. HM3.0+1/8-pel) Class B (1920x1080) Class C (832x480) (416x240) Class E (1280x720) LB-HE LB-LC BD-Rate (%) BD-Rate (%) Kimono ParkScene Cactus BasketballDrive BQTerrace Class B Average BasketballDrill BQMall PartyScene RaceHorses Class C Average BasketballPass BQSquare 0 0 Blowing Bubbles RaceHorses Average Vidyo Vidyo Vidyo Class E Average Total Average

12 14. Low delay with P picture (vs. HM3.0+1/8-pel) Table 14. Performance for Low delay with P picture coding structure (vs. HM3.0+1/8-pel) Class B (1920x1080) Class C (832x480) (416x240) Class E (1280x720) LP-HE LP-LC BD-Rate (%) BD-Rate (%) Kimono ParkScene Cactus BasketballDrive BQTerrace Class B Average BasketballDrill BQMall PartyScene 0 0 RaceHorses Class C Average BasketballPass BQSquare Blowing Bubbles RaceHorses Average Vidyo Vidyo Vidyo Class E Average Total Average HM3.0. Threshold HM HM HM3.0 1/4 1/8 Threshold.. 16 HM3.0 2%., Threshold,.. HM3.0 2%. 15. Table 15. Encoder complexity of the proposed algorithm RA-HE (%) RA-LC (%) LB-HE (%) LB-LC (%) LP-HE (%) LP-LC (%) Class A x x x x Class B Class C Class E x x Average Table 16. Decoder complexity of the proposed algorithm RA-HE (%) RA-LC (%) LB-HE (%) LB-LC (%) LP-HE (%) LP-LC (%) Class A x x x x Class B Class C Class E x x Average

13 ..,. HM3.0 Random Access 0.9%, Low Delay B picture 0.6%, P picture 2.7%., DVD VOD. Threshold. [1] Committee Consultative International Telegraphie et Telegraph (CCITT), H261 video for audiovisual services at p*64 kbits, Geneva, 1990 [2] Int. Telecommun. Union-Telecommun. (ITU-T) and Int. Standards Org./Int. Electrotech. Comm. (ISO/IEC) JTC 1, Rec. H262 and ISO/IEC (MPEG-2 Video), Generic Coding of Moving Pictures and Associated Audio Information-Part 2: Video 1994,11 [3] Int. Standards Org./Int. Electrotech. Comm. (ISO/IEC) JTC 1, ISO/IEC (MPEG-4 visual version 1), Coding of Audio-Visual Objects-Part 2: Visual [4] ITU-T Recommendation H.264 and ISO/IEC AVC Advanced video coding for generic audiovisual services, version 3: 2005 [5] T. Weigand, G. J. Sullivan, G. Bjontegaard, and A. Luthra, Overview of the H.264/AVC video coding standard IEEE Trans. Circuits Syst. Video Technol., Vol. 13, no. 7, pp. 560~576, [6] Draft ITU-T Recommendation and Final Draft International Standard of Joint Specification (ITU-T Rec. H.264/IEC AVC). Mar, 2003 [7] ITU-T VCEG, Reference ITU-T VCEG-KTA Software is available at [8] J.Ostremann and M.Narroschke, Motion compensated prediction with 1/8-pel displacement vector resolution, ITU-T SG16 Q6 VCEG-AD09, 2006, 10 [9] T. Wiegand, B. Bross, W.-J. Han, J.-R. Ohm, and G. J. Sullivan, WD3: Working Draft 3 of High Efficiency Video Coding, JCTVC-E603, Geneva, Switzerland, Mar, 2011 [10] K. McCann, B. Bross, S. Sekiguchi, W-J. Han, HM3: High Efficiency Video Coding (HEVC) Test Model 3 Encoder Description, JCTVC-E602. Geneva, Switzerland, Mar, [11] M. H. Jang, C.W. Seo, and J. K. Han Motion Estimation using Region-based Adaptive Motion Vector Prediction, The 26th International Technical Conference on Circuits/Systems, Computers and Communications, Jun [12] F. Bossen, Common test conditions and software reference configuration, JCTVC-E700, Geneva, Switzerland, Mar, 2011 [13] K. McCann, W-J. Han and I-K Kim, Samsung s Response to the Call for Proposals on Video Compression Technology, JCTVC-A124, Dresden, Germany, April [14] E. Alshina, J. Chen, A. Alshin, N. Shlyakhov, and W.-J. Han, CE3: Experimental results of DCTIF by Samsung, JCT-VC meeting contribution JCTVC-D344, Daegu, KR, Jan,

178 방송공학회논문지 년제 권제호 2012 17 1 저자소개 장명훈 년 : 세종대학교 정보통신공학과 학사 년 ~ 현재: 세종대학교 정보통신공학과 석사과정 주관심분야 :

264/AVC, 영상처리 - 2010-2010 - 서찬원 년 : 세종대학교 정보통신공학과 학사 년 : 세종대학교 정보통신공학과 석사 년 ~ 현재 : 세종대학교 정보통신공학과

한국과학기술원(KAIST) 전기 및 전자공학과 석사 년 : 한국과학기술원(KAIST) 전기 및 전자공학과 박사 년 2월 ~ 2001년 8월 : 삼성전자 DM 연구소 책임 연구원

14 178 방송공학회논문지 년제 권제호 저자소개 장명훈 년 : 세종대학교 정보통신공학과 학사 년 ~ 현재: 세종대학교 정보통신공학과 석사과정 주관심분야 : HEVC, H.264/AVC, 영상처리 서찬원 년 : 세종대학교 정보통신공학과 학사 년 : 세종대학교 정보통신공학과 석사 년 ~ 현재 : 세종대학교 정보통신공학과 박사과정 주관심분야 : HEVC, H.264/AVC, SVC 한종기 - 년 : 한국과학기술원(KAIST) 전기 및 전자공학과 학사 년 : 한국과학기술원(KAIST) 전기 및 전자공학과 석사 년 : 한국과학기술원(KAIST) 전기 및 전자공학과 박사 년 2월 ~ 2001년 8월 : 삼성전자 DM 연구소 책임 연구원 년 9월 ~ 2006년 2월 : 세종대학교 정보통신공학과 조교수 년 3월 ~ 2011년 8월 : 세종대학교 정보통신공학과 부교수 년 9월 ~ 현재 : 세종대학교 정보통신공학과 교수 주관심분야 : HEVC, H.264/AVC, SVC, DVC, Transcoding, 영상처리, 신호처리

그림 2. 최근 출시된 스마트폰의 최대 확장 가능한 내장 및 외장 메모리 용량 원한다. 예전의 피쳐폰에 비해 대용량 메모리를 채택하고 있지 만, 아직 데스크톱 컴퓨터 에 비하면 턱없이 부족한 용량이다. 또한, 대용량 외장 메모리는 그 비용이 비싼 편이다. 그러므로 기존

그림 2. 최근 출시된 스마트폰의 최대 확장 가능한 내장 및 외장 메모리 용량 원한다. 예전의 피쳐폰에 비해 대용량 메모리를 채택하고 있지 만, 아직 데스크톱 컴퓨터 에 비하면 턱없이 부족한 용량이다. 또한, 대용량 외장 메모리는 그 비용이 비싼 편이다. 그러므로 기존 스마트폰을 위한 A/V 신호처리기술 편집위원 : 김홍국 (광주과학기술원) 스마트폰을 위한 동영상 압축 기술 호요성, 최정아 광주과학기술원 요 약 스마트폰이 대중화되면서 이동통신 시장은 일대 혁신을 맞이 했다. 최근 출시되는 스마트폰이 크고 선명한 화면과 빠른 프로 세서를 잇따라 탑재하면서 고해상도 및 고품질 영상에 대한 사 용자들의 수요가 급증하고 있다. 하지만