(JBE Vol. 21, No. 4, July 2016) (Regular Paper) 21 4, (JBE Vol. 21, No. 4, July 2016) ISSN

Transcription

1 (Regular Paper) 21 4, (JBE Vol. 21, No. 4, July 2016) ISSN (Online) ISSN (Print) H.265/HEVC a), b), a) A Study on the Compression Efficiency of a Digital Hologram Video using Domain Transforms and H.265/HEVC Su-Jin Jang a), Young-Ho Seo b), and Dong-Wook Kim a) H.265/HEVC,. H.265/HEVC.,,.. Abstract Recently, many researches on digital holograms, which retain almost perfect 3 dimensional image information, have been performed actively that it seems for them to be serviced soon. Accordingly, this paper proposes a data compression technique for a digital hologram video for this service. It uses H.265/HEVC, the most recent international 2 dimensional video compression standard, for which we consider various domain transform methods to increase the correlation among the pixels in a digital hologram. Also we consider the various parameters on H.265/HEVC. The purpose of this paper is to find empirically the optimal condition for the domain transform method, the size of transform unit, and the H.265/HEVC parameters. The proposed method satisfying the optimal parameter set found is compared to the existing methods to prove that ours shows better performance. Keyword : Digital hologram, Data compression, Domain transform, H.265/HEVC, Optimal compression condition a) (Dept. of Electronic Materials Engineering, Kwangwoon University) b) (Dept. of Culture, Kwangwoon University) Corresponding Author : (Dong-Wook Kim) dwkim@kw.ac.kr Tel: ORCID: Manuscript received April 28, 2016; Revised May 30, 2016; Accepted May 30, 2016.

2 2: H.265/HEVC (Su-Jin Jang et al.: A Study on the Compression Efficiency of a Digital Hologram Video using Domain Transforms and H.265/HEVC). 2009, 3D, [1]. (stereoscopic) (multiple viewpoints) [2],, 3D, (hologram). (, object wave) (, reference wave) (fringe pattern), (digital hologram, DH). 2D 3D [3]..,, 3 3D, 2020 [4]. DH,. DH. Yoshikawa DH DH, [5][6]. DH 1 segment (discrete cosine transform, DCT) MPEG-1 MPEG-2 [7][8]. Javidi DH [9], [10]. [11]. DH. DH DH DCT (discrete wavelet transform, DWT) DH (sequence) MPEG2 MPEG4 H.264/AVC ZIP [12], DH DCT DWT DH [13]. DCT DH (integrated image) MPEG2 [14]. DH DH DCT, 1 motion-compensated temporal filtering (MCTF) [15], Mallat-tree DWT Bandelet [16]. Liebling DH (Fresnel transform, FT) (wavelet) (Fresenelet) (FLT) [17], [18]. [13]~[16], [17] DH 2. DCT([13][14] DCT DWT DCT ), FT, FLT, 2

3 H.265/HEVC(high efficient video coding) [19]. DCT, FT, FLT. DCT FT DH, FLT (level), HEVC.. 2 DH 3 DH DH 2D H.265/HEVC. HEVC. DH. 2D DH DH., DCT, FT, FLT DCT. 0 (, DC),. 2 DCT 2 DCT, 2 (2-dimensional discrete cosine transform, 2DDCT). (1) 2DDCT, 2DDCT, (),., (integral basis), 0, 1. 1 DH 2DDCT. (a) (b), (c) (d) (a) (b) DH, [3] CGH(computer generated hologram), 1,024 1,024. 2DDCT - ((c d), (g h), (k l)) - ((e f), (i j), (m n)). DH 2DDCT(g j) DH 1/2 DH 2DDCT (k n)., 2DDCT. k n 2DDCT g j. cos cos

4 2: H.265/HEVC (Su-Jin Jang et al.: A Study on the Compression Efficiency of a Digital Hologram Video using Domain Transforms and H.265/HEVC) (a) (b) (c) (d) (e) (f) (g) (h) (i) (j) (k) (l) (m) (n) 1. 2DDCT : ; (a), (b), ; (c), (d), (e), (f), 2DDCT ; (g), (h), (i), (j), 1/4 2DDCT ; (k). (l), (m), (n) Fig. 1. Examples of 2DDCT results from a digital hologram: original object information; (a) light intensity, (b) depth, digital hologram planes; (c) real, (d) imaginary, (e) magnitude, (f) phase, 2DDCT result planes from the whole hologram; (g) real, (h) imaginary, (i) magnitude, (j) phase, 2DDCT result planes from 1/4 partial holograms; (k) real, (l) imaginary, (m) magnitude, (n) phase 2. DH DH (diffraction), (spatial light modulator, SLM).,. (Fresnel diffraction) (FT), exp

5 FT (2)., ( ) DH FT, DH, FT, DH FT, DH FT,,,. (a)~(d) DH, (e)~(h) 1/4 DH. (e)~(f) FT (a)~(d) DH. ( ), (3) (4), (, ) (5) (6). (7) (8) FLT ( ) ( ) DH (FLT) FT DWT [17]. ( ) exp exp (a) (b) (c) (d) (e) (f) (g) (h) 2. 1 DH FT : FT ; (a), (b), (c), (d) ; 1/4 FT ; (e), (f), (g), (h) Fig. 2. FT results from a DH in Fig. 1: FT result planes from the whole hologram; (a) real, (b) imaginary), (c) magnitude, (d) phase, FT result planes from the 1/4 partial holograms; (e) real, (f) imaginary, (g) magnitude, (h) phase

6 2: H.265/HEVC (Su-Jin Jang et al.: A Study on the Compression Efficiency of a Digital Hologram Video using Domain Transforms and H.265/HEVC) exp exp FLT 2. 1/2 sub-sampling(decimation) [12][17]. DH 2, 1/2 decimation, LL, LH, HL, HH 4 (subband) ( 3(a)). LLLL LLHL LLLL LLHL HLLL HLHL LL HL HL LLLH LLHH LLLH LLHH HLLH HLHH LHLL LHHL HHLL HHHL LH HH LH HH LHLH LHHH LLLH HHHH (a) (b) (c) 3. FLT ; (a) 1- FLT, (b) 2- Mallat-tree FLT, (c) 2- quad-tree FLT Fig. 3. Two types of FLT: (a) 1-level FLT, (b) 2-level Mallat-tree FLT, (c) 2-level quad-tree FLT (a) (b) (c) (d) (e) (f) (g) (h) 4. 1 DH quad-tree FLT : 1- FLT ; (a), (b), (c), (d), 2- FLT ; (e), (f), (g), (f) Fig. 4. Quad-tree FLT results from DH in Fig. 1: 1-level FLT planes; (a) real, (b) imaginary, (c) magnitude, (d) phase, 2-level FLT planes; (e) real, (f) imaginary, (g) magnitude, (h) phase

7 XY(X Y L H),. FLT (level),. 3, (b) Mallat-tree FLT, LL 2 FLT, (c) quad-tree FLT FLT. 3(b) (c) WXYZ(W, X, Y, Z L H) 1 W, X, 2 X, Z. quad-tree FLT. - FLT. 4 1 DH quad-tree FLT.,,,, (a)~(d) 1- FLT, (e)~(h) quad-tree 2- FLT. DCT FT 1- FLT 2- FLT, DH FLT,,. 1 FLT, LL FLT Table 1. Energy distribution for 1-lewel FLT subbands LL (%) LH (%) HL (%) HH (%) Real plane Imaginary plane Magnitude plane D DH, 5.,. DH DH, DH. 2D H.265/HEVC. DH DH. Compression Digital hologram video Digital hologram segmentation 2D Discrete Cosine Transform Fresnelet Transform Compression by 2D video techniques De-compression De-Compression by 2D video techniques Inverse 2D Discrete Cosine Transform Evaluation Fresnel Transform Video sequence formation Inverse Fresnel Transform Digital hologram comparison Image reconstruction Inverse Fresnelet Transform Digital hologram re-combination Reconstructed image comparison Transform level, Sub-DH size Intra perod Size, GOP size, CTU size, 5. DH, Fig. 5. The proposed procedure to compress, decompress a DH video data and the quality evaluation

8 2: H.265/HEVC (Su-Jin Jang et al.: A Study on the Compression Efficiency of a Digital Hologram Video using Domain Transforms and H.265/HEVC) DH FT. 1. DH HEVC (intra prediction) (inter prediction). DH. 5 2DDCT, FT, FLT. 2DDCT 1DDCT [7,8,12~15]. FT FLT. 2DDCT FT. FLT 1/2 decimation, FLT. quad-tree FLT, - quad-tree FLT., FLT. 2DDCT FT DH DH DH. 2. HEVC 2D. 6(a) DH 2DDCT FT DH. DH DH 2DDCT FT DH. 6(b) DH 1/4, 4. [13] DH 3 (zig-zag),. FLT 1 1/4 4 Domain Transformed Domain Transformed Domain result Transformed Domain result Transformed Domain result Transformed result result Partial Partial Partial DH Partial DH Partial DH Partial DH Partial DH Partial DH Partial DHPartial Partial DHPartial DHPartial DHPartial Partial DH Partial DH Partial DH Partial DH Partial DH Partial DH DH DH LL HL LL HL LL HL LL LH HL HH LL LH HL HH LH HH LH HH LH HH (a) (b) (c) 6. : (a) DH 2DDCT FT, (b) DH 2DDCT FT, (c) FLT Fig. 6. Video sequencing: (a) when 2DDCT or FT is performed for the whole DH, (b) when 2DDCT or FT is performed for partial DHs, (c) when FLT is performed

9 . 6(c) (1- FLT). 3. 2D, HEVC. DH HEVC (intra period) DH FLT. (low delay) (random access), CTU(coding-tree unit). QP(quantization parameter) [19]. 4.., HEVC DH. DH. DH DH FT,.. DH, PC, PC Intel Core(TM) i CPU GPU NVIDIA GeForce GTX GPU, HEVC HM16.0, C/C++. DH +, CGH. CGH 2, DH (monochromatic) Y,. 2. CGH Table 2. CGH generation parameters Parameter Wavelength Value 633 [nm] Original data resolution Hologram pixel pitch [μm] Hologram resolution 1,024 1,024 Depth range 80 ~ 120 [cm] CGH (clip) 3. / [20] 4. (vertical rig), RGB 1, RGB. Windmill [21] MPEG4 MVC(multiview video coding) 3. Table 3. Original video data used Origin Name Number of frames Selfcaptured [20] Sujin Sujin Huynjin 200 Yoonjin 200 [21] Windmill 200 MPEG4 MVC test seq. [22] Ballet 200 Breakdancers 200

10 2: H.265/HEVC (Su-Jin Jang et al.: A Study on the Compression Efficiency of a Digital Hologram Video using Domain Transforms and H.265/HEVC) Ballet Breakdancers. MPEG DH MPEG, DH MVC , H.265/HEVC HM-16.0 main. DH DH. 4. 2DDCT 4. Table 4. Parameters related to compression Process Parameter Value Transform HEVC Size of partial DH for 2DDCT and FT ~ Level for FLT 1, 2, 3 level Size of CTU ~ Intra period 16 Mode Low-delay GOP 4, 8 Random access GOP 4, 8 Compression ratio QP, bit-rate FT DH(1,024 1,024) DH( 256 DH), FLT 3( 64 ). HEVC CTU 64 64, 32 32, (a) (b) (c) (d) (e) (f) (g) (h) (i) (j) (k) (l) 7. : (a)(e)(i), (b)(f)(j) 200:1, (c)(g)(k) 500:1, (d)(h)(l) 1000:1 ; (a)(b)(c)(d), (e)(f)(g)(h) DH, (i)(j)(k)(l) DH )(j)(k)(l) imagi Fig. 7. Examples of compression results: (a)(e)(i) original data, (b)(f)(j) 200:1 compressed result, (c)(g)(k) 500:1 compressed result, (d)(h)(l) 1000:1 compressed result; (a)(b)(c)(d) reconstructed images, (e)(f)(g)(h) real part of DH, (inary part of DH

11 ., GOP(group of prediction) 4 8, 16. QP. 2. DH 7. DH(1,024 1,024) 1- FLT, CTU 64 64, 16, GOP 4,. ((a)(e)(i)) 200:1((b)(f)(j)), 500:1((c)(g)(k)), 1000:1((d)(h)(l)), ((a)(b)(c)(d)), ((e)(f)(g)(h)) DH, ((i)(j)(k)(l)) DH. PSNR ( ) 6. DH PSNR, DH. 1000:1 PSNR 40[dB] PSNR Table 5. PSNR values of the images in Fig. 6 (a) (b) (c) (d) (e) (f) (g) (h) (i) (j) (k) (l) DH (2DDCT FT) (FLT) 8. HEVC CTU 64 64, 16, GOP 4. (a)(b)(c) 2DDCT, (d)(e)(f) FT, (g)(h)(i) FLT, (a)(d)(g), (b)(e)(h) DH, (c)(f)(i) DH, PSNR. 2DDCT FT DH, FLT 1-4, 1/4 FLT 2DDCT FT DH FLT 3-. PSNR DH, DH. 2DDCT FT DH, FLT 1-. DH 2DDCT, FT FLT. FT, FLT, 2DDCT. HEVC CTU, 9., DH. 8, 2DDCT FT, FLT 1-. DH 8. CTU ,

12 2: H.265/HEVC (Su-Jin Jang et al.: A Study on the Compression Efficiency of a Digital Hologram Video using Domain Transforms and H.265/HEVC) (a) (b) (c) (d) (e) (f) (g) (h) (i) 8. DH : ; (a)(b)(c) 2DDCT, (d)(e)(f) FT, (g)(h)(i) FLT, ; (a)(d)(g), (b)(e)(h) DH, (c)(f)(i) DH Fig. 8. Compressed results for the size of partial DH or transform level: for the kind of transform; (a)(b)(c) 2DDCT, (d)(e)(f) FT, (g)(h)(i) FLT, for the kind of data; (a)(d)(g) reconstructed image, (b)(e)(h) real part of DH, (c)(f)(i) imaginary part of DH (a) (b) (c) 9. HEVC CTU : (a) 2DDCT, (b) FT, (c) FLT Fig. 9. Compressed results of the reconstruction image for the CTU size in HEVC: (a) 2DDCT, (b) FT, (c) FLT HEVC GOP, , GOP 4 GOP 8. GOP

13 (a) (b) (c) 10. HEVC GOP : (a) 2DDCT, (b) FT, (c), FLT Fig. 10. Compressed results of reconstructed image for the mode and GOP size in HEVC: for the kind of transform; (a) 2DDCT, (b) FT, (c) FLT (a) (b) (c) 11., (a), (b) DH, (c) DH Fig. 11. Comparison of compression efficiency in the optimal condition for each transform, (a) reconstructed image, (b) real part of DH, (c) imaginary part of DH, GOP 4. 6, PSNR 11. FT, FLT FT 2DDCT., 1000:1 DH, 2DDCT PSNR. FT 1000: [dB], DH 24.17[dB], 23.97[dB] PSNR. 6. Table 6. The optimal compression condition for each transform Parameter 2DDCT FT FLT Size of partial DH&Level Unsplit Unsplit 1-level Size of CTU Compression mode Randomaccess Randomaccess Randomaccess Size of GOP [9]~[15], [9]~[11] [14] [12][13][15][16].

14 2: H.265/HEVC (Su-Jin Jang et al.: A Study on the Compression Efficiency of a Digital Hologram Video using Domain Transforms and H.265/HEVC) 7. Table 7. Comparing the performance evaluation with pervious works Method Proposed 50:1 100:1 200:1 PSNR NC NRMS PSNR NC NRMS PSNR NC NRMS (36.23) (0.990) (0.032) (34.62) (0.987) (0.0378) (30.75) (0.966) [12] [13] [15] 18 (27.95) (25.83) (24.87) (0.059) - - [16] , PSNR NC(normal correlation) NRMS(normalized root mean square)[16] : :1. 50:1, 100:1, 200:1,. 7,. [15] DH,.. 2 H.265/HEVC [12][13][15] H.264/AVC. H.265/HEVC H.264/AVC 1.5. [15] PSNR 200: [dB], 540: [13] 100:1 NC ([12] 100:1, 50:1 [13] [12] ), NC 850: [16] 100:1 NRMS 0.575, 1000: , [16] H.265/HEVC H.264/AVC H.265/HEVC. 100:1 200:1, H.265/HEVC 3[dB]. 100:1 [13] NC H.264/AVC NC [15], 200:1 DH PSNR 24.87[dB], H.264/AVC PSNR [dB], 100:1 [15] 25.83[dB], [dB]. 2.

15 8. H.264/AVC H.265/HEVC Table 8. Comparing the results by applying our method to H.264/AVC and H.265/HEVC 100:1 200:1 PSNR[dB] NC PSNR[dB] NC H.264 H.265 H.264 H.265 H.264 H.265 H.264 H DH DH ,. V.. 2 H.265/HEVC, 2,,. H.265/HEVC CTU,, GOP., CTU 64 64, GOP GOP :1 PSNR 39.17[dB]. 2., 2. (References) [1] (Jin-Woong Kim), (Chideuk An), (Jin-Soo Choi), (Kyung-Ae Moon), (Nam-Ho Heo), (Ki-Moon Eum), (Kyung-Wook Kang), 3D (Obviouslylooking 3D techniques), (Electronic Technology News), [2] Y. Gao, G. Cheung, T. Maugey, P.Frossard, and J. Liang, Encoderdriven inpainting strategy in multiview video compression, IEEE Trans. in Image Processing, Vol. 25, No. 1, pp , Ja [3] S. A. Benton and V. M. Bove Jr., Holographic imaging, John Wiley and Sons Inc., [4] (Ki-Pyung Han), (Giga Korea), TTL Journal, Vol. 146, pp , (March 2013). [5] H. Yoshikawa and K. Sasaki, "Information reduction by limited resolution for electro -holographic display," SPIE Proc. Vol Practical Holography, pp , Feb [6] H. Yoshikawa and K. Sasaki, "Image Scaling for electro-holographic display," SPIE Proc. Vol. 2176, paper # , pp , Feb, [7] H. Yoshikawa, "Digital holographic signal processing," Proc. TAO First International Symposium on Three Dimensional Image Communication Technologies, pp. S-4-2, Dec [8] H. Yoshikawa and J. tamai, "Holographic image compression by motion picture coding," editor, SPIE Proc. vol 2652 Practical Holography, pp , Jan, [9] T. J. Naughton and B. Javidi, "Compression of encrypted three-dimensional objects using digital holography," Optical Engineering, 43(10), pp , October [10] T. J. Naughton, Y. Frauel, E. Tajahuerce, and B. Javidi, "Compression of digital holograms for three-dimensional object reconstruction and recognition," Applied Optics, 41(20), pp , July 10, 2002.

16 2: H.265/HEVC (Su-Jin Jang et al.: A Study on the Compression Efficiency of a Digital Hologram Video using Domain Transforms and H.265/HEVC) [11] O. Matoba, T. J. Naughton, Y. Frauel, N. Bertaux and B. Javidi, Real-time three-dimensional object reconstruction by use of a phase-encoded digital hologram," Appl. Opt. 41(29), pp , Oct, [12] Young-Ho Seo, Hyun-Jun Choi, and Dong-Wook Kim, "Lossy coding technique for digital holographic signal", SPIE Optical Engineering, 45(6), , Jun [13] Young-Ho Seo, Hyun-Jun Choi, and Dong-Wook Kim, "3D scanning-based compression technique for digital hologram video", Elsevier Signal Processing - Image Communication, Vol.22, Issue 2, pp Feb [14] Young-Ho Seo, Hyun-Jun Choi, Jin-Woo Bae, Hoon-Chong Kang, Seung-Hyun Lee, Ji-Sang Yoo and Dong-Wook Kim, "A new coding technique for digital holographic video using multi-view prediction", IEICE Transactions on Information and Systems, Vol. E90-D, No.1, pp , Jan [15] Young-Ho Seo, Hyun-Jun Choi, Ji-Sang Yoo, and Dong-Wook Kim, Digital hologram compression technique by eliminating spatial correlations based on MCTF, Opt. Commun. 283(21), pp , [16] Le Thanh Bang, Zulfiqar Ali, Pham Duc Quang, Jae-Hyeung Park, and Nam Kim, "Compression of digital hologram for three-dimensional object using Wavelet-Bandelets transform," Optics Express, Vol. 19 Issue 9, pp , [17] M. Liebling, T. Blu and M. Unser, "Fresnelets : new multiresolution wavelet bases for digital holography," IEEE Trans. Image Process. Vol. 12, No. 1, pp , [18] (Young-Ho Seo), (Moon-Seok Kim), (Dong- Wook Kim), (Quad-tree Subband Quantizer Design for Digital Hologram Encoding based on Fresenelet), (Journal of the Korea Institute of Information and Communication Engineering), 19(Vol. 19), 5(No. 5), pp , May [19] [20] Y-H. Seo, Y-H. Lee, J-M. Koo, W-Y. Kim, J-S. Yoo, and D-W. Kim, "Digital holographic video service system for natural color scene," Optical Engineering 52(11), , Nov [21] [22] : () ~ : () - ORCID : - :, HEVC : () : () : () ~ : ~ : - ORCID : - :, 2D/3D,, SoC

17 : () : : Georgia () ~ : ~ : - ORCID : - : 3D,, VLSI Testability, VLSI CAD, DSP, Wireless Communication