Electronics and Telecommunications Trends 디지털홀로그램압축기술및표준화동향 Research and Standardization Trends of Digital Hologram Compression 오관정 (K.-J. Oh, kjoh@etri.re.kr) 박중기 (J. Park, jkp@etri.re.kr) 디지털홀로그래피연구실선임연구원 디지털홀로그래피연구실책임연구원 / 실장 ABSTRACT Holography is a technique that can acquire and reproduce 3D objects nearly perfectly by representing both the amplitude and phase of light. Recently, digital holography has received considerable attention because it is simpler than analog holography from acquisition to reproduction. The data size of the digital hologram increases tremendously as the quality of digital holograms depends on their pixel pitch and resolution. Hence, efficient compression is necessary to realize holographic imaging services. In this report, we introduce recent digital hologram compression techniques and JPEG Pleno holography, which is the first international standardization activity for digital hologram compression. Furthermore, we discuss the future of this field. KEYWORDS 홀로그램, 홀로그램압축, 홀로그램표준화, JPEG Pleno Holography Ⅰ. 서론 80 10 10 2 3 1 DOI https doi org 10 22648 ETRI 2019 J 340613 2019 No 2019 0 00001 Holo TV 본저작물은공공누리제 4 유형출처표시 + 상업적이용금지 + 변경금지조건에따라이용할수있습니다. 2019 한국전자통신연구원
146 34 6 2019 12 JPEG a Ⅱ. 디지털홀로그램압축기술 1. 디지털홀로그램 3 3 2 3 CGH Computer Generated Hologram coherent CGH 4 b 1 a b CGH mesh 5 6 7 3 8 1 CGH CGH 3 2. 디지털홀로그램데이터표현
147 2 HD 1 920 1 080 raw Polar Coordinates Cartesian Coordinates 3 0 2 3 0 255 Noise 3 2 3. 디지털홀로그램압축기술 가. 복원도메인기반압축기술 2
148 34 6 2019 12 출처 Adapted with permission with A. Gilles et al., Hybrid approach for fast occlusion processing in computer-generated hologram calculation, Appl. Opt. 55, no. 20, pp. 5459 5470, 2016. 4 3 9 2 2 4 나. 분할기반압축기술 3 3 10 2 array 다. 최적주파수변환기반압축기술 2 DCT Discrete Cosine Transform Wavelet Transform DA DWT Directional Adaptive Discrete Wavelet Transform 11 wavelet bandelets 12 라. 기타압축기술 13 14
149 Ⅲ. 디지털홀로그램표준화동향 1. 국내표준화동향 2012 TTA PG610 22014 WG6102 1 TTA 10 0629 2012 12 21 2015 1 TTA IEC TC110 WG6 3DD 3D Display Devices ISO IEC JTC1 SC29 WG1 JPEG Pleno 2019 10 0630 2012 12 21 2. 국제표준화동향 TTAR 10 0050 10 0871 2015 11 18 2015 12 16 ISO IEC JCT 1 SC 29 WG 1 JPEG Joint Photographic Experts Group JPEG JPEG 2000 3 10 0872 10 1022 10 1025 2015 12 16 2017 12 13 2017 12 13 2019 12 2 5 3 3 15 2014 10 JPEG Pleno3 15 JPEG Pleno 3 2019 12 2019 12 JPEG Pleno 16 3 6 3
150 34 6 2019 12 나. 응용분야 출처 Reprinted with permission from ISO/IEC JTC1/SC29/WG1, JPEG PLENO Abstract and Executive Summary, WG1N6922, 68th JPEG Meeting, Sydney, Australia, Feb. 2015. 5 JPEG 출처 Reprinted from P. Schelkens et al., JPEG Pleno: Providing representation interoperability for holographic applications and devices, ETRI Journal vo. 41, 2019, pp. 93-108, Korea Open Government License (KOGL) Type 4. 6 JPEG Pleno 가. JPEG Pleno Holography 표준 JPEG Pleno JPEG Pleno Holography JPEG Pleno Holography SW JPEG Pleno Holography Tomography 17 18 19 Prototype VAC Vergence Accommodation Conflict 3D 3D HMD Head Mounted Display TV 20 HOE Holo graphic Optical Elements
151 a b 2 2 m2k WUT 24 2K 라. 표준요구사항 c 출처 Reprinted with permission from [22-24]. 7 JPEG Pleno Holography a Interfere Ball8KS b B com Dice1080P c UBI EmergImg Horse d WUT HeLa Cells 다. 실험영상 d JPEG Pleno Holography Interfere 3 Interfere 21 layer CGH B com CGH 22 0 4 m 16K CGH UBI EmergImg 23 JPEG Pleno Holography 25 random accessscalability 마. 화질평가방법 JPEG Pleno Holography 3 3
152 34 6 2019 12 a b 출처 JPEG Pleno Holography 3D volumetric quality assessment, Doc. ISO/IEC JTC 1/SC 29/WG1 M78045, Rio de Zaneiro, Brazil, Jan.-Feb. 2018. 8 a b JPEG PSNR Peak Signal to Noise Ratio SSIM Structural SIMilarity 8 26 3 PSNR SSIM 2 2 3 JPEG Pleno Light Field 바. 홀로그램수치복원 JPEG Pleno Holography NRSH Numerical Reconstruction Software for Holog a b 출처 Adapted with permission with A. Gilles et al., Hybrid approach for fast occlusion processing in computer-generated hologram calculation, Appl. Opt. 55, no. 20, pp. 5459 5470, 2016. 9 a b
153 출처 Reprinted with permission from JPEG Pleno Holography ES 1.2, Doc. ISO/IEC JTC 1/SC 29/WG1 M81031, Vancouver, Canada, Oct. 2018. 10 raphy V1 1 27 9 사. 압축실험결과 JPEG Pleno Holography 28 10 16 PSNR SSIM 11 a b B com Dices8k4k 11 c d UBI EmergImg Astronaut 11 a c PSNR 11 b d PSNR SSIM 4 HEVC a b c d 출처 Reprinted with permission from JPEG Pleno Holography ES 1.2, Doc. ISO/IEC JTC 1/SC 29/WG1 M81031, Vancouver, Canada, Oct. 2018. 11 a Dice8k4k b Dice8k4k c Astronaut d Astronaut
154 34 6 2019 12 CGH 아. 향후표준화전망 JPEG Pleno Holography AHG Ad Hoc Group JPEG 용어해설 홀로그래피빛의진폭 (amplitude) 과위상 (phase) 을획득또는생성하여공간상에빛의분포 (optical disturbance) 를재현하는기술또는광원의간섭성을이용하여물체광과참조광의간섭패턴을기록 재현하는기술홀로그램공간상의빛의분포를재현하기위하여빛의진폭과위상을가지고있는정보또는그정보를담은매체 (medium) 아날로그홀로그래피광원의간섭성을이용하여실제물체의물체광과참조광의간섭패턴을감광물질에직접기록하고물체광을재현하는기술디지털홀로그래피디지털적인방법을이용하여빛의진폭 (amplitude) 과위상 (phase) 을획득또는생성하여빛의분포를재현하는기술디지털홀로그램디지털적인방법을이용하여빛의분포를재현하기위하여빛의진폭과위상을가지고있는정보또는그정보를담은매체 (medium) CfP Call for Proposals Ⅲ. 결론 3 3DD AHG CGH DWT HOE JPEG NRSH PSNR SSIM VAC 3D Display Devices Ad Hoc Group Computer Generated Hologram Discrete Wavelet Transform Holographic Optical Elements Joint Photographic Experts Group Numerical Reconstruction Software for Holography Peak Signal to Noise Ratio Structural SIMilarity Vergence Accommodation Conflict JPEG Pleno [1] D. Gabor, A new microscopic principle, Nature, vol. 161, no. 4098, p. 777, 1948. [2] E. N. Leith and J. Upatnieks, Reconstructed Wavefronts and Communication Theory, J. Opt. Soc. Am., vol. 52, no. 10, pp. 1123 1128, Oct. 1962. [3] C. M. Vest, Holographic interferometry, J. Wiley and Sons, New York, 1979.
155 [4] B. R. Brown and A.W. Lohmann, Complex Spatial Filtering with Binary Masks, Appl. Opt., vol. 5, no. 6, pp. 967 969, Jun. 1966. [5] D. Leseberg and C. Frère, Computer-generated holograms of 3-D objects composed of tilted planar segments, Appl. Opt., vol. 27, no. 14, pp. 3020 3024, Jul. 1988. [6] A. W. Lohmann, Three-dimensional properties of wavefields, Optik, vol. 51, pp. 105 107, 1978. [7] T. Ichikawa, K. Yamaguchi, and Y. Sakamoto, Realistic expression for full-parallax computer-generated holograms with the ray-tracing method, Appl. Opt. 52, A201-A209, 2013. [8] Overview of Holography 3.0, Doc. ISO/IEC JTC 1/SC 29/ WG1 N81055, Vancouver, Canada, Oct. 2018. [9] E. Darakis and J.J. Soraghan, Reconstruction domain compression of phase-shifting digital holograms, Appl. Opt, vol. 46, no. 3, pp. 351-356, Jan. 2007. [10] H. Yoshikawa and J. Tamai Holographic image compression by motion picture coding, SPIE Proc, vol. 2652, Practical Holography X, pp. 2-9, March. 1996. [11] D. Blinder, T. Bruylants, H. Ottevaere, A. Munteanu, and P. Schelkens, JPEG 2000-based compression of fringe patterns for digital holographic microscopy, Optical Engineering, vol. 53, no. 12, pp. 1-13, Dec. 2014. [12] L. T. Bang et al., Compression of digital hologram for threedimensional object using Wavelet-Bandelets transform, Opt. Express 19, no. 9, pp. 8019 8031, 2011. [13] P. Memmolo, M. Paturzo, A. Pelagotti, A. Finizio, P. Ferraro, and B. Javidi, Compression of digital holograms via adaptivesparse representation, Optics letters, vol. 35, no. 23, pp. 3883-3885, Dec. 2010. [14] P. A. Cheremkhin, and E. A. Kurbatova, Numerical comparison of scalar and vector methods of digital hologram compression, Holography, Diffractive Optics, and Applications VII. vol. 10022, no. 1002227, pp. 1-10, Oct. 2016. [15] ISO/IEC JTC1/SC29/WG1, JPEG PLENO Abstract and Executive Summary, WG1N6922, 68th JPEG Meeting, Sydney, Australia, Feb. 2015. [16] P. Schelkens et al., JPEG Pleno: Providing representation interoperability for holographic applications and devices, ETRI Journal vo. 41, no. 1, pp. 93-108, 2019. [17] M. K. Kim, Digital holographic microscopy: Principles, techniques and applications, Springer, 2011. [18] Ovizio Imaging Systems, http://www.ovizio.com [19] C. M. Vest, Holographic interferometry, J. Wiley and Sons, New York, 1979. [20] M. Yamaguchi, N. Ohyama, and T. Honda, Holographic three-dimensional printer: new method, Appl. Opt. vol. 31, no. 2, pp. 217 222, 1992. [21] D. Blinder et al., Open access database for experimental validations of holographic compression engines, Int. Quality Multimedia Experience (QoMEX), Pylos Nestoras, Greece, May 26 29, pp. 1 6, 2015. [22] A. Gilles et al., Hybrid approach for fast occlusion processing in computer-generated hologram calculation, Appl. Opt. 55, no. 20, pp. 5459 5470, 2016. [23] M. V. Bernardo et al., Holographic representation: hologram plane vs. object plane, Signal Proces. Image Commun. 68, pp. 193 206, 2018. [24] Baczewska, M., Kujawińska, M., Skrzypek, E., and Sladowski, D., Feasibility study of investigation of skin at cellular level by digital holographic microscopy, in [Speckle 2018: VII International Conference on Speckle Metrology], 10834, 108341P, International Society for Optics and Photonics, 2018. [25] JPEG Pleno Holography Uses Cases and Requirements V2.0, Doc. ISO/IEC JTC 1/SC 29/WG1 N84037, Brussels, Belgium, July 2019. [26] JPEG Pleno Holography 3D volumetric quality assessment, Doc. ISO/IEC JTC 1/SC 29/WG1 M78045, Rio de Zaneiro, Brazil, Jan.-Feb. 2018. [27] Numerical reconstruction software for holography (NRSH)1.1, Doc. ISO/IEC JTC 1/SC 29/WG1 N84053, Brussels, Belgium, July 2019. [28] JPEG Pleno Holography ES 1.2, Doc. ISO/IEC JTC 1/SC 29/ WG1 M81031, Vancouver, Canada, Oct. 2018.