3 : DWT (I-Seul Kang et al.: An Empirical Digital Image Watermarking using Frequency Properties of DWT) (Special Paper) 22 3, 2017 5 (JBE Vol. 22, No. 3, May 2017) https://doi.org/10.5909/jbe.2017.22.3.295 ISSN 2287-9137 (Online) ISSN 1226-7953 (Print) DWT a), a), b), a) An Empirical Digital Image Watermarking using Frequency Properties of DWT I-Seul Kang a), Yong-Seok Lee a), Young-Ho Seo b), and Dong-Wook Kim a).,. 2 (2-Dimensional Discrete Wavelet Transform, 2D-DWT),. (Quantization Index Modulation, QIM),...,. Abstract Digital video content is the most information-intensive and high-value content. Therefore, it is necessary to protect the intellectual property rights of these contents, and this paper also proposes a watermarking method of digital image for this purpose. The proposed method uses the frequency characteristics of 2-Dimensional Discrete Wavelet Transform (2D-DWT) for digital images and digital watermark on global data without using local or specific data of the image for watermark embedding. The method to insert digital watermark data uses a simple Quantization Index Modulation (QIM) and a multiple watermarking method that inserts the same watermark data in multiple. When extracting a watermark, multiple watermarks are extracted and the final watermark data is determined by a simple statistical method. This method is an empirical method for experimentally determining the parameters in the watermark embedding process. The proposed method performs experiments on various images against various attacks and shows the superiority of the proposed method by comparing the performance with the representative existing methods. Keyword : digital image watermarking, frequency property, 2-dimensional discrete wavelet transform (2D-DWT), global data, empirical method Copyright 2017 Korean Institute of Broadcast and Media Engineers. All rights reserved. This is an Open-Access article distributed under the terms of the Creative Commons BY-NC-ND (http://creativecommons.org/licenses/by-nc-nd/3.0) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited and not altered.
(JBE Vol. 22, No. 3, May 2017).. (ownership) (intellec- tual property right), 30 [1]. [2]. (digital watermarking, DWM) [1],. DWM (proof of owner), (au- thentication), (integrity), / (copy control), (tracking), (broadcast- ing monitoring) [1],,. DWM (watermark, WM) blind non-blind [1]. Non-blind WM, blind. blind Non-blind [1]. WM a) (Department of Electronic Materials Engineering, Kwangwoon University) b) (School of Liberal Arts, Kwangwoon University) Corresponding Author : (Dong-Wook Kim) E-mail: dwkim@kw.ac.kr Tel: +82-2-940-5167 ORCID: http://orcid.org/0000-0002-4668-743x 2017. 2016 () (NRF-2016R1D1A1B03930691). Manuscript received February 28, 2017; Revised May 22, 2017; Accepted May 22, 2017. [1]. DWM WM (robustness) fragile [1]. WM (, invisible) WM (, visible) [1]. WM blind. DWM WM WM. 2 (2-dimensional discrete wavelet transform, 2D-DWT),. 2D- DWT. 2D-DWT. 2D-DWT 1- (level) [3~6], LL1(,, L, H.. LL1-1 (subband) ) 10 DWM, JPEG Salt& pepper, LL1 WM. [7], HH1. 2-, [8] 512 512 4 4 256 256 2-2D-DWT HH WM. WM, average filtering, median filtering, crop
3 : DWT (I-Seul Kang et al.: An Empirical Digital Image Watermarking using Frequency Properties of DWT). 2D-DWT DCT(discrete cosine transform) [9], HL1, LH1, HL2, LH2, HH2 8 8 DCT (6,7) (7,6) WM. median 0.7. 2- HH1 HH2 64 64 32 32 WM WM [10]. (color) DWM [11], (human visual system, HVS) blue WM 0.9. [12] RGB YCbCr HVS Cb, 4-2D-DWT HL4 WM. 0.9 NCC rotation. WM QIM(quantization index modulation) [13~15], [13], [14][15]. [16]. 1-2D-DWT, LL1 4 4 SVD(singular value decomposition) WM. WM (non-blind)., WM. WM, WM WM WM. WM (trade-off). 2D-DWT WM, WM. 2D-DWT, WM WM Image I One level transform g[n] 1/2 h[n] 1/2 g[n] h[n] g[n] 1/2 1/2 1/2 LL1 To next level transform LH1 HL1 LL3 HL3 LH3 HH3 LH2 HL2 HH2 HL1 Horizontal transform h[n] 1/2 HH1 LH1 HH1 Horizontal transform Gain (a) Level 3 Level 2 Level 1 (b) f n /8 f n /4 f n /2 f n... Frequency (c) 1. 2D-DWT : (a), (b) 3-2D-DWT, (c) 3- DWT. Fig. 1. 2D-DWT and the frequency band of subbands: (a) filter bank, (b) subbands after 3-level 2D-DWT, (c) frequency band for 3-level DWT.
(JBE Vol. 22, No. 3, May 2017) WM.. 2 2D- DWT. 3 DWM. 4,. 5.. 2D-DWT 2D-DWT 2 [17]. 1(a) 2D-DWT (filter bank), 2, ( ) ( ). 1/2 1/2. LL. 2(b) 3-. 1(c) 3-1 DWT.. 1- DWT 0, LL1 2 2 0 1 (HL1, LH1, HH1) (a) (b) (c) (d) (e) (f) 2. 2D-DWT : (a) 1,024 1,024, (b) (a) 4-2D-DWT, (c) (a) 512 512 -, (d) (b) 3-2D-DWT, (e) (b) -4, (f) (d) -3 Fig. 2. An example of 2d-DWT: (a) 1,024 1,024 original image, (b) result from 4-level 2D-DWT for (a), (c) 512 512 down-sampled result from (a), (d) resu;t from 3-level 2D-DWT for (c), (e) four level-4 subbands of (b), (f) four level-3 subbands of (d).
3 : DWT (I-Seul Kang et al.: An Empirical Digital Image Watermarking using Frequency Properties of DWT).., VR(virtual reality) AR(augmented reality). (scene).,., 2D-DWT? 2. 1,024 1,024 St. George Church(a) 1/2 (c), 4- (b), 3-2D-DWT(d). 1(c) (c) (a). 2D-DWT (b) (d). 2 (b) -4 (e) (d) -3 (f). (e) (f).. 2(b), -1,.. DWT DWM., DWM. 1. WM. YCbCr Y DWM. 2D-DWT, WM. WM (bit), WM ( WM). WM QIM. QIM [18], ( ) WM 3. 0 1 WM. DWM., WM WM. 3. Fig. 3. Quantizer...... 0 1 c i ' 2.5Δ L 1.5Δ L 0.5Δ L 0 1-0.5Δ L -1.5Δ L -2.5Δ L 0 1 c i
(JBE Vol. 22, No. 3, May 2017) (a) (b) (c) (d) 4. 1.024 1,024 : (a) St. George Church, (b) Two Horses, (c) Neuschwanstein Castle, (d) Four Kittens. Fig. 4. The 1.024 1,024 test images: (a) St. George Church, (b) Two Horses, (c) Neuschwanstein Castle, (d) Four Kittens., 1.,,. 1,024 1,024 4. 2D-DWT 2-1, 2- DWM. 512 512 2-2 WM, 3-3 4-4.,. DWM WM WM PSNR(peak signal-to-noise ratio) [19] 45[dB].. 2,. 1. Table 1. Summary of test experiments Resolution Highest 2D-DWT level Type Attacks Intensity 512 512 4 JPEG compression 40, 60, 80 640 480 4 Median filtering 3 3, 5 5, 7 7 1,024 1,024 5 Gaussian noise addition 1%, 2%, 3% 1,920 1,080 5 Sharpening 2, 3, 4 2,048 2,048 6 Rotation 15, 30, 45 2. Table 2. Summary of the three experiments Experiment Final WM data Quantization step size 1 2 3 1.1 1: All the embedded WM sets One WM set by statistical method One WM set by statistical method Same for all subbands Same for all subbands Adjustment according to subband energy ~, DWM 45[dB]. WM
3 : DWT (I-Seul Kang et al.: An Empirical Digital Image Watermarking using Frequency Properties of DWT) (a) (b) (c) (d) (e) (f) 5. 1,024 1,024 1 : (a) JPEG, (b), (c), (d), (e), (f). Fig. 5. Experiment 1 results of 1,024 1,024 images for: (a) JPEG compression attacks, (b) median filtering attacks, (c) Gaussian noise addition attacks, (d) sharpening attacks, (e) rotation attacks, (f) average for all the attacks. (a) (b) (c) (d) (e) (f) 6. 1,024 1,024 2 : (a) JPEG, (b), (c), (d), (e), (f). Fig. 6. Experiment 2 results of 1,024 1,024 images for: (a) JPEG compression attacks, (b) median filtering attacks, (c) Gaussian noise addition attacks, (d) sharpening attacks, (e) rotation attacks, (f) average for all the attacks.
(JBE Vol. 22, No. 3, May 2017) WM WM NCC(normalized cross correlation) [20]. 1,024 1,024 5,. 5, 2D-DWT, (f).. 2D-DWT. 1.2 2: WM 1 WM WM. WM,. 1 2 1,024 1,024 6,. 1, 1,. JPEG,. 1 NCC 5. (f) 4 5. 1.3 3: 1 2 WM.., WM,.. WM WM. 7,, 2D-DWT. 2D-DWT LL. LL 0 ( ), 0. (1) LL, RMS(root-mean-square). f or f or Image + - n-level 2DDWT Subband energy calculation Attack 7. Fig. 7. Experiment to estimate the effect of an attack WM 7 2 1,024 1,024 4-2D-DWT 3. 6(f) 1,024 1,024 4-2D-DWT. 3 (a) 7, (b) 2.
3 : DWT (I-Seul Kang et al.: An Empirical Digital Image Watermarking using Frequency Properties of DWT) 3. 1,024 1,024 4-2D-DWT Table 3. Example result from experiment on the effect of attack for 4-level 2D-DWT of 1,024 1,024 images. Attack (a) Effect of attack by energy (b) WM extraction rate by NCC LL HL LH HH LL HL LH HH No attack 149.349 (original image) (71.624) 16.211 15.598 20.128 - - - - 1 pxl 0.318 0.759 0.766 1.456 0.961 0.810 0.804 0.479 Sharpening 2 pxl 0.539 1.278 1.288 2.300 0.865 0.618 0.569 0.368 3 pxl 0.765 1.760 1.771 2.903 0.728 0.492 0.459 0.337 Gaussian 1% 0.256 0.456 0.470 0.913 0.994 0.971 0.983 0.581 noise 2% 0.508 0.859 0.885 1.674 0.855 0.767 0.735 0.177 addition 3% 0.843 1.292 1.264 2.556 0.524 0.338 0.288 0.009 Median filtering JPEG compression quality Rotation 3 3 1.045 1.841 1.751 3.336 0.541 0.469 0.447 0.283 5 5 2.198 3.872 3.936 7.172 0.390 0.330 0.309 0.167 7 7 3.185 5.739 5.804 10.527 0.343 0.277 0.269 0.139 80/100 0.237 0.409 0.439 2.373 0.712 0.413 0.376 0.056 60/100 0.354 0.614 0.616 1.248 0.963 0.881 0.892 0.361 40/100 0.686 1.180 1.216 0.901 0.996 0.989 0.980 0.605 15º 54.176 12.292 12.839 6.721 0.834 0.855 0.840 0.857 30º 67.896 11.921 12.995 15.248 0.776 0.796 0.780 0.802 45º 72.336 10.162 11.317 26.927 0.787 0.797 0.775 0.788,. (a),.,., 4-.,, JPEG -4. (b).,.,,, WM. WM DWM. DWM 3., 3.. 3 (a) (b), HL LH,. (2) (weighting factor, ) (1) ( ), LL, HL=LH, HH (3). 1.3.1
(JBE Vol. 22, No. 3, May 2017),. (3) WM (3). E Sn T Sn,h T Sn,l E Sn =e Sn 1.3.2 (2). (threshold value) (4) (1),. 8. if if if 8. Fig. 8. Quantization range T Sn,l T Sn,h 2, 1 2 1,024 1,024 9. 2, JPEG 2. JPEG 2.,., e Sn (a) (b) (c) (d) (e) (f) 9. 1,024 1,024 3 : (a) JPEG, (b), (c), (d), (e), (f). Fig. 9. Experiment 3 results of 1,024 1,024 images for: (a) JPEG compression attacks, (b) median filtering attacks, (c) Gaussian noise addition attacks, (d) sharpening attacks, (e) rotation attacks, (f) average for all the attacks.
3 : DWT (I-Seul Kang et al.: An Empirical Digital Image Watermarking using Frequency Properties of DWT)..., 2D-DWT 4,096 16,384. 2. 10. 3 Fig. 10. Results from Experiment 3 for all resolutions 3 10..., (5)., 2D-DWT DWM 11(a), 11(a) WM 11(b). 2.1 Y RGB YCbCr. Y (5) 2D-DWT. (1), Original RGB image Watermark data Watermarked and attacked image CbCr Convert to YCbCr format Y Determine 2D-DWT level and transform Weighting factor calculation Convert to YCbCr format Y Determine 2D-DWT level and transform Weighting factor calculation Multiple WM embedding Data scrambling Multiple WM extraction Inverse 2D-DWT Key De-scrambling Key Convert to RGB format Single WM formation Watermarked image Extracted WM (a) (b) 11. DWM : (a) WM, (b) WM. Fig. 11. The proposed DWM scheme: (a) WM embedding procedure, (b) WM extracting procedure.
(JBE Vol. 22, No. 3, May 2017) (2) (4) (3). 3 WM. WM, [18] (linear feedback shift register, LFSR) [18][20] WM Exclusive-OR. (key) LFSR. WM, 2D-DWT Y, CbCr RGB. 2.2 DWM WM 11(b)., 2D- DWT, WM. WM, 3 WM. WM WM,. WM WM LFSR, WM Exclusive-OR WM. IV. 3 WM. 1. i7-2700k CPU 16GB RAM PC 64- Windows 7 Ultimate C/C++. WM 12 2, 32 32. 4 (M:N). DWM, [21~23]. 2D-DWT. WM 32 32 2D-DWT 4 16 WM. 4 (symmetric extension) [24]. 1,920 1,080 8 1,920 1,088. WM. 12. WM Fig. 12. Used WM 4. Table 4. Used images in experiments M:N Resolution DWT level # of images 1:1 4:3 16:9 512 512 3 10 1,024 1,024 4 10 640 480 3 10 1,280 960 4 10 1,920 1,080 4 10 3,840 2,160 5 10 5. 5,,,. 5 (pixel- value change attack), (geometric attack)
3 : DWT (I-Seul Kang et al.: An Empirical Digital Image Watermarking using Frequency Properties of DWT). 5. Table 5. Experimented attacks Category Type Intensity Pixel-value change attack Geometrical attack JPEG compression 80, 60, 40, 20/100 Gaussian blurring 3 3, 5 5 Average blurring 3 3 Median filtering 3 3 Sharpening - Gaussian noise addition 3% Salt&pepper noise addition 3% Histogram equalization - Contrast -20 Shrink 0,8, 0.5, 0.25 Magnify 2 Rotation π/6, π/4, π/3, π/2 Cropping 25% 2. 3 (, ) ( ) 1. 6, LL,.. 6. Table 6. Determined parameter values by experiment Parameter LL LH HL HH TSn,l 1.5 2.0 2.0 2.0 TSn,h 2.5 8.0 8.0 8.0 γsn 0.1 0.2 0.2 0.3 3. 1 3 7 13. 7 WM PSNR (a) (b) (c) (d) (e) (f) 13. : (a) JPEG, (b),,, (c),,, Salt&pepper,, (d) (, ), (e), cropping, (f). Fig. 13. Experimental results for attacks: (a) JPEG compression, (b) Gaussian blurring, average blurring, median filtering, (c) sharpening, histogram equalization, Gaussian noise addition, Salt&pepper noise addition, contrast adjustment, (d) scaling (shrink, magnify), (e) rotation, cropping, (f) averages.
(JBE Vol. 22, No. 3, May 2017). WM, 40[dB], 39.67[dB]. 7. WM Table 7. Invisibility of the embedded WM Resolution PSNR[dB] 512 512 40.21 1,024 1,024 39.33 640 480 40.14 1,280 960 39.37 1,920 1,080 39.48 3,840 2,160 39.43 Average 39.67 13, ( ). PSNR ( P) WM NCC( N). PSNR, NCC, PSNR, NCC, PSNR NCC., (a), (b), (c), (d) (e), (f)., (a) JPEG, (b) (G blur), (Avg blur), (Med flt), (c), (sharpening), (Hist. Eq), (G noise), Salt&pepper (S noise), (Constrast). (d) (Shrink) (magnify), (e) (Rot) cropping(crop). (f) (Pixel Avg), (Geo Avg), (Total Avg)., (a) JPEG PSNR PSNR., JPEG quality 40/100 1,024 1,024 NCC. quality 40/100. (b) PSNR NCC. 5 5 1,024 1,024 0.9 NCC,. (c) PSNR NCC., PSNR, 0.6 NCC.. 4/5. (d) (e). (d) 1/4 1 NCC. 1/4 1,024 1,024 0.9 NCC. (e) π/2. 15[dB]. 0.9 NCC. π/3 π/4 1,920 1,080
3 : DWT (I-Seul Kang et al.: An Empirical Digital Image Watermarking using Frequency Properties of DWT). (f)., 0.9 NCC. 4.. [8], [14], [15], [16],. WM. 8 WM DWM PSNR. 32 32 WM 4~16. PSNR,, 39.67[dB]. 8. Table 8. Comparison of Invisibility with existing schemes Scheme Amount of WM PSNR[dB] Ours (32 32 4 4)~ (32 32 16 4) 39.67 [8] 32 32 42.42 [14] 64 64 40.48 [15] 64 64 39.88 [16] 32 32 44.08 14. 8 [8] [14] (a) (b) (c) (d) 14. : (a) [8][14], (b) [8][14], (c) [15], (d) [16]. Fig. 14. Robustness comparison with existing schemes: (a) pixel-value change attacks with [8] and[14], (b) pixel-value change attacks with [8] and [14], (c) pixel-value change attacks with [15], (d) geometric attacks with [16].
(JBE Vol. 22, No. 3, May 2017) WM WM BER(bit error rate), [15] [16] NCC. [8] [14] (a)(b), [15][16] (c)(d), (a) (c), (b) (d). 1 14,. [15], [16] 14(c) [15], 14(d) [16]. 14(a), [8] [14] BER. [14] 0.043, 0.050, [14] BER. BER, [8] 0.137, [14] 0.074, 0.0026 BER. (b) [8][14], BER. (Total Avg) [8] 0.039, [14] 0.075, 0.0133. [15], (c) NCC. JPEG 60/100, NCC. (d) [16] π/3, π/4, π/6 [16], 0.99 NCC. [16] 0.954, 0.973. 13 14,,.. 2D-DWT 2D-DWT,. WM WM. WM QIM,. WM WM WM, WM WM.,.,.. DWT, WM. (References) [1] I. J. Cox, et al., Digital watermarking and steganigraphy, Morgan Kaufmann Publisher, 2008. [2] Wlliam Stalling, Cryptography and network security, Prentice-Hall, 2011. [3] N. M. Makbol and B. E. Khoo, Robust blind image watermarking scheme based on redundant discrete wavelet transform and singular value decomposition, J. of Electronics and Communications, Vol. 67,
강이슬 외 인 의 주파수 특성을 이용한 실험적 디지털 영상 워터마킹 311 3 : DWT (I-Seul Kang et al.: An Empirical Digital Image Watermarking using Frequency Properties of DWT) No. 2, pp. 102-112, Feb. 2013. C. C. Lai and C. C. Tsai, Digital image watermarking using discrete wavelet transform and singluar value decomposition, IEEE Trans. on Instrumentation and Measurement, Vol. 59, No. 11, pp. 3060-3063, Nov. 2010. [5] E. Ganic and A. M. Exkicioglu, Robust embedding of visual watermarks using discrete wavelet transform and singular value decomposition, J. of Electronic Imaging, Vol. 14, No. 4, (043004), Dec. 2005. [6] S. Lagzian, M. Soryani, and M. Fathy, Robust watermarking scheme based on RDWT-SVD: embedding data in all subbands, Artificial Intelligence and Signal Processing Symposium, pp. 48-52, June 2011. [7] P. P. Thulasidharan and M. S. Nair, QR code based blind digital image watermarking with attack detection code, J. of Electronics and Communications, Vol. 69, No. 7, pp. 1074-1084, Jul. 2015. [8] R. Mehta, V. P. Vishwakarma and N. Rajpal, Lagrangian support vector regression based image watermarking in wavelet domain, Signal Processing and Integrated Networks, pp.854-859, Feb. 2015. [9] J. Maedeh, S. Shadrokh and K. Nader, Robust image watermarking by multi resolution embedding in wavelet transform coefficients, ICEE 2015, pp. 478-482, May 2015. [10] T. H. Nguyen, D. M. Duong and D. A. Duong, Robust and high capacity watermarking for image based on DWT-SVD, IEEE Int l Conf. on RIVF, pp. 83-88, Jan. 2015. [11] J. George, S. Varma and M. Chatterjee, Color image watermarking using DWT-SVD and Arnold transform, India Conference (INDICON), pp. 1-6, Dec. 2014. [12] A. Roy, A. K. Maiti and K. Ghosh, A perception based color image adaptive watermarking scheme in YcbCr space, SPIN, pp. 537-543, [4] 강이슬 Feb. 2015. [13] B. Liao and J. Lv, A Novel watermark embedding scheme using compressive sensing in wavelet domain, The Open Cybernetics & Systemics Journal, Vol. 9, No. 1, pp. 1-6, Jun. 2015. [14] H. T. Hu, Y. J. Chang and S. H. Chen, A progressive QIM to cope with SVD-based blind image watermarking in DWT domain, IEEE China SIP, pp. 421-425, Jul. 2014. [15] J. Ouyang, G. Coatrieux, B. Chen and H. Shu, Color image watermarking based on quaternion Fourier transform and improved uniform log-polar mapping, Computers & Electrical Engineering, http://dx.doi. org/ 10.1016/ j.compeleceng. 2015.03.004. [16] Y. Xueyi, et al. "A SIFT-based DWT-SVD blind watermark method against geometrical attacks," IEEE, Intl. Cong. CISP, pp. 323-329, Oct. 2014. [17] R. M. Rao and A. S. Bopardikar, Wavelet transforms, AddisonWesley, 1998. [18] Y. S. Lee, Y. H. Seo, and D. W. Kim, Robust and Blind Watermarking for DIBR Using a Depth Variation Map, JBE Vol. 21, No. 6, pp. 845-860, 2016 November. [19] R. C. Gonzales and R. E. Woods, Digital image processing, Pearson Prentice-hall, Upper Saddle River, NJ, 2008. [20] https://en.wikipedia.org/wiki/linear_feedback_shift _register [21] http://vision.middlebury.edu/stereo/ [22] http://www.dofpro.com/cgigallery.htm [23] http://www.wallpapervortex.com/animals-bear-wallpapers.html#. VbgqFvntlBc [24] http://www.iso.org/iso/iso_catalogue/catalogue_ics/catalogue_detail_ics.htm?csnumber=27687 저자소개 년 월 광운대학교 전자재료공학과 졸업 공학사) 년 월 현재 광운대학교 전자재료공학과 공학석사) 주관심분야 영상 신호처리 워터마킹 - 2016 2 : ( - 2016 3 ~ : ( - ORCID : http://orcid.org/0000-0002-7981-989x : Virtual Reality,, 이용석 년 월 광운대학교 전자재료공학과 졸업 공학사) 년 월 광운대학교 전자재료공학과 졸업 공학석사) 주관심분야 영상 신호처리 워터마킹 설계 - 2015 2 : ( - 2017 2 : ( - ORCID : http://orcid.org/0000-0002-1608-809x : 3D,, SoC
(JBE Vol. 22, No. 3, May 2017) - 1999 2 : () - 2001 2 : ( ) - 2004 8 : ( ) - 2005 9 ~ 2008 2 : - 2008 3 ~ : - ORCID : http://orcid.org/0000-0003-1046-395x - :, 2D/3D,, SoC - 1983 2 : () - 1985 2 : - 1991 9 : Georgia ( ) - 1992 3 ~ : - 2009 3 ~ : - ORCID : http://orcid.org/0000-0002-4668-743x - : 3D,, VLSI Testability, VLSI CAD, DSP, Wireless Communication