(Regular Paper) 23 5, 2018 9 (JBE Vol. 23, No. 5, September 2018) https://doi.org/10.5909/jbe.2018.23.5.682 ISSN 2287-9137 (Online) ISSN 1226-7953 (Print) MMT ARQ a), a), a), a), a) ARQ Packet Error Control Scheme Using Multiple Threads Based on MMT Protocol Kwang-eun Won a), Eun-bin Ahn a), Ayoung Kim a), Hong-rae Lee a), and Kwang-deok Seo a) MMT(MPEG Media Transport) ARQ. MMT (Header), (Payload) IP(Internet Protocol).. (packetization).. Abstract In this paper, we propose an ARQ packet error control scheme using multiple threads in delivering massive capacity of multimedia based on MMT(MPEG Media Transport) protocol. On the sending side, each frame that constitutes an image is packetized into MMT packets based on MMT protocol. The header of the packet stores the sequence number of the frames contained in the packet and the time of presentation information. The payload of the packet stores the direct information that comprises the frame. The generated MMT packet is transmitted to the IP network. The receiving side checks if any error has occurred in the received packet. For any identified error, it controls the error through ARQ error control scheme and reconfigure the frame according to the information stored in the header of the received packet. At this point, a multi-threading based transport design is constructed so that each thread takes over a single frame, which increases the transmission efficiency of massive capacity multimedia. The efficiency of the multi-threading transport method is verified by solving the problems that might arise when using a single-thread approach if packets with errors are retransmitted. Keyword : MMT protocol, Multi-thread processing, Multi-thread transport, ARQ error control Copyright 2016 Korean Institute of Broadcast and Media Engineers. All rights reserved. This is an Open-Access article distributed under the terms of the Creative Commons BY-NC-ND (http://creativecommons.org/licenses/by-nc-nd/3.0) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited and not altered.
4 : MMT ARQ (Kwang-eun Won et al.: ARQ Packet Error Control Scheme Using Multiple Threads Based on MMT Protocol) 1. MMT Fig. 1. Architecture of the huge-volume multimedia transceiver system implemented in this research I. UHD MPEG MPEG-H. MMT(MPEG Media Transport) MPEG (Broadcast Network) [1][2][3]. MMT [4]. [5][6]. MMT a) (Division of Computer and Telecommunications Engineering, Yonsei University) Corresponding Author : (Kwang-deok Seo) E-mail: kdseo@yonsei.ac.kr Tel: +82-33-760-2788 ORCID: http://orcid.org/0000-0001-5823-2857 This research was supported by the Basic Science Research Program through the National Research Foundation of Korea(NRF) funded by the Ministry of Education(NRF-2018R1D1A1B07047065). Manuscript received July 19, 2018; Revised August 24, 2018; Accepted, August 24, 2018.., MMT VOD.... MMT 1.. MMT. MMT. 1. MMT II. MMT 2
Encapsulation Function (E-layer), Delivery Function (D-layer), Signaling Function (S-layer) [1]. (E-layer) (encapsulation). MPU(Media Processing Unit) MMT ISO BMFF(ISO Based Media File Format).,. (D-layer). MPU (fragmentation) (aggregation).,, QoS(Quality of Service) AL-FEC ARQ(Automatic Re- peat request). (S-layer) MMT. 2. MMT Fig. 2. Layer structure of the MMT functional areas 5. 2. (Thread) (Flow). 3, 1 (Single-Thread), (Multi-Thread) [7]. 1 (Main-Thread). (Stack) Code, Data, Heap.. Code Data Heap. [8]... (Critical Section). [9]. (Dead Lock).
4 : MMT ARQ (Kwang-eun Won et al.: ARQ Packet Error Control Scheme Using Multiple Threads Based on MMT Protocol) (Codec). MMT timestamp DTS(Decoding Time Stamp) PTS(Presentation Time Stamp). 3. Fig. 3. Concepts of single-thread and multi-thread III. MMT MMT, MPU(Media Processing Unit), MMT,. MMT. 4 MMT. Sending Unit Receiving Unit (Pair). FFMPEG (Queue) MMT. MMT 4. MMT Fig. 4. Structure of the MMT packet transceiver based on single-thread (depacketization).
.,.. 5. FFMPEG MMT. (Pair) MMT. (Multi-channel).. (queue) (reor- dering)... IP. MMT (missing), (error) (delay). (retransmit). 5. MMT Fig. 5. Structure of the MMT packet transceiver based on multi-thread
4 : MMT ARQ (Kwang-eun Won et al.: ARQ Packet Error Control Scheme Using Multiple Threads Based on MMT Protocol) 6. Fig. 6. Decision process of retransmission request for error control 6.. (waiting time) MMT NACK(Negative ACKnowledge) (feedback) MMT [1].. Sending Unit Receiving Unit.,... [10] IP... MMT 7. ARQ Fig. 7. ARQ packet error control mechanism based on multi-thread
Sending Unit Receiving Unit ARQ (Multi-Channel). 7 ARQ.. 8 MMT ARQ. MMT.. (1). S S, T. 8. MMT ARQ Fig. 8. Model of the ARQ packet error control transceiver based on MMT protocol
4 : MMT ARQ (Kwang-eun Won et al.: ARQ Packet Error Control Scheme Using Multiple Threads Based on MMT Protocol) T.. IV. MMT ARQ Microsoft Network Emulator for Windows Toolkit [11][12]. 20% MMT ARQ waiting time 100ms 4K 5 20 MMT ARQ. Sending Unit Receiving Unit Transport Unit. 9 Transport Unit. 5 7 0. 0 9. 1, Fig. 9. Buffer status according to the packet losses (number_of_thread==1) 10. 2,. Fig. 10. Buffer status according to the packet losses (number_of_thread==2)
. 9 7. 20. 10 2. 1, 9. 9 0,. 11 12 4 8. 11 9 10 11. 4, Fig. 11. Buffer status according to the packet losses (number_of_thread==4) 12. 8, Fig. 12. Buffer status according to the packet losses (number_of_thread==8)
4 : MMT ARQ (Kwang-eun Won et al.: ARQ Packet Error Control Scheme Using Multiple Threads Based on MMT Protocol),... MMT,, ARQ. V. MMT ARQ..,.,,. (References) [1] ISO/IEC 23008-1:2014 (First edition), Information technology High efficiency coding and media delivery in heterogeneous environments Part 1: MPEG media transport (MMT), Jun. 2014. [2] Y. Sohn, M. Cho, and J. Paik, Design of MMT-based broadcasting system for UHD video streaming over heterogenous networks, Journal of Broadcast Engineering, vol. 20, no 1, pp. 16-25, Jan. 2015. [3] S. Aoki, K. Otsuki, and H. Hamada, Effective usage of MMT in broadcasting systems, in Proc. of IEEE Int. Symp. Broadband Multimedia Systems and Broadcasting (BMSB), pp. 1-6, 2013. [4] T. Jung, H. Lee, and K. Seo, Overview on MPEG MMT technology and its application to hybrid media delivery over heterogeneous networks, In Proc. of Pacific Rim Conference on Multimedia, pp. 660-669, 2015. [5] S. Cho, J. Lee, and K. Park, Low delayed mobile live streaming method and its implementation, In Proc. of IEEE Int. Conf. Multimedia and Expo Workshops (ICMEW), pp. 1-3, 2015. [6] Y. Hu, S. Xie, and Y. Xu, Dynamic VR live streaming over MMT, in Proc. of IEEE Int. Symp. Broadband Multimedia Systems and Broadcasting (BMSB), pp. 11-16, 2017. [7] A. Silberschatz, Operating System Concepts 8th Edition, Hongnung Publishing Company, pp.169-172, Feb. 2013. [8] D. Kang and H. Park, A design and implementation of transmit/receive model to speed up the transmission of large string-data sets in TCP/IP socket communication, Journal of Korea Institute of Information and Communication Engineering, vol. 17, no. 4, pp. 885-892, Apr. 2013. [9] J. Jeong, et al. Performance comparison method for multi-core based application software architecture alternatives, Journal of KIISE: Software and Applications, vol. 39, no 1, pp. 1-11, Jan. 2012. [10] C. Kim, et al. An efficient delay-constrained ARQ scheme for MMT packet-based real-time video streaming over IP networks, Journal of Real-Time Image Processing, vol. 12, no. 2, pp. 257-271, 2016. [11] ISO/IEC PDTR 23008-13, Information technology-high efficiency coding and media delivery in heterogeneous environments Part 13: MPEG media transport implementation guidelines. [12] Available at http://network-emulator-for-windows-toolkit.software. informer.com/.
- 2016 2 : - 2018 8 : - ORCID : https://orcid.org/0000-0002-6370-0608 - :, - 2016 8 : - 2017 3 ~ : - ORCID : https://orcid.org/0000-0001-7681-4682 - :,, 360/VR - 2016 2 : - 2016 3 ~ : - ORCID : https://orcid.org/0000-0002-3793-1365 - :,, 360/VR - 2010 2 : - 2012 8 : - 2012 9 ~ : - ORCID : https://orcid.org/0000-0001-6985-6016 - :,, - 1996 2 : KAIST - 1998 2 : KAIST - 2002 8 : KAIST - 2002 8 ~ 2005 2 : LG - 2012 9 ~ 2013 8 : Courtesy Professor, Univ. of Florida, USA - 2005 3 ~ : - ORCID : http://orcid.org/0000-0001-5823-2857 - :,,,