(JBE Vol. 22, No. 5, September 2017) (Special Paper) 22 5, 2017 9 (JBE Vol. 22, No. 5, September 2017) https://doi.org/10.5909/jbe.2017.22.5.548 ISSN 2287-9137 (Online) ISSN 1226-7953 (Print) MMT DASH MMTP DASH segment a), a), a) Method of Delivering DASH Segments based on MMTP for Re-use of DASH Contents under MMT Broadcasting Environment Hyomin An a), Dongjin Kang a), and Kyuheon Kim a), UHDTV AV,. UHD TV ATSC(Advanced Television Systems Committee) ATSC3.0. UHDTV DASH/ROUTE MMTP. DASH/ROUTE MMTP UHD DASH/ROUTE MMTP. DASH segment MPU DASH/ROUTE MMTP segment. DASH segment MPU, DASH segment MPU MMTP. Abstract Recently, various high-quality AV services such as UHDTV have begun to increase as broadcasting technology evolves, and various broadcasting standards have been defined. Among the various broadcasting standards, there are representative delivery technologies which are DASH/ROUTE and MMTP. DASH/ROUTE and MMTP are adopted as delivery standards for UHD broadcasting in south Korea, currently. DASH segment and MPU are segmented units including media data, which are delivered via DASH/ROUTE and MMTP, respectively. In this paper, we analyzed structure of DASH segment and MPU and propose a verification system which enables converting DASH segments to MPUs and delivering them via MMTP. Keyword : DASH segment, MPU, MMTP, Delivery, Box a) (Department of Electrics and Radio Engineering, Kyunghee University) Corresponding Author : (Kyuheon Kim) E-mail: kyuheonkim@khu.ac.kr Tel: +82-31-201-2442 ORCID: http://orcid.org/0000-0003-1553-936x 2017 ( ) (No. 2017-0-00224, UHD Dynamic Media, ). Manuscript received July 10, 2017; Revised September 8, 2017; Accepted September 8, 2017. Copyright 2017 Korean Institute of Broadcast and Media Engineers. All rights reserved. This is an Open-Access article distributed under the terms of the Creative Commons BY-NC-ND (http://creativecommons.org/licenses/by-nc-nd/3.0) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited and not altered.
2 : MMT DASH MMTP DASH segment (Hyomin An et al.: Method of Delivering DASH Segments based on MMTP for Re-use of DASH Contents under MMT Broadcasting Environment). TV TV, TV HDTV,., Moving Picture Expert Group(MPEG) MPEG-2 Transport Stream(MPEG-2 TS) [1-2]. MPEG-2 TS,, Over The Top(OTT)., MPEG MPEG Media Transport(MMT) [3-7] HTTP Dynamic Adaptive Streaming over HTTP(DASH) [6]. TV Advanced Television Systems Committee(ATSC) ATSC 3.0, ATSC 3.0 RF MMT DASH/ROUTE(Dynamic Adaptive Streaming over HTTP/Real-time Object delivery over Unidirectional Transport) [8], TCP/IP DASH [9]. ATSC UHD, ATSC 3.0 UHDTV, UHD 2017 5 [10]., ATSC 3.0 UHDTV MMT ROUTE. MMT DASH/ROUTE DASH segment MPU,, MMT DASH., DASH DASH segment MMT DASH segment Media Processing Unit (MPU) MPT (MMT Package Table) message MMT Protocol (MMTP),.. 2 MPEG Media Transport(MMT) Dynamic Adaptive Streaming over HTTP(DASH) segment, 3 DASH segment MPU, 4 5.. DASH segment MMT MMT DASH. 2.1 MMT MMTP MMT, 2.2 DASH DASH segment. 1. MPEG Media Transport(MMT) MMT. 1 MMT. 1 MMT Media Coding Layer, Transport Protocol, Internet Protocol, MMT IP 1 3 function Encapsulation function, Delivery function, Signaling function [11].
(JBE Vol. 22, No. 5, September 2017), Encapsulation function Delivery function, Signaling Signaling Messge [13]. 1. MPEG Media Transport(MMT) Fig 1. Structure of MPEG Media Transport(MMT) Encapsulation function Package, ISO Based Media File Format(ISOBMFF) [12] MPU. Delivery function Encapsulation function MPU,,, MMTP. MMTP IP. Signaling function 1.1 MMT Protocol(MMTP) MMT MMTP. MMT Delivery function MMTP, MPEG-2 TS Protocol,.., MMTP Package MPU. MMTP, MPU GFD. MPU MPU, GFD. ATSC 3.0 GFD, MPU. 1.2 MPU MMT Asset MPU. 2 MPU, Asset Asset ID MPU, MPEG-2 TS MP4 2. Media Processing Unit(MPU) Fig 2. Structure of Media Processing Unit(MPU)
2 : MMT DASH MMTP DASH segment (Hyomin An et al.: Method of Delivering DASH Segments based on MMTP for Re-use of DASH Contents under MMT Broadcasting Environment),, non-timed. MPU ISOBMFF, ISOBMFF MPEG metadata. ISOBMFF, ftyp, moov, moof, mdat,. MPU, AU(Access Unit) timed, non-timed. MPU ftyp, sidx, mmpu, moov, moof, mdat. 'ftyp brand name, ISOBMFF MPU. sidx segment. sidx. mmpu MPU sequence number MPU Asset ID,. moov,. moof mdat,,. mdat. 1.3 MFU & MMT Hint Track MFU MMT Hint Track. MPU Timed data, MPU 3. MPU ftyp mmpu' moov' MPU metadata 3. Media Processing Unit(MPU) Fig 3. Media Processing Unit(MPU) for Timed data 4. MMT Hint Fig 4. MMT Hint Sample
(JBE Vol. 22, No. 5, September 2017) MMTP, moof' mdat size Fragment metadata MPU metadata MMTP., MFU Hint Sample Video Sample, MMTP. MMT Hint Track moov, MPU MFU, MFU 4 MMT Hint Sample. MFU Hint Sample fragment_sequence_ number. 2. DASH(Dynamic Adaptive Streaming over HTTP) segment DASH segment. 5 DASH segment, DASH segment MPU ISOBMFF. DASH segment segment 5 Initialization segment media segment. Initialization segment. Initialization segment ftyp, MPU ISOBMFF DASH segment. moov. moov mvhd trak mvex. mvhd movie header. trak, mvex movie fragment. media segment, media segment styp, styp segment. sidx, sidx segment. fragment, fragment moof mdat. moof mfra traf. MPU DASH segment ISOBMFF DASH segment MPU.. DASH segment MPU MMTP UHDTV MMTP ROUTE. MMTP ROUTE MPU DASH segment, 5. DASH(Dynamic Adaptive Streaming over HTTP) Fig 5. Structure of DASH(Dynamic Adaptive Streaming over HTTP)
2 : MMT DASH MMTP DASH segment (Hyomin An et al.: Method of Delivering DASH Segments based on MMTP for Re-use of DASH Contents under MMT Broadcasting Environment) MMTP, ROUTE MMTP DASH segment. DASH segment MMTP DASH segment MPU, MMTP MPT message. DASH segment MPU MMTP 3.1, 3.2 DASH segment MPU. 3.3 MMTP MPT message. 1. DASH segment MPU MMTP DASH segment MPU MMTP. 6 DASH segment MPU MMTP, DASH segment MPU Generator DASH segment mmpu', MMT Hint trak MPU. DASH segment MPU 3.2. DASH segment MPU MPT message. MPT message 3.3. MPU MPT message MMTP Packetizer MMTP Packet. MMTP 3.4. 2. DASH segment MPU DASH segment MPU. 7, 2.1, MPU ftyp, mmpu, moov, moof, mdat. ftyp brand name DASH segment MPU. mmpu MPU Asset ID sequence number MPU MPU. moov DASH segment MPU, Timescale, MPU moov MMT Hint trak MPU moov. MMT Hint track 'mmth, packet ID MPU MFU timed non-timed. styp sidx DASH segment, moof MPU, mdat media sample DASH segment Hint sample. 6. DASH segment MPU MMTP Fig 6. System structure of delivering DASH segments over MMTP
(JBE Vol. 22, No. 5, September 2017) 7. DASH segment MPU Fig 7. Structure of conversion from DASH segment to MPU 3. MMTP MMTP. 8 MMTP. MMTP MMTP packet header payload data MMTP payload header. MMTP payload header DU header. MMTP packet header V MMTP header, header V=0. type payload, 0 MPU, 1, 2 signaling message, 3 repair symbol. type 0, packet_id Asset, timestamp UTC. UTC, 1972 1 1. packet_sequence_number packet_id packet, MMTP packet. header_extension source FEC payload ID. MMTP payload header length length payload. FT fragment, FT 0 MPU metadata, 1 Movie fragment metadata, 2 MFU. timed FT 2 8. MMTP Fig 8. Structure of MMTP
2 : MMT DASH MMTP DASH segment (Hyomin An et al.: Method of Delivering DASH Segments based on MMTP for Re-use of DASH Contents under MMT Broadcasting Environment). f_i payload fragment, f_i 0, 1 fragment, 2 fragment fragment, 3 fragment. MPU_sequence_number MPU fragment sequence number, DU header movie_fragment_sequence_number movie fragment sequence number, sample_number MFU sample sample number. 4. MPT message MPT message. 1 MPT message MP table, Asset Asset ID Asset Asset. MPT message MP table table_id table MP table, version MP table. length MP table, number of assets Asset., identifier_mapping() Asset ID,, byte Asset, asset_location Asset, asset_descriptors Asset descriptor. MPU Timestamp Descriptor. MPU Timestamp Descriptor Asset MPU [2]. 1. MP table Table 1. MP table Syntax syntax Value no. of bits. MP_table(){ table_id version length... number_of_assets for(i=0; i<n1; i++){ Identifier_mapping() asset_type... asset_location{ location_count for(i=0; i<n2; i++){ MMT_general_location_info() } } asset_descriptors{ asset_descriptors_length for(j=0; j<n3; j++){ asset_descriptors_byte } } } } N1 N2 N3 8 8 16 8 32 8 16 8 DASH segment MPU MPU Generator MPU. 8 DASH segment. 9.(a) ISOBMFF ftyp, moov Initialization segment, 9.(b) styp, sidx, moof, mdat media segment. 10(a) DASH segment moov, 10(b) DASH segment MPU moov. moov moov,. 11(a) DASH segment moof, 11(b) DASH segment MPU moof. moof moof,.
6 55 방송공학회논문지 제22권 제5호, 2017년 9월 (JBE Vol. 22, No. 5, September 2017) 그림 9. DASH segment Fig 9. DASH segment 그림 10. DASH segment 와 생성된 MPU moov 박스 Fig 10. moov box of DASH segment and generated MPU
안효민 외 2인: 방송을 위한 MMT 환경에서의 DASH 콘텐츠 사용을 위한 MMTP 기반 DASH segment 전송 방안 (Hyomin An et al.: Method of Delivering DASH Segments based on MMTP for Re-use of DASH Contents under MMT Broadcasting Environment) 557 그림 11. DASH segment 와 생성된 MPU moof 박스 Fig 11. moof box of DASH segment and generated MPU 아래 그림 12는 DASH segment를 MPU Generator를 통 하여 생성한 MPU 파일을 보여준다. 그림 12(a)는 brand 타 name으로 ISOBMFF를 기반으로 한 MPU 파일임을 나 박 내는 fytp 스를 생성한 것을 확인할 수 있다. 또한 박 확인할 수 있다. 그림 12(b)는 moov 박스에 MMT Hint track이 생성 된 것을 확인할 수 있다. 그림 12(c)는 hint sample이 생성되어 mdat 박스에 포함된 것을 확인할 수 있다. mmpu 스를 생성한 것을 그림 13은 생성된 MPU의 정보를 이용하여 MPT mes- sage를 생성한 그림이다. 생성된 MPT message는 하나의 확인할 수 있다. 해당 Asset 은 UDP/IP의 주소와 포트넘버가 존재 하는 것을 확인할 수 Asset으로 구성되어 있는 것을 있다. 그림 14은 UDP/IP를 통하여 MMTP Packet을 전송하고 다른 컴퓨터를 이용하여 전송 받아 player로 영상을 확인한 그림이다. 그림 14(a)는 UDP/IP를 통하여 MMTP Packet을 확인할 수 있는 그림이다. 그림 14(b)는 UDP/IP를 통해 전송한 MMTP Packet을 다른 컴퓨터에서 받았음을 확인할 수 있는 그림이다. 14(c)는 UDP를 통해 전송 받은 전송을 그림 12. DASH segment를 통하여 생성한 MPU Fig 12. Generated MPU through DASH segment
(JBE Vol. 22, No. 5, September 2017) 13. MPT message Fig 13. Generated MPT message 14. UDP MMTP Fig 14. Delivery MMTP Packet over UDP MMTP Packet UDP/IP player. 14(d) player MMTP packet.. DASH segment MPU MMTP. DASH segment MPU MPU generator, MPU MMTP MPU player. DASH segment MPU MMTP..
2 : MMT DASH MMTP DASH segment (Hyomin An et al.: Method of Delivering DASH Segments based on MMTP for Re-use of DASH Contents under MMT Broadcasting Environment) (References) [1] ISO/IEC 13818-1, Information technology Generic coding of moving pictures and associated audio information: Systems, Third Edition, 2007. [2] MinKyu Park, Yong Han Kim, An Overhead Comparison of MMT and MPEG-2 TS in Broadcast Services, Journal of Broadcast Engineering, Vol. 21, No. 3, pp.436-449, May, 2016. [3] ISO/IEC 23008-1, Information technology High efficiency coding and media delivery in heterogeneous environments Part 1: MPEG media transport (MMT), June 2014. [4] Y. Lim, K. Park, J. Y. Lee, S. Aoki, and G. Fernando, MMT: Anemerging MPEG standard for multimedia delivery over the internet, IEEE Multimedia, vol. 20, no. 1, pp. 80-85, Jan./Mar. 2013. [5] YeJin Sohn, MinJu Cho, JongHo Paik, Design of MMT-based Broadcasting System for UHD Video Streaming over Heterogeneous Networks, Journal of Broadcast Engineering, Vol.20 No.1, pp.16-25, January 2015. [6] ISO/IEC 23009-1, Information technology Dynamic adaptive streaming over HTTP(DASH) Part 1: Media presentation description and segment formats, February 2015. [7] MinKyu Park, Yong Han Kim, MMT-based Broadcasting Services Combined with MPEG-DASH, Journal of Broadcast Engineering, Vol. 20, No. 2, pp. 283-299, May, 2015. [8] TTAK.KO-07.0127/R1, Standard of Transmission and Reception for Terrestrial UHDTV Broadcasting Service, 2016. [9] H. Oh, H. Yim, S. Kim, B. Bae, H. M. Kim, System Interface Structure designed for IP based Broadcasting Services, Proceeding of the summer Conference of The Korean Institute of Communications and Information Sciences, pp. 679-680, 2016. [10] KOREA.net, Korea ushers in UHD broadcasts, http://www.korea. net/newsfocus/sci-tech/ view?articleid= 146764. (2017.6.1.) [11] S.H. Park, K.M. Park, D.Y. Seo, K.H. Kim, Implementation of media contents delivery and consumption platform using MPEG Media Transport considering real-time IP broadcasting environment, Telecommunication Review, pp. 627-641, 2014. [12] ISO/IEC 14496-12, Coding of audio-visual objects Part 12: ISO base media file format, Febrauary 2015. [13] Y. Lim, MMT, Next Generation Broadcasting and Internet Multimedia Broadcasting Service, The Korean Institute of Communications and Information Sciences, vol. 30, No.5, pp. 11-17, 2013. - 2015 8 : ( ) - 2015 ~ : - ORCID : http://orcid.org/0000-0003-3774-2916 - :,, - 2016 : ( ) - 2016 ~ : - ORCID : http://orcid.org/0000-0002-5054-9929 - :,, - 1989 2 : - 1992 9 : University of Newcastle upon Tyne - 1996 7 : University of Newcastle upon Tyne - 1996 ~ 1997 : University of Sheffield, Research Fellow - 1997 ~ 2006 : - 2006 ~ : - ORCID : http://orcid.org/0000-0003-1553-936x - :,,