2 : UHD MMT/ROUTE (Doohwan Kim et al.: Broadband Content Insertion Technology based on Terrestrial UHD Broadcasting MMT/ROUTE) (Regular Paper) 24 2, 2

Size: px

Start display at page:

Download "2 : UHD MMT/ROUTE (Doohwan Kim et al.: Broadband Content Insertion Technology based on Terrestrial UHD Broadcasting MMT/ROUTE) (Regular Paper) 24 2, 2"

담 제
4 years ago
Views:

1 2 : UHD MMT/ROUTE (Doohwan Kim et al.: Broadband Content Insertion Technology based on Terrestrial UHD Broadcasting MMT/ROUTE) (Regular Paper) 24 2, (JBE Vol. 24, No. 2, March 2019) ISSN (Online) ISSN (Print) UHD MMT/ROUTE a), b), a) Broadband Content Insertion Technology based on Terrestrial UHD Broadcasting MMT/ROUTE Doohwan Kim a), Dongkwan Lee b), and Kyuheon Kim a) UHD(Ultra-High Definition) AV(Audio-Video).,,.. UHD DASH(Dynamic Adaptive Streaming over HTTP)/ROUTE(Real time Object delivery Over Unidirectional Transport) MMT(MPEG Media Transport) ATSC (Advanced Television Systems Committee) 3.0 Event Signaling.,. Abstract Recently, broadcasting technologies have evolved as high-quality AV services such as domestic terrestrial UHD(Ultra-High Definition) broadcasting have been increasing, and broadcasting standards have been newly defined. Also, as network technology develops, contents are consumed not only in the country but also the world. Accordingly, content insertion technology, which is a method of providing suitable contents in accordance with the national and local environments, will be needed. This paper proposes a content insertion service system model and synchronization scheme using ATSC(Advanced Television Systems Committee) 3.0 Event Signaling standard under heterogeneous network environment of broadcasting network and internet network based on transmission standard DASH(Dynamic Adaptive Streaming over HTTP)/ROUTE(Real time Object delivery Over Unidirectional Transport) and MMT(MPEG Media Transport) of terrestrial UHD broadcasting. It also verifies that the service operates in an environment that meets the broadcast standard. Keyword : MPU, MMTP, DASH Segment, ROUTE, ISOBMFF Copyright 2019 Korean Institute of Broadcast and Media Engineers. All rights reserved. This is an Open-Access article distributed under the terms of the Creative Commons BY-NC-ND ( which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited and not altered.

2 (JBE Vol. 24, No. 2, March 2019). TV UHD , UHD [1][2] TV ATSC ATSC 3.0. UHD [3] DASH/ROUTE MMT, TCP(Transmission Control Protocol)/IP (Internet Protocol) DASH., UHD. [4],.,..,. ATSC 3.0 Event Signaling [5][6]., a) (Kyung Hee University Electronic Information University) b) (MBC) Corresponding Author : (Kyuheon Kim) kyuheonkim@khu.ac.kr Tel: ORCID: [ , UHD Dynamic Media, ] This Paper was conducted as a part of the information communication and broadcasting research and development project of the future creation science department and information and communication technology promotion center. [ , Development of intelligent dynamic media based on UHD broadcasting contents, distribution and consumption technology] Manuscript received January 21, 2019; Revised March 15, 2019; Accepted March 15, , DASH/ROUTE MMT [7].. UHD DASH/ ROUTE MMT, Event Signaling, DASH/ ROUTE MMT,,,.. DASH [2][9],, DASH Segment ISOBMFF(ISO Base Media File Format) [8], Initialization Segment Media Segment. Initialization Segment Initialization Segment. Media Segment Fragment,., Segment MPD(Media Presentation Description) [2][9]. MPD,. MPD Period,. Period Adaptation Set, /,,

3 2 : UHD MMT/ROUTE (Doohwan Kim et al.: Broadband Content Insertion Technology based on Terrestrial UHD Broadcasting MMT/ROUTE). Adaptation Set Representation,, Segment URL. Representation Segment List, Segment Template, Segment Base Information. ROUTE[3] DASH FLUTE(File Delivery over Unidi- rectional Transport), TV. MMT [1][3],,,,,. MMT function Encapsulation function, Delivery function, Signaling function. Encapsulation function Package, ISOBMFF MPU(Media Processing Unit). Delivery function,.,, MMTP(MPEG Media Transport Protocol). MMTP IP. Signaling function, Encapsulation function Delivery function, Signaling Signaling Message., MMT ATSC 3.0 Signaling Message [3][5] UHDTV. MMT ATSC 3.0 Signaling Message message_id 0x8100, message payload data atsc_message_content_ type.. DASH/ROUTE MMT Event Signaling /,.,. 1. DASH/ROUTE DASH/ROUTE. MPD Period Eventstream. 1. Eventstream Table 1. Semantics of Eventstream Element or Attribute Name Use Description Eventstream specifies event Mandatory URN or URL syntax. When used as URL, specify it as an Internet Optional Defined by the owner of the scheme identified in A time unit used to derive different real-time period values from an event element. Optional Event presentation time associated with the start of the Period element, initialized to '0' if the value does not Optional Event play time, unknown if value does not Optional Event identifiers, events with equal content in an event element, and events with attribute values have the same value.

4 (JBE Vol. 24, No. 2, March 2019) < 1> MPD Eventstream, schemeiduri MPD URL, Value, timescale, presentationtime, duration. 2. DASH/ROUTE DASH/ROUTE. emsg, MPD Adaptation Inband_event_stream Media segment emsg. 2. Inband_Event_stream Table 2. Semantics of Inband_event_stream Element or Attribute Name Use Mandatory Optional Description specifies event Stream URN or URL syntax. When used as URL, specify it as an Internet location. Defined by the owner of the scheme identified in attribute. < 2> MPD Inband_event_stream, SchemeIdUri, value. 3. emsg Table 3. Syntax of emsg box Syntax No. of bits Mnemonic scheme_id_uri value string string timescale 32 uimsbf presentation_time_delta 32 uimsbf event_duration 32 uimsbf id 32 uimsbf < 3> 'emsg', schemeiduri MPD URL, Value, timescale, presentation _time_delta, duration. emsg Media Segment styp moof. 3. MMT MMT 4. AEI Table 4. Semantics of AEI Element or Attribute Name Use Description AEI Specifies event Mandatory Identifier of MMT asset for time Mandatory Sequence number of anchor MPU for time Mandatory Presentation time of Anchor MPU Mandatory URN or URL syntax. When used as URL, specify it as an Internet Optional Defined by the owner of the scheme identified in A time unit used to derive different real-time period values from an event element. Optional Event presentation time associated with the start of the Period element, initialized to '0' if the value does not Optional Event play time, unknown if value does not Optional Event identifiers, events with equal content in an event element, and events with attribute values have the same value.

5 2 : UHD MMT/ROUTE (Doohwan Kim et al.: Broadband Content Insertion Technology based on Terrestrial UHD Broadcasting MMT/ROUTE). AEI (Application Event Information). < 4> AEI, assetid Identifier, mpuseqnum MPU number, timestamp MPU, schemeiduri MPD URL, Value, timescale, presentationtime, duration. 4. MMT MMT. evti 5. Inband_event_descriptor Table 5. Syntax of Inband_event_descriptor Syntax Value No. of Bits Format Inband_event_descriptor() { descriptor_tag 16 unmsbf descriptor_length 16 unmsbf number_of_assets N1 8 unmsbf for (i=0;i<n1;i++) { asset_id_length N2 32 unmsbf for (j=0;j<n2;j++) { asset_id_byte 8 unmsbf } scheme_id_uri_length N3 8 unmsbf for (j=0;j<n3;j++) { scheme_id_uri_byte 8 unmsbf } event_value_length N4 8 unmsbf for (j=0;j<n4;j++) { event_value_bytes 8 unmsbf } } }, Inband_event_descriptor MPU evti. < 5> Inband_event_descriptor, Descriptor _tag, number_of_assets. 6. evti Table 6. evti box structure Syntax No. of bits Mnemonic scheme_id_uri value string string timescale 32 uimsbf presentation_time_delta 32 uimsbf event_duration 32 uimsbf id 32 uimsbf < 6> 'evti', schemeiduri MPD URL, Value, timescale, presentation_ time_delta, duration. 'evti' MPU 'ftyp' 'mmpu'. 5. < 1>, (MPD Eventstream, AEI) Event Presentation Time, Event Duration Time, Event Timescale Event Start Time, Event End Time.

6 (JBE Vol. 24, No. 2, March 2019) 1. Fig. 1. Synchronization of static event 2. Fig. 2. Synchronization of dynamic event (1), Event Start Time Anchor Presentation Time (Anchor MPU Presentation Time, Anchor MPD Period Time) Event Presentation Time Event Timescale. (2), Event Start Time Event Duration Time Event Timescale (3), Event Start Time Anchor Presentation Time( evti MPU Presentation Time, emsg Segment Presentation Time) Event Delta Time Event Timescale. (2). 3. Fig. 3. Flowchart of Event Algorithm < 3>,

7 2 : UHD MMT/ROUTE (Doohwan Kim et al.: Broadband Content Insertion Technology based on Terrestrial UHD Broadcasting MMT/ROUTE).,.. DASH/ROUTE MMT.. 1. DASH/ROUTE < 4> DASH/ROUTE, DASH/ROUTE ISOBMFF Reading Module., UI(User Interface) Signaling message 'emsg'. ISOBMFF Reading Module, Segment ISOBMFF Writing Module DASH Segment. DASH dissolver 4. DASH/ROUTE Fig. 4. DASH/ROUTE server system model 5. DASH/ROUTE Fig. 5. DASH/ROUTE Client system model

8 (JBE Vol. 24, No. 2, March 2019) DASH Segment Fragments ROUTE Packet generating subsystem. RF RF UDP. < 5> DASH/ROUTE, ROUTE/DASH ROUTE, DASH Rebuilder DASH Segment, Signaling Message. Sample Pick-up module,. 'emsg' Signaling message, HTTP Request module MPD DASH segment -2, HTTP Response Receiver MPD DASH Segment.,. 2. MMT < 6> MMT 6. MMT Fig. 6. MMT sever system model 7. MMT Fig. 7. MMT Client system model

, UI (User Interface) Signaling message 'evti'. ISOBMFF Reading Module, MPU ISOBMFF Writing Module MPU.

< 7> MMT, MMT MMTP, MMT Rebuilder MPU, Signaling Message. Sample Pick-up module,.

9 2 : UHD MMT/ROUTE (Doohwan Kim et al.: Broadband Content Insertion Technology based on Terrestrial UHD Broadcasting MMT/ROUTE), MMT ISOBMFF Reading Module., UI (User Interface) Signaling message 'evti'. ISOBMFF Reading Module, MPU ISOBMFF Writing Module MPU. MMT dissolver MPU MPU Fragments(MPU metadata, Fragment metadata, MFUs) MMTP Packet generating subsystem. RF RF UDP. < 7> MMT, MMT MMTP, MMT Rebuilder MPU, Signaling Message. Sample Pick-up module,. 'evti' Signaling message, HTTP Request module MPD DASH segment -2, HTTP Response Receiver MPD DASH Segment.,..,.. (IDE) Visual Studio 2013 C++. HTTP hfs(http File Server). 100Mbps, UDP 21002, HTTP MPD Eventstream & DASH Segment Fig. 8. Example of MPD Eventstream & DASH Segment 9. MPD Inband_event_stream & DASH Segment Fig. 9. Example of MPD Inband_event_stream & DASH Segment

' ' MPD Inband_event_stream, DASH Segment emsg media Segment. 2. DASH/ROUTE Player < 10> ROUTE/DASH Player UDP ROUTE. /. 3.

10 (JBE Vol. 24, No. 2, March 2019) 1. DASH/ROUTE Generator < 8> DASH/ROUTE Generator MPD DASH Segment. ' ' MPD Eventstream, DASH Segment Media Segment. < 9> DASH/ROUTE Generator MPD DASH Segment. ' ' MPD Inband_event_stream, DASH Segment emsg media Segment. 2. DASH/ROUTE Player < 10> ROUTE/DASH Player UDP ROUTE. /. 3. MMT Generator < 11> MMT Generator AEI 10. DASH/ROUTE Player Fig. 10. Running Window of DASH/ROUTE Player 11. AEI & MPU Fig. 11. Example of AEI & MPU 12. Inband_event_descriptor & MPU Fig. 12. Example of Inband_event_descriptor & MPU

2 : UHD MMT/ROUTE (Doohwan Kim et al.: Broadband Content Insertion Technology based on Terrestrial UHD Broadcasting MMT/ROUTE) 13. MMT Player Fig. 13. Running Window of MMT Player MPU. ' ' AEI, MPU.

11 2 : UHD MMT/ROUTE (Doohwan Kim et al.: Broadband Content Insertion Technology based on Terrestrial UHD Broadcasting MMT/ROUTE) 13. MMT Player Fig. 13. Running Window of MMT Player MPU. ' ' AEI, MPU. < 12> MMT Generator Inband_ event_descriptor MPU. Event ' ' Inband_event_descriptor, MPU evti MPU.,.. 4. MMT Player < 13> MMT Player UDP MMTP. /.. /. DASH/ROUTE MMT (References) [1] ISO/IEC , Information Technology - High efficiency coding and media delivery in heterogeneous environments - Part 1:MPEG Media Transport(MMT), 2014 [2] ISO/IEC :2014 (Second edition), Information technology Dynamic adaptive streaming over HTTP (DASH) Part 1: Media presentation description and segment formats, 2014 [3] TTAK.KO /R1, "Terrestrial UHD Broadcasting Transmission and Reception - Part 3 Systems", Korea Information and Communications Technology Association, [4] ITU-R BT (2016), Intergrated broadcastbroadband [5] A/337:2018, ATSC : "Application Signaling", Advanced Television System Committee, , from [6] TTAK.KO /R1, "Terrestrial UHD IBB Part 2 App Signaling", Korea Information and Communications Technology Association, pp , [7] A/331:2017, ATSC : ATSC Candidate Standard: Signaling, Delivery, Synchronization and Error Protection, Advanced Television System Committee, from [8] ISO/IEC MPEG-4 Part 12, ISO base media file format,

(JBE Vol. 24, No. 2, March 2019) [9] MPEG DASH Industry Forum, Guidelines for Inplementation: DASH-IF Interoperability Points, Retrieved April.09, 2018, from http://dashif.

462-472, 2017, https://doi.org/10.5909/jbe.2017.22.4.462 (accessed July. 07, 2017) - 2016 2 : - 2018 2 : - 2018 3 ~ : - ORCID : https://orcid.

12 (JBE Vol. 24, No. 2, March 2019) [9] MPEG DASH Industry Forum, Guidelines for Inplementation: DASH-IF Interoperability Points, Retrieved April.09, 2018, from [10] Haejun Jung, Chanyeong Kim, Juyeong Yoo, Design and Implementation of a Model for ProvidingDynamic Linkage Service in UHDTV Broadcasting Standard, The Korean Society of Broadcast and Media Engineers, pp , [11] Dongjin Kang, Jeonho Kang, Kyuheon Kim, "Method of inserting In-program Ads in Hybrid Broadcasting Environment, The Korean Society of Broadcast and Media Engineers, Vol. 22, No. 4, pp , 2017, (accessed July. 07, 2017) : : ~ : - ORCID : - :, : ~ 2015 : ~ 2015 : / / DTV S/W ~ : ( ) ~ : UHD - ORCID : - : UHDTV,, Tiviva : : University of Newcastle upon Tyne : University of Newcastle upon Tyne ~ 1997 : University of Sheffield, Research Fellow ~ 2006 : ~ : - ORCID : - :,,

2 : MMT DASH MMTP DASH segment (Hyomin An et al.: Method of Delivering DASH Segments based on MMTP for Re-use of DASH Contents under MMT Broadcasting

2 : MMT DASH MMTP DASH segment (Hyomin An et al.: Method of Delivering DASH Segments based on MMTP for Re-use of DASH Contents under MMT Broadcasting (JBE Vol. 22, No. 5, September 2017) (Special Paper) 22 5, 2017 9 (JBE Vol. 22, No. 5, September 2017) https://doi.org/10.5909/jbe.2017.22.5.548 ISSN 2287-9137 (Online) ISSN 1226-7953 (Print) MMT DASH