(JBE Vol. 25, No. 5, September 2020) (Regular Paper) 25 5, 2020 9 (JBE Vol. 25, No. 5, September 2020) https://doi.org/10.5909/jbe.2020.25.5.758 ISSN 2287-9137 (Online) ISSN 1226-7953 (Print) IBB a), a), b), c), c), a) Content Insertion Method using by Frame Control based on Terrestrial IBB Service Junsik Kim a), Sunghwan Park a), Doohwan Kim b), Jaehwan Joo c), Sangjin Kim c), and Kyuheon Kim a).,,.., UHD, UHD.,. Abstract Hybrid broadcasts utilizing heterogeneous networks can provide not only uniform broadcasting services but also various services using broadcast networks and communication networks. In particular, as content is consumed in various countries and regions, demands for personalized services continue to increase, and research on content insertion technology utilizing heterogeneous networks has been actively conducted. The most important technical challenge when inserting content based on heterogeneous networks is that the start of the inserted content, which replaces the original broadcast content at the time of content insertion, should proceed smoothly, and it must be able to accurately return to the original broadcast content. Currently, UHD broadcasting is converted to digital. However, since there is a system that supports the frame rate used in the analog method, when content insertion occurs in a conventional UHD broadcasting service, there is a problem in decoding the broadcast and inserted content. Since the replacement cost of the broadcasting system is astronomical, this paper proposes a content insertion method using by frame control that can support analog methods without replacing transmission equipment. Keyword : IBB, MMTP, ROUTE, ATSC, ISOBMFF Copyright 2020 Korean Institute of Broadcast and Media Engineers. All rights reserved. This is an Open-Access article distributed under the terms of the Creative Commons BY-NC-ND (http://creativecommons.org/licenses/by-nc-nd/3.0) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited and not altered.
5 : IBB 759 (Junsik Kim et al.: Content Insertion Method using by Frame Control based on Terrestrial IBB Service). TV 4K Ultra High Definition(UHD). UHD [1] TV Advanced Television System Committee(ATSC) [2], ATSC 3.0 UHD,, [3]., [4][5]., [6][7].. [5]. National Television System Committee(NTSC) a) (Kyung Hee University Electronic Information University) b) (TTA Software Testing & Certification Laboratory) c) SBS (SBS Media Tech. R&D Center) Corresponding Author : (Kyuheon Kim) E-mail: kyuheonkim@khu.ac.kr Tel: +82-2-201-3810 ORCID: https://orcid.org/0000-0002-7673-652x This work was supported by Institute of Information & communications Technology Planning & Evaluation(IITP) grant funded by the Korea government(msit) (No.2018-0-00761, Development of ATSC3.0 based dynamic targeted advertisement platform and service technology). Manuscript received June 12, 2020; Revised September 9, 2020; Accepted September 9, 2020., 29.97 59.94. 56 60, 60 1.001., 1.001.,,., UHD., UHD Integrated Broadcast Broadband(IBB) [8].. IBB,.., V.. UHD,.,.
(JBE Vol. 25, No. 5, September 2020) 1. AEI [8] Table 1. Semantics of AEI [8] Element or Attribute Name Use Description AEI Specifies event Stream @assetid Mandatory Identifier of MMT asset for time reference @mpuseqnum Mandatory Sequence number of anchor MPU for time reference @timestamp Mandatory Presentation time of Anchor MPU Eventstream @schemeiduri Mandatory URN or URL syntax. When used as URL, specify it as an Internet location. @value Optional Defined by the owner of the scheme identified in the @schemeiduri attribute. @timescale A time unit used to derive different real-time period values from an event element. Event @presentationtime Optional Event presentation time associated with the start of the Period element, initialized to '0' if the value does not exist. @duration Optional Event play time, unknown if value does not exist. @id Optional Event identifiers, events with equal content in an event element, and events with attribute values have the same value.. URL,,. IBB MPEG Media Transport(MMT) [7] Real time Object delivery Over Uni- directional Transpor(ROUTE)/Dynamic Adaptive Streaming over HTTP(DASH) [8] Event Signaling /. 1. MMT Event Signaling MMT. MMT MMT ATSC 3.0 Message AEI (Application Event Information). < 1> AEI, assetid, mpuseqnum MPU, timestamp MPU, schemeiduri MPD URL, Value, timescale, presentationtime, duration. MMT evti box, MMT ATSC 3.0 Message Inband_event_descriptor MPU evti. < 2> Inband_ event_descriptor, Descriptor_tag, number_of_ assets. 2. Inband_event_descriptor [8] Table 2. Syntax of Inband_event_descriptor [8] Syntax Value No. of Bits Format Inband_event_descriptor() { descriptor_tag 16 unmsbf descriptor_length 16 unmsbf number_of_assets N1 8 unmsbf for (i=0;i<n1;i++) { asset_id_length N2 32 unmsbf for (j=0;j<n2;j++) { asset_id_byte 8 unmsbf } scheme_id_uri_length N3 8 unmsbf for (j=0;j<n3;j++) { scheme_id_uri_byte 8 unmsbf } event_value_length N4 8 unmsbf for (j=0;j<n4;j++) { event_value_bytes 8 unmsbf } } }
5 : IBB 761 (Junsik Kim et al.: Content Insertion Method using by Frame Control based on Terrestrial IBB Service) 3. evti [8] Table 3. evti box structure [8] Syntax No. of bits Mnemonic scheme_id_uri value string string timescale 32 uimsbf presentation_time_delta 32 uimsbf event_duration 32 uimsbf id 32 uimsbf < 3> 'evti', schemeiduri MPD URL, Value, timescale, presentation_ time_delta, duration. 'evti' MPU 'ftyp' 'mmpu'. 2. ROUTE/DASH Event Signaling ROUTE/DASH. ROUTE/DASH XML(Extensible Markup Language) MPD(Media Prensen- tation Description) Eventstream. < 4> MPD Eventstream, schemeiduri MPD URL, Value, timescale, presentationtime, duration. ROUTE/DASH emsg box, MPD Adaptation Inband_event_stream Media segment emsg. 4. Eventstream [8] Table 4. Semantics of Eventstream [8] Element or Attribute Name Use Description Eventstream @schemeiduri Mandatory specifies event Stream URN or URL syntax. When used as URL, specify it as an Internet location. @value Optional Defined by the owner of the scheme identified in the @schemeiduri attribute. @timescale Event @presentationtime Optional A time unit used to derive different real-time period values from an event element. Event presentation time associated with the start of the Period element, initialized to '0' if the value does not exist. @duration Optional Event play time, unknown if value does not exist. @id Optional Event identifiers, events with equal content in an event element, and events with attribute values have the same value. 5. Inband_Event_stream [8] Table 5. Semantics of Inband_event_stream [8] Element or Attribute Name Use Description Inband_event_stream @schemeiduri @value Mandatory Optional specifies event Stream URN or URL syntax. When used as URL, specify it as an Internet location. Defined by the owner of the scheme identified in the @schemeiduri attribute.
(JBE Vol. 25, No. 5, September 2020) < 5> MPD Inband_event_stream, SchemeIdUri, Value. 6. emsg [8] Table 6. Syntax of emsg box [8] Syntax No. of bits Mnemonic scheme_id_uri value string string timescale 32 uimsbf presentation_time_delta 32 uimsbf event_duration 32 uimsbf id 32 uimsbf < 6> 'emsg', schemeiduri MPD URL, Value, timescale, presentation_time_delta, duration. emsg styp moof.. UHD, UHD.,. UHD,. 1. National Television System Committee(NTSC), 29.97 59.94. UHD 56 60.,,. 1 2. 1 59.94fps, Group of Pictures(GoP) 60. duration 60 59.94fps, 1.001., DASH 1. DASH Media Segment 2 Fig. 1. An example in which two broadcast programs are included in one DASH Media Segment
5 : IBB 763 (Junsik Kim et al.: Content Insertion Method using by Frame Control based on Terrestrial IBB Service) 2..,,.,.,,.,.,,. I-,,. 2 UHD, 2 (a), 610th DASH. 600 610, 610th DASH I-. I-, 610th DASH (P-, B- ), 2 (b). 610th DASH, UHD TV. 2. 2. Fig. 2. Example of content insertion
(JBE Vol. 25, No. 5, September 2020) IBB 3., ROUTE. ROUTE/ DASH De-Packetizer ROUTE DASH. DASH ROUTE/DASH Rebuilder DASH. DASH DASH Receiver DASH Parser., MPD emsg [3]. 3. Fig. 3. Frame control based content insertion receiver model 4. Fig. 4. Example of non-playing frame control method
5 : IBB 765 (Junsik Kim et al.: Content Insertion Method using by Frame Control based on Terrestrial IBB Service).,.,. < 4> Video Decoder,. DASH Parser Module Access Unit(AU) Coded Picture Buffer(CPB), CPB Decoding Module. Decoded Picture Buffer(DPB), DPB Display Module, Display Module Clear., DPB Frame Drop Module Clear., DASH I-,. < 5>..,,., Coded Picture Buffer. Coded Picture Buffer Decoding Module, Decoding Module Decoded Picture Buffer. Renderer,,. Clear, Renderer., 5. Fig. 5. Flowchart of non-playing frame control method
(JBE Vol. 25, No. 5, September 2020). Decoding Module,.. UHD. (IDE) Visual Studio 2017 C++. HTTP hfs(http File Server), FFmpeg., 60, 1.66msec., 5. < 6> DPB., DPB ( ).,,. 6. Fig. 6. Decoding result by using the frame control based content insertion receiver 7. Fig. 7. Content insertion result by using the frame control based content insertion receiver
5 : IBB 767 (Junsik Kim et al.: Content Insertion Method using by Frame Control based on Terrestrial IBB Service) 5, DPB 6., DPB, < 6>. < 7> (a) ROUTE Packet Generator Graphical User Interface(GUI). < 7> (a),, 16., 10. ROUTE Packet Generator UHD < 7> (b) Player. Player, MPD < 7> (c) HTTP.. < 7> (d),..,.,., UHD...,,,. (References) [1] TTAK.KO-07.0127/R1, "Terrestrial UHD Broadcasting Transmission and Reception - Part 3 Systems", Korea Information and Communications Technology Association, 2016. [2] ATSC: ATSC Candidate Standard: Service Announcement, Doc. A/332, Advanced Television Systems Committee, Washington, D.C., 30 August 2016. [3] Yong Suk Kim, Jae Hyun Seo, Bong Ho Lee, Heung Mook Kim, Implementation of UHD Broadcasting Receiver Based on ATSC 3.0 Standards, JOURNAL OF BROADCAST ENGINEERING, Vol. 23, No. 6, pp.790-799, 2018. [4] Kugjin Yun, Won-Sik Cheonga, Jinyoung Lee, Kyuheon Kim, Design and Implementation of Hybrid Network Associated 3D Video Broadcasting System, JOURNAL OF BROADCAST ENGINEER- ING, Vol. 19, No. 5, pp.687-698, 2014. [5] JaeWon Moon, Tae-Beom Lim, SeungWoo Kum, YoonSeok Nam, Sangwon Lee, Design and Implementation of Platform Providing Adaptive Contents based on IBB Companion Screen Service, JOURNAL OF BROADCAST ENGINEERING, Vol. 22, No. 1, pp.95-106, 2017. [6] Doohwan Kim, Dongkwan Lee, Kyuheon Kim, Broadband Content Insertion Technology based on Terrestrial UHD Broadcasting MMT/ROUTE, JOURNAL OF BROADCAST ENGINEERING, Vol. 24, No. 2, pp.329-340, 2019. [7] Dongjin Kang, Jeonho Kang, Kyuheon Kim, "Method of insertingin-program Ads in Hybrid Broadcasting Environment, JOURNAL OF BROADCAST ENGINEERING, Vol. 22, No. 4, pp.462-472, 2017. [8] TTAK.KO-07.0128/R1, " UHD IBB ",, 2016. [9] ISO/IEC 23008-1:2017 (Second edition), "High efficiency coding and media delivery in heterogeneous environments MPEG-H Part 1: MPEG Media Transport (MMT)", 2017. [10] ISO/IEC 23009-1:2014 (Second edition), Information technology Dynamic adaptive streaming over HTTP (DASH) Part 1: Media presentation description and segment formats, 2014.
768 방송공학회논문지 제25권 제5호, 2020년 9월 (JBE Vol. 25, No. 5, September 2020) 저자소개 김준식 - 년 2월 : 경희대학교 전자공학과 공학사 년 2월 : 경희대학교 전자공학과 공학석사 년 3월 ~ 현재 : 경희대학교 전자공학과 박사과정 : https://orcid.org/0000-0002-0287-9640 주관심분야 : 영상처리, 멀티미디어 시스템, 포인트 클라우드 압축, 디지털 대화형 방송 2017 2019 2019 ORCID 박성환 - 년 2월 : 한국외국어대학교 디지털정보공학과 공학사 년 2월 : 경희대학교 전자공학과 공학석사 년 3월 ~ 현재 : 경희대학교 전자공학과 박사과정 : https://orcid.org/0000-0001-8554-745x 주관심분야 : 영상처리, 멀티미디어 시스템 2013 2015 2015 ORCID 김두환 년 월 경희대학교 전자공학과 공학석사 년 월 현재 연구원 주관심분야 멀티미디어 시스템 디지털 대화형방송 - 2020 2 : - 2020 3 ~ : TTA - ORCID : https://orcid.org/0000-0002-6010-274x :, 주재환 - 년 2월 : 연세대학교 전기전자공학과 학사 년 2월 : 연세대학교 전기전자공학과 석사 년 2월 ~ 2015년 3월 : 삼성전자 DMC 연구소 책임연구원 년 4월 ~ 현재 : SBS 미디어기술연구소 연구원 : https://orcid.org/0000-0002-7455-751x 주관심분야 : 차세대 방송/미디어 시스템 및 서비스, 비디오/영상 신호 처리 2007 2009 2009 2015 ORCID 김상진 - 년 2월 : 연세대학교 전기공학과 학사 년 2월 : 연세대학교 전기공학과 석사 년 2월 : 서울과학기술대학교 정보통신미디어공학과 박사 년 2월 ~ 현재 : SBS 미디어기술연구소 소장 년 ~ 현재 : 現 TTA 방송 기술위원회(TC8) 의장 : https://orcid.org/0000-0003-2142-4972 주관심분야 : 차세대 방송/미디어 시스템 및 서비스, 비디오/영상 신호 처리 1989 1991 2018 1991 2016 ORCID
5 : IBB 769 (Junsik Kim et al.: Content Insertion Method using by Frame Control based on Terrestrial IBB Service) - 1989 2 : - 1992 9 : University of Newcastle upon Tyne - 1996 7 : University of Newcastle upon Tyne - 1996 ~ 1997 : University of Sheffield, Research Fellow - 1997 ~ 2006 : - 2006 ~ : - ORCID : http://orcid.org/0000-0003-1553-936x - :,,