1 : (Chang Mo Yang et al.: Online Content Editing System to Edit Broadcasting and Personal Contents) (Regular Paper) 20 4, (JBE Vol. 20, No. 4,

Size: px

Start display at page:

Download "1 : (Chang Mo Yang et al.: Online Content Editing System to Edit Broadcasting and Personal Contents) (Regular Paper) 20 4, (JBE Vol. 20, No. 4,"

유규 옥
4 years ago
Views:

1 (Regular Paper) 20 4, (JBE Vol. 20, No. 4, July 2015) ISSN (nline) ISSN (Print) a), b) nline Content Editing System to Edit Broadcasting and Personal Contents Chang Mo Yang a) and Kwangsue Chung b)..,..,,.,.,.. Abstract In this paper, we propose a new online content editing system to edit the broadcasting and personal contents. The proposed editing system consists of the content management server and the content editor, in which the content management server is used for storing the contents, while the content editor is used for editing the contents via the user interface. Unlike the existing content editing methods which edit the downloaded contents, the proposed editing system edits the contents stored in the content management server while the content editor plays them by using the streaming technology. However, it is not effective to edit the whole segments of contents while playing them by using the streaming technology. To resolve the problem, the proposed editing system performs the scene detection of the contents, and the detected scene information is used for playing and editing of contents. After completing the content editing, the edited information is uploaded to the content management server as a metadata format. In the proposed editing system, both scene and edited information are represented only as the metadata format, and the physical content segmentation according to the scene and edited information is not performed. The implementation results show that the proposed editing system provides similar performances with the existing content editing methods which use the content download and editing methods. Keyword : nline, Content Editing, Editing System, Broadcasting Contents, Personal Contents

2 (JBE Vol. 20, No. 4, July 2015).,, SNS (Social Media Service).,.,,. (Linear editing technology) (Non-linear editing technology) [1-4]. VCR(Video Ca- ssette Recorder) VCR, (Generation loss).. Windows Movie a) (Smart Media Research Center, Korea Electronics Technology Institute) b) (Department of Communications Engineering, Kwangwoon University) Corresponding Author : (Kwangsue Chung) kchung@kw.ac.kr Tel: RCID: ( ) (No. B , (LifeMedia) ). Manuscript received May 30, 2015; Revised July 9, 2015; Accepted July 9, Maker, PotEncoder, VideoPad. Microsoft Windows Movie Maker,,,, Facebook, Youtube, Vimeo, Flickr SNS. Daum Communications Pot- Encoder,,, Tvpot, Cafe, Blog. NCH Software VideoPad,., CD (Compact Disc), DVD(Digital Versatile Disk), (Blu-ray disc) Youtube, Flicker, Facebook SNS.,...,.,, (Scene).

3 , (Segment).. II. III. IV V..,,,,,., [5].,,,. V. Rajgopalan [6]. SIFT(Scale Invariant Feature Transform), SIFT SIFT,. A. Yoshitaka [7] (Motion analysis) (Voice detection),., (Syntax) (Film grammar) (Action scene), (Tension rising scene), (Conversation scene), (Calm scene), (Tension releasing scene).,. I. Song [8] M. Kumano [9] (Shot)., M. Kumano [9] (Loose shot), (Medium shot), (Tight shot). A. Girgensohn [10] (Home video) Hitchcock., Hitchcock Fast pan, Slow zoom,. (Audio transcription). T. Takiguchi [11],. A. uttagarts [12],.

4 (JBE Vol. 20, No. 4, July 2015).,, (bject). S. Lu [13].. E. Bennett [14] Proscenium. Proscenium, (Spatio-temporal volume). X. Guo [15]. (Temporal alignment), (Pose rectification), (Precise recovery of the occlusion)..,.,.,. 1. (Content management server) (Content editor), (Content metadata generation module), (Content search module), (Content streaming module), (Timeline editing module), (Edit metadata generation module), (Edit content playback module). 1,, / 1. Fig. 1. Structure of the proposed online content editing system

5 /,. 1. (Content Metadata Generation Module) (Scene detection module), (Content storage), (Content metadata storage). 1,,. 1. 1, content_id, content_url, image_url Scene,. content_id ID, content_url 1. Table 1. Core elements of content metadata Name Type Description Attribute content_id string Describes unique ID of the content. mandatory content_url string Describes URL of the content. mandatory title string Describes title of the content. optional subtitle string Describes subtitle of the content. optional supplier_code string Describes supplier's code of the content. optional supplier_name string Describes supplier's name of the content. optional channel_name string Describes channel name used for broadcasting the content. optional content_onair_date string Describes broadcast date of the content. optional duration string Describes duration of the content in second. optional storyline string Describes storyline of the content. optional content_genre_code string Describes genre code of the content. optional Cast list Describes casting information of people such as their names, cast names and image URLs. optional image_url string Describes representative image URL of the content. mandatory Scene list Describes scene information as in Table 2. mandatory 2. Table 2. Elements of Scene Name Type Description Attribute scene_name string Describe name of the scene. optional scene_start_time scene_end_time string string Describe start time of the scene which is calculated on the basis of the start time of the original content. Describe end time of the scene which is calculated on the basis of the start time of the original content. mandatory mandatory scene_place string Describe the place where the scene occurs. optional scene_tag string Describe the text tag or keyword of the scene. optional scene_image_url string Describe representative image URL of the scene. optional

6 (JBE Vol. 20, No. 4, July 2015) image_url. (Thumbnail extractor), image_url. Scene,,. Scene 2 (scene_name), (scene_start_time, scene_end_time), (scene_place), (scene_tag), (scene_image_url). scene_ start_time scene_end_time. scene_image_url scene_start_ time content_url, scene_image_url., scene_name, scene_place, scene_tag. 2. (Content Retrieval Module)., (Scene search engine) (Scene search module). (Query), scene_name, scene_place, scene_ tag,. MPEG-QF(Query Format),. ID content_id content_url scene_name, scene_start_time, scene_end_time, scene_place, scene_image_url. scene_name, scene_place, scene_image_url, content_id, content_url, scene_start_time, scene_end_time. 3. (Content Streaming Module) (Streaming server) (Streaming player) (Preview). Apple HLS(HTTP Live Streaming). HLS MPEG-2 TS(Transport Stream), m3u8. 1,. m3u8, m3u8. m3u8. 2 m3u8 TimeLine. TimeLine ContentList Group. ContentList id, content_id, content_url Content, id

2. TimeLine Fig. 2. Structure of TimeLine metadata TimeLine ID, content_id ID, content_url., Group TimeLine 2 Group. group_type Group 'audio' 'video'. Group Track, track_type Track.

7 2. TimeLine Fig. 2. Structure of TimeLine metadata TimeLine ID, content_id ID, content_url., Group TimeLine 2 Group. group_type Group 'audio' 'video'. Group Track, track_type Track. track_type 'main', 'overlay', 'background', 'main', <?xml version="1.0" encoding="utf-8"?> <TimeLine> <ContentList> <Content id="1" content_id="s01" content_url=" </Content> <Content id="2" content_id="s02" content_url=" </Content> </ContentList> <Group group_type="video"> <Track tack_type="main"> <Clip start=" " stop="21.0" id="1" mstart="49.0"/> <Clip start=" " stop="51.0" id="2" mstart="857.0"/> </Track> </Group> <Group group_type="audio"> <Track tack_type="main"> <Clip start=" " stop="21.0" id="1" mstart="49.0"/> <Clip start=" " stop="51.0" id="2" mstart="857.0"/> </Track> </Group> </TimeLine> 3. XML TimeLine Fig. 3. Example of TimeLine metadata in XML format

8 (JBE Vol. 20, No. 4, July 2015) overlay', 'background'. start, stop, id, mstart Clip Track. start stop Clip, id Content id Clip. mstart id. 3 TimeLine XML. 3 TimeLine id , id , 51. TimeLine.,, TimeLine. 4. (Timeline Editing Module)., 2 TimeLine. ID(content_id) URL(content_url), (scene_start_time) (scene_end_time).,,. 5. (Edit Metadata Generation Module) (Metadata generator), (Metadata registration module), (Edit metadata storage) 3. Table 3. Core elements of edit metadata Name Type Description Attribute content_id string Describes unique ID of the content. mandatory title string Describes title of the content. optional subtitle string Describes subtitle of the content. optional Producer list Describes producers' information such as id and name of producers. optional SourceContent list Describes ID list of original contents which are used for editing of contents. optional production_date string Describes the date of when the content editing was completed. optional duration string Describes the duration of the content in second. optional storyline string Describes storyline of the content. optional content_genre_code string Describes genre code of the content. optional Cast list Describes casting information of people such as their names, cast names and image URLs. optional image_url string Describes representative image URL of the content. mandatory timeline_metadata XML Describes edit metadata of the content. mandatory keyword string Describes keyword of the content. optional

9 content_id ID, title, subtitle, storyline, content_genre_code, Cast, keyword,,,,,., Producer, SourceContent, production_date, duration, image_url, timeline_metadata ID,,, URL,., image_url, timeline_metadata 2 XML TimeLine. 6. (Edit Content Playback Module), (Edited content search module) (Edited content search engine) (Edited content streaming player) (Streaming server). 3 title, subtitle, storyline, keyword, MPEG-QF. 3 content_id, title, storyline, image_url. title, storyline, image_url, content_id. HLS. content_id, timeline_metadata m3u8. m3u8, m3u8. 4. Table 4. Support function comparisons of editors Functions Editors Content retrieval Content playback Windows Movie Maker (Ver. 16.4) (Personal contents) (Local playback) PotEncoder (Ver ) (Personal contents) (Local playback) VideoPad (Ver. 4.06) (Personal contents) (Local playback) Proposed Editing System (Broadcasting and personal contents) (Streaming playback) Timeline editing Preview of edited contents Edit metadata generation Content metadata generation X X X Content upload (Facebook, Youtube, Vimeo, Flickr) (TVPot, Cafe, Blog) (Youtube, Facebook, Flickr) (Proposed content management server) nline editing X X X

10 (JBE Vol. 20, No. 4, July 2015). 4 Windows Movie Maker, PotEncoder, VideoPad. 4,. 4. 4(a).,, 4(a). (title), (storyline), (genre),,,,,., [16-19], [16]. 4(b) 4(c). 4(b),, MPEG- QF. 4(c), 4. Fig. 4. Scene-based content editing

11 HLS, HLS.,,,. 4(d).. 5,., 5(a). HLS, HLS m3u8 XML TimeLine. 5(b),.. 5(b), (title), (storyline), (cast), (keyword), (genre). 5(c) 5(d) 5. Fig. 5. Edit metadata generation and playback of edited contents

12 (JBE Vol. 20, No. 4, July 2015). HLS...,.,,.,... (References) [1] S. wen, "The changing shape of on-line disc-based editing," Int'l Conference on Broadcasting Convention, pp , Sep [2] M. Horton, "Beyond non linear editing," Int'l Conference on Broadcasting Convention, pp , Sep [3] R. Jasinschi and J. Moura, "Nonlinear editing by generative video," Int'l Conference on Acoustics, Speech, and Signal Processing, vol. 2, pp , May [4] W. Aref, I. Kamel and S. Ghandeharizadeh, "Disk scheduling in video editing systems," IEEE Trans. on Knowledge and Data Engineering, vol. 13, no. 6, pp , Nov [5] J. Casares, A. Long, B. Myers, R. Bhatnagar, S. Stevens, L. Dabbish, D. Yocum and A. Corbett, "Simplifying video editing using metadata," Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques, pp , June [6] V. Rajgopalan, A. Ranganathan, R. Rajagopalan and S. Mudur, "Keyframe-guided automatic non-linear video editing," International Conference on Pattern Recognition, pp , Aug [7] A. Yoshitaka and Y. Deguchi, "Rendition-based video editing for public contents authoring," IEEE International Conference on Image Processing, pp , Nov [8] I. Song and J. Nang, "Design of a video metadata schema and implementation of an authoring tool for user edited contents creation," Journal of KIISE, vol. 42, no. 3, pp , March [9] M. Kumano, Y. Ariki, M. Amano, K. Uehara, K. Shunto and K. Tsukada, "Video editing support system based on video grammar and content analysis," Int'l Conference on Pattern Recognition, vol. 2, pp , Aug [10] A. Girgensohn, J. Boreczky, P. Chiu, J. Doherty, J. Foote, G. Golovchinsky, S. Uchihashi and L. Wilcox, "A semi-automatic approach to home video editing," ACM Symposium on User Interface Software and Tech., pp , Nov [11] T. Takiguchi, J. Adachi and Y. Ariki, "Audio-based video editing with two-channel microphone," Int'l Journal of Hybrid Information Technology, vol. 1, no. 3, pp , July [12] A. uttagarts and A. Mbodj, "A cloud-based collaborative and automatic video editor," IEEE International Symposium on Multimedia, pp , Dec [13] S. Lu, S. Zhang, J. Wei, S. Hu and R. Martin, "Timeline editing of objects in video," IEEE Trans. on Visualization and Computer Graphics, vol. 19, no. 7, pp , July [14] E. Bennett and L. Mcmillan, "Proscenium: a framework for spatio-temporal video editing," ACM International Conference on Multimedia, pp , Nov [15] X. Guo, X. Cao, X. Chen and Y. Ma, "Video editing with temporal, spatial and appearance consistency," IEEE Conference on Computer Vision and Pattern Recognition, pp , June [16] J. Ryu and J. Nang, "Video segmentation based on place for TV drama video," Korea Computer Congress, pp , June [17] H. Li, G. Liu, Z. Zhang and Y. Li, "Adaptive scene-detection algorithm for VBR video stream," IEEE Trans. on Multimedia, vol. 6, no. 4, pp , Aug [18] P. Panchal, S. Merchant and N. Patel, "Scene detection and retrieval of video using motion vector and occurrence rate of shot boundaries," Int'l Conference on Engineering, pp. 1-6, Dec [19] V. Chasanis, A. Likas and N. Galatsanos, "Scene detection in videos using shot clustering and sequence alignment," IEEE Trans. on Multimedia, vol. 11, no. 1, pp , Jan

- 1998 2-2000 2-2002 2-2002 3 ~ - 2012 9 ~ - RCID :

org/0000-0003-3573-0372 - :, - 1981 2-1983 2-1991 2

13 ~ ~ - RCID : - :, University of Florida ~ ~ - RCID : - : QoS,,

09권오설_ok.hwp

09권오설_ok.hwp (JBE Vol. 19, No. 5, September 2014) (Regular Paper) 19 5, 2014 9 (JBE Vol. 19, No. 5, September 2014) http://dx.doi.org/10.5909/jbe.2014.19.5.656 ISSN 2287-9137 (Online) ISSN 1226-7953 (Print) a) Reduction