(JBE Vol. 20, No. 1, January 2015) (Regular Paper) 20 1, 2015 1 (JBE Vol. 20, No. 1, January 2015) http://dx.doi.org/10.5909/jbe.2015.20.1.110 ISSN 2287-9137 (Online) ISSN 1226-7953 (Print) a), a), a) User Interaction Library for Natural Science Education Digital App-Book on Android Platform Kang-Woon Lee a), A-Ram Beak a), and Haechul Choi a),.,., -.,,,.,,.,. Abstract The digital app-book is an advanced form of the electronic book (e-book), which attracts a lot of interests by the help of video, sound, sensors and a variety of interactions. As mobile devices have evolved, the demand of digital app-books is also rising substantially. However, the distribution of digital app-book contents is hard to meet the demand because the digital app-book requires a lot of programming cost for the interaction. To resolve this problem, Was verified and implementation as a library function of the interaction between device and user. The proposed library consists of three parts (user action recognition, device action, and content action) and provides various user-device interaction functions by combining methods of each part, which can support source code reusability, easy understanding and availability, and wide expandibility. The library was used in the development of natural science education app-book contents. As a result, it could reduce a lot of code lines and facilitate more rapid app-book development. Keyword : E-Book, Digital App-Book, Mobile Application a) (Multimedia Engineering, Hanbat National University) Corresponding Author : (Haechul Choi) E-mail: choihc@hanbat.ac.kr Tel: +82-42-821-1149 ORCID: http://orcid.org/0000-0002-7594-0828 (NRF-2013 R1A1A1010344) ( ) (C0216895). Manuscript received August 19, 2014 Revised October 13, 2014 Accepted Novemver 11, 2014
2 : (Kang-Woon Lee et al. : User Interaction Library for Natural Science Education Digital App-Book on Android Platform)..,.,.. [1], ios [2] [3].,. Google Play. App Store, ibooks Author, ibooks Store [4]., (App-Book)..,,.,..,...,,,,,...,,,... 1....
(JBE Vol. 20, No. 1, January 2015).,. 2. (User Interaction Device: UID) (interface),,,... 1 AUI(Advanced User Interaction). 1. Fig. 1. An example of advanced user interaction interface (inter-operation). ISO/IEC JTC1/SC29/WG11 MPEG(Moving Picture Experts Group) AUI MPEG-U part 2: AUI Interface [5]. MPEG-U part 2 UID AUI [6]..,. 3..,,.,..,.,.,. [7][8], UI/UX [9]-[11],
2 : (Kang-Woon Lee et al. : User Interaction Library for Natural Science Education Digital App-Book on Android Platform) [12]-[15]. III.., on/off,,,...,,,,..,,,.,,,... [16].,,. 2 3. ( ). 2. Fig. 2. Proposed digital app-book interaction library structure
(JBE Vol. 20, No. 1, January 2015),,.,,, /, /., 2..,,,. 2,,.,,, (, ).. ( )....,. apk 10Kb. [17],,.,,... 1.. 1.. X Y (0, 0). ACTION_ DOWN, ACTION_MOVE, ACTION_UP. ACTION_DOWN. ACTION_MOVE.
2 : (Kang-Woon Lee et al. : User Interaction Library for Natural Science Education Digital App-Book on Android Platform) 1. Table 1. User action recognition commands User Actions Features Applicable Functions Touch Multi-Touch Drag Drag & Drop - Basic interface on smart devices like mouse clicks on PC platform - Operation available on capacitive touch screen devices - Common user experience - Techniques detecting number of fingers pressed and measuring distance between the fingers - Basic interface on smart devices like mouse drags on PC platform - User experience for page fliping on e-books and digital app-book - Basic interface on smart devices like moving an icon on PC platform to move an object to another location within screen contents screen contents forward/backward flipping, execution, selection Image scaling, image rotation screen contents flipping, page flipping Item addition, Puzzle Sweep - Sweeping action on the smart device screen Drawing, erasing Shake - Exclusive interface supported on smart devices - (x, y, z) coordinate detection using gyroscope sensor Mixing ACTION_UP... ACTION_POINTER_DOWN, ACTION_POINTER_UP.. (X, Y, Z).. 2.,,,,. 2. [18] Table 2. Media format and CODEC list supported on Android [18] Types CODEC Supported File/Container Formats Video Audio H.263 H.264 AVC MPEG-4 SP VP8 AAC LC HE-AACv1 HE-AACv2 AAC ELD AMR-NB AMR-WB FLAC MP3 MIDI Vorbis PCM/WAVE 3GPP (.3gp) MPEG-4 (.mp4) 3GPP (.3gp) MPEG-4 (.mp4) MPEG-TS (.ts) 3GPP (.3gp) WebM (.webm) Matroska(.mkv) 3GPP (.3gp) MPEG-4 (.mp4,.m4a) ADTS raw AAC (.aac) MPEG-TS (.ts) 3GPP (.3gp) FLAC (.flac) only MP3 (.mp3) Type 0 & 1 (.mid,.xmf,.mxmf) RTTTL/RTX (.rtttl,.rtx) OTA (.ota) imelody (.imy) Ogg (.ogg) Matroska (.mkv) WAVE (.wav)
(JBE Vol. 20, No. 1, January 2015).,. 2. VideoView, MediaPlayer. 3..,, /,,. (activity).. (layout) Intent..,. /.. View (custom inner class).. (Listener),,. ImageView. IV.. JAVA, Eclipse 4.2.1, ADT v22.3.0 -. SDK 4.1.2.. 1.. 'Interaction_lib'. 3, 5, 6, 48. Is Library..
2 : (Kang-Woon Lee et al. : User Interaction Library for Natural Science Education Digital App-Book on Android Platform). & 3 attach drop_attach attach.. a) Magnet Attach(Contents action set) public void attach(view v, ImageView dst_iv){ v.setx(dst_iv.getx()); v.sety(dst_iv.gety()); b) Drag & Drop(User action recognition set) + Magnet Attach(Contents action set) = Interaction command(drop_attach) public void drop_attach(imageview drag_iv, final ImageView dst_iv, final int init_x, final int init_y){ drag_iv.setontouchlistener(new View.OnTouchListener() { @Override public boolean ontouch(view v, MotionEvent event) { int touchx = (int) event.getrawx(); int touchy = (int) event.getrawy(); switch (event.getaction()) { case MotionEvent.ACTION_MOVE: v.setx(touchx - (v.getwidth() / 2)); v.sety(touchy - (v.getheight())); break; case MotionEvent.ACTION_UP: if (dst_iv.getx() < touchx && touchx < dst_iv.getx() + dst_iv.getwidth() && dst_iv.gety() < touchy && touchy < dst_iv.gety() + dst_iv.getheight()) { attach(v,dst_iv); else{ v.setx(init_x); v.sety(init_y); break; return true; ); 3. Fig. 3. Example of an interaction method including content operation and user action methods 2., 'Interaction_lib'... 6 8.,. touch_page.,.. mt_si.. drop_attach... drag_mov.
(JBE Vol. 20, No. 1, January 2015) Combined commands User action recognition commands Device (or Contents) action commands Before Interaction After Interaction description tap touch_page User flips to next page by touch. next_page mt_si multi_touch scailing_img User enables magnifier by multi-touch. drop_attach drag_drop attach User collects particular objects into a box. drag_mov drag play_move User drags the rig ship from top to bottom in order to activates video play. shake_img shake play_img User shakes the erlenmeyer flask in order to mix some liquids. sweep_de sweep draw_erase User sweeps the top-layer image to find the bottom-layer objects 4. Fig. 4. Combined commands to facilitate interactions.,. shake_img....
2 : (Kang-Woon Lee et al. : User Interaction Library for Natural Science Education Digital App-Book on Android Platform) (a) Apply Interaction library code drop_attach(drag_iv, dst_iv, 0, 300); (b) Not apply Interaction library code public void drop_attach(imageview drag_iv, final ImageView dst_iv, final int init_x, final int init_y){ drag_iv.setontouchlistener(new View.OnTouchListener() { @Override public boolean ontouch(view v, MotionEvent event) { int touchx = (int) event.getrawx(); int touchy = (int) event.getrawy(); switch (event.getaction()) { case MotionEvent.ACTION_MOVE: v.setx(touchx - (v.getwidth() / 2)); v.sety(touchy - (v.getheight())); break; case MotionEvent.ACTION_UP: if (dst_iv.getx() < touchx && touchx < dst_iv.getx() + dst_iv.getwidth() && dst_iv.gety() < touchy && touchy < dst_iv.gety() + dst_iv.getheight()) { v.setx(dst_iv.getx()); v.sety(dst_iv.gety()); else{ v.setx(0); v.sety(300); break; return true; ); 5. Fig. 5. Example of interaction implementations when the proposed library is used or not used sweep_de..,. 5 drop_attach. 5 (a),, x, y. 5 (b) 27.. 3. 3 3. Table 3. Code lines of interaction commands Interaction commands Number of lines Using the proposed library Original Interaction commands Interaction command set Number of lines Using the proposed library Original Interaction commands Number of lines Using the proposed library tap_mov 1 39 mt_mov 1 80 sweep_mov 1 102 tap_sound 1 19 mt_sound 1 60 sweep_sound 1 82 tap_vibrate 1 12 mt_vibrate 1 53 sweep_vibrate 1 75 tap_page 1 17 mt_page 1 58 sweep_page 1 80 tap_attach 1 10 mt_attach 1 49 sweep_attach 1 71 tap_img 1 14 mt_img 1 54 sweep_img 1 76 tap_si 1 12 mt_si 1 53 sweep_si 1 75 tap_de 3 68 mt_de 3 109 sweep_de 3 131 drag_mov 1 49 drop_mov 1 56 shake_mov 1 62 drag_sound 1 29 drop_sound 1 36 shake_sound 1 42 drag_vibrate 1 22 drop_vibrate 1 29 shake_vibrate 1 35 drag_page 1 27 drop_page 1 34 shake_page 1 40 drag_attach 1 20 drop_attach 1 27 shake_attach 1 33 drag_img 1 24 drop_img 1 31 shake_img 1 37 drag_si 1 22 drop_si 1 29 shake_si 1 35 drag_de 3 78 drop_de 3 85 shake_de 3 91 Original
(JBE Vol. 20, No. 1, January 2015).. 5.. V..,,.... (References) [1] Ji-Hwan Kim, "Amazon's new business success secret: Leverage Strategy", SERI Management Notes, No. 162, pp.1-10, 2012. [2] Yang-Hoe Song, Yeong-Sik Kang, "Electronic publications promoting standardization direction for industry competitiveness", TTA Journal, No. 130, pp.14-19, 2010. [3] Ju-Young Lee, "E-book Market Status and Forecast of the value chain and market structure change in book publishing", KISDI Information Communication and Broadcasting Policy, Vol. 26, No. 8, pp.1-4, 2014. [4] Yong-Ho Jang, Byung-Hoon Kong, The emergence and ensuing typology of global ebook platform -The case study on Google ebook, Amazon Kindle, Apple ibooks Store, Journal of academia-industrial technology Vol. 13, No. 8, pp.3389-3404, 2012. [5] Min-Hye Kim, Jung-Gon Si, A Study on the relationship between Touch interactions and Story in Tablet PC App-book : Focused on Children s App-Story Book, Journal of the HCI Society of Korea, pp.996-998, 2012. [6] Gukhee Han, A-Ram Beak, Haechul Choi, MPEG-U part 2 based Advanced User Interaction Interface System, Journal of the Korea Contents Association, Vol. 12, No. 12, pp.54-62, 2012. [7] Hameed, N., Cheah, Y.-N, and Rafie, M., An e-book Personalization Architecture With Digital Rights and Encryption Procedures, Information Technology (ITSim), Vol.3, pp.1222-1227, 2010. [8] Jong-Wook Bae, Seon-Hwan Jeong, "Scale Resilient Watermarking System for E-book Copyright Management", Journal of Information Science, Vol. 19, No. 6, pp.356-360, 2013. [9] Veronica Liesaputra, Ian H. Witten, and David Bainbridge, "Creating and Reading Realistic Electronic Books", IEEE Computer Society, Vol42, Issue2, pp.72-81, 2009. [10] Ji-Eun Kwon, Bo-Young Kim, A Study Funology for Reformatting to App Book: Focused on 'Moo, Baa, La La La!' of App Book, Journal of Cartoon and Animation Studies, No. 30, pp.221-243, 2013. [11] So-Young Park, Jea-Hwan Lee, A study on the preference comparison according to the difference of the user mode of children's app-book interface, Journal of Digital Design, Vol. 12, No. 4, pp.599-608, 2012. [12] Jin Gerlach, Peter Buxmann, Analyzing Electronic Book Acceptance : A Compatibility Perspective, System Sciences (HICSS), pp.2813-2822, 2013. [13] Jun-Sik Kim, Ok-Hwa Bae, Mi-Sol Lim, Jae-Won Lee, "A Study on E-book Contents Distribution Business Model and its Adoption Attitude of College Students", Journal of practical engineering education, Vol. 4, No. 2, pp.75-84, 2012. [14] Hye-Ran Jang, "The Use of Web-based Electronic Books among Undergraduate Students", Journal of Information Management, Vol. 23, No. 4, pp.233-256, 2006. [15] Jong-Ok Lee, Yong-Moon Kim, "A Study on the Impact of the App-Book Purchasing Behavior of Smart phone Users in Korea", Journal of Korea Electronic Commerce, Vol. 18, No. 3, pp.45-67, 2013. [16] Kang, Eun-Jin, Analyzing the Types of Contents and Interactivity of Picture Book Applications, Journal of Children's Literature and Education, Vol. 14, No. 3, pp.1-23, 2013. [17] Byeong-Seong Park, Yong-Deok Yu, Hoon Choi, A Dynamic Reconfiguration Method of Android Platform, Journal of Information Science, Vol. 38, No. 1, pp.16-24, 2011. [18] Android official web site, accessed Aug, 8, http://developer.android. com/guide/appendix/media-formats.html
2 : (Kang-Woon Lee et al. : User Interaction Library for Natural Science Education Digital App-Book on Android Platform) - 2012 2 : ( ) - 2013 2 ~ : - ORCID : http://orcid.org/0000-0002-2599-3286 - :, - 2012 2 : ( ) - 2014 2 : ( ) - 2014 3 ~ : - ORCID : http://orcid.org/0000-0001-7773-2347 - : GPU, - 1997 2 : ( ) - 1999 2 : ( ) - 2004 8 : ( ) - 2004 9 ~ 2010 2 : - 2010 3 ~ : - ORCID : http://orcid.org/0000-0002-7594-0828 - :,,,