A Framework for Seamless Human-Content-Environment Interaction Abstract. In this paper, we propose a new framework which can support seamless human-contentenvironment interactions in ubiquitous computing environments. Although there have been many research activities on concepts of computing (virtual reality, augmented reality, mobile, wearable, and ubiquitous computing), they have focused on development of technologies in their territories. There have been a few research efforts on the concept of natural human-content-environment interaction in a unified way with a usercentered perspective. The proposed framework provides seamless interactions with a consistent and a unified way by taking into account mobile/wearable computing as users, VR/AR as contents, and ubiquitous computing as environments, respectively. To support the consistent and unified perspective for developers, users, contents, and environments can be modeled by a set of sensors and services as well as the interaction among them can be modeled by user-centric context. We believe that the proposed framework can be an initiative interaction paradigm for user-centric ubiquitous computing environments. Keywords: Seamless interaction, personalized user interface, responsive content, harmonious service environment
I
II III
IV
V
VI
VII [1] M. Weiser, ''The Computer for the 21st Century,'' Scientific American, Vol. 265, No. 3, Sep. 1991, pp.94-104 [2] Ishii, H. and Ullmer, B., ''Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms,'' in Proceedings of Conference on Human Factors in Computing Systems CHI '97, ACM Press, 1997, pp. 234-241 [3] Bill N. Schilit, Norman I. Adams, and Roy Want, ''Context-Aware Computing Applications,'' In Proceedings of the Workshop on Mobile Computing Systems and Applications, 1994, pp.85-90. [4] H.Lieberman and T.Selker, ''Out of Context: Computer Systems that Adapt to and Learn from Context,'' IBM System Journal, Vol. 39, No. 3, 2000, pp.617-631 [5] Anind K. Dey, Gregory D. Abowd, ''Towards a Better Understanding of Context and Context-Awareness,'' CHI 2000 Workshop on the What, Who, Where, When, Why and How of Context-Awareness, Apr. 1-6, 2000. [6] A. Schmidt, M. Beigl, and H.-W. Gellersen, ''There is more to context than location,'' Computers and Graphics Vol. 23, No. 6, 1999, pp. 893-901 [7] B. Rhodes, ''The Wearable Remembrance Agent: A System for augmented memory,'' In Proceeding of the 1 st International Symposium on Wearable Computers, 1998, pp.123-128 [8] R. Want, A. Hopper, V. Falcao, J. Gibbons, ''The Active Badge Location System,'' ACM Transcation on Information System, Vol. 10, No. 1, 1992, pp. 91-102 [9] M. Dertouzos, ''The Future of Computing,'' Scientific American 281, No. 2, 1999, pp. 52-55 [10] D. Garlan, D. Siewiorek, A. Smailagic, P. Steenkiste, ''Project Aura: Towards Distraction-Free Pervasive Computing Environments,'' IEEE Pervasive Computing, Special Issue on Integrated Pervasive Computing Environments, Vol. 1, No. 2, 2002, pp. 22-31 [11] J. Hong, J. Llanday, ''A Context/Communication Information Agent,'' Personal and Ubiquitous Computing, Special Issue on Situated Interaction and Context-Aware Computing, Vol. 5, No. 1, 2001, pp. 78-81 [12] J. Pascoe, ''Adding Generic Contextual Capabilities to Wearable Computers,'' In proceedings of the 2nd IEEE International Symposium on Wearable Computers, IEEE Computer Society, 1998, pp. 92-99 [13] Anind K. Dey and Daniel Salber and Gregory D. Abowd and Masayasu Futakawa, ''The Conference Assistant: Combining Context-Awareness with
Wearable Computing,'' ISWC 99, 1999, pp. 21-28 [14] DeVaul, R., Sung, M., Gips, J., Pentland, A, ''MIThril 2003: applications and architecture,'' ISWC 03, 2003, pp. 4-11 [15] M. Mateas, ''An Oz-Centric Review of Interactive Drama and Believable Agents,'' Technical Report CMU-CS-97-156, 1997. [16] S. Yoon, R.C. Burke, B.M. Blumberg, G.E.Schneider, ''Interactive Training for Synthetic Characters,'' AAAI, 2000, pp. 249-254 [17] Y.Arafa, A.Mamdani, ''Virtual personal service assistants: towards real-time characters with artificial hearts,'' International Conference on Intelligent User Interfaces, 2000, p.9-12 [18] Mozer, M. C., ''An intelligent environment must be adaptive,'' IEEE Intelligent Systems and their Applications, Vol. 14, No. 2, 1999, pp. 11-13 [19] Manuel Roma n, Christopher K. Hess, Renato Cerqueira, Anand Ranganathan, Roy H. Campbell, and Klara Nahrstedt, ''Gaia: A Middleware Infrastructure to Enable Active Spaces,'' In IEEE Pervasive Computing, Oct-Dec 2002, pp.74-83 [20] S. S. Yau, F. Karim, Y. Wang, B. Wang, and S.Gupta, ''Reconfigurable Context-Sensitive Middleware for Pervasive Computing,'' IEEE Pervasive Computing, joint special issue with IEEE Personal Communications, Vol. 1, No. 3, Jul.-Sep. 2002, pp. 33-40 [21] D.Hong, Y.Suh, A.Choi, U.Rashid, and W.Woo, ''wear- UCAM: A Toolkit for Mobile User Interactions in Smart Environments,'' IFIP International Conference on Embedded and Ubiquitous Computing (EUC 06- LNCS), Vol. 4096, Aug. 2006, pp. 1047-1057 [22] SJ.Oh, Y.Lee, W.Woo, ''vr-ucam2.0: A Unified Context-aware Application Model for virtual environments,'' ubicns, ProceedingCD, 2005. [23] Y.Oh, C.Shin, S.Jang, W.Woo, ''ubi-ucam 2.0: A Unified Context-aware Application Model for Ubiquitous Computing Environments,'' UbiCNS, ProceedingCD, 2005. [24] Brezillon P, ''Context in Artificial Intelligence: I. A survey of the literature,'' Computer & Artificial Intelligence, Vol. 18, No. 4, 1999, pp. 321-340 [25] Brezillon P, ''Context in Artificial Intelligence: II. Key elements of contexts,'' Computer & Artificial Intelligence1, Vol. 8 No. 5, 1999, pp.425-446 [26] M. Theodorakis, and N. Spyratos, ''Context in Artificial Intelligent and Information Modeling,'' In proceedings of the 2nd Hellenic Conference on Artificial Intelligence (SETN-02), 2002, pp. 27-28 [27] Ghita Kouadri Mostefaoui, Jacques Pasquier-Rocha, Patrick Brezillon, ''Context-Aware Computing: A Guide for the Pervasive Computing Community,'' International Conference on Pervasive Services (ICPS'04), 2004, pp. 39-48 [28] D.Hong and W.Woo, ''Survye on Context Definitions and Context Modeling Techniques,'' Korea MultiMedia System (KMMS 06), Vol. 10, No. 1, 2006, pp. 15-28 [29] S.Jang and W.Woo, ''Unified Context Representing User-Centric Context: Who, Where, When, What, How and Why,'' ubicomp workshop (ubipcmm), 2005, pp. 26-34 [30] S.Jang, and W.Woo, ''5W1H: Unified User-Centric Context,'' ubicomp 2005, Poster, 2005. [31] Kipling method, available from http://changingminds. org/techniques/questioning/5w1h.htm [32] S.Jang, C.Shin, Y.Oh, and W.Woo, ''Introduction of UbiHome Testbed,'' ubicns 2005, Proceeding CD, 2005. [33] W.Jung and W.Woo, ''Orientation tracking exploiting ubitrack,'' A workshop on Smart Object Systems in ubicomp05, 2005, pp. 47-50 [34] H.Yoon, W.Jung, and W.Woo, ''ubicontroller: Activity-based Universal Service Controller for ubihome,'' KHCI2006, Vol. 1, 2006, pp. 293-298 [35] Y.Suh, W.Woo, ''Context-based User Profile Management for Personalized Services,'' ubicomp workshop (ubipcmm), 2005, pp. 64-73 [36] A.Choi, U.Rashid, W.Woo, '','' KHCI2006, 2006, pp. 960-965 [37] Umar Rashid, A.Choi, W.Woo, '', KHCI2006, 2006, pp. 970-975 [38] SJ.Oh, Y.Lee, W.Woo, ''Reactive Multimedia Contents in Smart Home Environments,'' ubicomp workshop (Situating Ubiquitous Computing in Everyday Life: Bridging the Social and Technical Divide), 2005, pp. 1-4 [39] Y.Oh, S.Lee, W.Woo, ''User-centric Integration of 5W1H Contexts for A Unified Context-aware Application Model,'' ubicomp workshop (ubipcmm), 2005, pp. 9-16 [40] C.Shin, W.Woo, ''Conflict Management for Media Services by exploiting Service History and User,'' ubicomp workshop (ubipcmm), 2005, pp. 48-57 [41] Y.Oh, C.Shin, W.Jung, W.Woo, ''The ubitv application for a Family in ubihome,'' 2nd Ubiquitous Home workshop, 2005, pp. 23-32