Electronics and Telecommunications Trends 스마트폰대체재로서의신뢰증강보는통신용스마트안경기술 Smart Glasses Technologies for Trustworthy, Augmented Reality, See-Through Eyes-Direct Communications as Substitute for Smart Phones 송기봉 (K.B. Song, kbsong@etri.re.kr) 이준경 (J.K. Lee, leejk@etri.re.kr) 김광용 (K.Y. Kim, kwangyk@etri.re.kr) 김건우 (G.W. Kim, kimgw@etri.re.kr) 박소희 (S.H. Park, parksh@etri.re.kr) 김태연 (T.Y. Kim, tykim@etri.re.kr) 윤호선 (H.S. Yoon, yhs@etri.re.kr) 이재호 (J.H. Lee, bigleap@etri.re.kr) 김도형 (D.H. Kim, kimdh@etri.re.kr) 미래원천연구본부본부장뇌휴먼인터페이스연구실책임연구원 / 실장뇌휴먼인터페이스연구실책임연구원신인증 물리보안연구실책임연구원 / 실장신인증 물리보안연구실책임연구원지능네트워크연구실책임연구원 / 실장지능네트워크연구실책임연구원고성능디바이스SW연구실책임연구원고성능디바이스SW연구실책임연구원 ABSTRACT In this paper, we present the R&D status of ETRI s Trusted Reality (TR) project and its core technologies. ETRI's TR project focuses on the next-generation paradigm of smart phones, ETRI-TR Smart Glasses, which aims to provide the same features as those of smart phones without the involvement of any handheld device. Furthermore, they are characterized by additional features enabled by trustworthy VR/AR/MR/XR, such as privacy masking/unmasking, distributed structure of thin-client computing/networking among TR- Glasses, TR-LocalEdge, and TR-RemoteEdge, with novel see-through eyes-direct communication between IoT real/virtual objects and human eyes. Based on these core technologies of the ETRI s TR project, the human-held ETRI-TR Smart Glasses is expected to aid in the realization of XR vision with particularly more XR's safe_privacy on social life in the near future. KEYWORDS TR 안경플랫폼, TR 프라이버시보호, TR 개방형 MEC, TR 보는통신, TR 안경시점제어 Ⅰ. 서론 ETRI 2018 10 Trusted Reality ETRI TR DOI https doi org 10 22648 ETRI 2019 J 340506 2018 2018 0 00226 Trusted Reality 본저작물은공공누리제 4 유형출처표시 + 상업적이용금지 + 변경금지조건에따라이용할수있습니다. 2019 한국전자통신연구원
59 TR TR ETRI TR VR AR MR 4 5G Hyper Connectivity DispalyAR VR Tracking Rendering HW SW VR AR UI Interaction 1 ETRI TR ETRI TR XR Thin Client TR 5G ICT 4 TR TR 5G ICT II. 5G+VR/AR/MR/XR 기술동향 VR AR MR XR 5G Connectivity 7
60 34 5 2019 10 1. 현재 VR/AR/MR/XR 기기동향가. 초고화질광시야각오감형디스플레이 VR HMD 90 Google Card board 210 Starbreeze StarVR 110 AR HMD 14 7 Google glass 35 Microsoft Hololens 60 ODG R9 90 Meta Meta2 AR VR HMDHD 720p full HD 1 080p 2K AR VR LCD Liquid Crystal Display OLED Organic Light Emitting Diode Oculus Rift 2018 HTC Vive pro 2018 HMD Odyssey 2017 Virtual sick ness VRLCD 65Hz OLED 86Hz 16K 140 250 See through 나. 초정밀이미지센서트레킹 6DoF Degree of Freedom GPS RFID Microsoft Google Tango Project 3D 다. 초저지연정합 (Rendering) HW/SW NVIDIA Direct Mode AMD HMD AR VR Latest data latch 5ms 50ppd pixel per degree Ray tracing NVIDIA Direct Mode 라. 인터랙션및 UI/UX AMAZON Alexa AR HMD Smart glass
61 35G Core 2. 5G+ 스마트안경 (TR) 연동 2 5G Core 3GPP Leap motion Virtuix Omni Cyberith Virtualizer VR AR pairing Wi Fi LocalEdge AP tethering Wi FiLocalEdge 5G 5G SnapDragon Stand alone Small cell 5G Macro cell 4GMulti path 28G 5 5G 2016 2017 RAN D2D RAN 3GPP 2019 4
62 34 5 2019 10 5G VR AR TRG 5G Core 6 8 III. 현 ETRI-TR 주요핵심기술들 1. TR 글라스소프트웨어플랫폼 2 HMD 3 QR VR AR AR VR MR TR 1 4 TR TRX GW TR extensible GateWay 1) TRG 소프트웨어플랫폼구조 [4] TRG TRG IoT Device Abstraction Layer Use Case Event Chain TRXGW Device Application Layer 가. TR 의소프트웨어플랫폼 4 TR TRXGW
63 5 TRG Application Layer TRG TRG Application Common Service Framework Layer TRG User s System Libraries Layer TRG IoT Device Abstraction Layer Application Layer System Service Layer Device Driver Layer IoT Device Input Output 6 TRXGW 2) TRXGW 소프트웨어플랫폼구조 [4] TRXGW TRGIoT IoT Device Abstraction Layer Use Case Event Chain TRG Device Application Layer TRXGWTRG
64 34 5 2019 10 Application Layer Application Common Service Framework Layer User s System Libraries Layer System Service Layer IoT Device Abstraction Layer Device Driver Layer TRG TRXGW TRG TRXGW Object Discovery Manager Use Case Manager DB Manager Application Layer TRG TRG Application Common Service Framework Layer TRG User s System Libraries Layer TRXGW IoT Device Abstraction Layer Application Layer System Service Layer Device Driver Layer IoT Device Input Output 가. Set-and-See 프라이버시개념 TR 9 10 ETRI TR Set and See Set See 2. Set-and-See 프라이버시기술 TR Set and See 7 Set and See
65 Set and See Set and See Set and See 나. Set-and-See 프라이버시의세부기술 Set and See Set and See Set and See Set See 3) 오프라인 Set-and-See 프라이버시기술 Set TR See 1) 경량형프라이버시객체검출기술 TR TR false negative rate 0 4) 차등프라이버시권한설정기술 11 2) 온라인 Set-and-See 프라이버시기술 3. TR 시점기반네트워킹기술 TRVN TR
66 34 5 2019 10 Viewpoint Networking 가. TRVN 개념및프레임워크 TRTRVN Viewpoint TR 12 TRVN VE Virtual Entity PE Physical Entity PoP Point of Presence TRVN 나. TRVN 요소기술 TRVN AR VR MR 8 TR 1) 마이크로서비스아키텍처기술
67 TRVN 2) 이벤트기반브로커링기술 TRVN 13 14 3) TRVN 통합오케스트레이션기술 4. TRG를위한통신인터페이스 TRG Look and Connect IoT UX ETRI See Direct 가. 시선인터페이스의필요성 Wi Fi IoT Scan and Select TRG Wi Fi Blue tooth NFC IrDA MAC 15 16 IrDA NFC
68 34 5 2019 10 AR VR MR SNS DB 5 1 Direction Finding AoA Angle of Arrival 17 See Direct AoA 나. See-Direct 프레임워크구조 See Direct TRG IoT AoA TRG See Direct API 1) 통신대상인식기술 See Direct 9 See Direct Comm Framework TRG TRG IoT CNN See Direct TRG
69 2) 비주얼커넥션프로토콜 Wi Fi Bluetooth ID See DirectIoT Ⅳ. 결론 3) 개방형 API See Direct TR See Direct TRG See Direct TRG IoT TRG TRG IoT D2D IoT [1] 포스트스마트폰시대를대비한 Trusted Reality 핵심기술개 발, 정보통신방송연구개발사업계획서, 2018-0-00226, 2019. [2] AR/VR 기술 - 제 3 장산업동향, KISTEP 기술동향브리프, 2018-09 호, Jul. 2018. [3] m-ar/vr 산업동향분석, Hello T 첨단뉴스, Jun. 2018. [4] 모바일장치의기능및스마트글라스의기능을만족시키는신 뢰현실소프트웨어플랫폼구조, 10-2018-0153141, Nov. 2018. [5] Qualcomm, VR and AR pushing connectivity limits, Qualcomm Technologies, Inc., May. 2017. [6] 3GPP TR23.501 V0.4.0 System Architecture for the 5G System; Stage 2, Apr. 2017. [7] AT&T Foundry, Enabling Mobile Augmented and Virtual Reality with 5G Networks, AT&T, Jan. 2017. [8] 3GPP TR 22.864, Feasibility Study on New Services and Markets Technology Enablers - Network Operation - Stage 1, Feb. 2016. [9] J. P. Pesce, D. L. Casas, G. Rauber, V. Almeida, Privacy attacks in social media using photo tagging networks: A case study with Facebook, Proc. ACM PSOSM, 2012. [10] 행정안전부, 한국인터넷진흥원, 2018 년개인정보보호상담사 례집, 2019 년 4 월.
70 34 5 2019 10 [11] V. C. Hu et al., Guide to attribute based access control (ABAC) definition and considerations (draft), NIST Special Pub., vol. 800, no. 162, pp. 15-26, 2013. [12] Q. Liu, S. Huang, J. Opadere and T. Han, An Edge Network Orchestrator for Mobile Augmented Reality, IEEE Infocom 2018. [13] K. Ha, Z. Chen, W. Hu, W. Richeter, P. Pillai and M. Satyanarayanan, Towards Wearable Cognitive Assistance, MobiSys, June. 2014. [14] M. Satyanarayanan, Edge computing for situational awareness, IEEE LANMAN, June. 2017. [15] C.-B. Park, C. Ryu, M.-H. Yun, and J.-H. Lee, A Wi-Fi direct access technique for smartphones using NFC, in Proc. 7th International Symposium on Embedded Technology, (ISET 2012), 2012, pp. 168-171. [16] T. Clifton, D. D. Joos, C. D. Knutson, and R. W. Woodings, Rapid Heterogeneous Ad Hoc Connection Establishment: Accelerating Bluetooth Inquiry Using IrDA, 2002. [17] Martin Woolley, Bluetooth Direction Finding, A technical Overview, Mar. 2019.