KRnet2010 Emotional Applications and Services Standardization Issues in Haptic Sensing and Display 2010.06.21 Ki-Uk Kyung
주목받고있는촉각상호작용기술 Forbes 기사, 2006.2.16 Nature, 2008.9.3 2
주목받고있는촉각상호작용기술 시, 청, 촉각융합인터페이스 차세대 HCI 기술 Forbes, Technology Review등미래기술로예측 대부분의단말기에적용될것으로예상됨 휴대폰, PDA, UMPC, KIOSK, 게임, 각종가상현실시뮬레이터등 특허출원경쟁및분쟁 1990년중반이후미국, 일본이주도 관련특허 1000건이상, 증가추세 Immersion Corp. Sony에 1억 5천만달러승소 MS, 삼성전자, LG전자, BMW등과협약및기술선도 3
촉각상호작용표준개발의목표 촉각상호작용의기대증가에비하여, 개별적인연구개발수준에머무르고있는현실 일관적이고호환성있는촉각상호작용을구성할수있도록하는규격제시 촉각상호작용관련용어정의 촉각상호작용의구성단위체계적분류 단위별요소정의및체계적분류 촉각상호작용데이터규격정의 물리적설계규격에관한인간공학적기준마련 국제표준화선도 국제표준화위원회활동 ISO/TC159/SC4/WG9 Haptic and tactile interaction 발족, 2005.10 국내표준의국제표준화 4
촉각상호작용환경의구성 햅틱디바이스햅틱렌더링가상환경 햅틱디바이스 사용자에게가상의촉각정보를전달하는물리적장치 가상환경 촉각반응정보를포함하고있는가상의물리적환경 햅틱렌더링 가상의환경을체험하는동안발생해야하는촉각반응을계산하는과정 5
구성단위별표준의정의및역할 햅틱디바이스정의 디바이스속성정의에관한통일된규칙이필요 디바이스가바뀌어도사용자는동일한가상환경을체험 가상환경정의 가상환경을묘사하는방법에관한통일된규칙이필요 정의한가상의촉감체험환경에관한공유 햅틱렌더링정의 촉각상호작용입출력데이터에관한규격필요 그래픽물체와의상관관계에대한규격필요 충돌검출, 반응계산법등 다수의사용자가동일환경에서촉각체험을가능케하는규칙 6
국내외표준화노력 국내 촉각상호작용메타데이터 (ETRI) 촉각연동 MPEG (ETRI, GIST) 이미지 - 촉각데이터융합기법 (ETRI, KAIST) 국제 ISO TC159/SC4/WG9 Tactile and Haptic Interaction ETRI 참여 ISO/IEC JTC1/SC29/WG11 Moving Picture Expert Group ETRI, GIST 외다수 ISO/IEC JTC1/SC35 User Interface WG 미정 7
햅틱다바이스정의메타데이터 Name Force Feedback Device General D.O.F. Workspace Resolution Max Force General Name # of tactors Tactor Arrange Haptic Device Capability Max Torque Max Impedance Tactor Size Tactor Spacing Tactile Display Device Sampling Rate Capability Stroke Freq. Respond BW Exerting Force Max Heat Flow Rate Vibration 8
가상환경정의메타데이터 Name value-name/check Primitives Geometry value-vertex data/file/primitives Object Property Mass Impedance value-mass value-stiffness, damping Position value-p(x,y,z) Groove value-orientation q, width, height Virtual Environment Surface Property Grating Roughness Friction value-spacing, ridge width, height value-roughness value-friction Thermal value-thermal conductivity Pattern value-pre defined pattern Environment Condition Gravity Gravity Dir. Viscosity value-gravity value-d(x,y,z) value-viscosity Flow value-characteristics of flow 9
햅틱렌더링정의메타데이터 Haptic Rendering Device Interaction Data Haptic Rendering Method Position Velocity Acceleration Orientation Force Torque Transform matrix Library Collision Detection Force Response Tactor Response value-input device position value-input device velocity value-input device acceleration value-input device orientation value-device output force value-device output torque Matrix value-[3x3]transformation matrix value-name, Check Registered Library BOOL-collision state value-force x,y,z, Torque x,y,z value-tactor stroke, force, frequency Vibration Response value-intensity 10
HapticML 을이용한촉각상호작용구현 HapticML Parser User Device Definition Haptic Rendering Virtual Environment 촉각상호작용모습 Device Setting Algorithm Hapic Device Computer 11
RoSE Activities in MPEG RoSE: Representation of Sensory Effects 12
Application of RoSE SMSD (Single Media Single Device) A/V media Single Renderer SMMD (Single Media Multiple Devices) MDSM (Multiple Devices Single Media) 13
ISO TC 159 / SC 4 / WG 9 Haptic Interaction Standards 14
The ISO 9241 series A highly recognized standard, developed by ISO TC159 Ergonomics /SC 4 Ergonomics of human-system interaction The high level structure of ISO 9241 series involves: 001 Technical Report introduction to the current series 002-099 general standards that apply in all areas 100-199 Software 200-299 Human system interaction processes 300-399 Displays and display related hardware 400-499 Physical Input devices 500-599 Workplace 600-699 Environment 700-799 Special application domains 710-719 Control Centre 800-899 --- 900-999 Tactile and haptic interactions (being developed by SC4/WG9) 15
WG 9 Tactile / haptic interactions History Founded in 2005 10 meetings to date Active participation from: (P members) Canada Germany Japan Korea Netherlands Sweden United Kingdom United States 16
ISO 9241-910 Structure The main clauses in ISO 9241-910 include: Definitions Introduction to haptics When to use tactile / haptic interactions Human touch and haptics Designing tactile / haptic interactions Interaction task primitives Overviewing Searching Navigation Targeting Selection Manipulation Range of tactile / haptic user interface devices Tactile / haptic elements Tactile/haptic functional effects Tactile/haptic time-dependent effects Tactile/haptic properties of objects 17
ISO 9241-910 Framework Haptics is composed: Haptics Touch (Tactile, Cutaneous) Kinaes-thesis (Kinaes-thetic ) Mechanical stimulation Electric stimulation Thermal stimulation Chemical stimulation Force Position Direction Angle 18
ISO 9241-920 Structure The main current categories of guidance include: Tactile/haptic inputs, outputs, and/or combinations General guidance Intentional individualization Unintentional user perceptions Attributes of haptic encoding of information High level guidance on encoding Guidance on specific attributes of encoding Content-specific encoding Encoding and using text data Encoding and using graphic data Encoding and using controls Design of tactile/haptic objects and space Tactile/haptic display spaces Objects Interaction Navigation Reconfiguration of tactile/haptic space Interaction techniques 19
ISO 9241-940 Structure The main current categories of guidance include: Application of 9241-940 Guidance on the analysis of haptic/tactile devices Analysis of a device s workspace Analysis of a device s tactile properties Analysis of a device s kinaesthetic properties Usability analysis of haptic/tactile devices in human-machine interactions Usability analysis of haptic/tactile devices in human-machine interactions Quantifications of interactions for a device s tactile properties Quantifications of interactions for a device s dynamic properties Potential problems with tactile/haptic interactionss User performance in tactile/haptic interactions Measures for user performance Application of methods Interpreting evaluation results Interpreting results within evaluations Applying results in design 20
Future Additions to 900 Series 930 Haptic / tactile interactions in multimodal environments will include immersive and other multimodal environments exploratory work is beginning 950 Design of tactile / haptic devices will focus on hardware issues start of work not yet scheduled 971 Haptic / tactile interfaces to publicly available devices will deal with THI specific accessibility concerns in public environments and systems especially those systems where assistive technologies cannot be connected by users exploratory work is beginning 21
국제표준화 : ISO/TC159/SC4/WG9 Haptic and Tactile Interaction Evaluation of tactile/haptic interactions (9241-940) USER - tasks - points of contact - interaction techniques (9241-910) INTERACTIONS - guidance - inc. Encoding (9241-920) SYSTEM - device design (9241-950) - user interface elements (9241-910) CONTEXT OF USE (9241-210, 9241-11) APPLICATION Applicability (9241-910) Use in Multi-Modal Environments (9241-930) Use with Public / Closed Systems (9241-971) ISO 9241-920: 촉각상호작용참조문서, IS 확정 ISO 9241-910: 향후개발될표준안전체에관한 Framework, 현재 DIS 단계 ISO 9241-930: Milti-modal Interaction, 현재 WD 단계 22
국제표준화추진전략 WG9활동시작 (2006), 한국정식멤버로써저자가대표자격으로참가 (2007) ISO 9241-910 표준안개발의 Editor로선정, 2007.9 WG9 8차회의한국유치 (2009.5) New Work Item Proposal 제출을통한 Convenorship확보를최종목표로함 ISO/TC159/SC4/WG9 의꾸준한참여 Editorship 확보 TTA 표준개발 NWIP 제출 Project Leader Convenorship 확보 한국회의개최 ISO/JTC1/SC35 User Interface New WG 2007 2008 2009 2010 2011 2012 23
국내표준화개발추진체계 지식경제부 - 기술개발및표준화정책수립 - 산업기반육성정책수립 차세대컴퓨팅산업협회 응용서비스표준화분과 TTA 차세대 PC 국제표준활동지원및표준제정 IT 응용기술위원회 (TC4) 차세대 PC PG415 차세대 PC 표준화포럼 - 차세대 PC 국제표준활동 - 차세대 PC 산업실태조사 - 차세대 PC 기술국내보급 차세대 PC 운영위원회 차세대 PC 분과위원회 기술표준화분과 관련국제표준화기구 MIPI NFC-Forum NOSE-II 일본오감산업포럼 ISO ECMA TC32/TG19/TG11 OMA, OMAPL, SALT WWRF WG5 ELC 관련협의회및표준포럼 차세대컴퓨팅산업협회홈네트워크산업협회임베디드 S/W 산업협회 IPv6 포럼코리아 LBS, 텔레매틱스포럼블루투스표준화포럼음성정보처리기술포럼디지털홈표준화포럼 개인정보서비스 WG 미래생활서비스 WG 워킹그룹 차세대 PC 플랫폼 WG 사용자인터페이스 WG 웨어러블네트워크 WG 오감정보처리 WG 24
Thank you