Overview Stereoscopic Computer Graphics 3D Depth Cues (3차원깊이인식단서들 ) 3D Stereographics Terminology (3차원입체영상용어정리 ) 3D Display (3차원입체영상디스플레이 ) 470420-1 Fall 2013 12/02/2013 Kyoung Shin Park Multimedia Engineering Dankook University 2 3D Depth Cues Visual Depth Cues - Perceiving depth with one eye closed 3 대상중심단서들 (Object-centered cues) or 회화적단서 (Pictorial cues): Linear perspective ( 직선조망 ) 평행선이한소실점으로수렴 Size of known objects ( 알려진물체들의상대적크기 ) 가까이있는물체가더크게보임 Detail (texture gradient) ( 텍스쳐변화 ) 가까이있는물체의텍스쳐가더선명하게보임 Occlusion (hidden surfaces) ( 다른물체에의한중첩 ) Lighting and Shadows ( 빛에의한반사, 그림자에의한효과 ) 가까운물체가더밝고, 먼물체는희미하게보임 그림자는일종의 occlusion을보여주는형태 Relative motion (motion parallax due to head motion) ( 운동시차 ) 멀리있는물체가가까이있는것보다더천천히움직임 4
Perspective 도로, 철로와같은평행선이멀어질수록하나의소실점 (Single vanishing point) 으로수렴 평행한선상에놓여있는물체 ( 예 : 빌딩, 가로수 ) 의경우에높이 (Height) 가작아질수록멀리있는것으로보임 Size 우리가잘알고있는물체들의크기 (Size) 를비교해서, 어느것이더멀리있는지를측정할수있음 E.g. 코끼리와작은공의크기가비슷하게보인다면코끼리가멀리있는것임 같은물체들끼리의크기를비교해서물체들간의상대적인거리를측정할수있음 5 6 Detail 인간의눈은가까이있는것과비교해서멀리있는물체의텍스쳐기울기상세함 (Details in texture gradient) 을식별하지못함 도로의보도블럭과같이규칙적이고동일한크기의요소가일정하게배열된텍스쳐가촘촘하게보일수록멀리있는것으로보임 아지랑이또는안개와같은공기중의빛의산란때문에즉, 공중원근 (Atmospheric perspective) p 에의해서, 멀리있는물체가더희미하게보임 Occlusion 가려진대상은가린대상보다멀리있는것으로보임 가장강력한 3차원깊이인식단서임 7 8
Lighting and Shadow 밝은 (Brighter) 물체가더가까이있는것으로보임 하나의빛이있을경우, 모든그림자는한방향으로생김 빛이위에서비춘다고가정하기때문에물체의아래부분에그림자가있으면튀어나온것으로보임 빛과그림자에의하여두물체간의상대적인위치를감지함 9 Motion Parallax 관찰자가대상을보면서움직이면가까운대상은먼대상보다더많이눈의망막상에서옮겨지는데이를운동시차 (Motion Parallax) 라함 기차를타고가다보면먼산은자기를따라오고가까운나무는빠르게뒤로가는것처럼보이는것으로, 관찰자의위치와대상간의상대적인위치의변화에의해생기는현상 가상현실을위해서양안시차 (Stereoscopy) 보다더중요함 서로겹쳐져보이는두대상을보면서움직일때는방향에따라뒤쪽대상의표면에서삭제와증식 (Deletion & Accretion) 이일어남 이단서는중첩과운동시차가결합된것으로서 10 모서리에서의상대적거리를정확히판단하는데유용함 Visual Depth Cues - Using both eyes 양안단서 (Binocular cues): Binocular disparity (Stereopsis) 인간의두눈사이거리 (Interocular distance) 가약 6cm 떨어져있어서양쪽눈에맺힌망막상은약간다르다다, 이를양안시차 (Binocular disparity) 또는입체시각 (Stereopsis) 라고하며, 이때문에거리의판단과입체감을경험함 안구운동적단서 (Oculomotor cues): Accommodation (Focus) ( 조절 / 초점 ) 특정거리에있는대상에초점을맞추기위하여 ( 즉, 물체의거리에따라조절을통해정확한상을맺게하기위해 ) 눈의근육에긴장을줌 Convergence ( 수렴 ) 대상에초점을맞추기위하여두눈이대상을향해서수렴하게되어눈의근육에긴장을줌 Accommodation과 Convergence는특정거리에있는대상에초점을맞추기위해동시에작용함 11 Stereoscopy 양안시차시각 (Binocular vision) 은두눈이약간다른방향에서대상을인지하는것으로두눈에약간다른영상을맺힘 인간의뇌에서두눈에맺힌영상을합성함 두눈사이의거리에의하여양쪽눈에약간다른영상이맺히게되는현상을양안시차 (Binocular disparity) 라부름 입체시각 (Stereopsis) 는양안시차에의하여생긴깊이지각임 관찰자로부터두물체가서로다른거리에있으면그다른정도에따라두물체가망막에맺히는상대적인 12 거리가달라지거나위치가역전됨
Accommodation (focus) Convergence 13 14 Some Terminology Homologous Points Horizontal Parallax / Binocular disparity ( 수평시차 ) 디스플레이스크린상의동일점 ( 즉, 두개의일치하는지점 ) 사이의수평거리 Stereo Window/Plane ( 스테레오평면 ) 두눈으로보는것간에차이가없는지점 일반적으로동일점이모니터 / 프로젝션스크린과같은깊이에있음 Homologous Points ( 동일점 ) 인간의시각시스템좌, 우눈에서나오는광선이스크린상에서교차하는점 Vertical Displacement ( 수직시차 ) 디스플레이스크린상의동일점 ( 즉, 두개의일치하는지점 ) 사이의수직거리 Scan line Stereo Plane 15 16
Some Terminology Interocular Distance ( 양안간거리 ) 인간의좌, 우눈사이의거리 ( 일반적으로 2.5in, 6.5cm) Hypostereo/Giantism ( 준입체 ) 양안간이 65 6.5 cm 의표준치미만인 macro 3 차원입체이미지를말하며접사로촬영된입체이미지를말함 Hyperstereo/Lilliputism ( 초입체 ) 양안간이 6.5 cm 표준치를초과하는원경 3차원입체이미지를말하며 3차원입체로촬영한풍경이미지가좋은예임 Interocular Crosstalk (Ghosting) 혼신 근접한어떤회선으로부터다른회선으로신호가흘러들어가는현상으로, 입체영상에서는원하지않는좌, 우영상이다른쪽눈에보여지는것을말하는것 눈의피로감을일으킴 17 Some Terminology Positive Parallax ( 포지티브입체시차 ) 스테레오평면에맺힌두점이각각좌, 우눈으로들어오고, 뇌에서하나로합쳐져서스테레오평면보다들어가보이는것 Negative Parallax ( 네거티브입체시차 ) 스테레오평면에맺힌두점이각각반대쪽좌, 우눈으로들어오고, 뇌에서하나로합쳐져서스테레오평면보다앞으로튀어나와보이는것 Zero Parallax ( 제로입체시차 ) 스테레오평면 (stereo window) 에정확한초점을맺으며양안시차가없는것 18 Positive Parallax Accommodation-convergence mismatch Negative Parallax Accommodation-convergence mismatch L R R L The left and right eye images projected on the screen If Objects are too close in front of the projection plane, negative parallax will increase. If negative parallax is wider than eye separation, then result is pain. 19 20
Zero Parallax When the object is actually on the screen Stereo Approximation Left Eye Right Eye Viewing a point in a scene from two difference camera positions produces differing view planes 21 22 Stereo Approximation Left Eye Right Eye Using parallel views (i.e. symmetric view frustums) produces a single view plane, but images must be ti trimmed dto area of overlap - Projection Planes are not the same 그러나, 물체가너무가까이있을경우경계면에서물체가잘려보여서눈에피로를일으킬수있음 미간의차이를넓히면문제가더욱심각해짐 Correct Stereo Computer Graphics The correct approach using parallel views and asymmetric view frustrum produces a single viewplane and overlapped image 23 24
Stereo Images on the GeoWall 1개의 2048x768 화면에좌, 우이미지를보여주는 2개의뷰포트 (i (viewports) t) 를생성함 각뷰포트의이미지는 2개의프로젝터로내보냄 Off-axis Perspective Projection in a CAVE CAVE 시스템의경우, 가시부피 (view frustum) 가 off-axis projection 을고려해야함 front wall view left wall view eye right wall view 25 26 Making the virtual world look true to size Left Eye Right Eye f Set camera properties to be the same as real world properties: Set user s distance to screen (i.e. focal length d) Measure the screen s height (h) Compute the field of view (f = 2*atan(h/2d)) Use real world eye separation distance (2.5 inches) d h 27 How to Generate Stereo Images Present a distinct image to each eye: Free-viewing Optics (lenses) Chromadepth Pulfrich Effect Anaglyph (color) Polarization Active Shuttering Autostereo 28
Free-viewing Free-viewing ( 육안감상 ) 안경이나렌즈를전혀사용하지않고한쌍의 3차원이미지를감상하는방법을말하며, 병렬식 (parallel) 육안감상과교차식 (cross-eyed) 육안감상이있음 Optics Optics ( 입체광학기 ) 물리적으로좌, 우분리된렌즈를사용하여각각의눈에좌, 우영상을보여줌 Stereoscope, invented by Charles Wheatstone in early 1800s 29 30 Optics Optics Viewmaster Slidemaster HMD BOOM 31 32
Chromadepth Chromadepth 입체안경은일반적인 2차원이미지에서도입체효과를볼수있도록고안된특수안경으로, 이안경의특수한필터가색깔별로깊이감을느끼게끔만들어줌 빨강색이가장앞으로튀어나오는효과를주며, 파란색이가장멀리있는것처럼느끼게됨 33 Pulfrich Effect Pulfrich Effect ( 풀프리히효과 ) 는천문학자 Carl Pulfrich에의해발견된생리현상 농도차효과라고도하며안경좌우에투과율이다른필터를장착하여움직임이있는평면화상을관찰하면, 투과율의차에따른지각시간의차이로인해입체감이느끼게됨 빨간공과하얀공이있다. 빨간공은그냥있고하얀공은좌우로움직이고있다. 그런데투시장치를통해빨간공을보니하얀공이원을그리며돌고있다. 이유는? 투시장치는움직이는공을조금늦게보게만든다. 그결과우리는공의서로다른상을보게된다. 이정보를뇌는공이원을그리며도는것으로해석한다. Pulfrich Glass ( 풀프리히안경 ) 은한렌즈는투명하고다른쪽은어두운필터로되어있는것으로풀프리히효과를응용해촬영한영상을감상하는데사용 어두운렌즈로본이미지가투명한렌즈를통해본 34 이미지보다뇌에늦게도달함 Anaglyph 일반적으로왼쪽눈에빨간색과오른쪽눈에파란색 ( 또는초록색또는청록색 cyan) 필터가부착된애너글리프안경을사용하여입체를감상함 애너글리프색렌즈가각눈에들어가는이미지를다른쪽에비해더욱두드러지게나타내어입체감을느끼게함 35 36
Passive Polarization Passive Polarization GeoWall IDesk4 Circular Polarization 37 IDesk4 Linear Polarization 38 Linear Polarization 영사기전구에서나오는빛은기본적으로산란광임 ( 즉, 모든방향으로진동하는빛들이섞여있음 ) 렌즈앞에부착된편광필터 (polarization filter) 는한방향으로진동하는빛만을통과시킴 두개의편광필터가각기통과시키는빛은진동방향이서로직각임 ( 즉, 왼쪽눈이미지는수직, 오른쪽눈이미지는수평으로서로직각이되게구성함 ) 편광안경에도같은편광필터를부착하여입체를느끼게함 문제 : head-tilting problem Circular Polarization 선형편광 (Linear polarization) 에 1/4 파장위상차판 (quarter-wave retarder) 를사용하면원형편광 (Circular polarization) 을만들수있음 원형편광은 head-tilt problem 가없음 문제 : 많은프로젝션스크린이편광을소멸시키는재질임 ; 반사가클때거울도역시편광을소멸시킴 ; LCD 는내부적으로편광을투사함 39 40
Active Shutter Glasses Active stereo Liquid crystal lenses 안경이매우빠르게좌, 우눈을밝고어둡게해서입체감을느끼게함 이안경은비디오디스플레이와동기화 (synchronized) 되어야함 왼쪽눈은홀수프레임을보고오른쪽눈은짝수프레임을보게함 때문에 flickering을막기위해 90Hz 이상의매우빠른비디오화면갱신률 (refresh rate) LCD 프로젝터는빠른 frequency 에적합하지못하고, 싼 DLP 프로젝터는빠른 frequency를지원하도록프로그램되지않음 41 Auto-stereoscopic Auto-stereoscopic은무안경식입체영상 (Glass-free stereo) 으로여러시점에서본이미지가수직스트립들로나눠져서제공됨 Auto-stereoscopic Parallax barrier ( 시차배리어 ): Barrier strip (PHSCologram, Synthagram, etc) separate layer with strips that block all but one image from any viewpoint Lenticular ( 렌티큘러 ): lens like stripes Lenslet ( 렌즈렛 ): Integral photograph or integram 3D displays (3차원디스플레이 ) Holography ( 홀로그래픽 ) Volumetric ( 부피방식 ) Stereoscopic: Active stereo ( 액티브셔터방식 ), Passive stereo ( 편광방식 ), Autostereoscopic ( 무안경식 ) 42 Hologram Volumetric Display MARK-II @ MIT Media Lab Spinning Screen Display Slice-Stacking Display Actuality Systems LightSpace Tech
Autostereo 3D Display Autostereo 3D Display Integral-Imaging System Pickup Display Philips, 42 WOWvx 42-3D6C01 -Lenticular, support for multiusers Pick up device Object Lens array Display panel Lens array Integrated image Pavonine, 17 /19 Dimen -Backlight switchable barrier Sharp, Actius RD3D Notebook -Backlight switchable barrier Parallax Barrier 왼쪽이미지정보를담은줄과오른쪽이미지정보를담은줄이교대로나타나면서하나의 3차원이미지를구성함 수직슬릿 (Vertial slit) 이있는 ( 불투명한소재의 ) 배리어스트립 (Barrier Strips) 을통과하는빛은왼쪽눈으로가는이미지와오른쪽눈으로가는이미지로분할되어입체적으로볼수있음 Lenticular 몇개의이미지를수직으로아주잘게분할하고분할된조각을하나씩돌아가면서배치한뒤반원통형렌즈수직선 (Cylindrical lenses strips) 를통해서 3차원입체적으로볼수있음 47 48
Lenslet Reference 반구형렌즈 (Spherical lenses) 를사용하여수직과수평시차이미지 (Full parallax image) 를만들어줌 http://www.mlab.uiah.fi/nmc/stereo/masters/eng/vocabulary.html http://www.3dnshop.com/dic/list.php php http://local.wasp.uwa.edu.au/~pbourke/projection/caev/ http://web.cs.wpi.edu/~matt/courses/cs563/talks/stereohtml/stere ohtml o.html James Helman SIGGRAPH 93 Applied VR course notes Dennis Proffitts SIGGRAPH 94 Developing Advanced VR Applications course notes Lou Harrison SIGGRAPH 97 Stereo Computer Graphics for Virtual Reality notes http://www.siggraph.org/education/materials/hypervis/virtual.env/ env/ percept.iss/percept.htm http://www.wmin.ac.uk/itrg/is/dpi/hiw/human%20visual%20syst em.pdf http://web.media.mit.edu/~halazar/autostereo/autostereo.html 49 50