CONTENTS INTRODUCTION CHARE COUPLED DEVICE(CCD) CMOS IMAE SENSOR(CIS) PIXEL STRUCTURE CONSIDERIN ISSUES SINAL PROCESSIN

Size: px

Start display at page:

Download "CONTENTS INTRODUCTION CHARE COUPLED DEVICE(CCD) CMOS IMAE SENSOR(CIS) PIXEL STRUCTURE CONSIDERIN ISSUES SINAL PROCESSIN"

효섭 양
6 years ago
Views:

1 CMOS IMAE SENSOR and Its Application W.H. Jo System IC SP Div. MT CIS Dev. Team

2 CONTENTS INTRODUCTION CHARE COUPLED DEVICE(CCD) CMOS IMAE SENSOR(CIS) PIXEL STRUCTURE CONSIDERIN ISSUES SINAL PROCESSIN

Mobile Application Hyca Application INTRODUCTION 15.5 15.

3 Mobile Application Hyca Application INTRODUCTION mm Old Version (CIS+ISP) Two Chips Hyca3 (ISP Merged) Single Chip Mobile Phone Row Driver PDA Chip Block Diagram Pixel Array Notebook I 2 C Timing and Control Register CDS/PA/ADC ISP Block RB/YUV 16/8bit

4 Hynix Camera Module Structure Single Chip Solution INTRODUCTION CIS ISP + Block Diagram Pixel Column CDS ADC with Knee + RoW Decoder LENS Timing Control PA/ADC Configure Register AWB AE I2C Hyca Camera Module RESETB MCLK ENB SCK SDA amma Color Interpolation Scaling Color Correction Color Space Conversion Output Formatting VCLK Y[7:0] C[7:0] VSYNC HSYNC

5 Application Market Forecast Unit: Mpcs Toy camera 250 INTRODUCTION Dual DSC DSC PC camera Mobile camera Unit: Mpcs ( 02~ 06) CAR Mobile cameras % PC Cameras % DSC % Dual mode cameras % Toy cameras %

6 INTRODUCTION CMOS Image Sensor and Its Application Object Luminance to Photons

7 INTRODUCTION CMOS Image Sensor and Its Application Si-Absorption Coefficient

8 INTRODUCTION CMOS Image Sensor and Its Application eneration of e-h Pairs

9 INTRODUCTION CMOS Image Sensor and Its Application Collection of Electrons

10 INTRODUCTION CMOS Image Sensor and Its Application Photon Sensing

11 INTRODUCTION CMOS Image Sensor and Its Application Mis-diffusion of Electrons

12 CHARE COUPLED DEVICE(CCD) CMOS Image Sensor and Its Application Vertical Structure & Potential Curve

13 CHARE COUPLED DEVICE(CCD) CMOS Image Sensor and Its Application Making Potential Well

14 CHARE COUPLED DEVICE(CCD) CMOS Image Sensor and Its Application Charge Transfer(1/2)

15 CHARE COUPLED DEVICE(CCD) Charge Transfer(2/2)

16 CHARE COUPLED DEVICE(CCD) Charge Transfer Architectures

17 Image Sensor Architectures CMOS IMAE SENSOR(CIS) Horizontal CCD (Analog Shift Register) Vertical CCD(Analog Shift Register Row Decoder Column Amplifiers Column Decoder

18 CMOS Enables Integration CMOS IMAE SENSOR(CIS) Lens RB PATTERN Analog Signal Chain Control Block ADC Image Signal Processor

19 CMOS IMAE SENSOR(CIS) CMOS Image Sensor and Its Application Performance Comparison : CMOS Sensor & CCD

20 Passive Pixel Row Select PIXEL STRUCTURE Row Select

21 Photodiode Active Pixel Row Select PIXEL STRUCTURE Row Select T SL

22 Photogate Active Pixel Row Select PIXEL STRUCTURE T SL T TX Row Select Transfer ate

23 Photodiode Pixel - 3T Current Output Row Select PIXEL STRUCTURE Row Select T SL

24 PIXEL STRUCTURE CMOS Image Sensor and Its Application Photo-Charge Collection

25 Pixel Layout Example and Fill Factor Row Select PIXEL STRUCTURE T TX T SL Transfer ate

26 PIXEL STRUCTURE CMOS Image Sensor and Its Application Pixel Architecture Layout Comparison

27 PIXEL STRUCTURE CMOS Image Sensor and Its Application Micro-Lenses(1/3)

28 PIXEL STRUCTURE CMOS Image Sensor and Its Application Micro-Lenses(2/3)

29 PIXEL STRUCTURE CMOS Image Sensor and Its Application Micro-Lenses(3/3)

On-Chip Color Filter Arrays PIXEL STRUCTURE B B B B R R R R B B B B R R R R B B B B R R R R B B B B R R R R YE M M M M YE M M M M YE CY YE CY YE CY YE CY CY YE CY YE CY YE CY CY YE CY YE CY YE CY M

30 On-Chip Color Filter Arrays PIXEL STRUCTURE B B B B R R R R B B B B R R R R B B B B R R R R B B B B R R R R YE M M M M YE M M M M YE CY YE CY YE CY YE CY CY YE CY YE CY YE CY CY YE CY YE CY YE CY M M M M YE CY YE CY YE CY YE CY M M M M CY CY YE CY YE CY YE CY YE R R R R R R R R YE CY YE CY YE CY YE CY B B B B B B B B CY YE CY YE CY YE CY YE R R R R R R R R YE CY YE CY YE CY YE CY B B B B B B B B

31 On-Chip A/D Conversion CONSIDERIN ISSUES Row Decoder Column Amplifiers A/D A/D Column Decoder

32 Temporal Noise -- APS Row Select CONSIDERIN ISSUES Row Select T SL

33 Fixed Pattern Noise Components Row Select CONSIDERIN ISSUES Row Decoder Column Decoder Column Amplifiers T SL

34 CONSIDERIN ISSUES CMOS Image Sensor and Its Application Fixed Pattern Noise

35 CONSIDERIN ISSUES CMOS Image Sensor and Its Application Spatial Resolution

36 CONSIDERIN ISSUES CMOS Image Sensor and Its Application Effect of LPF and Aliasing

37 Image Lag CONSIDERIN ISSUES V P V TX V TX

38 Leakage Current CONSIDERIN ISSUES V P V TX

39 CONSIDERIN ISSUES CMOS Image Sensor and Its Application Pixel Size

40 Image Signal Processing Data Path SINAL PROCESSIN Bayer image

41 Image Signal Processing Block Diagram SINAL PROCESSIN 8bit Bayer RB Stream Y CbCr Color Interpolation to 24bit RB Histogram Equalization Color Correction Y Y YCbCr Edge Enhancement False Color Suppression AE AWB RB ain Control by AWB amma Correction Output Formatting Integration Time Setting RB gain control YCbCr 4:2:2 Color Space Conversion Compression Engine

42 Color Interpolation(1/3) SINAL PROCESSIN Interpolation Slide Window P ij P i+1j P ij+1 P i+1j+1 < Interpolation eneralization > 1. when P ij = red, Rij = P ij ij = (P ij+1 + P i+1j ) / 2 Bij = P i+1j+1 r11 g21 g12 b22 r13 g23 g14 b24 Current Interpolation Slide Window Position 2. when P ij = green, a) P ij+1 = red Rij = P ij+1 ij = (P ij + P i+1j+1 ) / 2 Bij = P i+1j b) P ij+1 = blue Rij = P i+1j ij = (P ij + P i+1j+1 ) / 2 Bij = P ij+1 R1111 R1212 B11 B R2121 R2222 B21 B22 3. when P ij = blue, Rij = P i+1j+1 ij = (P ij+1 + P i+1j ) / 2 Bij = P ij

43 Color Interpolation(2/3) SINAL PROCESSIN

44 Color Interpolation(3/3) SINAL PROCESSIN Bayer Image before color interpolation Interpolation using typical 2x2 bilinear smooth hue transition filter Interpolation using 5x5 adaptive spatial filter -Quite color moirés -Blurred Edge -Almost no color moirés -Super edge reproduction

45 SINAL PROCESSIN Color Correction Rnew new Bnew Color = Correction Matrix R B

46 amma Correction (1/2) SINAL PROCESSIN Image Data (R//B) ammac ammab amma Curve amma Corrected Data = + = = CRT Response Curve Final Linear Image Data Linear Response

47 amma Correction (2/2) SINAL PROCESSIN γ = 0.45

48 Color Space Converter SINAL PROCESSIN Y = ( 77R B)/256, Range: 16 ~ 235 Cb = (-44R B)/ , Range: 16 ~ 240 Cr = (131R B)/ , Range: 16 ~ 240 Y Color Space R Cb Conversion Cr 3x3 Matrix B

49 Histogram Equalization SINAL PROCESSIN Number of pixels HistoEq(Y) Yvariance Pixel values = Histogram Equalization = Yx Ptarget - + Ymean Ytarget Ymean Number of pixels x Yvariance Pixel values Applicable Formula

50 Edge Enhancement SINAL PROCESSIN

51 Auto Exposure SINAL PROCESSIN

52 Auto White Balance(1/3) SINAL PROCESSIN Spectral reflectance of an object Spectral power distribution of two illuminants Spectral power distribution of light reflected from object Image Sensor with no adaptation White Balance Correction in image signal processing The flow of Imaging System

53 Auto White Balance(2/3) SINAL PROCESSIN Color Space Conversion YCbCr streams Yes No Segment Allocation statistics repeat New RB... Segments Statistics Analyzer Color Correction... Weighting Enforcer Scene CbCr Cr AWBCr - AWBCb White Balance Checker Cb Yes No White Point Deviation Range AWBCb - AWBCr

54 Auto White Balance(3/3) SINAL PROCESSIN

Microsoft PowerPoint - 카메라 시스템

Microsoft PowerPoint - 카메라 시스템 카메라 시스템 中 I. CMOS Image Sensor CCD / CIS @ CCD와 CMOS 이미지센서는 광검출 방식에 있어서 모두 p-n 포토다이오드 (photodiode)를 이용한다. 그러나 CCD와 CMOS는 포토다이오드에서 광 검출을 통해 출력된 전자를 전송하는 회로에 있어서 근본적으로 전혀 다른 방식을 채택하고 있다. @ CCD는 개개의 MOS (metal