CMOS IMAE SENSOR and Its Application W.H. Jo System IC SP Div. MT CIS Dev. Team
CONTENTS INTRODUCTION CHARE COUPLED DEVICE(CCD) CMOS IMAE SENSOR(CIS) PIXEL STRUCTURE CONSIDERIN ISSUES SINAL PROCESSIN
Mobile Application Hyca Application INTRODUCTION 15.5 15.5mm Old Version (CIS+ISP) Two Chips Hyca3 (ISP Merged) Single Chip Mobile Phone Row Driver PDA Chip Block Diagram Pixel Array Notebook I 2 C Timing and Control Register CDS/PA/ADC ISP Block RB/YUV 16/8bit
Hynix Camera Module Structure Single Chip Solution INTRODUCTION CIS ISP + Block Diagram Pixel Column CDS ADC with Knee + RoW Decoder LENS Timing Control PA/ADC Configure Register AWB AE I2C Hyca Camera Module RESETB MCLK ENB SCK SDA amma Color Interpolation Scaling Color Correction Color Space Conversion Output Formatting VCLK Y[7:0] C[7:0] VSYNC HSYNC
Application Market Forecast Unit: Mpcs 350 300 Toy camera 250 INTRODUCTION Dual DSC DSC PC camera Mobile camera 200 150 100 50 0 2001 2002 2003 2004 2005 2006 Unit: Mpcs ( 02~ 06) 2001 2002 2003 2004 2005 2006 CAR Mobile cameras 4 19 70 110 170 250 90.5% PC Cameras 9 10 15 20 25 30 31.6% DSC 2 6 9 14 20 28 47.0% Dual mode cameras 1 2 4 7 10 13 59.7% Toy cameras 2 3 4 6 8 10 35.1%
INTRODUCTION CMOS Image Sensor and Its Application Object Luminance to Photons
INTRODUCTION CMOS Image Sensor and Its Application Si-Absorption Coefficient
INTRODUCTION CMOS Image Sensor and Its Application eneration of e-h Pairs
INTRODUCTION CMOS Image Sensor and Its Application Collection of Electrons
INTRODUCTION CMOS Image Sensor and Its Application Photon Sensing
INTRODUCTION CMOS Image Sensor and Its Application Mis-diffusion of Electrons
CHARE COUPLED DEVICE(CCD) CMOS Image Sensor and Its Application Vertical Structure & Potential Curve
CHARE COUPLED DEVICE(CCD) CMOS Image Sensor and Its Application Making Potential Well
CHARE COUPLED DEVICE(CCD) CMOS Image Sensor and Its Application Charge Transfer(1/2)
CHARE COUPLED DEVICE(CCD) Charge Transfer(2/2)
CHARE COUPLED DEVICE(CCD) Charge Transfer Architectures
Image Sensor Architectures CMOS IMAE SENSOR(CIS) Horizontal CCD (Analog Shift Register) Vertical CCD(Analog Shift Register Row Decoder Column Amplifiers Column Decoder
CMOS Enables Integration CMOS IMAE SENSOR(CIS) Lens RB PATTERN Analog Signal Chain Control Block ADC Image Signal Processor
CMOS IMAE SENSOR(CIS) CMOS Image Sensor and Its Application Performance Comparison : CMOS Sensor & CCD
Passive Pixel Row Select PIXEL STRUCTURE Row Select
Photodiode Active Pixel Row Select PIXEL STRUCTURE Row Select T SL
Photogate Active Pixel Row Select PIXEL STRUCTURE T SL T TX Row Select Transfer ate
Photodiode Pixel - 3T Current Output Row Select PIXEL STRUCTURE Row Select T SL
PIXEL STRUCTURE CMOS Image Sensor and Its Application Photo-Charge Collection
Pixel Layout Example and Fill Factor Row Select PIXEL STRUCTURE T TX T SL Transfer ate
PIXEL STRUCTURE CMOS Image Sensor and Its Application Pixel Architecture Layout Comparison
PIXEL STRUCTURE CMOS Image Sensor and Its Application Micro-Lenses(1/3)
PIXEL STRUCTURE CMOS Image Sensor and Its Application Micro-Lenses(2/3)
PIXEL STRUCTURE CMOS Image Sensor and Its Application Micro-Lenses(3/3)
On-Chip Color Filter Arrays PIXEL STRUCTURE B B B B R R R R B B B B R R R R B B B B R R R R B B B B R R R R YE M M M M YE M M M M YE CY YE CY YE CY YE CY CY YE CY YE CY YE CY CY YE CY YE CY YE CY M M M M YE CY YE CY YE CY YE CY M M M M CY CY YE CY YE CY YE CY YE R R R R R R R R YE CY YE CY YE CY YE CY B B B B B B B B CY YE CY YE CY YE CY YE R R R R R R R R YE CY YE CY YE CY YE CY B B B B B B B B
On-Chip A/D Conversion CONSIDERIN ISSUES Row Decoder Column Amplifiers A/D A/D Column Decoder
Temporal Noise -- APS Row Select CONSIDERIN ISSUES Row Select T SL
Fixed Pattern Noise Components Row Select CONSIDERIN ISSUES Row Decoder Column Decoder Column Amplifiers T SL
CONSIDERIN ISSUES CMOS Image Sensor and Its Application Fixed Pattern Noise
CONSIDERIN ISSUES CMOS Image Sensor and Its Application Spatial Resolution
CONSIDERIN ISSUES CMOS Image Sensor and Its Application Effect of LPF and Aliasing
Image Lag CONSIDERIN ISSUES V P V TX V TX
Leakage Current CONSIDERIN ISSUES V P V TX
CONSIDERIN ISSUES CMOS Image Sensor and Its Application Pixel Size
Image Signal Processing Data Path SINAL PROCESSIN Bayer image
Image Signal Processing Block Diagram SINAL PROCESSIN 8bit Bayer RB Stream Y CbCr Color Interpolation to 24bit RB Histogram Equalization Color Correction Y Y YCbCr Edge Enhancement False Color Suppression AE AWB RB ain Control by AWB amma Correction Output Formatting Integration Time Setting RB gain control YCbCr 4:2:2 Color Space Conversion Compression Engine
Color Interpolation(1/3) SINAL PROCESSIN Interpolation Slide Window P ij P i+1j P ij+1 P i+1j+1 < Interpolation eneralization > 1. when P ij = red, Rij = P ij ij = (P ij+1 + P i+1j ) / 2 Bij = P i+1j+1 r11 g21 g12 b22 r13 g23 g14 b24 Current Interpolation Slide Window Position 2. when P ij = green, a) P ij+1 = red Rij = P ij+1 ij = (P ij + P i+1j+1 ) / 2 Bij = P i+1j b) P ij+1 = blue Rij = P i+1j ij = (P ij + P i+1j+1 ) / 2 Bij = P ij+1 R1111 R1212 B11 B12...... R2121 R2222 B21 B22 3. when P ij = blue, Rij = P i+1j+1 ij = (P ij+1 + P i+1j ) / 2 Bij = P ij
Color Interpolation(2/3) SINAL PROCESSIN
Color Interpolation(3/3) SINAL PROCESSIN Bayer Image before color interpolation Interpolation using typical 2x2 bilinear smooth hue transition filter Interpolation using 5x5 adaptive spatial filter -Quite color moirés -Blurred Edge -Almost no color moirés -Super edge reproduction
SINAL PROCESSIN Color Correction Rnew new Bnew Color = Correction Matrix R B
amma Correction (1/2) SINAL PROCESSIN Image Data (R//B) ammac ammab amma Curve amma Corrected Data = + = = CRT Response Curve Final Linear Image Data Linear Response
amma Correction (2/2) SINAL PROCESSIN γ = 0.45
Color Space Converter SINAL PROCESSIN Y = ( 77R + 150 + 29B)/256, Range: 16 ~ 235 Cb = (-44R - 87 + 131B)/256 + 128, Range: 16 ~ 240 Cr = (131R - 110-21B)/256 + 128, Range: 16 ~ 240 Y Color Space R Cb Conversion Cr 3x3 Matrix B
Histogram Equalization SINAL PROCESSIN Number of pixels HistoEq(Y) Yvariance Pixel values = Histogram Equalization = Yx Ptarget - + Ymean Ytarget Ymean Number of pixels x Yvariance Pixel values Applicable Formula
Edge Enhancement SINAL PROCESSIN
Auto Exposure SINAL PROCESSIN
Auto White Balance(1/3) SINAL PROCESSIN Spectral reflectance of an object Spectral power distribution of two illuminants Spectral power distribution of light reflected from object Image Sensor with no adaptation White Balance Correction in image signal processing The flow of Imaging System
Auto White Balance(2/3) SINAL PROCESSIN Color Space Conversion YCbCr streams Yes No Segment Allocation statistics repeat New RB... Segments Statistics Analyzer Color Correction... Weighting Enforcer Scene CbCr Cr AWBCr - AWBCb White Balance Checker Cb Yes No White Point Deviation Range AWBCb - AWBCr
Auto White Balance(3/3) SINAL PROCESSIN