Double Binnable RGB, RGBW and LMS Color Filter Arrays (2306.17078v2)
Abstract: New, high-resolution CMOS image sensors for mobile phones have moved beyond the single-binnable Quad Bayer and RGBW-Kodak patterns to the double binnable Hexadeca Bayer pattern featuring 4x4 tiles of like-colored pixels. Pixel binning enables high-speed, low-power readout in low-resolution modes and, more importantly, a reduction of read noise via floating diffusion binning. In this paper, we present the non-intuitive result that Nona and Hexadeca Bayer can be superior to Quad Bayer in demosaicking quality due to degeneracies in the latter's spectrum. However, Hexadeca Bayer suffers from the weakness of generating Quad Bayer after on round of binning. We introduce novel double binnable RGBW and LMS CFAs, composed of 2x2 tiles capable of 4:1 floating diffusion binning, that are free from spectral degeneracies and thus demosaic well in full resolution and both binned modes. RGBW offers a 6 dB low-light, read noise-limited, SNR advantage over Quad and Hexadeca Bayer in all resolution modes, while for LMS, the corresponding advantage is 4.2 dB.
- “Method and apparatus for improving low-light performance for small pixel image sensors,” June 11 2013, US Patent 8,462,220.
- “Improving low-light cmos performance with four-transistor four-shared pixel architecture and charge-domain binning,” in Digital Photography II. SPIE, 2006, vol. 6069, pp. 25–33.
- “1.5 μ𝜇\muitalic_μ dual conversion gain, backside illuminated image sensor using stacked pixel level connections with 13ke-full-well capacitance and 0.8 e-noise,” in 2018 IEEE International Electron Devices Meeting (IEDM). IEEE, 2018, pp. 10–1.
- “A 0.8 μ𝜇\muitalic_μm smart dual conversion gain pixel for 64 megapixels cmos image sensor with 12k e-full-well capacitance and low dark noise,” in 2019 IEEE International Electron Devices Meeting (IEDM). IEEE, 2019, pp. 16–2.
- “New digital camera sensor architecture for low light imaging,” in 2009 16th IEEE International Conference on Image Processing (ICIP). IEEE, 2009, pp. 2681–2684.
- Eric Dubois, “Color filter array sampling of color images,” in Single-Sensor Imaging Methods and Applications for Digital Cameras, Rastislav Lukac, Ed., chapter 7, pp. 183–212. CRC Press, 2008.
- “A 0.8 μ𝜇\muitalic_μm nonacell for 108 megapixels cmos image sensor with fd-shared dual conversion gain and 18,000 e-full-well capacitance,” in 2020 IEEE International Electron Devices Meeting (IEDM). IEEE, 2020, pp. 16–2.
- T. Singh and M. Singh, “Disregarding Spectral Overlap - a unified approach for Demosaicking, Compressive Sensing and Color Filter Array Design,” in Proc. of IEEE ICIP, 2011.
- “New Color Filter Arrays of High Light Sensitivity and High Demosaicking Performance,” in Proc. of IEEE ICIP, 2011.
- “Demosaicking algorithm for the kodak-rgbw color filter array,” in Color Imaging XX: Displaying, Processing, Hardcopy, and Applications. SPIE, 2015, vol. 9395, pp. 27–32.
- “The case for an lms camera,” Electronic Imaging, vol. 35, no. 15, pp. 201–1–201–1, 2023.
- “Adaptive residual interpolation for color and multispectral image demosaicking,” Sensors, vol. 17, no. 12, pp. 2787, 2017.