An approach to Physics Based Single Photon Vision System Design (2307.15184v7)

Abstract: Design of the camera and optical measurement is a crucial part of optimizing machine vision systems. However, camera designs are usually optimized to produce human interpretable images. Moreover camera optimization is typically making the assumption of additive noise, while modern optical imaging systems are mainly affected by photon noise which is not additive. Previous studies have highlighted the fundamental effect of the noise model on the outcome of the design process in the context of coded single pixel and compressed sensing cameras. In addition to the exact noise model, the nature of the encountered data and vision task fundamentally affects the optimal hardware design. This means that a camera or a compressed sensing code that is optimal for capturing images is almost certainly not optimal for any downstream vision task. In this work, we use a simple end-to-end model on a single-pixel camera to study the effects of the noise model for different vision tasks. We demonstrate the importance of incorporating nonliear noise features in optimizing even the simplest vision systems.