OSPC: Online Sequential Photometric Calibration (2305.17673v2)
Abstract: Photometric calibration is essential to many computer vision applications. One of its key benefits is enhancing the performance of Visual SLAM, especially when it depends on a direct method for tracking, such as the standard KLT algorithm. Another advantage could be in retrieving the sensor irradiance values from measured intensities, as a pre-processing step for some vision algorithms, such as shape-from-shading. Current photometric calibration systems rely on a joint optimization problem and encounter an ambiguity in the estimates, which can only be resolved using ground truth information. We propose a novel method that solves for photometric parameters using a sequential estimation approach. Our proposed method achieves high accuracy in estimating all parameters; furthermore, the formulations are linear and convex, which makes the solution fast and suitable for online applications. Experiments on a Visual Odometry system validate the proposed method and demonstrate its advantages.
- Online photometric calibration of auto exposure video for realtime visual odometry and slam. IEEE Robotics and Automation Letters, 3(2):627–634, 2017.
- Recovering high dynamic range radiance maps from photographs. In ACM SIGGRAPH 2008 classes, pages 1–10. 2008.
- Direct sparse odometry. IEEE transactions on pattern analysis and machine intelligence, 40(3):611–625, 2017.
- A photometrically calibrated benchmark for monocular visual odometry. arXiv preprint arXiv:1607.02555, 2016.
- Vignette and exposure calibration and compensation. In Tenth IEEE International Conference on Computer Vision (ICCV’05) Volume 1, volume 1, pages 899–906 Vol. 1, 2005.
- Determining the camera response from images: what is knowable? IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(11):1455–1467, 2003.
- What is the space of camera response functions? In 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings., volume 2, pages II–602. IEEE, 2003.
- Post-processing approach for radiometric self-calibration of video. In IEEE International Conference on Computational Photography (ICCP), pages 1–9. IEEE, 2013.
- Takeo Kanade. An iterative image registration technique with an application to stereo vision (ijcai).
- Radiometric calibration with illumination change for outdoor scene analysis. In 2008 IEEE Conference on Computer Vision and Pattern Recognition, pages 1–8, 2008.
- Joint radiometric calibration and feature tracking system with an application to stereo. Computer Vision and Image Understanding, 114(5):574–582, 2010.
- Robust radiometric calibration and vignetting correction. IEEE transactions on pattern analysis and machine intelligence, 30(4):562–576, 2008.
- Radiometric calibration from a single image. In Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004., volume 2, pages II–II. IEEE, 2004.
- Determining the radiometric response function from a single grayscale image. In 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), volume 2, pages 66–73. IEEE, 2005.
- David G Lowe. Distinctive image features from scale-invariant keypoints. International journal of computer vision, 60(2):91–110, 2004.
- Radiometric self calibration. In Proceedings. 1999 IEEE computer society conference on computer vision and pattern recognition (Cat. No PR00149), volume 1, pages 374–380. IEEE, 1999.
- Ambiguity-free radiometric calibration for internet photo collections. IEEE Transactions on Pattern Analysis and Machine Intelligence, 42(7):1670–1684, 2019.
- The tum vi benchmark for evaluating visual-inertial odometry. in 2018 ieee. In RSJ International Conference on Intelligent Robots and Systems (IROS), pages 1680–1687.
- Jianbo Shi and Tomasi. Good features to track. In 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pages 593–600, 1994.
- Single-image vignetting correction. IEEE transactions on pattern analysis and machine intelligence, 31(12):2243–2256, 2008.