Photometric Correction for Infrared Sensors
Abstract: Infrared thermography has been widely used in several domains to capture and measure temperature distributions across surfaces and objects. This methodology can be further expanded to 3D applications if the spatial distribution of the temperature distribution is available. Structure from Motion (SfM) is a photometric range imaging technique that makes it possible to obtain 3D renderings from a cloud of 2D images. To explore the possibility of 3D reconstruction via SfM from infrared images, this article proposes a photometric correction model for infrared sensors based on temperature constancy. Photometric correction is accomplished by estimating the scene irradiance as the values from the solution to a differential equation for microbolometer pixel excitation with unknown coefficients and initial conditions. The model was integrated into an SfM framework and experimental evaluations demonstrate the contribution of the photometric correction for improving the estimates of both the camera motion and the scene structure. Further, experiments show that the reconstruction quality from the corrected infrared imagery achieves performance on par with state-of-the-art reconstruction using RGB sensors.
- “Are Boson, Tau 2, and Quark 2 and Lepton rolling shutter cameras or framing cameras?” Accessed: 2022-05-31, https://flir.custhelp.com/app/answers/detail/a_id/3090/related/1
- Steven S. Beauchemin and John L. Barron “The computation of optical flow” In ACM computing surveys (CSUR) 27.3 ACM New York, NY, USA, 1995, pp. 433–466
- Donald J Berndt and James Clifford “Using dynamic time warping to find patterns in time series.” In KDD workshop 10.16, 1994, pp. 359–370 Seattle, WA, USA:
- “ULIS bolometer improvements for fast imaging applications” In Infrared Technology and Applications XLV 11002, 2019, pp. 366–375 SPIE
- “CMOS Image Sensor Random Telegraph Noise Time Constant Extraction From Correlated To Uncorrelated Double Sampling” In IEEE Journal of the Electron Devices Society 5.1, 2017, pp. 79–89 DOI: 10.1109/JEDS.2016.2623799
- Manash Pratim Das, Larry Matthies and Shreyansh Daftry “Online photometric calibration of automatic gain thermal infrared cameras” In IEEE Robotics and Automation Letters 6.2 IEEE, 2021, pp. 2453–2460
- “Computing discrete Fréchet distance” Technical Report CD-TR 94/64, Christian Doppler Laboratory for Expert …, 1994
- “Chameleon on fire—thermal infrared indoor positioning” In 2014 IEEE/ION Position, Location and Navigation Symposium-PLANS 2014, 2014, pp. 637–644 IEEE
- Jakob Engel, Vladlen Koltun and Daniel Cremers “Direct sparse odometry” In IEEE transactions on pattern analysis and machine intelligence 40.3 IEEE, 2017, pp. 611–625
- Jakob Engel, Thomas Schöps and Daniel Cremers “LSD-SLAM: Large-scale direct monocular SLAM” In European conference on computer vision, 2014, pp. 834–849 Springer
- Jakob Engel, Jörg Stückler and Daniel Cremers “Large-scale direct SLAM with stereo cameras” In 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2015, pp. 1935–1942 DOI: 10.1109/IROS.2015.7353631
- Jakob Engel, Vladyslav Usenko and Daniel Cremers “A photometrically calibrated benchmark for monocular visual odometry” In arXiv preprint arXiv:1607.02555, 2016
- P. Favaro, Hailin Jin and S. Soatto “A semi-direct approach to structure from motion” In Proceedings 11th International Conference on Image Analysis and Processing, 2001, pp. 250–255 DOI: 10.1109/ICIAP.2001.957017
- Christian Forster, Matia Pizzoli and Davide Scaramuzza “SVO: Fast semi-direct monocular visual odometry” In 2014 IEEE international conference on robotics and automation (ICRA), 2014, pp. 15–22 IEEE
- “LWIR sensor parameters for deep learning object detectors” In OSA Continuum 4.2 Optical Society of America, 2021, pp. 529–541
- Caroline Hyll “Infrared Emittance of Paper: Method Development, Measurements and Application”, 2012
- Shehryar Khattak, Christos Papachristos and Kostas Alexis “Keyframe-based direct thermal–inertial odometry” In 2019 International Conference on Robotics and Automation (ICRA), 2019, pp. 3563–3569 IEEE
- Shehryar Khattak, Christos Papachristos and Kostas Alexis “Keyframe-based thermal–inertial odometry” In Journal of Field Robotics 37.4 Wiley Online Library, 2020, pp. 552–579
- Sungho Kim, Woo-Jin Song and So-Hyun Kim “Infrared variation optimized deep convolutional neural network for robust automatic ground target recognition” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2017, pp. 1–8
- Margaret Kohin and Neal R Butler “Performance limits of uncooled VOx microbolometer focal plane arrays” In Infrared Technology and Applications XXX 5406, 2004, pp. 447–453 SPIE
- “Keyframe-based visual–inertial odometry using nonlinear optimization” In The International Journal of Robotics Research 34.3 SAGE Publications Sage UK: London, England, 2015, pp. 314–334
- “Thermal stereo odometry for UAVs” In IEEE Sensors Journal 15.11 IEEE, 2015, pp. 6335–6347
- “All-weather vision for automotive safety: which spectral band?” In International Forum on Advanced Microsystems for Automotive Applications, 2018, pp. 3–15 Springer
- “Unmanned ground vehicle perception using thermal infrared cameras” In Unmanned Systems Technology XIII 8045, 2011, pp. 19–44 Spie
- Johannes L Schonberger and Jan-Michael Frahm “Structure-from-motion revisited” In Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 4104–4113
- Jae Kyu Suhr “Kanade-lucas-tomasi (klt) feature tracker” In Computer Vision (EEE6503) Yonsei University Seoul, Korea, 2009, pp. 9–18
- “TELEDYNE FLIR Dataset” Accessed: 2022-05-31, https://flir.box.com/s/suwst0b3k9rko35homhr3rnyytf3102d
- “Time Constant Design of Tau2 and Quark2” Accessed: 2022-11-06, https://flir.custhelp.com/app/answers/detail/a_id/3171/related/1
- Ming Wilson “Temperature measurement” In Anaesthesia & Intensive Care Medicine 22.3, 2021, pp. 202–207 DOI: https://doi.org/10.1016/j.mpaic.2021.01.015
- “A thermal infrared video benchmark for visual analysis” In CVPR PBVS Workshop, 2014, pp. 201–208
Paper Prompts
Sign up for free to create and run prompts on this paper.