System Calibration of a Field Phenotyping Robot with Multiple High-Precision Profile Laser Scanners (2403.17788v1)
Abstract: The creation of precise and high-resolution crop point clouds in agricultural fields has become a key challenge for high-throughput phenotyping applications. This work implements a novel calibration method to calibrate the laser scanning system of an agricultural field robot consisting of two industrial-grade laser scanners used for high-precise 3D crop point cloud creation. The calibration method optimizes the transformation between the scanner origins and the robot pose by minimizing 3D point omnivariances within the point cloud. Moreover, we present a novel factor graph-based pose estimation method that fuses total station prism measurements with IMU and GNSS heading information for high-precise pose determination during calibration. The root-mean-square error of the distances to a georeferenced ground truth point cloud results in 0.8 cm after parameter optimization. Furthermore, our results show the importance of a reference point cloud in the calibration method needed to estimate the vertical translation of the calibration. Challenges arise due to non-static parameters while the robot moves, indicated by systematic deviations to a ground truth terrestrial laser scan.
- S. Asseng, F. Ewert, P. Martre, R. P. Rötter, D. B. Lobell, D. Cammarano, B. A. Kimball, M. J. Ottman, G. W. Wall, J. W. White et al., “Rising temperatures reduce global wheat production,” Nature climate change, vol. 5, no. 2, pp. 143–147, 2015.
- S. Asseng, P. Martre, A. Maiorano, R. P. Rötter, G. J. O’Leary, G. J. Fitzgerald, C. Girousse, R. Motzo, F. Giunta, M. A. Babar et al., “Climate change impact and adaptation for wheat protein,” Global change biology, vol. 25, no. 1, pp. 155–173, 2019.
- J. L. Araus and J. E. Cairns, “Field high-throughput phenotyping: the new crop breeding frontier,” Trends in plant science, vol. 19, no. 1, pp. 52–61, 2014.
- S. Jay, G. Rabatel, X. Hadoux, D. Moura, and N. Gorretta, “In-field crop row phenotyping from 3d modeling performed using structure from motion,” Computers and Electronics in Agriculture, vol. 110, pp. 70–77, 2015.
- F. Magistri, N. Chebrolu, J. Behley, and C. Stachniss, “Towards in-field phenotyping exploiting differentiable rendering with self-consistency loss,” in 2021 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2021, pp. 13 960–13 966.
- E. Marks, F. Magistri, and C. Stachniss, “Precise 3d reconstruction of plants from uav imagery combining bundle adjustment and template matching,” in 2022 International Conference on Robotics and Automation (ICRA). IEEE, 2022, pp. 2259–2265.
- U. Weiss and P. Biber, “Plant detection and mapping for agricultural robots using a 3d lidar sensor,” Robotics and autonomous systems, vol. 59, no. 5, pp. 265–273, 2011.
- F. Esser, L. Klingbeil, L. Zabawa, and H. Kuhlmann, “Quality analysis of a high-precision kinematic laser scanning system for the use of spatio-temporal plant and organ-level phenotyping in the field,” Remote Sensing, vol. 15, no. 4, p. 1117, 2023.
- Q. Qiu, N. Sun, H. Bai, N. Wang, Z. Fan, Y. Wang, Z. Meng, B. Li, and Y. Cong, “Field-based high-throughput phenotyping for maize plant using 3d lidar point cloud generated with a “phenomobile”,” Frontiers in plant science, vol. 10, p. 554, 2019.
- F. Esser, R. A. Rosu, A. Cornelißen, L. Klingbeil, H. Kuhlmann, and S. Behnke, “Field robot for high-throughput and high-resolution 3d plant phenotyping,” IEEE Robotics & Automation Magazine, 2023.
- H. Kaartinen, J. Hyyppä, A. Kukko, A. Jaakkola, and H. Hyyppä, “Benchmarking the performance of mobile laser scanning systems using a permanent test field,” Sensors, vol. 12, no. 9, pp. 12 814–12 835, 2012.
- E. Heinz, C. Eling, M. Wieland, L. Klingbeil, and H. Kuhlmann, “Development, calibration and evaluation of a portable and direct georeferenced laser scanning system for kinematic 3d mapping,” Journal of Applied Geodesy, vol. 9, no. 4, pp. 227–243, 2015.
- T. O. Chan, D. D. Lichti, and C. L. Glennie, “Multi-feature based boresight self-calibration of a terrestrial mobile mapping system,” ISPRS journal of photogrammetry and remote sensing, vol. 82, pp. 112–124, 2013.
- P. Rieger, N. Studnicka, M. Pfennigbauer, and G. Zach, “Boresight alignment method for mobile laser scanning systems,” Journal of Applied Geodesy, 2010.
- J. Yu, X. Lu, M. Tian, T. O. Chan, and C. Chen, “Automatic extrinsic self-calibration of mobile lidar systems based on planar and spherical features,” Measurement Science and Technology, vol. 32, no. 6, p. 065107, 2021.
- R. Ravi, Y.-J. Lin, M. Elbahnasawy, T. Shamseldin, and A. Habib, “Bias impact analysis and calibration of terrestrial mobile lidar system with several spinning multibeam laser scanners,” IEEE Transactions on Geoscience and Remote Sensing, vol. 56, no. 9, pp. 5261–5275, 2018.
- W. Maddern, A. Harrison, and P. Newman, “Lost in translation (and rotation): Rapid extrinsic calibration for 2d and 3d lidars,” in 2012 IEEE International Conference on Robotics and Automation. IEEE, 2012, pp. 3096–3102.
- M. Hillemann, M. Weinmann, M. S. Mueller, and B. Jutzi, “Automatic extrinsic self-calibration of mobile mapping systems based on geometric 3d features,” Remote Sensing, vol. 11, no. 16, p. 1955, 2019.
- J. Elseberg, D. Borrmann, and A. Nüchter, “Automatic and full calibration of mobile laser scanning systems,” in Experimental Robotics: The 13th International Symposium on Experimental Robotics. Springer, 2013, pp. 907–917.
- G. Tombrink, A. Dreier, L. Klingbeil, and H. Kuhlmann, “Trajectory evaluation using repeated rail-bound measurements,” Journal of Applied Geodesy, no. 0, 2023.
- M. Weinmann, B. Jutzi, and C. Mallet, “Geometric features and their relevance for 3d point cloud classification,” ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. 4, pp. 157–164, 2017.
- A. Dittrich, M. Weinmann, and S. Hinz, “Analytical and numerical investigations on the accuracy and robustness of geometric features extracted from 3d point cloud data,” ISPRS journal of photogrammetry and remote sensing, vol. 126, pp. 195–208, 2017.
- F. Dellaert, “Factor graphs and gtsam: A hands-on introduction,” Georgia Institute of Technology, Tech. Rep, vol. 2, p. 4, 2012.
- C. Forster, L. Carlone, F. Dellaert, and D. Scaramuzza, “On-manifold preintegration for real-time visual–inertial odometry,” IEEE Transactions on Robotics, vol. 33, no. 1, pp. 1–21, 2016.
- L. Carlone, Z. Kira, C. Beall, V. Indelman, and F. Dellaert, “Eliminating conditionally independent sets in factor graphs: A unifying perspective based on smart factors,” in 2014 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2014, pp. 4290–4297.
- T. Lupton and S. Sukkarieh, “Visual-inertial-aided navigation for high-dynamic motion in built environments without initial conditions,” IEEE Transactions on Robotics, vol. 28, no. 1, pp. 61–76, 2011.
- M. Kaess, H. Johannsson, R. Roberts, V. Ila, J. J. Leonard, and F. Dellaert, “isam2: Incremental smoothing and mapping using the bayes tree,” The International Journal of Robotics Research, vol. 31, no. 2, pp. 216–235, 2012.
- M. Kaess, H. Johannsson, R. Roberts, V. Ila, J. Leonard, and F. Dellaert, “isam2: Incremental smoothing and mapping with fluid relinearization and incremental variable reordering,” in 2011 IEEE International Conference on Robotics and Automation. IEEE, 2011, pp. 3281–3288.
- D. Lague, N. Brodu, and J. Leroux, “Accurate 3d comparison of complex topography with terrestrial laser scanner: Application to the rangitikei canyon (nz),” ISPRS journal of photogrammetry and remote sensing, vol. 82, pp. 10–26, 2013.