2000 character limit reached
Online Calibration of a Single-Track Ground Vehicle Dynamics Model by Tight Fusion with Visual-Inertial Odometry (2309.11148v3)
Published 20 Sep 2023 in cs.RO and cs.CV
Abstract: Wheeled mobile robots need the ability to estimate their motion and the effect of their control actions for navigation planning. In this paper, we present ST-VIO, a novel approach which tightly fuses a single-track dynamics model for wheeled ground vehicles with visual inertial odometry (VIO). Our method calibrates and adapts the dynamics model online to improve the accuracy of forward prediction conditioned on future control inputs. The single-track dynamics model approximates wheeled vehicle motion under specific control inputs on flat ground using ordinary differential equations. We use a singularity-free and differentiable variant of the single-track model to enable seamless integration as dynamics factor into VIO and to optimize the model parameters online together with the VIO state variables. We validate our method with real-world data in both indoor and outdoor environments with different terrain types and wheels. In experiments, we demonstrate that ST-VIO can not only adapt to wheel or ground changes and improve the accuracy of prediction under new control inputs, but can even improve tracking accuracy.
- S. Leutenegger, S. Lynen, M. Bosse, R. Siegwart, and P. Furgale, “Keyframe-based visual–inertial odometry using nonlinear optimization,” Int. J. of Robotics Research, vol. 34, no. 3, pp. 314–334, 2015.
- T. Qin, P. Li, and S. Shen, “Vins-mono: A robust and versatile monocular visual-inertial state estimator,” IEEE Transactions on Robotics, vol. 34, no. 4, pp. 1004–1020, 2018.
- V. Usenko, N. Demmel, D. Schubert, J. Stueckler, and D. Cremers, “Visual-inertial mapping with non-linear factor recovery,” IEEE Rob. and Automation Letters (RA-L), vol. 5, no. 2, pp. 422–429, 2020.
- G. Reina, M. Paiano, and J. L. Blanco-Claraco, “Vehicle parameter estimation using a model-based estimator,” Mechanical Systems and Signal Processing, vol. 87, pp. 227–241, 2017.
- M. Wielitzka, M. Dagen, and T. Ortmaier, “Joint unscented Kalman filter for state and parameter estimation in vehicle dynamics,” in IEEE Conference on Control and Applications (CCA), 2015.
- C. You and P. Tsiotras, “Vehicle modeling and parameter estimation using adaptive limited memory joint-state UKF,” Proceedings of the American Control Conference, pp. 322–327, 2017.
- K. J. Wu, C. X. Guo, G. Georgiou, and S. I. Roumeliotis, “Vins on wheels,” in IEEE Int. Conf. on Robotics and Automation (ICRA), 2017.
- W. Lee, K. Eckenhoff, Y. Yang, P. Geneva, and G. Huang, “Visual-inertial-wheel odometry with online calibration,” in IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), 2020.
- B. Nisar, P. Foehn, D. Falanga, and D. Scaramuzza, “Vimo: Simultaneous visual inertial model-based odometry and force estimation,” IEEE Robotics and Automation Letters (RA-L), vol. 4, no. 3, 2019.
- G. Cioffi, L. Bauersfeld, and D. Scaramuzza, “Hdvio: Improving localization and disturbance estimation with hybrid dynamics vio,” in Robotics: Science and Systems, 2023.
- J. Kabzan, L. Hewing, A. Liniger, and M. N. Zeilinger, “Learning-based model predictive control for autonomous racing,” IEEE Robotics and Automation Letters, vol. 4, pp. 3363–3370, 2019.
- S. Aghli and C. Heckman, “Online system identification and calibration of dynamic models for autonomous ground vehicles,” in IEEE Int. Conf. on Robotics and Automation (ICRA), 2018, pp. 4933–4939.
- J. Xu, Q. Luo, K. Xu, X. Xiao, S. Yu, J. Hu, J. Miao, and J. Wang, “An automated learning-based procedure for large-scale vehicle dynamics modeling on baidu apollo platform,” IEEE International Conference on Intelligent Robots and Systems (IROS), pp. 5049–5056, 2019.
- S. Hochreiter and J. Schmidhuber, “Long short-term memory,” Neural Comput., vol. 9, no. 8, p. 1735–1780, nov 1997.
- S. Jiang, W. Lin, Y. Cao, Y. Wang, J. Miao, and Q. Luo, “Learning-based vehicle dynamics residual correction model for autonomous driving simulation,” IEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC, pp. 782–789, 2021.
- F. Ma, J. Shi, Y. Yang, J. Li, and K. Dai, “ACK-MSCKF: Tightly-coupled ackermann multi-state constraint kalman filter for autonomous vehicle localization,” Sensors, vol. 19, 2019.
- P. Zhang, L. Xiong, Z. Yu, R. Kang, M. Xu, and D. Zeng, “VINS-PL-Vehicle: Points and lines-based monocular VINS combined with vehicle kinematics for indoor garage,” IEEE Intelligent Vehicles Symposium, pp. 825–830, 2020.
- L. Xiong, R. Kang, J. Zhao, P. Zhang, M. Xu, R. Ju, C. Ye, and T. Feng, “G-VIDO: A vehicle dynamics and intermittent gnss-aided visual-inertial state estimator for autonomous driving,” IEEE Trans. Intell. Transp. Syst., vol. 23, no. 8, pp. 11 845–11 861, 2022.
- M. Weydert, “Model-based ego-motion and vehicle parameter estimation using visual odometry,” Proceedings of the Mediterranean Electrotechnical Conference - MELECON, pp. 914–919, 2012.
- H. Li and J. Stueckler, “Visual-inertial odometry with online calibration of velocity-control based kinematic motion models,” IEEE Robotics Autom. Lett., vol. 7, no. 3, pp. 6415–6422, 2022.
- V. Zhang, S. M. Thornton, and J. C. Gerdes, “Tire modeling to enable model predictive control of automated vehicles from standstill to the limits of handling,” Int. Symp. on Advanced Vehicle Control, 2018.
- K. M. Lynch, N. Marchuk, and M. L. Elwin, “Chapter 25 - brushed permanent magnet dc motors,” in Embedded Computing and Mechatronics with the PIC32, K. M. Lynch, N. Marchuk, and M. L. Elwin, Eds. Oxford: Newnes, 2016, pp. 399–425.
- Z. Zhang and D. Scaramuzza, “A tutorial on quantitative trajectory evaluation for visual(-inertial) odometry,” in IEEE/RSJ Int. Conf. Intell. Robot. Syst. (IROS), 2018.