Stereo-NEC: Enhancing Stereo Visual-Inertial SLAM Initialization with Normal Epipolar Constraints (2403.07225v1)
Abstract: We propose an accurate and robust initialization approach for stereo visual-inertial SLAM systems. Unlike the current state-of-the-art method, which heavily relies on the accuracy of a pure visual SLAM system to estimate inertial variables without updating camera poses, potentially compromising accuracy and robustness, our approach offers a different solution. We realize the crucial impact of precise gyroscope bias estimation on rotation accuracy. This, in turn, affects trajectory accuracy due to the accumulation of translation errors. To address this, we first independently estimate the gyroscope bias and use it to formulate a maximum a posteriori problem for further refinement. After this refinement, we proceed to update the rotation estimation by performing IMU integration with gyroscope bias removed from gyroscope measurements. We then leverage robust and accurate rotation estimates to enhance translation estimation via 3-DoF bundle adjustment. Moreover, we introduce a novel approach for determining the success of the initialization by evaluating the residual of the normal epipolar constraint. Extensive evaluations on the EuRoC dataset illustrate that our method excels in accuracy and robustness. It outperforms ORB-SLAM3, the current leading stereo visual-inertial initialization method, in terms of absolute trajectory error and relative rotation error, while maintaining competitive computational speed. Notably, even with 5 keyframes for initialization, our method consistently surpasses the state-of-the-art approach using 10 keyframes in rotation accuracy.
- “Keyframe-based visual–inertial odometry using nonlinear optimization” In The International Journal of Robotics Research 34.3, 2015, pp. 314–334 DOI: 10.1177/0278364914554813
- Travis Manderson, Florian Shkurti and Gregory Dudek “Texture-Aware SLAM Using Stereo Imagery and Inertial Information” In 13th Conference on Computer and Robot Vision (CRV), 2016, pp. 456–463 DOI: 10.1109/CRV.2016.69
- “A comparative analysis of tightly-coupled monocular, binocular, and stereo VINS” In IEEE International Conference on Robotics and Automation (ICRA), 2017, pp. 165–172 DOI: 10.1109/ICRA.2017.7989022
- “Direct visual-inertial odometry with stereo cameras” In IEEE International Conference on Robotics and Automation (ICRA), 2016, pp. 1885–1892 DOI: 10.1109/ICRA.2016.7487335
- “Visual-Inertial-Aided Navigation for High-Dynamic Motion in Built Environments Without Initial Conditions” In IEEE Transactions on Robotics 28.1, 2012, pp. 61–76 DOI: 10.1109/TRO.2011.2170332
- “A General Optimization-based Framework for Global Pose Estimation with Multiple Sensors” In arXiv preprint arXiv:1901.03642, 2019
- “ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAM” In IEEE Transactions on Robotics 37.6, 2021, pp. 1874–1890
- “Closed-form solution for absolute scale velocity determination combining inertial measurements and a single feature correspondence” In IEEE International Conference on Robotics and Automation (ICRA), 2011, pp. 4546–4553
- “EDI: ESKF-based Disjoint Initialization for Visual-Inertial SLAM Systems” In Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2023
- Agostino Martinelli “Closed-form solution of visual-inertial structure from motion” In International Journal of Computer Vision (IJCV) 106.2, 2014, pp. 138–152
- “Simultaneous State Initialization and Gyroscope Bias Calibration in Visual Inertial Aided Navigation” In IEEE Robotics and Automation Letters 2.1, 2017, pp. 18–25
- Tue-Cuong Dong-Si and Anastasios I. Mourikis “Estimator initialization in vision-aided inertial navigation with unknown camera-IMU calibration” In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2012, pp. 1064–1071
- Carlos Campos, José M.M. Montiel and Juan D. Tardós “Fast and robust initialization for visual-inertial SLAM” In IEEE International Conference on Robotics and Automation (ICRA), 2019, pp. 1288–1294
- Raul Mur-Artal and Juan D Tardós “Visual-Inertial monocular SLAM with map reuse” In IEEE Robotics and Automation Letters 2.2, 2017, pp. 796–803
- “Online initialization and automatic camera-IMU extrinsic calibration for monocular visual-inertial SLAM” In IEEE International Conference on Robotics and Automation (ICRA), 2018, pp. 5182–5189
- Tong Qin, Peiliang Li and Shaojie Shen “VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator” In IEEE Transactions on Robotics 34.4, 2018, pp. 1004–1020
- Carlos Campos, José M.M. Montiel and Juan D. Tardós “Inertial-Only Optimization for Visual-Inertial Initialization” In IEEE International Conference on Robotics and Automation (ICRA), 2020, pp. 51–57
- “OpenVINS: A Research Platform for Visual-Inertial Estimation” In IEEE International Conference on Robotics and Automation (ICRA), 2020, pp. 4666–4672 DOI: 10.1109/ICRA40945.2020.9196524
- Weibo Huang, Hong Liu and Weiwei Wan “An Online Initialization and Self-Calibration Method for Stereo Visual-Inertial Odometry” In IEEE Transactions on Robotics 36.4, 2020, pp. 1153–1170 DOI: 10.1109/TRO.2019.2959161
- Peiyu Chen, Weipeng Guan and Peng Lu “ESVIO: Event-Based Stereo Visual Inertial Odometry” In IEEE Robotics and Automation Letters 8.6, 2023, pp. 3661–3668 DOI: 10.1109/LRA.2023.3269950
- “Direct Optimization of Frame-to-Frame Rotation” In IEEE International Conference on Computer Vision, 2013, pp. 2352–2359
- “A Rotation-Translation-Decoupled Solution for Robust and Efficient Visual-Inertial Initialization” In IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 739–748
- Laurent Kneip, Roland Siegwart and Marc Pollefeys “Finding the exact rotation between two images independently of the translation” In European Conference on Computer Vision, 2012, pp. 696–709
- Raul Mur-Artal and Juan D. Tardos “ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras” In IEEE Transactions on Robotics 33.5 Institute of ElectricalElectronics Engineers (IEEE), 2017, pp. 1255–1262 DOI: 10.1109/tro.2017.2705103
- “The EuRoC micro aerial vehicle datasets” In The International Journal of Robotics Research, 2016