RTS-GT: Robotic Total Stations Ground Truthing dataset (2309.11935v2)
Abstract: Numerous datasets and benchmarks exist to assess and compare Simultaneous Localization and Mapping (SLAM) algorithms. Nevertheless, their precision must follow the rate at which SLAM algorithms improved in recent years. Moreover, current datasets fall short of comprehensive data-collection protocol for reproducibility and the evaluation of the precision or accuracy of the recorded trajectories. With this objective in mind, we proposed the Robotic Total Stations Ground Truthing dataset (RTS-GT) dataset to support localization research with the generation of six-Degrees Of Freedom (DOF) ground truth trajectories. This novel dataset includes six-DOF ground truth trajectories generated using a system of three Robotic Total Stations (RTSs) tracking moving robotic platforms. Furthermore, we compare the performance of the RTS-based system to a Global Navigation Satellite System (GNSS)-based setup. The dataset comprises around sixty experiments conducted in various conditions over a period of 17 months, and encompasses over 49 kilometers of trajectories, making it the most extensive dataset of RTS-based measurements to date. Additionally, we provide the precision of all poses for each experiment, a feature not found in the current state-of-the-art datasets. Our results demonstrate that RTSs provide measurements that are 22 times more stable than GNSS in various environmental settings, making them a valuable resource for SLAM benchmark development.
- “Multi-Modal Lidar Dataset for Benchmarking General-Purpose Localization and Mapping Algorithms” In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2022, pp. 3837–3844 DOI: 10.1109/IROS47612.2022.9981078
- “The TUM VI Benchmark for Evaluating Visual-Inertial Odometry” In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2018, pp. 1680–1687 DOI: 10.1109/IROS.2018.8593419
- “KAIST Multi-Spectral Day/Night Data Set for Autonomous and Assisted Driving” In IEEE Transactions on Intelligent Transportation Systems 19.3, 2018, pp. 934–948 DOI: 10.1109/TITS.2018.2791533
- “The Oxford Radar RobotCar Dataset: A Radar Extension to the Oxford RobotCar Dataset” In IEEE International Conference on Robotics and Automation (ICRA), 2020, pp. 6433–6438 DOI: 10.1109/ICRA40945.2020.9196884
- Nicholas Carlevaris-Bianco, Arash K. Ushani and Ryan M. Eustice “University of Michigan North Campus long-term vision and lidar dataset” In International Journal of Robotics Research 35.9, 2015, pp. 1023–1035
- Andreas Geiger, Philip Lenz and Raquel Urtasun “Are we ready for autonomous driving? The KITTI vision benchmark suite” In IEEE Conference on Computer Vision and Pattern Recognition, 2012, pp. 3354–3361 DOI: 10.1109/CVPR.2012.6248074
- “Present and Future of SLAM in Extreme Environments: The DARPA SubT Challenge” In arXiv preprint arXiv:2208.01787, 2022 arXiv: http://arxiv.org/abs/2208.01787
- “Hilti-Oxford Dataset: A Millimeter-Accurate Benchmark for Simultaneous Localization and Mapping” In IEEE Robotics and Automation Letters 8.1, 2023, pp. 408–415 DOI: 10.1109/LRA.2022.3226077
- “Are We Ready for Autonomous Drone Racing? The UZH-FPV Drone Racing Dataset” In International Conference on Robotics and Automation (ICRA), 2019, pp. 6713–6719 DOI: 10.1109/ICRA.2019.8793887
- “The Hilti SLAM Challenge Dataset” In IEEE Robotics and Automation Letters 7.3, 2022, pp. 7518–7525 DOI: 10.1109/LRA.2022.3183759
- “Challenging data sets for point cloud registration algorithms” In The International Journal of Robotics Research 31.14, 2012, pp. 1705–1711 DOI: 10.1177/0278364912458814
- “Uncertainty analysis for accurate ground truth trajectories with robotic total stations” In IEEE International Conference on Intelligent Robots and Systems (IROS), 2023
- Carlos Campos, Jose M.M. Montiel and Juan D. Tardos “Inertial-Only Optimization for Visual-Inertial Initialization” In IEEE International Conference on Robotics and Automation (ICRA) IEEE, 2020 DOI: 10.1109/icra40945.2020.9197334
- “Extrinsic calibration for highly accurate trajectories reconstruction” In IEEE International Conference on Robotics and Automation (ICRA), 2023, pp. 4185–4192 DOI: 10.1109/ICRA48891.2023.10160505
- “Wild-Places: A Large-Scale Dataset for Lidar Place Recognition in Unstructured Natural Environments” In IEEE International Conference on Robotics and Automation (ICRA), 2023, pp. 11322–11328 DOI: 10.1109/ICRA48891.2023.10160432
- “nuScenes: A Multimodal Dataset for Autonomous Driving” In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 11618–11628 DOI: 10.1109/CVPR42600.2020.01164
- “The EuRoC micro aerial vehicle datasets” In The International Journal of Robotics Research 35.10, 2016, pp. 1157–1163 DOI: 10.1177/0278364915620033
- Mohinder S Grewal, Lawrence R Weill and Angus P Andrews “Global positioning systems, inertial navigation, and integration” John Wiley & Sons, 2007
- Vladimír Kubelka, Maxime Vaidis and François Pomerleau “Gravity-constrained point cloud registration” In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2022, pp. 4873–4879 DOI: 10.1109/IROS47612.2022.9981916
- “Accurate outdoor ground truth based on total stations” In 18th Conference on Robots and Vision (CRV), 2021, pp. 1–8 DOI: 10.1109/CRV52889.2021.00012