UAV-Borne Mapping Algorithms for Low-Altitude and High-Speed Drone Applications (2401.06407v2)
Abstract: This article presents an analysis of current state-of-the-art sensors and how these sensors work with several mapping algorithms for UAV (Unmanned Aerial Vehicle) applications, focusing on low-altitude and high-speed scenarios. A new experimental construct is created using highly realistic environments made possible by integrating the AirSim simulator with Google 3D maps models using the Cesium Tiles plugin. Experiments are conducted in this high-realism simulated environment to evaluate the performance of three distinct mapping algorithms: (1) Direct Sparse Odometry (DSO), (2) Stereo DSO (SDSO), and (3) DSO Lite (DSOL). Experimental results evaluate algorithms based on their measured geometric accuracy and computational speed. The results provide valuable insights into the strengths and limitations of each algorithm. Findings quantify compromises in UAV algorithm selection, allowing researchers to find the mapping solution best suited to their application, which often requires a compromise between computational performance and the density and accuracy of geometric map estimates. Results indicate that for UAVs with restrictive computing resources, DSOL is the best option. For systems with payload capacity and modest compute resources, SDSO is the best option. If only one camera is available, DSO is the option to choose for applications that require dense mapping results.
- Paul J Besl and Neil D McKay “Method for registration of 3-D shapes” In Sensor fusion IV: control paradigms and data structures 1611, 1992, pp. 586–606 Spie
- Teng Cao, Zhi-Yu Xiang and Ji-Lin Liu “Perception in disparity: An efficient navigation framework for autonomous vehicles with stereo cameras” In IEEE Transactions on Intelligent Transportation Systems 16.5 IEEE, 2015, pp. 2935–2948
- Kurt Cornelis, Marc Pollefeys and Luc Van Gool “Tracking based structure and motion recovery for augmented video productions” In Proceedings of the ACM symposium on Virtual reality software and technology, 2001, pp. 17–24
- “SfM with MRFs: Discrete-continuous optimization for large-scale structure from motion” In IEEE transactions on pattern analysis and machine intelligence 35.12 IEEE, 2012, pp. 2841–2853
- Jakob Engel, Vladlen Koltun and Daniel Cremers “Direct sparse odometry” In IEEE transactions on pattern analysis and machine intelligence 40.3 IEEE, 2017, pp. 611–625
- Carlos Hernández Esteban and Francis Schmitt “Silhouette and stereo fusion for 3D object modeling” In Computer Vision and Image Understanding 96.3 Elsevier, 2004, pp. 367–392
- Andreas Geiger, Julius Ziegler and Christoph Stiller “Stereoscan: Dense 3d reconstruction in real-time” In 2011 IEEE intelligent vehicles symposium (IV), 2011, pp. 963–968 Ieee
- Donald B Gennery “A Stereo Vision System for an Autonomous Vehicle.” In IJCAI, 1977, pp. 576–582
- “Multiple view geometry in computer vision” Cambridge university press, 2003
- Patrick Irmisch “Camera-based distance estimation for autonomous vehicles”, 2017
- “From structure-from-motion point clouds to fast location recognition” In 2009 IEEE Conference on Computer Vision and Pattern Recognition, 2009, pp. 2599–2606 IEEE
- Olga Krutikova, Aleksandrs Sisojevs and Mihails Kovalovs “Creation of a depth map from stereo images of faces for 3D model reconstruction” In Procedia Computer Science 104 Elsevier, 2017, pp. 452–459
- “Keyframe-based visual–inertial odometry using nonlinear optimization” In The International Journal of Robotics Research 34.3 SAGE Publications Sage UK: London, England, 2015, pp. 314–334
- Manolis IA Lourakis and Antonis A Argyros “SBA: A software package for generic sparse bundle adjustment” In ACM Transactions on Mathematical Software (TOMS) 36.1 ACM New York, NY, USA, 2009, pp. 1–30
- Benjamin U Meinen and Derek T Robinson “Mapping erosion and deposition in an agricultural landscape: Optimization of UAV image acquisition schemes for SfM-MVS” In Remote Sensing of Environment 239 Elsevier, 2020, pp. 111666
- “Applying robust structure from motion to markerless augmented reality” In 2009 Workshop on Applications of Computer Vision (WACV), 2009, pp. 1–8 IEEE
- “Online robust 3D mapping using structure from motion cues” In OCEANS 2008-MTS/IEEE Kobe Techno-Ocean, 2008, pp. 1–7 IEEE
- Sudeep Pillai, Srikumar Ramalingam and John J Leonard “High-performance and tunable stereo reconstruction” In 2016 IEEE International Conference on Robotics and Automation (ICRA), 2016, pp. 3188–3195 IEEE
- “Dsol: A fast direct sparse odometry scheme” In 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2022, pp. 10587–10594 IEEE
- “Monocular vision for mobile robot localization and autonomous navigation” In International Journal of Computer Vision 74.3 Springer, 2007, pp. 237–260
- Grant Schindler, Panchapagesan Krishnamurthy and Frank Dellaert “Line-based structure from motion for urban environments” In Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT’06), 2006, pp. 846–853 IEEE
- “AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles” In Field and Service Robotics, 2017 URL: https://arxiv.org/abs/1705.05065
- “Interactive 3D architectural modeling from unordered photo collections” In ACM Transactions on Graphics (TOG) 27.5 ACM New York, NY, USA, 2008, pp. 1–10
- Minas Spetsakis and John Yiannis Aloimonos “A multi-frame approach to visual motion perception” In International Journal of Computer Vision 6.3 Springer, 1991, pp. 245–255
- “Stereo Direct Sparse Odometry Non-official Implementation” Accessed: 2024-01-02, https://github.com/JiatianWu/stereo-dso
- “Real-time stereo reconstruction in robotically assisted minimally invasive surgery” In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2010: 13th International Conference, Beijing, China, September 20-24, 2010, Proceedings, Part I 13, 2010, pp. 275–282 Springer
- Richard Szeliski “Computer vision: algorithms and applications” Springer Nature, 2022
- Richard Szeliski and Sing Bing Kang “Recovering 3D shape and motion from image streams using nonlinear least squares” In Journal of Visual Communication and Image Representation 5.1 Elsevier, 1994, pp. 10–28
- “Shape and motion from image streams under orthography: a factorization method” In International journal of computer vision 9 Springer, 1992, pp. 137–154
- “Bundle adjustment—a modern synthesis” In Vision Algorithms: Theory and Practice: International Workshop on Vision Algorithms Corfu, Greece, September 21–22, 1999 Proceedings, 2000, pp. 298–372 Springer
- Darren Turner, Arko Lucieer and Christopher Watson “An automated technique for generating georectified mosaics from ultra-high resolution unmanned aerial vehicle (UAV) imagery, based on structure from motion (SfM) point clouds” In Remote sensing 4.5 Molecular Diversity Preservation International (MDPI), 2012, pp. 1392–1410
- Rui Wang, Martin Schworer and Daniel Cremers “Stereo DSO: Large-scale direct sparse visual odometry with stereo cameras” In Proceedings of the IEEE International Conference on Computer Vision, 2017, pp. 3903–3911