Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
110 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
44 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

NanoSLAM: Enabling Fully Onboard SLAM for Tiny Robots (2309.12008v1)

Published 21 Sep 2023 in cs.RO

Abstract: Perceiving and mapping the surroundings are essential for enabling autonomous navigation in any robotic platform. The algorithm class that enables accurate mapping while correcting the odometry errors present in most robotics systems is Simultaneous Localization and Mapping (SLAM). Today, fully onboard mapping is only achievable on robotic platforms that can host high-wattage processors, mainly due to the significant computational load and memory demands required for executing SLAM algorithms. For this reason, pocket-size hardware-constrained robots offload the execution of SLAM to external infrastructures. To address the challenge of enabling SLAM algorithms on resource-constrained processors, this paper proposes NanoSLAM, a lightweight and optimized end-to-end SLAM approach specifically designed to operate on centimeter-size robots at a power budget of only 87.9 mW. We demonstrate the mapping capabilities in real-world scenarios and deploy NanoSLAM on a nano-drone weighing 44 g and equipped with a novel commercial RISC-V low-power parallel processor called GAP9. The algorithm is designed to leverage the parallel capabilities of the RISC-V processing cores and enables mapping of a general environment with an accuracy of 4.5 cm and an end-to-end execution time of less than 250 ms.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (55)
  1. C. Wang, J. Wang, J. Wang, and X. Zhang, “Deep-reinforcement-learning-based autonomous uav navigation with sparse rewards,” IEEE Internet of Things Journal, vol. 7, no. 7, pp. 6180–6190, 2020.
  2. P. Huang, L. Zeng, X. Chen, K. Luo, Z. Zhou, and S. Yu, “Edge robotics: Edge-computing-accelerated multirobot simultaneous localization and mapping,” IEEE Internet of Things Journal, vol. 9, no. 15, pp. 14 087–14 102, 2022.
  3. L. Yang, J. Yu, S. Yang, B. Wang, B. J. Nelson, and L. Zhang, “A survey on swarm microrobotics,” IEEE Transactions on Robotics, vol. 38, no. 3, pp. 1531–1551, 2021.
  4. O. Vermesan, R. Bahr, M. Ottella, M. Serrano, T. Karlsen, T. Wahlstrøm, H. E. Sand, M. Ashwathnarayan, and M. T. Gamba, “Internet of robotic things intelligent connectivity and platforms,” Frontiers in Robotics and AI, vol. 7, p. 104, 2020.
  5. B. P. Duisterhof, S. Krishnan, J. J. Cruz, C. R. Banbury, W. Fu, A. Faust, G. C. de Croon, and V. J. Reddi, “Tiny robot learning (tinyrl) for source seeking on a nano quadcopter,” in 2021 IEEE International Conference on Robotics and Automation (ICRA).   IEEE, 2021, pp. 7242–7248.
  6. S. Karam, F. Nex, O. Karlsson, J. Rydell, E. Bilock, M. Tulldahl, M. Holmberg, and N. Kerle, “Micro and macro quadcopter drones for indoor mapping to support disaster management,” ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. 1, pp. 203–210, 2022.
  7. V. Niculescu, L. Lamberti, F. Conti, L. Benini, and D. Palossi, “Improving autonomous nano-drones performance via automated end-to-end optimization and deployment of dnns,” IEEE Journal on Emerging and Selected Topics in Circuits and Systems, vol. 11, no. 4, pp. 548–562, 2021.
  8. D. Liu, W. Bao, X. Zhu, B. Fei, T. Men, and Z. Xiao, “Cooperative path optimization for multiple uavs surveillance in uncertain environment,” IEEE Internet of Things Journal, vol. 9, no. 13, pp. 10 676–10 692, 2021.
  9. B. P. Duisterhof, S. Li, J. Burgués, V. J. Reddi, and G. C. de Croon, “Sniffy bug: A fully autonomous swarm of gas-seeking nano quadcopters in cluttered environments,” in 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).   IEEE, 2021, pp. 9099–9106.
  10. V. Niculescu, D. Palossi, M. Magno, and L. Benini, “Energy-efficient, precise uwb-based 3-d localization of sensor nodes with a nano-uav,” IEEE Internet of Things Journal, 2022.
  11. H. Müller, N. Zimmerman, T. Polonelli, M. Magno, J. Behley, C. Stachniss, and L. Benini, “Fully on-board low-power localization with multizone time-of-flight sensors on nano-uavs,” in 2023 Design, Automation & Test in Europe Conference & Exhibition (DATE).   IEEE, 2023, pp. 1–6.
  12. S. Kisseleff, S. Chatzinotas, and B. Ottersten, “Reconfigurable intelligent surfaces in challenging environments: Underwater, underground, industrial and disaster,” IEEE Access, vol. 9, pp. 150 214–150 233, 2021.
  13. D. Cristiani, F. Bottonelli, A. Trotta, and M. Di Felice, “Inventory management through mini-drones: Architecture and proof-of-concept implementation,” in 2020 IEEE 21st International Symposium on” A World of Wireless, Mobile and Multimedia Networks”(WoWMoM).   IEEE, 2020, pp. 317–322.
  14. S. Chen, W. Meng, W. Xu, Z. Liu, J. Liu, and F. Wu, “A warehouse management system with uav based on digital twin and 5g technologies,” in 2020 7th International Conference on Information, Cybernetics, and Computational Social Systems (ICCSS).   IEEE, 2020, pp. 864–869.
  15. A. Moura, J. Antunes, A. Dias, A. Martins, and J. Almeida, “Graph-slam approach for indoor uav localization in warehouse logistics applications,” in 2021 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC).   IEEE, 2021, pp. 4–11.
  16. G. Grisetti, R. Kümmerle, C. Stachniss, and W. Burgard, “A tutorial on graph-based slam,” IEEE Intelligent Transportation Systems Magazine, vol. 2, no. 4, pp. 31–43, 2010.
  17. Y. Chen, S. Huang, L. Zhao, and G. Dissanayake, “Cramér–rao bounds and optimal design metrics for pose-graph slam,” IEEE Transactions on Robotics, vol. 37, no. 2, pp. 627–641, 2021.
  18. H. Chao, Y. Cao, and Y. Chen, “Autopilots for small unmanned aerial vehicles: A survey,” International Journal of Control, Automation and Systems, vol. 8, pp. 36–44, 2010. [Online]. Available: https://doi.org/10.1007/s12555-010-0105-z
  19. H. Zhou, Z. Hu, S. Liu, and S. Khan, “Efficient 2d graph slam for sparse sensing,” in 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).   IEEE, 2022, pp. 6404–6411.
  20. S. Srinara, C.-M. Lee, S. Tsai, G.-J. Tsai, and K.-W. Chiang, “Performance analysis of 3d ndt scan matching for autonomous vehicles using ins/gnss/3d lidar-slam integration scheme,” in 2021 IEEE International Symposium on Inertial Sensors and Systems (INERTIAL).   IEEE, 2021, pp. 1–4.
  21. R. Eyvazpour, M. Shoaran, and G. Karimian, “Hardware implementation of slam algorithms: a survey on implementation approaches and platforms,” Artificial Intelligence Review, pp. 1–53, 2022.
  22. H. Shen, Q. Zong, B. Tian, X. Zhang, and H. Lu, “Pgo-liom: Tightly-coupled lidar-inertial odometry and mapping via parallel and gradient-free optimization,” IEEE Transactions on Industrial Electronics, 2022.
  23. N. Chen, F. Kong, W. Xu, Y. Cai, H. Li, D. He, Y. Qin, and F. Zhang, “A self-rotating, single-actuated uav with extended sensor field of view for autonomous navigation,” Science Robotics, vol. 8, no. 76, p. eade4538, 2023.
  24. V. Niculescu, H. Müller, I. Ostovar, T. Polonelli, M. Magno, and L. Benini, “Towards a multi-pixel time-of-flight indoor navigation system for nano-drone applications,” in 2022 IEEE International Instrumentation and Measurement Technology Conference (I2MTC).   IEEE, 2022, pp. 1–6.
  25. D. Rossi, F. Conti, M. Eggiman, A. Di Mauro, G. Tagliavini, S. Mach, M. Guermandi, A. Pullini, I. Loi, J. Chen et al., “Vega: A ten-core soc for iot endnodes with dnn acceleration and cognitive wake-up from mram-based state-retentive sleep mode,” IEEE Journal of Solid-State Circuits, vol. 57, no. 1, pp. 127–139, 2021.
  26. H. Müller, V. Niculescu, T. Polonelli, M. Magno, and L. Benini, “Robust and efficient depth-based obstacle avoidance for autonomous miniaturized uavs,” arXiv preprint arXiv:2208.12624, 2022.
  27. G. Cerutti, R. Andri, L. Cavigelli, E. Farella, M. Magno, and L. Benini, “Sound event detection with binary neural networks on tightly power-constrained iot devices,” in Proceedings of the ACM/IEEE International Symposium on Low Power Electronics and Design, 2020, pp. 19–24.
  28. N. Dilshad, A. Ullah, J. Kim, and J. Seo, “Locateuav: Unmanned aerial vehicle location estimation via contextual analysis in an iot environment,” IEEE Internet of Things Journal, 2022.
  29. Z. Li, X. Zhao, Z. Zhao, and T. Braun, “Crowdfusion: Multi-signal fusion slam positioning leveraging visible light,” IEEE Internet of Things Journal, 2023.
  30. R. Latif and A. Saddik, “Slam algorithms implementation in a uav, based on a heterogeneous system: A survey,” in 2019 4th World Conference on Complex Systems (WCCS).   IEEE, 2019, pp. 1–6.
  31. J. A. Placed, J. Strader, H. Carrillo, N. Atanasov, V. Indelman, L. Carlone, and J. A. Castellanos, “A survey on active simultaneous localization and mapping: State of the art and new frontiers,” IEEE Transactions on Robotics, 2023.
  32. T. Suzuki, “Time-relative rtk-gnss: Gnss loop closure in pose graph optimization,” IEEE Robotics and Automation Letters, vol. 5, no. 3, pp. 4735–4742, 2020.
  33. H. Cao, J. Xu, D. Li, L. Shangguan, Y. Liu, and Z. Yang, “Edge assisted mobile semantic visual slam,” IEEE Transactions on Mobile Computing, 2022.
  34. M. Kasper, S. McGuire, and C. Heckman, “A benchmark for visual-inertial odometry systems employing onboard illumination,” in 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).   IEEE, 2019, pp. 5256–5263.
  35. F. Causa, M. Asciolla, R. Opromolla, P. Molina, A. Mennella, M. Nisi, and G. Fasano, “Uav-based lidar mapping with galileo-gps ppp processing and cooperative navigation,” in 2022 International Conference on Unmanned Aircraft Systems (ICUAS).   IEEE, 2022, pp. 938–947.
  36. E. Ghignone, N. Baumann, and M. Magno, “TC-driver: A trajectory conditioned reinforcement learning approach to zero-shot autonomous racing,” Field Robotics, vol. 3, no. 1, pp. 637–651, Jan. 2023. [Online]. Available: https://doi.org/10.55417/fr.2023020
  37. Y. Chang, K. Ebadi, C. E. Denniston, M. F. Ginting, A. Rosinol, A. Reinke, M. Palieri, J. Shi, A. Chatterjee, B. Morrell et al., “Lamp 2.0: A robust multi-robot slam system for operation in challenging large-scale underground environments,” IEEE Robotics and Automation Letters, vol. 7, no. 4, pp. 9175–9182, 2022.
  38. P. Mayer, M. Magno, and L. Benini, “Smart power unit—mw-to-nw power management and control for self-sustainable iot devices,” IEEE Transactions on Power Electronics, vol. 36, no. 5, pp. 5700–5710, 2020.
  39. Y. Alghamdi, A. Munir, and H. M. La, “Architecture, classification, and applications of contemporary unmanned aerial vehicles,” IEEE Consumer Electronics Magazine, vol. 10, no. 6, pp. 9–20, 2021.
  40. B. Zhou, H. Xu, and S. Shen, “Racer: Rapid collaborative exploration with a decentralized multi-uav system,” IEEE Transactions on Robotics, 2023.
  41. S. Karam, F. Nex, B. T. Chidura, and N. Kerle, “Microdrone-based indoor mapping with graph slam,” Drones, vol. 6, no. 11, p. 352, 2022.
  42. E. Jeong, S. Kang, D. Lee, and P. Kim, “Parsing indoor manhattan scenes using four-point lidar on a micro uav,” in 2022 22nd International Conference on Control, Automation and Systems (ICCAS).   IEEE, 2022, pp. 708–713.
  43. G. A. Kumar, A. K. Patil, R. Patil, S. S. Park, and Y. H. Chai, “A lidar and imu integrated indoor navigation system for uavs and its application in real-time pipeline classification,” Sensors, vol. 17, no. 6, 2017. [Online]. Available: https://www.mdpi.com/1424-8220/17/6/1268
  44. F. Gao, W. Wu, W. Gao, and S. Shen, “Flying on point clouds: Online trajectory generation and autonomous navigation for quadrotors in cluttered environments,” Journal of Field Robotics, vol. 36, no. 4, pp. 710–733, 2019. [Online]. Available: https://onlinelibrary.wiley.com/doi/abs/10.1002/rob.21842
  45. Z. Fang, S. Yang, S. Jain, G. Dubey, S. Roth, S. Maeta, S. Nuske, Y. Zhang, and S. Scherer, “Robust autonomous flight in constrained and visually degraded shipboard environments,” Journal of Field Robotics, vol. 34, no. 1, pp. 25–52, 2017. [Online]. Available: https://onlinelibrary.wiley.com/doi/abs/10.1002/rob.21670
  46. H. Han and J. Siebert, “Tinyml: A systematic review and synthesis of existing research,” in 2022 International Conference on Artificial Intelligence in Information and Communication (ICAIIC).   IEEE, 2022, pp. 269–274.
  47. E. Tabanelli, G. Tagliavini, and L. Benini, “Dnn is not all you need: Parallelizing non-neural ml algorithms on ultra-low-power iot processors,” ACM Transactions on Embedded Computing Systems, vol. 22, no. 3, pp. 1–33, 2023.
  48. J. Kühne, M. Magno, and L. Benini, “Parallelizing optical flow estimation on an ultra-low power risc-v cluster for nano-uav navigation,” in 2022 IEEE International Symposium on Circuits and Systems (ISCAS).   IEEE, 2022, pp. 301–305.
  49. S. Tijmons, G. C. H. E. de Croon, B. D. W. Remes, C. De Wagter, and M. Mulder, “Obstacle avoidance strategy using onboard stereo vision on a flapping wing mav,” IEEE Transactions on Robotics, vol. 33, no. 4, pp. 858–874, 2017.
  50. S. Touchette, W. Gueaieb, and E. Lanteigne, “Efficient cholesky factor recovery for column reordering in simultaneous localisation and mapping,” Journal of Intelligent & Robotic Systems, vol. 84, pp. 859–875, 2016.
  51. E. S. Quintana, G. Quintana, X. Sun, and R. van de Geijn, “A note on parallel matrix inversion,” SIAM Journal on Scientific Computing, vol. 22, no. 5, pp. 1762–1771, 2001.
  52. G. Grisetti, R. Kümmerle, C. Stachniss, U. Frese, and C. Hertzberg, “Hierarchical optimization on manifolds for online 2d and 3d mapping,” in 2010 IEEE International Conference on Robotics and Automation.   IEEE, 2010, pp. 273–278.
  53. A. Azad, M. Jacquelin, A. Buluç, and E. G. Ng, “The reverse cuthill-mckee algorithm in distributed-memory,” in 2017 IEEE International Parallel and Distributed Processing Symposium (IPDPS).   IEEE, 2017, pp. 22–31.
  54. P. Mukhopadhyay and B. B. Chaudhuri, “A survey of hough transform,” Pattern Recognition, vol. 48, no. 3, pp. 993–1010, 2015.
  55. T. Polonelli, C. Feldmann, V. Niculescu, H. Müller, M. Magno, and L. Benini, “Towards robust and efficient on-board mapping for autonomous miniaturized uavs,” in 2023 9th International Workshop on Advances in Sensors and Interfaces (IWASI).   IEEE, 2023, pp. 9–14.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (4)
  1. Vlad Niculescu (9 papers)
  2. Tommaso Polonelli (16 papers)
  3. Michele Magno (118 papers)
  4. Luca Benini (362 papers)
Citations (10)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now