FPGA-Based Neural Thrust Controller for UAVs (2403.18703v2)
Abstract: The advent of unmanned aerial vehicles (UAVs) has improved a variety of fields by providing a versatile, cost-effective and accessible platform for implementing state-of-the-art algorithms. To accomplish a broader range of tasks, there is a growing need for enhanced on-board computing to cope with increasing complexity and dynamic environmental conditions. Recent advances have seen the application of Deep Neural Networks (DNNs), particularly in combination with Reinforcement Learning (RL), to improve the adaptability and performance of UAVs, especially in unknown environments. However, the computational requirements of DNNs pose a challenge to the limited computing resources available on many UAVs. This work explores the use of Field Programmable Gate Arrays (FPGAs) as a viable solution to this challenge, offering flexibility, high performance, energy and time efficiency. We propose a novel hardware board equipped with an Artix-7 FPGA for a popular open-source micro-UAV platform. We successfully validate its functionality by implementing an RL-based low-level controller using real-world experiments.
- S. Liu, Z. Wei, Z. Guo, X. Yuan, and Z. Feng, “Performance analysis of UAVs assisted data collection in wireless sensor network,” in 2018 IEEE 87th Vehicular Technology Conference (VTC Spring), 2018, pp. 1–5.
- F. R. D. Giordan, A. Manconi and F. Nex, “Use of unmanned aerial vehicles in monitoring application and management of natural hazards,” Geomatics, Natural Hazards and Risk, vol. 8, no. 1, pp. 1–4, 2017.
- H. Hildmann and E. Kovacs, “Review: Using unmanned aerial vehicles (UAVs) as mobile sensing platforms (MSPs) for disaster response, civil security and public safety,” Drones, vol. 3, no. 3, 2019.
- J. N. Yasin, S. A. S. Mohamed, M.-H. Haghbayan, J. Heikkonen, H. Tenhunen, and J. Plosila, “Unmanned aerial vehicles (UAVs): Collision avoidance systems and approaches,” IEEE Access, vol. 8, pp. 105 139–105 155, 2020.
- S. Azem, A. Tahir, and H. Koeppl, “Dynamic time slot allocation algorithm for quadcopter swarms,” in 2022 IEEE 19th Annual Consumer Communications & Networking Conference (CCNC). IEEE, 2022, pp. 1–6.
- M. W. Mueller, M. Hamer, and R. D’Andrea, “Fusing ultra-wideband range measurements with accelerometers and rate gyroscopes for quadrocopter state estimation,” in 2015 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2015, pp. 1730–1736.
- A. Molchanov, T. Chen, W. Hönig, J. A. Preiss, N. Ayanian, and G. S. Sukhatme, “Sim-to-(multi)-real: Transfer of low-level robust control policies to multiple quadrotors,” in 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2019, pp. 59–66.
- K. Kefferpütz and K. McGuire, “Error-state unscented kalman-filter for UAV indoor navigation,” in 2022 25th International Conference on Information Fusion (FUSION), 2022, pp. 01–08.
- R. Ourari, K. Cui, A. Elshamanhory, and H. Koeppl, “Nearest-neighbor-based collision avoidance for quadrotors via reinforcement learning,” in 2022 International Conference on Robotics and Automation (ICRA), 2022, pp. 293–300.
- S. Batra, Z. Huang, A. Petrenko, T. Kumar, A. Molchanov, and G. S. Sukhatme, “Decentralized control of quadrotor swarms with end-to-end deep reinforcement learning,” in Conference on Robot Learning. PMLR, 2022, pp. 576–586.
- A. Taffanel, B. Rousselot, J. Danielsson, K. McGuire, K. Richardsson, M. Eliasson, T. Antonsson, and W. Hönig, “Lighthouse positioning system: Dataset, accuracy, and precision for UAV research,” arXiv preprint arXiv:2104.11523, 2021.
- W. Giernacki, M. Skwierczyński, W. Witwicki, P. Wroński, and P. Kozierski, “Crazyflie 2.0 quadrotor as a platform for research and education in robotics and control engineering,” in 2017 22nd International Conference on Methods and Models in Automation and Robotics (MMAR), 2017, pp. 37–42.
- G. Hempel, C. Hochberger, and M. Raitza, “Towards GCC-based automatic soft-core customization,” in 22nd International Conference on Field Programmable Logic and Applications (FPL), 2012, pp. 687–690.
- G. Hempel and C. Hochberger, “A resource optimized SoC kit for FPGAs,” in 2007 International Conference on Field Programmable Logic and Applications, 2007, pp. 761–764.
- F. Dewald, J. Rohde, C. Hochberger, and H. Mantel, “Improving loop parallelization by a combination of static and dynamic analyses in HLS,” ACM Trans. Reconfigurable Technol. Syst., vol. 15, no. 3, feb 2022.
- J. Rohde, K. Müller, and C. Hochberger, “Improving HLS generated accelerators through relaxed memory access scheduling,” in 2020 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW), 2020, pp. 74–81.
- Z. Huang, S. Batra, T. Chen, R. Krupani, T. Kumar, A. Molchanov, A. Petrenko, J. A. Preiss, Z. Yang, and G. S. Sukhatme, “Quadswarm: A modular multi-quadrotor simulator for deep reinforcement learning with direct thrust control,” arXiv preprint arXiv:2306.09537, 2023.