Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
102 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Lander.AI: Adaptive Landing Behavior Agent for Expertise in 3D Dynamic Platform Landings (2403.06572v2)

Published 11 Mar 2024 in cs.RO and cs.NE

Abstract: Mastering autonomous drone landing on dynamic platforms presents formidable challenges due to unpredictable velocities and external disturbances caused by the wind, ground effect, turbines or propellers of the docking platform. This study introduces an advanced Deep Reinforcement Learning (DRL) agent, Lander:AI, designed to navigate and land on platforms in the presence of windy conditions, thereby enhancing drone autonomy and safety. Lander:AI is rigorously trained within the gym-pybullet-drone simulation, an environment that mirrors real-world complexities, including wind turbulence, to ensure the agent's robustness and adaptability. The agent's capabilities were empirically validated with Crazyflie 2.1 drones across various test scenarios, encompassing both simulated environments and real-world conditions. The experimental results showcased Lander:AI's high-precision landing and its ability to adapt to moving platforms, even under wind-induced disturbances. Furthermore, the system performance was benchmarked against a baseline PID controller augmented with an Extended Kalman Filter, illustrating significant improvements in landing precision and error recovery. Lander:AI leverages bio-inspired learning to adapt to external forces like birds, enhancing drone adaptability without knowing force magnitudes.This research not only advances drone landing technologies, essential for inspection and emergency applications, but also highlights the potential of DRL in addressing intricate aerodynamic challenges.

View on arXiv
Definition Search Book Streamline Icon: https://streamlinehq.com
References (27)
  1. M.Bajpai, P.Singh and S.Sinha, “A review on the applications of UAVs in various field , “JETIR, Volume 6, Issue 5 ,2019.
  2. S. Lee, T. Shim, S. Kim, J. Park, K. Hong and H. Bang, “Vision-Based Autonomous Landing of a Multi-Copter Unmanned Aerial Vehicle using Reinforcement Learning,” International Conference on Unmanned Aircraft Systems (ICUAS), 2018, pp. 108-114.
  3. R. Polvara, M.Patacchiola, S.Sharma1, J.Wan1, A.Manning, R.Sutton and A. Cangelosi “Toward End-to-End Control for UAV Autonomous Landing via Deep Reinforcement Learning,” International Conference on Unmanned Aircraft Systems (ICUAS), 2018, pp. 115-123.
  4. M. B. Vankadari, K. Das, C. Shinde and S. Kumar, “A Reinforcement Learning Approach for Autonomous Control and Landing of a Quadrotor,” International Conference on Unmanned Aircraft Systems (ICUAS), 2018, pp. 676-683.
  5. S. Karaf, A. Fedoseev, M. Martynov, Z. Darush, A. Shcherbak and D. Tsetserukou, “MorphoLander: Reinforcement Learning Based Landing of a Group of Drones on the Adaptive Morphogenetic UAV,” IEEE International Conference on Systems, Man, and Cybernetics (SMC), 2023, pp. 2507-2512.
  6. J. Amendola, L. R. Cenkeramaddi and A. Jha, “Single Reinforcement Learning Policy for Landing a Drone Under Different UGV Velocities and Trajectories,” International Conference on Control, Mechatronics and Automation (ICCMA), 2023, pp. 115-120.
  7. Z. Jiang and G. Song, “A Deep Reinforcement Learning Strategy for UAV Autonomous Landing on a Platform,” International Conference on Computing, Robotics and System Sciences (ICRSS),2022, pp. 104-109.
  8. J.Tsai, P.Chen,M.Tsai, “Accuracy Improvement of Autonomous Straight Take off,Flying Forward, and Landing of a Drone with Deep Reinforcement Learning,” ICCETW,2019.
  9. Y. Rao, S. Ma, J. Xing, H. Zhang and X. Ma, “Real time vision-based autonomous precision landing system for UAV airborne processor,” Chinese Automation Congress (CAC), 2020, pp. 532-537.
  10. T. Swain, M. Rath, J. Mishra, S. Banerjee and T. Samant, “Deep Reinforcement Learning based Target Detection for Unmanned Aerial Vehicle,”India Council International Subsections Conference (INDISCON), Bhubaneswar, 2022, pp. 1-5.
  11. J. Bialas and M. Doller, “Coverage Path Planning for Unmanned Aerial Vehicles in Complex 3D Environments with Deep Reinforcement Learning,” IEEE International Conference on Robotics and Biomimetics (ROBIO), 2022, pp. 1080-1085.
  12. M. Piponidis, P. Aristodemou and T. Theocharides, “Towards a Fully Autonomous UAV Controller for Moving Platform Detection and Landing,” International Conference on VLSI Design and 2022 21st International Conference on Embedded Systems (VLSID), 2022, pp. 180-185.
  13. F.Hauf, B.Kocer, A.Slatter, H.Nguyen, O.Pang, R.Clark, E.Johns and M.Kovac1, “Learning Tethered Perching for Aerial Robots,” IEEE International Conference on Robotics and Automation (ICRA), 2023, pp. 1298-1304.
  14. K. Backman, D. Kulic and H. Chung, “Learning to Assist Drone Landings,” IEEE Robotics and Automation Letters, vol. 6, no. 2, pp. 3192-3199, 2021.
  15. Y. Song, M. Steinweg, E. Kaufmann and D. Scaramuzza, “Autonomous Drone Racing with Deep Reinforcement Learning,” IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021, pp. 1205-1212.
  16. J. Panerati, H. Zheng, S. Zhou, J. Xu, A. Prorok and A. P. Schoellig, “Learning to Fly—a Gym Environment with PyBullet Physics for Reinforcement Learning of Multi-agent Quadcopter Control,” IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021, pp. 7512-7519.
  17. G. Shi, X.Shi,M.Connell, R.Yu,K. Azizzadenesheli, A.Anandkumar, Y.Yue, S.Chung, “Neural Lander: Stable Drone Landing Control Using Learned Dynamics,” 2019 International Conference on Robotics and Automation (ICRA), 2019, pp. 9784-9790.
  18. Z.Feiyu, L.Dayan, W.Zhengxu, M.Jianlin and W.Niya, “Autonomous localized path planning algorithm for UAVs based on TD3 strategy,” Sci Rep 14, 763, 2024.
  19. K.Backman, D.Kulic and H.Chung, “ Reinforcement learning for shared autonomy drone landings,” Auton Robot 47,2023, pp. 1419-1438.
  20. A.Keipour, A.S. Pereira, R.Bonatti, R.Garg, P.Rastogi, G.Dubey and S. Scherer, “Visual Servoing Approach to Autonomous UAV Landing on a Moving Vehicle ,”Sensors, 22(17), 6549,2022.
  21. E.Kaufmann, L.Bauersfeld, A. Loquercio, M.Muller, V.Koltun and D.Scaramuzza, “Champion-level drone racing using deep reinforcement learning,” Nature,620, 2023, pp, 982–987.
  22. G.Ting,J.Gau, “UAV Path Planning and Obstacle Avoidance Based on Reinforcement Learning in 3D Environments,”Special Issue Intelligent Control and Robotic System in Path Planning,MDPI,2023.
  23. G. Xu, L. Liu and H. Liu, “UAV Landing Control Disturbed by Carrier Air-Wake Based on Deep Reinforcement Learning,” 34th Chinese Control and Decision Conference (CCDC), 2022, pp. 4719-4724.
  24. M.Tahir, I.Mir and T.Islam, “Control Algorithms, Kalman Estimation and Near Actual Simulation for UAVs: State of Art Perspective,” Drones,7(6),339,MDPI,2023.
  25. N.Lin, D.Zhao, M.Sellier and X.Liu, “Experimental investigation on turbulence effects on unsteady aerodynamics performances of two horizontally placed small-size UAV rotors,”Aerospace Science and Technology,141,2023.
  26. J. E. Kooi and R. Babuska, “Inclined Quadrotor Landing using Deep Reinforcement Learning,” IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021, pp. 2361-2368.
  27. A. Raffin, A. Hill, A. Gleave, A. Kanervisto, M. Ernestus, and N. Dormann, “Stable-Baselines3: Reliable Reinforcement Learning Implementations,” Journal of Machine Learning Research, vol. 22, no. 268, pp. 1-8, 2021.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (5)
  1. Robinroy Peter (9 papers)
  2. Lavanya Ratnabala (6 papers)
  3. Demetros Aschu (5 papers)
  4. Aleksey Fedoseev (47 papers)
  5. Dzmitry Tsetserukou (144 papers)

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now