Towards Non-Robocentric Dynamic Landing of Quadrotor UAVs (2401.11445v1)
Abstract: In this work, we propose a dynamic landing solution without the need for onboard exteroceptive sensors and an expensive computation unit, where all localization and control modules are carried out on the ground in a non-inertial frame. Our system starts with a relative state estimator of the aerial robot from the perspective of the landing platform, where the state tracking of the UAV is done through a set of onboard LED markers and an on-ground camera; the state is expressed geometrically on manifold, and is returned by Iterated Extended Kalman filter (IEKF) algorithm. Subsequently, a motion planning module is developed to guide the landing process, formulating it as a minimum jerk trajectory by applying the differential flatness property. Considering visibility and dynamic constraints, the problem is solved using quadratic programming, and the final motion primitive is expressed through piecewise polynomials. Through a series of experiments, the applicability of this approach is validated by successfully landing 18 cm x 18 cm quadrotor on a 43 cm x 43 cm platform, exhibiting performance comparable to conventional methods. Finally, we provide comprehensive hardware and software details to the research community for future reference.
- P. Tokekar, J. Vander Hook, D. Mulla, and V. Isler, “Sensor planning for a symbiotic uav and ugv system for precision agriculture,” IEEE Transactions on Robotics, vol. 32, no. 6, pp. 1498–1511, 2016.
- J. Sun, B. Li, Y. Jiang, and C.-Y. Wen, “A camera-based target detection and positioning uav system for search and rescue (sar) purposes,” Sensors, vol. 16, no. 11, p. 1778, 2016.
- Q. Zhou, L.-Y. Lo, B. Jiang, C.-W. Chang, C.-Y. Wen, C.-K. Chen, and W. Zhou, “Development of fixed-wing uav 3d coverage paths for urban air quality profiling,” Sensors, vol. 22, no. 10, p. 3630, 2022.
- D. Dissanayaka, T. R. Wanasinghe, O. De Silva, A. Jayasiri, and G. K. Mann, “Review of navigation methods for uav-based parcel delivery,” IEEE Transactions on Automation Science and Engineering, 2023.
- C.-W. Chang, L.-Y. Lo, H. C. Cheung, Y. Feng, A.-S. Yang, C.-Y. Wen, and W. Zhou, “Proactive guidance for accurate uav landing on a dynamic platform: A visual–inertial approach,” Sensors, vol. 22, no. 1, p. 404, 2022.
- D. Lee, T. Ryan, and H. J. Kim, “Autonomous landing of a vtol uav on a moving platform using image-based visual servoing,” in 2012 IEEE international conference on robotics and automation. IEEE, 2012, pp. 971–976.
- L. Coutard, F. Chaumette, and J.-M. Pflimlin, “Automatic landing on aircraft carrier by visual servoing,” in 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 2011, pp. 2843–2848.
- P. Serra, R. Cunha, T. Hamel, D. Cabecinhas, and C. Silvestre, “Landing of a quadrotor on a moving target using dynamic image-based visual servo control,” IEEE Transactions on Robotics, vol. 32, no. 6, pp. 1524–1535, 2016.
- J. S. Wynn and T. W. McLain, “Visual servoing with feed-forward for precision shipboard landing of an autonomous multirotor,” in 2019 American Control Conference (ACC). IEEE, 2019, pp. 3928–3935.
- C. Chen, S. Chen, G. Hu, B. Chen, P. Chen, and K. Su, “An auto-landing strategy based on pan-tilt based visual servoing for unmanned aerial vehicle in gnss-denied environments,” Aerospace Science and Technology, vol. 116, p. 106891, 2021.
- D. Falanga, A. Zanchettin, A. Simovic, J. Delmerico, and D. Scaramuzza, “Vision-based autonomous quadrotor landing on a moving platform,” in 2017 IEEE International Symposium on Safety, Security and Rescue Robotics (SSRR). IEEE, 2017, pp. 200–207.
- C. Forster, Z. Zhang, M. Gassner, M. Werlberger, and D. Scaramuzza, “Svo: Semidirect visual odometry for monocular and multicamera systems,” IEEE Transactions on Robotics, vol. 33, no. 2, pp. 249–265, 2016.
- T. Baca, P. Stepan, V. Spurny, D. Hert, R. Penicka, M. Saska, J. Thomas, G. Loianno, and V. Kumar, “Autonomous landing on a moving vehicle with an unmanned aerial vehicle,” Journal of Field Robotics, vol. 36, no. 5, pp. 874–891, 2019.
- S. Yang, S. A. Scherer, and A. Zell, “An onboard monocular vision system for autonomous takeoff, hovering and landing of a micro aerial vehicle,” Journal of Intelligent & Robotic Systems, vol. 69, no. 1, pp. 499–515, 2013.
- P. Vlantis, P. Marantos, C. P. Bechlioulis, and K. J. Kyriakopoulos, “Quadrotor landing on an inclined platform of a moving ground vehicle,” in 2015 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2015, pp. 2202–2207.
- Y. Meng, W. Wang, H. Han, and J. Ban, “A visual/inertial integrated landing guidance method for uav landing on the ship,” Aerospace Science and Technology, vol. 85, pp. 474–480, 2019.
- Y. Qi, J. Jiang, J. Wu, J. Wang, C. Wang, and J. Shan, “Autonomous landing solution of low-cost quadrotor on a moving platform,” Robotics and Autonomous Systems, vol. 119, pp. 64–76, 2019.
- A. Paris, B. T. Lopez, and J. P. How, “Dynamic landing of an autonomous quadrotor on a moving platform in turbulent wind conditions,” in 2020 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2020, pp. 9577–9583.
- C. Martínez, P. Campoy, I. Mondragón, and M. A. Olivares-Méndez, “Trinocular ground system to control uavs,” in 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems. Ieee, 2009, pp. 3361–3367.
- W. Kong, D. Zhang, X. Wang, Z. Xian, and J. Zhang, “Autonomous landing of an uav with a ground-based actuated infrared stereo vision system,” in 2013 IEEE/RSJ international conference on intelligent robots and systems. IEEE, 2013, pp. 2963–2970.
- W. Kong, D. Zhou, Y. Zhang, D. Zhang, X. Wang, B. Zhao, C. Yan, L. Shen, and J. Zhang, “A ground-based optical system for autonomous landing of a fixed wing uav,” in 2014 IEEE/RSJ international conference on intelligent robots and systems. IEEE, 2014, pp. 4797–4804.
- T. Ferreira, A. Bernardino, and B. Damas, “6d uav pose estimation for ship landing guidance,” in OCEANS 2021: San Diego–Porto. IEEE, 2021, pp. 1–10.
- J. Sola, J. Deray, and D. Atchuthan, “A micro lie theory for state estimation in robotics,” arXiv preprint arXiv:1812.01537, 2018.
- M. Faessler, E. Mueggler, K. Schwabe, and D. Scaramuzza, “A monocular pose estimation system based on infrared leds,” in 2014 IEEE international conference on robotics and automation (ICRA). IEEE, 2014, pp. 907–913.
- A. Breitenmoser, L. Kneip, and R. Siegwart, “A monocular vision-based system for 6d relative robot localization,” in 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 2011, pp. 79–85.
- V. Lepetit, F. Moreno-Noguer, and P. Fua, “Ep n p: An accurate o (n) solution to the p n p problem,” International journal of computer vision, vol. 81, pp. 155–166, 2009.
- Q. Fu, Q. Quan, and K.-Y. Cai, “Robust pose estimation for multirotor uavs using off-board monocular vision,” IEEE Transactions on Industrial Electronics, vol. 64, no. 10, pp. 7942–7951, 2017.
- B. M. Bell and F. W. Cathey, “The iterated kalman filter update as a gauss-newton method,” IEEE Transactions on Automatic Control, vol. 38, no. 2, pp. 294–297, 1993.
- R. G. Brown and P. Y. Hwang, “Introduction to random signals and applied kalman filtering: with matlab exercises and solutions,” Introduction to random signals and applied Kalman filtering: with MATLAB exercises and solutions, 1997.
- D. Mellinger and V. Kumar, “Minimum snap trajectory generation and control for quadrotors,” in 2011 IEEE international conference on robotics and automation. IEEE, 2011, pp. 2520–2525.
- S. Liu, M. Watterson, K. Mohta, K. Sun, S. Bhattacharya, C. J. Taylor, and V. Kumar, “Planning dynamically feasible trajectories for quadrotors using safe flight corridors in 3-d complex environments,” IEEE Robotics and Automation Letters, vol. 2, no. 3, pp. 1688–1695, 2017.
- W. Hönig, J. A. Preiss, T. S. Kumar, G. S. Sukhatme, and N. Ayanian, “Trajectory planning for quadrotor swarms,” IEEE Transactions on Robotics, vol. 34, no. 4, pp. 856–869, 2018.
- B. Stellato, G. Banjac, P. Goulart, A. Bemporad, and S. Boyd, “OSQP: an operator splitting solver for quadratic programs,” Mathematical Programming Computation, vol. 12, no. 4, pp. 637–672, 2020. [Online]. Available: https://doi.org/10.1007/s12532-020-00179-2
- S. Garrido-Jurado, R. Muñoz-Salinas, F. J. Madrid-Cuevas, and M. J. Marín-Jiménez, “Automatic generation and detection of highly reliable fiducial markers under occlusion,” Pattern Recognition, vol. 47, no. 6, pp. 2280–2292, 2014.