A Vision-based Autonomous Perching Approach for Nano Aerial Vehicles (2306.09591v1)
Abstract: Over the past decades, quadcopters have been investigated, due to their mobility and flexibility to operate in a wide range of environments. They have been used in various areas, including surveillance and monitoring. During a mission, drones do not have to remain active once they have reached a target location. To conserve energy and maintain a static position, it is possible to perch and stop the motors in such situations. The problem of achieving a reliable and highly accurate perching method remains a challenge and promising. In this paper, a vision-based autonomous perching approach for nano quadcopters onto a predefined perching target on horizontal surfaces is proposed. First, a perching target with a small marker inside a larger one is designed to improve detection capability at a variety of ranges. Second, a monocular camera is used to calculate the relative poses of the flying vehicle from the markers detected. Then, a Kalman filter is applied to determine the pose more reliably, especially when measurement data is missing. Next, we introduce an algorithm for merging the pose data from multiple markers. Finally, the poses are sent to the perching planner to conduct the real flight test to align the drone with the target's center and steer it there. Based on the experimental results, the approach proved to be effective and feasible. The drone can successfully perch on the center of markers within two centimeters of precision.
- M. Silvagni, A. Tonoli, E. Zenerino, and M. Chiaberge, “Multipurpose uav for search and rescue operations in mountain avalanche events,” Geomatics, Natural Hazards and Risk, vol. 8, no. 1, pp. 18–33, 2017.
- L.-A. Tran, N.-P. Le, T.-D. Do, and M.-H. Le, “A vision-based method for autonomous landing on a target with a quadcopter,” in 2018 4th International Conference on Green Technology and Sustainable Development (GTSD), pp. 601–606, IEEE, 2018.
- N. Xuan-Mung, N. P. Nguyen, T. Nguyen, D. B. Pham, M. T. Vu, H. L. N. N. Thanh, and S. K. Hong, “Quadcopter precision landing on moving targets via disturbance observer-based controller and autonomous landing planner,” IEEE Access, vol. 10, pp. 83580–83590, 2022.
- J.-W. Lee, N. Xuan-Mung, N. P. Nguyen, and S. K. Hong, “Adaptive altitude flight control of quadcopter under ground effect and time-varying load: Theory and experiments,” Journal of Vibration and Control, vol. 29, no. 3-4, pp. 571–581, 2023.
- W. Giernacki, M. Skwierczyński, W. Witwicki, P. Wroński, and P. Kozierski, “Crazyflie 2.0 quadrotor as a platform for research and education in robotics and control engineering,” in 2017 22nd International Conference on Methods and Models in Automation and Robotics (MMAR), pp. 37–42, IEEE, 2017.
- G. A. Garcia, A. R. Kim, E. Jackson, S. S. Keshmiri, and D. Shukla, “Modeling and flight control of a commercial nano quadrotor,” in 2017 International Conference on Unmanned Aircraft Systems (ICUAS), pp. 524–532, IEEE, 2017.
- N. P. Nguyen, D. Park, D. N. Ngoc, N. Xuan-Mung, T. T. Huynh, T. N. Nguyen, and S. K. Hong, “Quadrotor formation control via terminal sliding mode approach: Theory and experiment results,” Drones, vol. 6, no. 7, p. 172, 2022.
- V. Niculescu, L. Lamberti, F. Conti, L. Benini, and D. Palossi, “Improving autonomous nano-drones performance via automated end-to-end optimization and deployment of dnns,” IEEE Journal on Emerging and Selected Topics in Circuits and Systems, vol. 11, no. 4, pp. 548–562, 2021.
- J. Meng, J. Buzzatto, Y. Liu, and M. Liarokapis, “On aerial robots with grasping and perching capabilities: A comprehensive review,” Frontiers in Robotics and AI, p. 405, 2022.
- J. Mao, S. Nogar, C. M. Kroninger, and G. Loianno, “Robust active visual perching with quadrotors on inclined surfaces,” IEEE Transactions on Robotics, 2023.
- T.-D. Do, N. Xuan-Mung, N.-P. Nguyen, J.-W. Lee, Y.-S. Lee, S.-T. Lee, and S.-K. Hong, “Multi-sensor-based target pose estimation for autonomous precision perching of nano aerial vehicles,” in 2022 22nd International Conference on Control, Automation and Systems (ICCAS), pp. 1565–1571, 2022.
- T.-D. Do, M.-T. Duong, Q.-V. Dang, and M.-H. Le, “Real-time self-driving car navigation using deep neural network,” in 2018 4th International Conference on Green Technology and Sustainable Development (GTSD), pp. 7–12, IEEE, 2018.
- L.-A. Tran, T.-D. Do, D.-C. Park, and M.-H. Le, “Enhancement of robustness in object detection module for advanced driver assistance systems,” in 2021 International Conference on System Science and Engineering (ICSSE), pp. 158–163, IEEE, 2021.
- S. Hutchinson, G. D. Hager, and P. I. Corke, “A tutorial on visual servo control,” IEEE transactions on robotics and automation, vol. 12, no. 5, pp. 651–670, 1996.
- F. Chaumette and S. Hutchinson, “Visual servo control. i. basic approaches,” IEEE Robotics & Automation Magazine, vol. 13, no. 4, pp. 82–90, 2006.
- J. Thomas, G. Loianno, K. Daniilidis, and V. Kumar, “Visual servoing of quadrotors for perching by hanging from cylindrical objects,” IEEE robotics and automation letters, vol. 1, no. 1, pp. 57–64, 2015.
- H. Zhang, B. Cheng, and J. Zhao, “Optimal trajectory generation for time-to-contact based aerial robotic perching,” Bioinspiration & biomimetics, vol. 14, no. 1, p. 016008, 2018.
- T.-D. Do, N. Xuan-Mung, and S.-K. Hong, “Vision-based target pose estimation with multiple markers for the perching of uavs,” arXiv preprint arXiv:2304.14838, 2023.
- S. Garrido-Jurado, R. Muñoz-Salinas, F. J. Madrid-Cuevas, and M. J. Marín-Jiménez, “Automatic generation and detection of highly reliable fiducial markers under occlusion,” Pattern Recognition, vol. 47, no. 6, pp. 2280–2292, 2014.
- G. Bradski, “The opencv library.,” Dr. Dobb’s Journal: Software Tools for the Professional Programmer, vol. 25, no. 11, pp. 120–123, 2000.
- V. Lepetit, F. Moreno-Noguer, and P. Fua, “Ep n p: An accurate o (n) solution to the p n p problem,” International journal of computer vision, vol. 81, pp. 155–166, 2009.
- R. E. Kalman, “A new approach to linear filtering and prediction problems,” 1960.
- “Crazyflie 2.1,” Apr. 25, 2023 [Online].
- S. Haykin and B. Widrow, “Least-mean-square adaptive filters,” 2003.