YoloTag: Vision-based Robust UAV Navigation with Fiducial Markers
Abstract: By harnessing fiducial markers as visual landmarks in the environment, Unmanned Aerial Vehicles (UAVs) can rapidly build precise maps and navigate spaces safely and efficiently, unlocking their potential for fluent collaboration and coexistence with humans. Existing fiducial marker methods rely on handcrafted feature extraction, which sacrifices accuracy. On the other hand, deep learning pipelines for marker detection fail to meet real-time runtime constraints crucial for navigation applications. In this work, we propose YoloTag -a real-time fiducial marker-based localization system. YoloTag uses a lightweight YOLO v8 object detector to accurately detect fiducial markers in images while meeting the runtime constraints needed for navigation. The detected markers are then used by an efficient perspective-n-point algorithm to estimate UAV states. However, this localization system introduces noise, causing instability in trajectory tracking. To suppress noise, we design a higher-order Butterworth filter that effectively eliminates noise through frequency domain analysis. We evaluate our algorithm through real-robot experiments in an indoor environment, comparing the trajectory tracking performance of our method against other approaches in terms of several distance metrics.
- A. Couturier and M. A. Akhloufi, “A review on absolute visual localization for UAV,” Robotics and Autonomous Systems, vol. 135, p. 103666, 2021.
- D. Scaramuzza and F. Fraundorfer, “Visual odometry [tutorial],” IEEE robotics & automation magazine, vol. 18, no. 4, pp. 80–92, 2011.
- A. Z. Zhu, L. Yuan, K. Chaney, and K. Daniilidis, “EV-FlowNet: Self-supervised optical flow estimation for event-based cameras,” ArXiv, vol. abs/1802.06898, 2018.
- M. Mostafa, A. Moussa, N. El-Sheimy, and A. Sesay, “A smart hybrid vision aided inertial navigation system approach for uavs in a gnss denied environment,” Navigation, vol. 65, 12 2018.
- R. Mur-Artal and J. D. Tardós, “ORB-SLAM2: An open-source SLAM system for monocular, stereo, and RGB-D cameras,” IEEE Transactions on Robotics, vol. 33, no. 5, pp. 1255–1262, 2017.
- R. Mur-Artal, J. M. M. Montiel, and J. D. Tardós, “ORB-SLAM: A versatile and accurate monocular SLAM system,” IEEE Transactions on Robotics, vol. 31, no. 5, pp. 1147–1163, 2015.
- S. Leutenegger, S. Lynen, M. Bosse, R. Siegwart, and P. Furgale, “Keyframe-based visual-inertial odometry using nonlinear optimization,” The International Journal of Robotics Research, vol. 34, 02 2014.
- T. Qin, P. Li, and S. Shen, “Vins-mono: A robust and versatile monocular visual-inertial state estimator,” IEEE Transactions on Robotics, vol. 34, no. 4, pp. 1004–1020, 2018.
- H.-P. Chiu, S. Williams, F. Dellaert, S. Samarasekera, and R. Kumar, “Robust vision-aided navigation using sliding-window factor graphs,” 2013 IEEE International Conference on Robotics and Automation, pp. 46–53, 2013.
- D. Gruyer, R. Belaroussi, and M. Revilloud, “Map-aided localization with lateral perception,” 2014 IEEE Intelligent Vehicles Symposium Proceedings, pp. 674–680, 2014.
- M. S. Amiri and R. Ramli, “Visual navigation system for autonomous drone using fiducial marker detection,” International Journal of Advanced Computer Science and Applications, vol. 13, no. 9, 2022.
- H. Kato and M. Billinghurst, “Marker tracking and hmd calibration for a video-based augmented reality conferencing system,” in Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR’99), pp. 85–94, 1999.
- E. Olson, “Apriltag: A robust and flexible visual fiducial system,” 2011 IEEE International Conference on Robotics and Automation, pp. 3400–3407, 2011.
- J. Wang and E. Olson, “Apriltag 2: Efficient and robust fiducial detection,” in 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 4193–4198, 2016.
- J. DeGol, T. Bretl, and D. Hoiem, “Chromatag: A colored marker and fast detection algorithm,” 2017 IEEE International Conference on Computer Vision, pp. 1481–1490, 2017.
- D. Hu, D. DeTone, V. Chauhan, I. Spivak, and T. Malisiewicz, “Deep charuco: Dark charuco marker pose estimation,” 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 8428–8436, 2018.
- M. B. Yaldiz, A. Meuleman, H. Jang, H. Ha, and M. H. Kim, “Deepformabletag: end-to-end generation and recognition of deformable fiducial markers,” ACM Transactions on Graphics, vol. 40, p. 1–14, July 2021.
- Z. Zhang, Y. Hu, G. Yu, and J. Dai, “Deeptag: A general framework for fiducial marker design and detection,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 45, no. 3, pp. 2931–2944, 2023.
- X. Zhang, H. Guo, J. Mariani, and L. Xiao, “U-star: an underwater navigation system based on passive 3d optical identification tags,” in Annual International Conference on Mobile Computing And Networking, p. 648–660, 2022.
- J. B. Peace, E. Psota, Y. Liu, and L. C. Pérez, “E2etag: An end-to-end trainable method for generating and detecting fiducial markers,” 2021.
- M. Fiala, “Artag, a fiducial marker system using digital techniques,” in 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 590–596 vol. 2, 2005.
- S. Garrido-Jurado, R. Muñoz-Salinas, F. J. Madrid-Cuevas, and M. J. MarĂn-JimĂ©nez, “Automatic generation and detection of highly reliable fiducial markers under occlusion,” Pattern Recognit., vol. 47, pp. 2280–2292, 2014.
- F. Bergamasco, A. Albarelli, E. Rodolà , and A. Torsello, “Rune-tag: A high accuracy fiducial marker with strong occlusion resilience,” in Conference on Computer Vision and Pattern Recognition, pp. 113–120, 2011.
Paper Prompts
Sign up for free to create and run prompts on this paper.