AERIAL-CORE: AI-Powered Aerial Robots for Inspection and Maintenance of Electrical Power Infrastructures (2401.02343v1)
Abstract: Large-scale infrastructures are prone to deterioration due to age, environmental influences, and heavy usage. Ensuring their safety through regular inspections and maintenance is crucial to prevent incidents that can significantly affect public safety and the environment. This is especially pertinent in the context of electrical power networks, which, while essential for energy provision, can also be sources of forest fires. Intelligent drones have the potential to revolutionize inspection and maintenance, eliminating the risks for human operators, increasing productivity, reducing inspection time, and improving data collection quality. However, most of the current methods and technologies in aerial robotics have been trialed primarily in indoor testbeds or outdoor settings under strictly controlled conditions, always within the line of sight of human operators. Additionally, these methods and technologies have typically been evaluated in isolation, lacking comprehensive integration. This paper introduces the first autonomous system that combines various innovative aerial robots. This system is designed for extended-range inspections beyond the visual line of sight, features aerial manipulators for maintenance tasks, and includes support mechanisms for human operators working at elevated heights. The paper further discusses the successful validation of this system on numerous electrical power lines, with aerial robots executing flights over 10 kilometers away from their ground control stations.
- A. Ollero, M. Tognon, A. Suarez, D. Lee, and A. Franchi, “Past, present, and future of aerial robotic manipulators,” IEEE Transactions on Robotics, vol. 38, no. 1, pp. 626–645, 2021.
- M. Chen, Y. Cao, Y. Tian, E. Li, Z. Liang, and M. Tan, “A passive compliance obstacle-crossing robot for power line inspection and maintenance,” IEEE Robotics and Automation Letters, vol. 8, no. 5, pp. 2377–3766, 2023.
- C. Vourtsis, V. C. Rochel, N. S. Müller, W. Stewart, and D. Floreano, “Wind Defiant Morphing Drones,” Advanced Intelligent Systems, vol. 5, no. 3, p. 2200297.
- J. Xing, G. Cioffi, J. Hidalgo-Carrió, and D. Scaramuzza, “Autonomous power line inspection with drones via perception-aware MPC,” 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2023.
- A. Dietsche, G. Cioffi, J. Hidalgo-Carrió, and D. Scaramuzza, “Powerline tracking with event cameras,” in 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2021, pp. 6990–6997.
- J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, “You only look once: Unified, real-time object detection,” in Proc. of the IEEE conference on computer vision and pattern recognition, 2016, pp. 779–788.
- B. D. Lucas and T. Kanade, “An iterative image registration technique with an application to stereo vision,” in IJCAI’81: 7th international joint conference on Artificial intelligence, vol. 2, 1981, pp. 674–679.
- G. Gallego, T. Delbruck, G. Orchard, C. Bartolozzi, B. Taba, A. Censi, S. Leutenegger, A. Davison, J. Conradt, K. Daniilidis, and D. Scaramuzza, “Event-based vision: A survey,” 2020.
- L. Everding and J. Conradt, “Low-latency line tracking using event-based dynamic vision sensors,” Frontiers in neurorobotics, vol. 12, p. 4, 2018.
- P. Foehn, E. Kaufmann, A. Romero, R. Penicka, S. Sun, L. Bauersfeld, T. Laengle, G. Cioffi, Y. Song, A. Loquercio et al., “Agilicious: Open-source and open-hardware agile quadrotor for vision-based flight,” Science robotics, vol. 7, no. 67, p. eabl6259, 2022.
- J. Paneque, V. Valseca, J. Martínez-de Dios, and A. Ollero, “Autonomous reactive lidar-based mapping for powerline inspection,” in 2022 International Conference on Unmanned Aircraft Systems (ICUAS). IEEE, 2022, pp. 962–971.
- A. Suarez and A. Ollero, “Dual arm aerial manipulation while flying, holding and perching: Comparative case study,” in Iberian Robotics conference. Springer, 2022, pp. 259–270.
- A. Suarez, S. R. Nekoo, and A. Ollero, “Ultra-lightweight anthropomorphic dual-arm rolling robot for dexterous manipulation tasks on linear infrastructures: A self-stabilizing system,” Mechatronics, vol. 94, p. 103021, 2023.
- M. Marolla, J. Cacace, and V. Lippiello, “Design and control of a novel high payload light arm for heavy aerial manipulation tasks,” in Proc. of the 20th International Conference on Informatics in Control, Automation and Robotics, vol. 1, 2023.
- D. Stuhne, V. D. Hoang, G. Vasiljevic, S. Bogdan, Z. Kovacic, A. Ollero, and E. S. M. Ebeid, “Design of a wireless drone recharging station and a special robot end effector for installation on a power line,” IEEE Access, vol. 10, pp. 88 719–88 737, 2022.
- V. D. Hoang and E. Ebeid, “Advanced magnetic energy harvester for charging drones from overhead powerlines,” in 2023 25th European Conference on Power Electronics and Applications (EPE’23 ECCE Europe). IEEE, 2023, pp. 1–9.
- W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C.-Y. Fu, and A. C. Berg, “SSD: Single Shot MultiBox Detector,” in Proc. of the European Conference on Computer Vision, 2016, pp. 21–37.
- C. Papaioannidis, I. Mademlis, and I. Pitas, “Fast CNN-based Single-Person 2D Human Pose Estimation for Autonomous Systems,” In IEEE Transactions on Circuits and Systems for Video Technology, vol. 33, no. 3, pp. 1262–1275, 2023.
- C. Papaioannidis, D. Makrygiannis, I. Mademlis, and I. Pitas, “Learning Fast and Robust Gesture Recognition,” in Proc. of the EURASIP European Conference on Signal Processing, 2021, pp. 761–765.
- V. Kratky, A. Alcantara, J. Capitan, P. Štěpán, M. Saska, and A. Ollero, “Autonomous aerial filming with distributed lighting by a team of unmanned aerial vehicles,” IEEE Robotics and Automation Letters, vol. 6, no. 4, pp. 7580–7587, 2021.