Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
129 tokens/sec
GPT-4o
28 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Automatic UAV-based Airport Pavement Inspection Using Mixed Real and Virtual Scenarios (2401.06019v1)

Published 11 Jan 2024 in cs.CV

Abstract: Runway and taxiway pavements are exposed to high stress during their projected lifetime, which inevitably leads to a decrease in their condition over time. To make sure airport pavement condition ensure uninterrupted and resilient operations, it is of utmost importance to monitor their condition and conduct regular inspections. UAV-based inspection is recently gaining importance due to its wide range monitoring capabilities and reduced cost. In this work, we propose a vision-based approach to automatically identify pavement distress using images captured by UAVs. The proposed method is based on Deep Learning (DL) to segment defects in the image. The DL architecture leverages the low computational capacities of embedded systems in UAVs by using an optimised implementation of EfficientNet feature extraction and Feature Pyramid Network segmentation. To deal with the lack of annotated data for training we have developed a synthetic dataset generation methodology to extend available distress datasets. We demonstrate that the use of a mixed dataset composed of synthetic and real training images yields better results when testing the training models in real application scenarios.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (34)
  1. Irizarry, J., Gheisari, M., and Walker, B. N., “Usability assessment of drone technology as safety inspection tools,” (2012).
  2. Seo, J., Duque, L., and Wacker, J., “Drone-enabled bridge inspection methodology and application,” Automation in Construction 94, 112–126 (2018).
  3. Hubbard, S., Pak, A., Gu, Y., and Jin, Y., “Uas to support airport safety and operations: opportunities and challenges,” Journal of Unmanned Vehicle Systems 6(1), 1–17 (2018).
  4. Khan, W., “Image segmentation techniques: A survey,” Journal of Image and Graphics 1, 166–170 (Dec. 2013).
  5. Kaur, R. and Malik, E. G., “An image segmentation using improved fcm watershed algorithm and dbmf,” Journal of Image and Graphics 2, 106–112 (Dec. 2014).
  6. Thanammal, K. K., Jayasudha, J. S., Vijayalakshmi, R. R., and Arumugaperumal, S., “Effective histogram thresholding techniques for natural images using segmentation,” Journal of Image and Graphics 2, 113–116 (Dec. 2014).
  7. Richard, N., Fernandez-Maloigne, C., Bonanomi, C., and Rizzi, A., “Fuzzy color image segmentation using watershed transform,” Journal of Image and Graphics 1, 157–160 (Sept. 2013).
  8. Zhang, L., Yang, F., Zhang, Y. D., and Zhu, Y. J., “Road crack detection using deep convolutional neural network,” in [2016 IEEE International Conference on Image Processing (ICIP) ], 3708–3712, IEEE (2016).
  9. Jenkins, M. D., Carr, T. A., Iglesias, M. I., Buggy, T., and Morison, G., “A deep convolutional neural network for semantic pixel-wise segmentation of road and pavement surface cracks,” in [2018 26th European Signal Processing Conference (EUSIPCO) ], 2120–2124, IEEE (Sept. 2018).
  10. Shi, Y., Cui, L., Qi, Z., Meng, F., and Chen, Z., “Automatic road crack detection using random structured forests,” IEEE Transactions on Intelligent Transportation Systems 17(12), 3434–3445 (2016).
  11. Zou, Q., Zhang, Z., Li, Q., Qi, X., Wang, Q., and Wang, S., “Deepcrack: Learning hierarchical convolutional features for crack detection,” IEEE Transactions on Image Processing 28, 1498–1512 (Mar. 2019).
  12. Yang, F., Zhang, L., Yu, S., Prokhorov, D., Mei, X., and Ling, H., “Feature pyramid and hierarchical boosting network for pavement crack detection,” IEEE Transactions on Intelligent Transportation Systems (2019).
  13. Du, Y., Pan, N., Xu, Z., Deng, F., Shen, Y., and Kang, H., “Pavement distress detection and classification based on yolo network,” International Journal of Pavement Engineering 22, 1659 – 1672 (2020).
  14. Milletari, F., Navab, N., and Ahmadi, S.-A., “V-net: Fully convolutional neural networks for volumetric medical image segmentation,” 2016 Fourth International Conference on 3D Vision (3DV) , 565–571, IEEE (Oct. 2016).
  15. Wang, W. and Su, C., “Convolutional neural network-based pavement crack segmentation using pyramid attention network,” IEEE Access 8, 206548–206558 (2020).
  16. Rill-García, R., Dokladalova, E., and Dokládal., P., “Syncrack: Improving pavement and concrete crack detection through synthetic data generation,” in [Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP ], 147–158, INSTICC, SciTePress (2022).
  17. Kanaeva, I. A. and Ivanova, J. A., “Road pavement crack detection using deep learning with synthetic data,” IOP Conference Series: Materials Science and Engineering 1019, 012036 (Jan. 2021).
  18. Hoskere, V., Narazaki, Y., and Spencer, B., “Physics-based graphics models in 3d synthetic environments as autonomous vision-based inspection testbeds,” Sensors 22, 532 (Jan. 2022).
  19. Shah, S., Dey, D., Lovett, C., and Kapoor, A., “Airsim: High-fidelity visual and physical simulation for autonomous vehicles,” in [Field and Service Robotics ], (2017).
  20. Epic Games, “Unreal engine.” https://www.unrealengine.com (2022). Version 5.0.2.
  21. Gunther, E., “Ultra dynamic sky.” https://www.unrealengine.com/marketplace/en-US/product/ultra-dynamic-sky. Accessed 2022-05-01.
  22. Tan, M. and Le, Q., “EfficientNet: Rethinking model scaling for convolutional neural networks,” in [Proceedings of the 36th International Conference on Machine Learning ], Chaudhuri, K. and Salakhutdinov, R., eds., Proceedings of Machine Learning Research 97, 6105–6114, PMLR (June 2019).
  23. Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., and Belongie, S., “Feature pyramid networks for object detection,” in [Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) ], (July 2017).
  24. Kirillov, A., He, K., Girshick, R., and Dollár, P., “A unified architecture for instance and semantic segmentation.” http://presentations.cocodataset.org/COCO17-Stuff-FAIR.pdf (2017). International Conference on Computer Vision.
  25. Sudre, C. H., Li, W., Vercauteren, T. K. M., Ourselin, S., and Cardoso, M. J., “Generalised dice overlap as a deep learning loss function for highly unbalanced segmentations,” Deep learning in medical image analysis and multimodal learning for clinical decision support : Third International Workshop, DLMIA 2017, and 7th International Workshop, ML-CDS 2017, held in conjunction with MICCAI 2017 Quebec City, QC,… 2017, 240–248 (2017).
  26. Simard, P., Steinkraus, D., and Platt, J., “Best practices for convolutional neural networks applied to visual document analysis,” in [Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings. ], 958–963 (2003).
  27. Yakubovskiy, P., “Segmentation models pytorch.” https://github.com/qubvel/segmentation_models.pytorch (2020).
  28. Smith, L. N. and Topin, N., “Super-convergence: Very fast training of neural networks using large learning rates,” (2017).
  29. Eisenbach, M., Stricker, R., Seichter, D., Amende, K., Debes, K., Sesselmann, M., Ebersbach, D., Stoeckert, U., and Gross, H.-M., “How to get pavement distress detection ready for deep learning? A systematic approach.,” in [International Joint Conference on Neural Networks (IJCNN) ], 2039–2047 (2017).
  30. Liu, Y., Yao, J., Lu, X., Xie, R., and Li, L., “Deepcrack: A deep hierarchical feature learning architecture for crack segmentation,” Neurocomputing 338, 139–153 (2019).
  31. Arbelaez, P., Maire, M., Fowlkes, C., and Malik, J., “From contours to regions: An empirical evaluation,” in [2009 IEEE Conference on Computer Vision and Pattern Recognition ], 2294–2301 (2009).
  32. Li, H., Zong, J., Nie, J., Wu, Z., and Han, H., “Pavement crack detection algorithm based on densely connected and deeply supervised network,” IEEE Access 9, 11835–11842 (2021).
  33. Lau, S. L. H., Chong, E. K. P., Yang, X., and Wang, X., “Automated pavement crack segmentation using u-net-based convolutional neural network,” IEEE Access 8, 114892–114899 (2020).
  34. Wang, W. and Su, C., “Deep learning-based real-time crack segmentation for pavement images,” KSCE Journal of Civil Engineering 25, 4495–4506 (Dec. 2021).
Citations (1)

Summary

We haven't generated a summary for this paper yet.