Segmentation tool for images of cracks (2403.19492v1)
Abstract: Safety-critical infrastructures, such as bridges, are periodically inspected to check for existing damage, such as fatigue cracks and corrosion, and to guarantee the safe use of the infrastructure. Visual inspection is the most frequent type of general inspection, despite the fact that its detection capability is rather limited, especially for fatigue cracks. Machine learning algorithms can be used for augmenting the capability of classical visual inspection of bridge structures, however, the implementation of such an algorithm requires a massive annotated training dataset, which is time-consuming to produce. This paper proposes a semi-automatic crack segmentation tool that eases the manual segmentation of cracks on images needed to create a training dataset for a machine learning algorithm. Also, it can be used to measure the geometry of the crack. This tool makes use of an image processing algorithm, which was initially developed for the analysis of vascular systems on retinal images. The algorithm relies on a multi-orientation wavelet transform, which is applied to the image to construct the so-called "orientation scores", i.e. a modified version of the image. Afterwards, the filtered orientation scores are used to formulate an optimal path problem that identifies the crack. The globally optimal path between manually selected crack endpoints is computed, using a state-of-the-art geometric tracking method. The pixel-wise segmentation is done afterwards using the obtained crack path. The proposed method outperforms fully automatic methods and shows potential to be an adequate alternative to the manual data annotation.
- Procedures required for assessing highway structures-background, details and progress. Technical Report COST 345, European commission directorate general transport and energy, 2003.
- Y. Kitane and A. J. Aref. Sustainable replacement of aging bridge superstructures using fiber-reinforced polymer (FRP) composites. Advanced Composites in Bridge Construction and Repair, pages 287–322, 5 2014.
- Guideline for Inspection and Condition Assessment of Existing European Railway Bridges. Technical Report SB-ICA, European commission, 11 2007.
- M. Rossow. FHWA Bridge Inspector’s Manual: Bridge inspection program. Continuing Education and Development, Inc., 2012.
- Benchmark for evaluating performance in visual inspection of fatigue cracking in steel bridges. Journal of Bridge Engineering, 25(1), 2020.
- A review of advanced bridge inspection technologies based on robotic systems and image processing. International Journal of Contents, 14(3), 2018.
- Causes and consequences of metallic bridge failures. Structural Engineering International, 22(1):93–98, 2012.
- A. Mohan and S. Poobal. Crack detection using image processing: A critical review and analysis. Alexandria Engineering Journal, 57(2):787–798, 2018.
- A review on deep learning-based structural health monitoring of civil infrastructures. Smart Structures and Systems, 24(5):567–585, 2019.
- Crack identification for bridge condition monitoring using deep convolutional networks trained with a feedback-update strategy. Maintenance, Reliability and Condition Monitoring, 1(2):37–51, 2021.
- Vision-based automated crack detection for bridge inspection. Computer-Aided Civil and Infrastructure Engineering, 30(10):759–770, 2015.
- Artificial neural network-based automated crack detection and analysis for the inspection of concrete structures. Applied Sciences (Switzerland), 10:1–13, 11 2020.
- Computer vision-based bridge damage detection using deep convolutional networks with expectation maximum attention module. Sensors (Switzerland), 21:1–18, 2 2021.
- Detection crack in image using otsu method and multiple filtering in image processing techniques. Optik, 127(3):1030–1033, 2016.
- Q. Li and X. Liu. Novel approach to pavement image segmentation based on neighboring difference histogram method. In 2008 Congress on Image and Signal Processing, volume 2, pages 792–796. IEEE, 2008.
- Z. Yiyang. The design of glass crack detection system based on image preprocessing technology. In 2014 IEEE 7th Joint International Information Technology and Artificial Intelligence Conference, pages 39–42. IEEE, 2014.
- A method of detecting the cracks of concrete undergo high-temperature. Construction and Building Materials, 162:345–358, 2018.
- H. Oliveira and P.L. Correia. Crackit—an image processing toolbox for crack detection and characterization. In 2014 IEEE international conference on image processing ICIP, pages 798–802. IEEE, 2014.
- Analysis of sem digital images to quantify crack network pattern area in chromium electrodeposits. Surface and Coatings Technology, 285:289–297, 2016.
- Improved image analysis for evaluating concrete damage. Journal of Computing in Civil Engineering, 20:1–7, 2006.
- Y. Huang and B. Xu. Automatic inspection of pavement cracking distress. Journal of Electronic Imaging, 15:13–17, 1 2006.
- Automatic detection and classification of defect on road pavement using anisotropy measure; automatic detection and classification of defect on road pavement using anisotropy measure. In 17th European Signal Processing Conference, pages 617–621, Glasgow, Scotland, 2009. IEEE.
- Y. Hu. A local binary pattern based methods for pavement crack detection. Journal of Pattern Recognition Research, 1:140–147, 2010.
- An operational application of automatic feature extraction: the measurement of cracks in concrete structures. The Photogrammetric Record, 17(99):453–464, 2002.
- Detecting curves with unknown endpoints and arbitrary topology using minimal paths. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34(10):1952–1965, 2011.
- A new minimal path selection algorithm for automatic crack detection on pavement images. In 2014 IEEE International Conference on Image Processing (ICIP), pages 788–792. IEEE, 2014.
- Automatic crack detection on two-dimensional pavement images: An algorithm based on minimal path selection. IEEE Transactions on Intelligent Transportation Systems, 17(10):2718–2729, 2016.
- An improved minimal path selection approach with new strategies for pavement crack segmentation. Measurement, 184:109877, 2021.
- A multi-orientation analysis approach to retinal vessel tracking. Journal of Mathematical Imaging and Vision, 49:583–610, 2014.
- R. Duits. Perceptual organization in image analysis: a mathematical approach based on scale, orientation and curvature. PhD thesis, Eindhoven University of Technology, 2005.
- A pde approach to data-driven sub-riemannian geodesics in SE(2). SIAM Journal on Imaging Sciences, 8(4):2740–2770, 2015.
- Geodesic tracking via new data-driven connections of cartan type for vascular tree tracking. arXiv e-prints, pages arXiv–2208, 2022.
- J.-M. Mirebeau. Anisotropic fast-marching on cartesian grids using lattice basis reduction. SIAM jpurnal of numerical analysis, 52:1573–1599, 1 2014.
- Optimal paths for variants of the 2d and 3d reeds–shepp car with applications in image analysis. Journal of Mathematical Imaging and Vision, 60:816–848, 7 2018.
- Crossing-preserving multi-scale vesselness. In Polina Golland, Nobuhiko Hata, Christian Barillot, Joachim Hornegger, and Robert Howe, editors, Medical Image Computing and Computer-Assisted Intervention – MICCAI 2014, pages 603–610, Cham, 2014. Springer International Publishing.
- J.-M. Mirebeau. Adaptive grid discretization - A set of tools for discretizing anisotropic PDEs on cartesian grids kernel description.
- R. Duits and E. M. Franken. Left invariant parabolic evolution equations on SE(2)𝑆𝐸2{SE}(2)italic_S italic_E ( 2 ) and contour enhancement via invertible orientation scores, part I: Linear left-invariant diffusion equations on SE(2)𝑆𝐸2{SE}(2)italic_S italic_E ( 2 ). Quarterly of Applied mathematics, AMS, 68:255–292, June 2010.
- Numerical approaches for linear left-invariant diffusions on SE(2), their comparisons to exact solutions, and their applications in retinal imaging. Numerical Mathematics: Theory Methods and Applications, 9(1):1–50, January 2016.
- O. Wittich. An explicit local uniform large deviation bound for Brownian bridges. Statistics & probability letters, 73(1):51–56, 2005.
- Multiscale vessel enhancement filtering. In International conference on medical image computing and computer-assisted intervention, pages 130–137. Springer, 1998.
- Aiglern dataset. https://www.irit.fr/~Sylvie.Chambon/Crack_Detection_Database.html. Accessed on 2022-05-8.
- Free-form anisotropy: A new method for crack detection on pavement surface images. In 2011 18th IEEE International Conference on Image Processing, pages 1069–1072. IEEE, 2011.