Evaluation of Data Augmentation and Loss Functions in Semantic Image Segmentation for Drilling Tool Wear Detection (2302.05262v2)
Abstract: Tool wear monitoring is crucial for quality control and cost reduction in manufacturing processes, of which drilling applications are one example. In this paper, we present a U-Net based semantic image segmentation pipeline, deployed on microscopy images of cutting inserts, for the purpose of wear detection. The wear area is differentiated in two different types, resulting in a multiclass classification problem. Joining the two wear types in one general wear class, on the other hand, allows the problem to be formulated as a binary classification task. Apart from the comparison of the binary and multiclass problem, also different loss functions, i. e., Cross Entropy, Focal Cross Entropy, and a loss based on the Intersection over Union (IoU), are investigated. Furthermore, models are trained on image tiles of different sizes, and augmentation techniques of varying intensities are deployed. We find, that the best performing models are binary models, trained on data with moderate augmentation and an IoU-based loss function.
- A systematic literature review of cutting tool wear monitoring in turning by using artificial intelligence techniques, Machines 9 (2021). URL: https://www.mdpi.com/2075-1702/9/12/351. doi:10.3390/machines9120351.
- Publisher correction: Integrating object detection and image segmentation for detecting the tool wear area on stitched image, Scientific Reports 11 (2021). doi:10.1038/s41598-021-01172-y.
- Evaluation of deep learning for semantic image segmentation in tool condition monitoring, in: 2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA), 2019, pp. 2008–2013. doi:10.1109/ICMLA.2019.00321.
- Tool wear prediction in computer numerical control milling operations via machine learning, in: 2021 12th International Conference on Information and Communication Systems (ICICS), 2021, pp. 220–227. doi:10.1109/ICICS52457.2021.9464580.
- A comparative study on machine learning algorithms for smart manufacturing: Tool wear prediction using random forests, Journal of Manufacturing Science and Engineering 139 (2017). URL: https://doi.org/10.1115/1.4036350. doi:10.1115/1.4036350, 071018.
- Digital image processing with deep learning for automated cutting tool wear detection, Procedia Manufacturing 48 (2020) 947–958. URL: https://www.sciencedirect.com/science/article/pii/S2351978920315869. doi:https://doi.org/10.1016/j.promfg.2020.05.134, 48th SME North American Manufacturing Research Conference, NAMRC 48.
- Deep learning and rule-based image processing pipeline for automated metal cutting tool wear detection and measurement, IFAC-PapersOnLine 55 (2022) 534–539. URL: https://www.sciencedirect.com/science/article/pii/S2405896322002506. doi:https://doi.org/10.1016/j.ifacol.2022.04.249, 14th IFAC Workshop on Intelligent Manufacturing Systems IMS 2022.
- Research on wear detection of end milling cutter edge based on image stitching, Applied Sciences 12 (2022). URL: https://www.mdpi.com/2076-3417/12/16/8100. doi:10.3390/app12168100.
- A u-net-based approach for tool wear area detection and identification, IEEE Transactions on Instrumentation and Measurement 70 (2021) 1–10. doi:10.1109/TIM.2020.3033457.
- Computer vision-based approach to end mill tool monitoring, International Journal of Simulation Modelling 14 (2015) 571–583. doi:10.2507/IJSIMM14(4)1.301.
- Modeling of tool wear in drilling by statistical analysis and artificial neural network, Journal of Materials Processing Technology 170 (2005) 494–500. URL: https://www.sciencedirect.com/science/article/pii/S0924013605004929. doi:10.1016/j.jmatprotec.2005.04.072.
- Tool wear classification using time series imaging and deep learning, The International Journal of Advanced Manufacturing Technology 104 (2019). doi:10.1007/s00170-019-04090-6.
- Tool wear classification using decision treesin stone drilling applications: A preliminary study, Procedia Engineering 69 (2014) 1326–1335. URL: https://www.sciencedirect.com/science/article/pii/S1877705814003713. doi:10.1016/j.proeng.2014.03.125, 24th DAAAM International Symposium on Intelligent Manufacturing and Automation, 2013.
- Tool-wear analysis using image processing of the tool flank, Symmetry 9 (2017). URL: https://www.mdpi.com/2073-8994/9/12/296. doi:10.3390/sym9120296.
- Research on tool wear detection based on machine vision in end milling process, Production Engineering 6 (2012). URL: https://doi.org/10.1007/s11740-012-0395-5. doi:10.1007/s11740-012-0395-5.
- U-net: Convolutional networks for biomedical image segmentation, in: International Conference on Medical image computing and computer-assisted intervention, Springer, 2015, pp. 234–241.
- Fully convolutional networks for semantic segmentation, in: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015, pp. 3431–3440. doi:10.1109/CVPR.2015.7298965.
- S. Karen, Z. Andrew, Very deep convolutional networks for large-scale image recognition, arXiv preprint (2014). doi:10.48550/arXiv.1409.1556.
- Focal loss for dense object detection, CoRR abs/1708.02002 (2017). doi:10.48550/arXiv.1708.02002.
- Deep neural networks with intersection over union loss for binary image segmentation, 2019. doi:10.5220/0007347504380445.
- S. Ioffe, C. Szegedy, Batch normalization: Accelerating deep network training by reducing internal covariate shift, in: International conference on machine learning, pmlr, 2015, pp. 448–456.
- Towards a guideline for evaluation metrics in medical image segmentation, BMC Research Notes 15 (2022). doi:10.1186/s13104-022-06096-y.