CSE: Surface Anomaly Detection with Contrastively Selected Embedding (2403.01859v1)
Abstract: Detecting surface anomalies of industrial materials poses a significant challenge within a myriad of industrial manufacturing processes. In recent times, various methodologies have emerged, capitalizing on the advantages of employing a network pre-trained on natural images for the extraction of representative features. Subsequently, these features are subjected to processing through a diverse range of techniques including memory banks, normalizing flow, and knowledge distillation, which have exhibited exceptional accuracy. This paper revisits approaches based on pre-trained features by introducing a novel method centered on target-specific embedding. To capture the most representative features of the texture under consideration, we employ a variant of a contrastive training procedure that incorporates both artificially generated defective samples and anomaly-free samples during training. Exploiting the intrinsic properties of surfaces, we derived a meaningful representation from the defect-free samples during training, facilitating a straightforward yet effective calculation of anomaly scores. The experiments conducted on the MVTEC AD and TILDA datasets demonstrate the competitiveness of our approach compared to state-of-the-art methods.
- Anomalib: A deep learning library for anomaly detection.
- MVTec AD — a comprehensive real-world dataset for unsupervised anomaly detection. In 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 9584–9592. IEEE.
- Describing textures in the wild. In 2014 IEEE Conference on Computer Vision and Pattern Recognition, pages 3606–3613. IEEE.
- PaDiM: a patch distribution modeling framework for anomaly detection and localization. In 2021 ICPR International Workshops and Challenges.
- Anomaly detection via reverse distillation from one-class embedding. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 9737–9746.
- ImageNet: A large-scale hierarchical image database. In 2009 IEEE Conference on Computer Vision and Pattern Recognition, pages 248–255. ISSN: 1063-6919.
- DFG (1996). TILDA textile texture-database.
- Generative adversarial networks. In Advances in neural information processing systems. 2014.
- ADBench: Anomaly detection benchmark.
- Deep residual learning for image recognition. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR.
- Distilling the knowledge in a neural network. In NIPS 2014 Deep Learning Workshop.
- Adam: A method for stochastic optimization. In 2015 International Conference on Learning Representations (ICLR).
- ImageNet classification with deep convolutional neural networks. In NIPS’12: Proceedings of the 25th International Conference on Neural Information Processing Systems, volume 60, pages 84–90.
- CFA: Coupled-hypersphere-based feature adaptation for target-oriented anomaly localization. In IEEE Access Volume 10 Pages 78446-78454 2022.
- CutPaste: Self-supervised learning for anomaly detection and localization. In 2021 IEEE Conference on Computer Vision and Pattern Recognition.
- Omni-frequency channel-selection representations for unsupervised anomaly detection. In IEEE Transactions on Image Processing 2022.
- Automatic fabric defect detection with a multi-scale convolutional denoising autoencoder network model. In Sensors 2018, volume 18, page 1064.
- GEE: A gradient-based explainable variational autoencoder for network anomaly detection. In IEEE Conference on Communications and Network Security (CNS) 2019.
- G2d: Generate to detect anomaly. In 2021 IEEE Winter Conference on Applications of Computer Vision (WACV), pages 2002–2011. IEEE. event-place: Waikoloa, HI, USA.
- Variational inference with normalizing flows. In Proceedings of the 32nd International Conference on Machine Learning 2016.
- Towards total recall in industrial anomaly detection. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
- Fully convolutional cross-scale-flows for image-based defect detection. In Winter Conference on Applications of Computer Vision (WACV) 2022.
- f-AnoGAN: Fast unsupervised anomaly detection with generative adversarial networks. In Medical Image Analysis 54, volume 54, pages 30–44.
- Smith, L. N. (2018). A disciplined approach to neural network hyper-parameters: Part 1 – learning rate, batch size, momentum, and weight decay.
- EfficientNet: Rethinking model scaling for convolutional neural networks. In Proceedings of the 36th International Conference on Machine Learning 2019.
- MixedTeacher: Knowledge distillation for fast inference textural anomaly detection. In 2023 International Conference on Computer Vision Theory and Applications (VISAPP 2023), pages 487–494.
- Revisiting reverse distillation for anomaly detection. In 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
- Student-teacher feature pyramid matching for anomaly detection. In The British Machine Vision Conference (BMVC)2021.
- An improved fabric defect detection method based on SSD. In AATCC Journal of Research Volume 8. 2021, volume 8, pages 181–190.
- MemSeg: A semi-supervised method for image surface defect detection using differences and commonalities. In Engineering Applications of Artificial Intelligence Volume 119, page 15.
- FastFlow: Unsupervised anomaly detection and localization via 2d normalizing flows.
- Wide residual networks.
- DRAEM – a discriminatively trained reconstruction embedding for surface anomaly detection. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV).2021.
Sponsor
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.