Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
97 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

MiniMaxAD: A Lightweight Autoencoder for Feature-Rich Anomaly Detection (2405.09933v3)

Published 16 May 2024 in cs.CV and cs.AI

Abstract: Previous unsupervised anomaly detection (UAD) methods often struggle to handle the extensive diversity in training sets, particularly when they contain stylistically diverse and feature-rich samples, which we categorize as feature-rich anomaly detection datasets (FRADs). This challenge is evident in applications such as multi-view and multi-class scenarios. To address this challenge, we developed MiniMaxAD, a lightweight autoencoder designed to efficiently compress and memorize extensive information from normal images. Our model employs a technique that enhances feature diversity, thereby increasing the effective capacity of the network. It also utilizes large kernel convolution to extract highly abstract patterns, which contribute to efficient and compact feature embedding. Moreover, we introduce an Adaptive Contraction Hard Mining Loss (ADCLoss), specifically tailored to FRADs. In our methodology, any dataset can be unified under the framework of feature-rich anomaly detection, in a way that the benefits far outweigh the drawbacks. Our approach has achieved state-of-the-art performance in multiple challenging benchmarks.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (50)
  1. Dræm - A discriminatively trained reconstruction embedding for surface anomaly detection. In 2021 IEEE/CVF International Conference on Computer Vision, ICCV 2021, Montreal, QC, Canada, October 10-17, 2021, pages 8310–8319. IEEE, 2021.
  2. Revisiting reverse distillation for anomaly detection. In 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 24511–24520, 2023.
  3. Diffusionad: Denoising diffusion for anomaly detection, 2023.
  4. Cflow-ad: Real-time unsupervised anomaly detection with localization via conditional normalizing flows. In 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pages 1819–1828, Waikoloa, HI, USA, 2022. IEEE.
  5. Recontrast: Domain-specific anomaly detection via contrastive reconstruction. In A. Oh, T. Neumann, A. Globerson, K. Saenko, M. Hardt, and S. Levine, editors, Advances in Neural Information Processing Systems, volume 36, pages 10721–10740. Curran Associates, Inc., 2023.
  6. Efficientad: Accurate visual anomaly detection at millisecond-level latencies, 2023.
  7. Mvtec AD - A comprehensive real-world dataset for unsupervised anomaly detection. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2019, Long Beach, CA, USA, June 16-20, 2019, pages 9592–9600. Computer Vision Foundation / IEEE, 2019.
  8. Spot-the-difference self-supervised pre-training for anomaly detection and segmentation, 2022.
  9. Beyond dents and scratches: Logical constraints in unsupervised anomaly detection and localization. International Journal of Computer Vision, 130(4):947–969, 2022.
  10. A unified model for multi-class anomaly detection, 2022.
  11. Pku-goodsad: A supermarket goods dataset for unsupervised anomaly detection and segmentation. IEEE Robotics and Automation Letters, 9(3):2008–2015, 2024.
  12. Pad: A dataset and benchmark for pose-agnostic anomaly detection, 2023.
  13. Towards total recall in industrial anomaly detection, 2021.
  14. Anomaly detection via reverse distillation from one-class embedding. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2022, New Orleans, LA, USA, June 18-24, 2022, pages 9727–9736. IEEE, 2022.
  15. Industrial anomaly detection with domain shift: A real-world dataset and masked multi-scale reconstruction. Computers in Industry, 151(C), 2023.
  16. Multiresolution knowledge distillation for anomaly detection. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021, virtual, June 19-25, 2021, pages 14902–14912. Computer Vision Foundation / IEEE, 2021.
  17. Student-teacher feature pyramid matching for anomaly detection, 2021.
  18. Wide residual networks. In Richard C. Wilson, Edwin R. Hancock, and William A. P. Smith, editors, Proceedings of the British Machine Vision Conference 2016, BMVC 2016, York, UK, September 19-22, 2016. BMVA Press, 2016.
  19. Convnext v2: Co-designing and scaling convnets with masked autoencoders. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 16133–16142, 2023.
  20. Unireplknet: A universal perception large-kernel convnet for audio, video, point cloud, time-series and image recognition, 2023.
  21. Deep autoencoding models for unsupervised anomaly segmentation in brain mr images. In Alessandro Crimi, Spyridon Bakas, Hugo Kuijf, Farahani Keyvan, Mauricio Reyes, and Theo van Walsum, editors, Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries, pages 161–169, Cham, 2019. Springer International Publishing.
  22. Auto-encoding variational bayes. In Yoshua Bengio and Yann LeCun, editors, 2nd International Conference on Learning Representations, ICLR 2014, Banff, AB, Canada, April 14-16, 2014, Conference Track Proceedings, 2014.
  23. Improving unsupervised defect segmentation by applying structural similarity to autoencoders. In Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, pages 372–380, 2019.
  24. Memorizing normality to detect anomaly: Memory-augmented deep autoencoder for unsupervised anomaly detection. In 2019 IEEE/CVF International Conference on Computer Vision, ICCV 2019, Seoul, Korea (South), October 27 - November 2, 2019, pages 1705–1714. IEEE, 2019.
  25. Towards visually explaining variational autoencoders. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2020, Seattle, WA, USA, June 13-19, 2020, pages 8639–8648. IEEE, 2020.
  26. Learning memory-guided normality for anomaly detection. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2020, Seattle, WA, USA, June 13-19, 2020, pages 14360–14369. IEEE, 2020.
  27. Generative adversarial nets. In Zoubin Ghahramani, Max Welling, Corinna Cortes, Neil D. Lawrence, and Kilian Q. Weinberger, editors, Advances in Neural Information Processing Systems 27: Annual Conference on Neural Information Processing Systems 2014, December 8-13 2014, Montreal, Quebec, Canada, pages 2672–2680, 2014.
  28. Ganomaly: Semi-supervised anomaly detection via adversarial training, 2018.
  29. Skip-ganomaly: Skip connected and adversarially trained encoder-decoder anomaly detection. In 2019 International Joint Conference on Neural Networks (IJCNN), pages 1–8, 2019.
  30. OCGAN: one-class novelty detection using gans with constrained latent representations. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2019, Long Beach, CA, USA, June 16-20, 2019, pages 2898–2906. Computer Vision Foundation / IEEE, 2019.
  31. Unsupervised anomaly detection with generative adversarial networks to guide marker discovery, 2017.
  32. F-anogan: Fast unsupervised anomaly detection with generative adversarial networks. Medical Image Analysis, 54:30–44, 2019.
  33. Omni-frequency channel-selection representations for unsupervised anomaly detection. IEEE Transactions on Image Processing, 32:4327–4340, 2023.
  34. Uninformed students: Student-teacher anomaly detection with discriminative latent embeddings. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2020, Seattle, WA, USA, June 13-19, 2020, pages 4182–4191. IEEE, 2020.
  35. Remembering normality: Memory-guided knowledge distillation for unsupervised anomaly detection. In 2023 IEEE/CVF International Conference on Computer Vision (ICCV), pages 16355–16363, Paris, France, 2023. IEEE.
  36. Distilling the knowledge in a neural network, 2015.
  37. Simplenet: A simple network for image anomaly detection and localization, 2023.
  38. Destseg: Segmentation guided denoising student-teacher for anomaly detection. In 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 3914–3923, 2023.
  39. Slsg: Industrial image anomaly detection by learning better feature embeddings and one-class classification, 2023.
  40. Anoseg: Anomaly segmentation network using self-supervised learning, 2021.
  41. Cutpaste: Self-supervised learning for anomaly detection and localization. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021, virtual, June 19-25, 2021, pages 9664–9674. Computer Vision Foundation / IEEE, 2021.
  42. Memseg: A semi-supervised method for image surface defect detection using differences and commonalities. Engineering Applications of Artificial Intelligence, 119:105835, 2023.
  43. Sub-image anomaly detection with deep pyramid correspondences, 2020.
  44. Are pre-trained cnns good feature extractors for anomaly detection in surveillance videos?, 2018.
  45. Anomaly detection in nanofibrous materials by cnn-based self-similarity. Sensors, 18(1):209, 2018.
  46. Set features for fine-grained anomaly detection, 2023.
  47. Repvgg: Making vgg-style convnets great again. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021, virtual, June 19-25, 2021, pages 13733–13742. Computer Vision Foundation / IEEE, 2021.
  48. Imagenet: A large-scale hierarchical image database. In 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2009), 20-25 June 2009, Miami, Florida, USA, pages 248–255. IEEE Computer Society, 2009.
  49. Decoupled weight decay regularization. In 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019. OpenReview.net, 2019.
  50. Nerf: Representing scenes as neural radiance fields for view synthesis, 2020.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (4)
  1. Fengjie Wang (8 papers)
  2. Chengming Liu (7 papers)
  3. Lei Shi (262 papers)
  4. Pang Haibo (2 papers)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets