Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
102 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Unsupervised Anomaly Detection via Masked Diffusion Posterior Sampling (2404.17900v1)

Published 27 Apr 2024 in cs.CV

Abstract: Reconstruction-based methods have been commonly used for unsupervised anomaly detection, in which a normal image is reconstructed and compared with the given test image to detect and locate anomalies. Recently, diffusion models have shown promising applications for anomaly detection due to their powerful generative ability. However, these models lack strict mathematical support for normal image reconstruction and unexpectedly suffer from low reconstruction quality. To address these issues, this paper proposes a novel and highly-interpretable method named Masked Diffusion Posterior Sampling (MDPS). In MDPS, the problem of normal image reconstruction is mathematically modeled as multiple diffusion posterior sampling for normal images based on the devised masked noisy observation model and the diffusion-based normal image prior under Bayesian framework. Using a metric designed from pixel-level and perceptual-level perspectives, MDPS can effectively compute the difference map between each normal posterior sample and the given test image. Anomaly scores are obtained by averaging all difference maps for multiple posterior samples. Exhaustive experiments on MVTec and BTAD datasets demonstrate that MDPS can achieve state-of-the-art performance in normal image reconstruction quality as well as anomaly detection and localization.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (36)
  1. Skip-GANomaly: Skip connected and adversarially trained encoder-decoder anomaly detection. In International Joint Conference on Neural Networks (IJCNN), pages 1–8. IEEE, 2019.
  2. Autoencoders for unsupervised anomaly segmentation in brain mr images: A comparative study. Medical Image Analysis, 69:101952, 2021.
  3. Mask, stitch, and re-sample: Enhancing robustness and generalizability in anomaly detection through automatic diffusion models. In ICML 3rd Workshop on Interpretable Machine Learning in Healthcare (IMLH), 2023.
  4. Improving unsupervised defect segmentation by applying structural similarity to autoencoders. In International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP), pages 372–380. INSTICC, SciTePress, 2019.
  5. The MVTec anomaly detection dataset: a comprehensive real-world dataset for unsupervised anomaly detection. International Journal of Computer Vision, 129(4):1038–1059, 2021.
  6. Diffusion posterior sampling for general noisy inverse problems. In International Conference on Learning Representations (ICLR), 2023.
  7. Generative adversarial networks for anomaly detection in aerial images. Computers and Electrical Engineering, 106:108470, 2023.
  8. Padim: a patch distribution modeling framework for anomaly detection and localization. In International Conference on Pattern Recognition (ICPR), pages 475–489. Springer, 2021.
  9. Iterative energy-based projection on a normal data manifold for anomaly localization. In International Conference on Learning Representations (ICLR), 2020.
  10. Diffusion models beat gans on image synthesis. Advances in Neural Information Processing Systems (NIPS), 34:8780–8794, 2021.
  11. A survey of methods for automated quality control based on images. International Journal of Computer Vision, pages 1–29, 2023.
  12. Sano: Score-based diffusion model for anomaly localization in dermatology. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 2987–2993, 2023.
  13. Denoising diffusion probabilistic models. Advances in Neural Information Processing Systems (NIPS), 33:6840–6851, 2020.
  14. Pyramidflow: High-resolution defect contrastive localization using pyramid normalizing flow. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 14143–14152, 2023.
  15. Towards visually explaining variational autoencoders. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 8642–8651, 2020.
  16. Anomaly-gan: A data augmentation method for train surface anomaly detection. Expert Systems with Applications, 228:120284, 2023.
  17. Removing anomalies as noises for industrial defect localization. In IEEE International Conference on Computer Vision (ICCV), pages 16166–16175, 2023.
  18. Vt-adl: A vision transformer network for image anomaly detection and localization. In International Symposium on Industrial Electronics (ISIE), pages 01–06. IEEE, 2021.
  19. Fast unsupervised brain anomaly detection and segmentation with diffusion models. In International Conference on Medical image computing and computer-assisted intervention, pages 705–714. Springer, 2022.
  20. Towards total recall in industrial anomaly detection. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 14318–14328, 2022.
  21. A unifying review of deep and shallow anomaly detection. Proceedings of the IEEE, 109(5):756–795, 2021.
  22. Unsupervised anomaly detection with generative adversarial networks to guide marker discovery. In International Conference on Information Processing in Medical Imaging, pages 146–157. Springer, 2017.
  23. f-anogan: Fast unsupervised anomaly detection with generative adversarial networks. Medical image analysis, 54:30–44, 2019.
  24. Denoising diffusion implicit models. In International Conference on Learning Representations (ICLR), 2021.
  25. Score-based generative modeling through stochastic differential equations. In International Conference on Learning Representations (ICLR), 2021.
  26. Anomaly segmentation network using self-supervised learning. In AAAI Workshop on AI for Design and Manufacturing (ADAM), 2022.
  27. Ramfae: a novel unsupervised visual anomaly detection method based on autoencoder. International Journal of Machine Learning and Cybernetics, 2023.
  28. Anomaly detection neural network with dual auto-encoders gan and its industrial inspection applications. Sensors, 20(12):3336, 2020.
  29. Diffusion models for medical anomaly detection. In International Conference on Medical image computing and computer-assisted intervention, pages 35–45. Springer, 2022.
  30. Anoddpm: Anomaly detection with denoising diffusion probabilistic models using simplex noise. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 650–656, 2022.
  31. Gan-based anomaly detection: A review. Neurocomputing, 493:497–535, 2022.
  32. A unified model for multi-class anomaly detection. Advances in Neural Information Processing Systems (NIPS), 35:4571–4584, 2022.
  33. ADTR: Anomaly detection transformer with feature reconstruction. In International Conference on Neural Information Processing (ICONIP), pages 298–310. Springer, 2022.
  34. Wide residual networks. In British Machine Vision Conference (BMVC), 2016.
  35. Draem-a discriminatively trained reconstruction embedding for surface anomaly detection. In IEEE International Conference on Computer Vision (ICCV), pages 8330–8339, 2021.
  36. The unreasonable effectiveness of deep features as a perceptual metric. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 586–595, 2018.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (7)
  1. Di Wu (477 papers)
  2. Shicai Fan (7 papers)
  3. Xue Zhou (17 papers)
  4. Li Yu (193 papers)
  5. Yuzhong Deng (1 paper)
  6. Jianxiao Zou (4 papers)
  7. Baihong Lin (3 papers)
Citations (2)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com