Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
149 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Unsupervised Anomaly Detection using Aggregated Normative Diffusion (2312.01904v1)

Published 4 Dec 2023 in cs.CV, cs.LG, and eess.IV

Abstract: Early detection of anomalies in medical images such as brain MRI is highly relevant for diagnosis and treatment of many conditions. Supervised machine learning methods are limited to a small number of pathologies where there is good availability of labeled data. In contrast, unsupervised anomaly detection (UAD) has the potential to identify a broader spectrum of anomalies by spotting deviations from normal patterns. Our research demonstrates that existing state-of-the-art UAD approaches do not generalise well to diverse types of anomalies in realistic multi-modal MR data. To overcome this, we introduce a new UAD method named Aggregated Normative Diffusion (ANDi). ANDi operates by aggregating differences between predicted denoising steps and ground truth backwards transitions in Denoising Diffusion Probabilistic Models (DDPMs) that have been trained on pyramidal Gaussian noise. We validate ANDi against three recent UAD baselines, and across three diverse brain MRI datasets. We show that ANDi, in some cases, substantially surpasses these baselines and shows increased robustness to varying types of anomalies. Particularly in detecting multiple sclerosis (MS) lesions, ANDi achieves improvements of up to 178% in terms of AUPRC.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (32)
  1. Bayesian skip-autoencoders for unsupervised hyperintense anomaly detection in high resolution brain mri. pages 1905–1909, 2020.
  2. Autoencoders for unsupervised anomaly segmentation in brain mr images: a comparative study. Medical Image Analysis, 69:101952, 2021.
  3. Mask, stitch, and re-sample: Enhancing robustness and generalizability in anomaly detection through automatic diffusion models. In ICML 3rd Workshop on Interpretable Machine Learning in Healthcare (IMLH), 2023a.
  4. Generalizing unsupervised anomaly detection: Towards unbiased pathology screening. In Medical Imaging with Deep Learning, 2023b.
  5. Reversing the abnormal: Pseudo-healthy generative networks for anomaly detection. arXiv preprint arXiv:2303.08452, 2023c.
  6. A review of atlas-based segmentation for magnetic resonance brain images. Computer methods and programs in biomedicine, 104(3):e158–e177, 2011.
  7. Unsupervised detection of lesions in brain mri using constrained adversarial auto-encoders. arXiv preprint arXiv:1806.04972, 2018.
  8. Normative ascent with local gaussians for unsupervised lesion detection. Medical Image Analysis, 74:102208, 2021.
  9. Objective evaluation of multiple sclerosis lesion segmentation using a data management and processing infrastructure. Scientific reports, 8(1):13650, 2018.
  10. Ujjwal Baid et. al. The rsna-asnr-miccai brats 2021 benchmark on brain tumor segmentation and radiogenomic classification. arXiv preprint arXiv: 2107.02314, 2021.
  11. Generative adversarial nets. Advances in neural information processing systems, 27, 2014.
  12. Isles 2022: A multi-center magnetic resonance imaging stroke lesion segmentation dataset. Scientific data, 9(1):762, 2022.
  13. Denoising diffusion probabilistic models. In Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual, 2020.
  14. Denoising autoencoders for unsupervised anomaly detection in brain mri. In International Conference on Medical Imaging with Deep Learning, pages 653–664. PMLR, 2022.
  15. The role of noise in denoising models for anomaly detection in medical images. Medical Image Analysis, 90:102963, 2023.
  16. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114, 2013.
  17. A large, curated, open-source stroke neuroimaging dataset to improve lesion segmentation algorithms. Scientific data, 9(1):320, 2022.
  18. Low-rank to the rescue–atlas-based analyses in the presence of pathologies. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2014: 17th International Conference, Boston, MA, USA, September 14-18, 2014, Proceedings, Part III 17, pages 97–104. Springer, 2014.
  19. Shifts: A dataset of real distributional shift across multiple large-scale tasks. arXiv preprint arXiv:2107.07455, 2021.
  20. Challenging current semi-supervised anomaly segmentation methods for brain mri. In International MICCAI brainlesion workshop, pages 63–74. Springer, 2021.
  21. New variants of a method of mri scale standardization. IEEE transactions on medical imaging, 19(2):143–150, 2000.
  22. Ken Perlin. Improving noise. In Proceedings of the 29th annual conference on Computer graphics and interactive techniques, pages 681–682, 2002.
  23. Fast unsupervised brain anomaly detection and segmentation with diffusion models. MICCAI, 2022.
  24. A brain tumor segmentation framework based on outlier detection. Medical image analysis, 8(3):275–283, 2004.
  25. The sri24 multichannel atlas of normal adult human brain structure. Human brain mapping, 31(5):798–819, 2010.
  26. A primitive study on unsupervised anomaly detection with an autoencoder in emergency head ct volumes. In Medical Imaging 2018: Computer-Aided Diagnosis, pages 388–393. SPIE, 2018.
  27. Unsupervised anomaly detection with generative adversarial networks to guide marker discovery. In International conference on information processing in medical imaging, pages 146–157. Springer, 2017.
  28. f-anogan: Fast unsupervised anomaly detection with generative adversarial networks. Medical image analysis, 54:30–44, 2019.
  29. Automated segmentation of multiple sclerosis lesions by model outlier detection. IEEE transactions on medical imaging, 20(8):677–688, 2001.
  30. Jonathan Whitaker. Multi-Resolution-Noise-for-Diffusion-Model-Training. https://wandb.ai/johnowhitaker/multires_noise/reports/Multi-Resolution-Noise-for-Diffusion-Model-Training--VmlldzozNjYyOTU2, 2023. Accessed: 2023-4-21.
  31. Anoddpm: Anomaly detection with denoising diffusion probabilistic models using simplex noise. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 650–656, 2022.
  32. A new criterion for automatic multilevel thresholding. IEEE Transactions on Image Processing, 4(3):370–378, 1995.
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now