BMAD: Benchmarks for Medical Anomaly Detection (2306.11876v3)
Abstract: Anomaly detection (AD) is a fundamental research problem in machine learning and computer vision, with practical applications in industrial inspection, video surveillance, and medical diagnosis. In medical imaging, AD is especially vital for detecting and diagnosing anomalies that may indicate rare diseases or conditions. However, there is a lack of a universal and fair benchmark for evaluating AD methods on medical images, which hinders the development of more generalized and robust AD methods in this specific domain. To bridge this gap, we introduce a comprehensive evaluation benchmark for assessing anomaly detection methods on medical images. This benchmark encompasses six reorganized datasets from five medical domains (i.e. brain MRI, liver CT, retinal OCT, chest X-ray, and digital histopathology) and three key evaluation metrics, and includes a total of fourteen state-of-the-art AD algorithms. This standardized and well-curated medical benchmark with the well-structured codebase enables comprehensive comparisons among recently proposed anomaly detection methods. It will facilitate the community to conduct a fair comparison and advance the field of AD on medical imaging. More information on BMAD is available in our GitHub repository: https://github.com/DorisBao/BMAD
- Samet Akcay, Amir Atapour-Abarghouei and Toby P Breckon “Ganomaly: Semi-supervised anomaly detection via adversarial training” In Asian conference on computer vision, 2018, pp. 622–637 Springer
- “Anomalib: A Deep Learning Library for Anomaly Detection”, 2022 arXiv:2202.08341 [cs.CV]
- “The RSNA-ASNR-MICCAI BraTS 2021 benchmark on brain tumor segmentation and radiogenomic classification” In arXiv preprint arXiv:2107.02314, 2021
- “Advancing the cancer genome atlas glioma MRI collections with expert segmentation labels and radiomic features” In Scientific data 4.1 Nature Publishing Group, 2017, pp. 1–13
- “Fusing unsupervised and supervised deep learning for white matter lesion segmentation” In International Conference on Medical Imaging with Deep Learning, 2019, pp. 63–72 PMLR
- “Diagnostic assessment of deep learning algorithms for detection of lymph node metastases in women with breast cancer” In Jama 318.22 American Medical Association, 2017, pp. 2199–2210
- “Improving unsupervised defect segmentation by applying structural similarity to autoencoders” In arXiv preprint arXiv:1807.02011, 2018
- “MVTec AD–A comprehensive real-world dataset for unsupervised anomaly detection” In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019, pp. 9592–9600
- “Uninformed students: Student-teacher anomaly detection with discriminative latent embeddings” In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 4183–4192
- “The liver tumor segmentation benchmark (lits)” In arXiv preprint arXiv:1901.04056, 2019
- “The liver tumor segmentation benchmark (lits)” In Medical Image Analysis 84 Elsevier, 2023, pp. 102680
- Van Loi Cao, Miguel Nicolau and James McDermott “A hybrid autoencoder and density estimation model for anomaly detection” In International Conference on Parallel Problem Solving from Nature, 2016, pp. 717–726 Springer
- Van Loi Cao, Miguel Nicolau and James McDermott “One-class classification for anomaly detection with kernel density estimation and genetic programming” In European Conference on Genetic Programming, 2016, pp. 3–18 Springer
- “Informative knowledge distillation for image anomaly segmentation” In Knowledge-Based Systems 248 Elsevier, 2022, pp. 108846
- Varun Chandola, Arindam Banerjee and Vipin Kumar “Anomaly detection: A survey” In ACM computing surveys (CSUR) 41.3 ACM New York, NY, USA, 2009, pp. 1–58
- “UTRAD: Anomaly detection and localization with U-Transformer” In Neural Networks 147 Elsevier, 2022, pp. 53–62
- “Unsupervised detection of lesions in brain MRI using constrained adversarial auto-encoders” In arXiv preprint arXiv:1806.04972, 2018
- “Padim: a patch distribution modeling framework for anomaly detection and localization” In International Conference on Pattern Recognition, 2021, pp. 475–489 Springer
- “Anomaly Detection via Reverse Distillation from One-Class Embedding” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 9737–9746
- “Self-supervised Anomaly Detection with Random-shape Pseudo-outliers” In International Conference of the IEEE Engineering in Medicine & Biology Society, 2022
- “Memorizing normality to detect anomaly: Memory-augmented deep autoencoder for unsupervised anomaly detection” In Proceedings of the IEEE/CVF International Conference on Computer Vision, 2019, pp. 1705–1714
- Denis Gudovskiy, Shun Ishizaka and Kazuki Kozuka “Cflow-ad: Real-time unsupervised anomaly detection with localization via conditional normalizing flows” In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2022, pp. 98–107
- “Adbench: Anomaly detection benchmark” In Advances in Neural Information Processing Systems 35, 2022, pp. 32142–32159
- “Whole-slide-imaging Cancer Metastases Detection and Localization with Limited Tumorous Data” In Medical Imaging with Deep Learning, 2023
- “Divide-and-assemble: Learning block-wise memory for unsupervised anomaly detection” In Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 8791–8800
- Junjie Hu, Yuanyuan Chen and Zhang Yi “Automated segmentation of macular edema in OCT using deep neural networks” In Medical image analysis 55 Elsevier, 2019, pp. 216–227
- Wenping Jin, Fei Guo and Li Zhu “Incremental Self-Supervised Learning Based on Transformer for Anomaly Detection and Localization” In arXiv preprint arXiv:2303.17354, 2023
- Antanas Kascenas, Nicolas Pugeault and Alison Q O’Neil “Denoising Autoencoders for Unsupervised Anomaly Detection in Brain MRI” In Medical Imaging with Deep Learning, 2022
- “Identifying medical diagnoses and treatable diseases by image-based deep learning” In Cell 172.5 Elsevier, 2018, pp. 1122–1131
- “Miccai multi-atlas labeling beyond the cranial vault–workshop and challenge” In Proc. MICCAI Multi-Atlas Labeling Beyond Cranial Vault—Workshop Challenge 5, 2015, pp. 12
- Sungwook Lee, Seunghyun Lee and Byung Cheol Song “Cfa: Coupled-hypersphere-based feature adaptation for target-oriented anomaly localization” In IEEE Access 10 IEEE, 2022, pp. 78446–78454
- “AnoViT: Unsupervised anomaly detection and localization with vision transformer-based encoder-decoder” In IEEE Access 10 IEEE, 2022, pp. 46717–46724
- “Cutpaste: Self-supervised learning for anomaly detection and localization” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 9664–9674
- “Anomaly detection via self-organizing map” In 2021 IEEE International Conference on Image Processing (ICIP), 2021, pp. 974–978 IEEE
- “Discriminative pattern mining for breast cancer histopathology image classification via fully convolutional autoencoder” In IEEE Access 7 IEEE, 2019, pp. 36433–36445
- “Cancer metastasis detection with neural conditional random field” In arXiv preprint arXiv:1806.07064, 2018
- “Superpixel masking and inpainting for self-supervised anomaly detection” In Bmvc, 2020
- “The multimodal brain tumor image segmentation benchmark (BRATS)” In IEEE transactions on medical imaging 34.10 IEEE, 2014, pp. 1993–2024
- “Deep learning for anomaly detection: A review” In ACM computing surveys (CSUR) 54.2 ACM New York, NY, USA, 2021, pp. 1–38
- Hyunjong Park, Jongyoun Noh and Bumsub Ham “Learning memory-guided normality for anomaly detection” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020, pp. 14372–14381
- Pramuditha Perera, Ramesh Nallapati and Bing Xiang “Ocgan: One-class novelty detection using gans with constrained latent representations” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019, pp. 2898–2906
- “Unsupervised brain anomaly detection and segmentation with transformers” In arXiv preprint arXiv:2102.11650, 2021
- Hari Mohan Rai, Kalyan Chatterjee and Sergey Dashkevich “Automatic and accurate abnormality detection from brain MR images using a novel hybrid UnetResNext-50 deep CNN model” In Biomedical Signal Processing and Control 66 Elsevier, 2021, pp. 102477
- “Variational inference with normalizing flows” In International conference on machine learning, 2015, pp. 1530–1538 PMLR
- “Towards total recall in industrial anomaly detection” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 14318–14328
- Marco Rudolph, Bastian Wandt and Bodo Rosenhahn “Same same but differnet: Semi-supervised defect detection with normalizing flows” In Proceedings of the IEEE/CVF winter conference on applications of computer vision, 2021, pp. 1907–1916
- “Asymmetric Student-Teacher Networks for Industrial Anomaly Detection” In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2023, pp. 2592–2602
- “Fully convolutional cross-scale-flows for image-based defect detection” In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2022, pp. 1088–1097
- “Deep one-class classification” In International conference on machine learning, 2018, pp. 4393–4402 PMLR
- “Adversarially learned one-class classifier for novelty detection” In Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 3379–3388
- “Anomaly detection using autoencoders with nonlinear dimensionality reduction” In Proceedings of the MLSDA 2014 2nd workshop on machine learning for sensory data analysis, 2014, pp. 4–11
- “Multiresolution knowledge distillation for anomaly detection” In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021, pp. 14902–14912
- “f-AnoGAN: Fast unsupervised anomaly detection with generative adversarial networks” In Medical image analysis 54 Elsevier, 2019, pp. 30–44
- “Unsupervised anomaly detection with generative adversarial networks to guide marker discovery” In International conference on information processing in medical imaging, 2017, pp. 146–157 Springer
- “Estimating the support of a high-dimensional distribution” In Neural computation 13.7 MIT Press One Rogers Street, Cambridge, MA 02142-1209, USA journals-info …, 2001, pp. 1443–1471
- “Detecting Outliers with Foreign Patch Interpolation” In Journal of Machine Learning for Biomedical Imaging 13, 2022
- David MJ Tax and Robert PW Duin “Support vector data description” In Machine learning 54.1 Springer, 2004, pp. 45–66
- “Unsupervised Visual Defect Detection with Score-Based Generative Model” In arXiv preprint arXiv:2211.16092, 2022
- “Computer-aided detection of squamous carcinoma of the cervix in whole slide images” In arXiv preprint arXiv:1905.10959, 2019
- “Revisiting Reverse Distillation for Anomaly Detection” In Proceedings of the IEEE conference on computer vision and pattern recognition, 2023
- “Student-teacher feature pyramid matching for unsupervised anomaly detection” In arXiv preprint arXiv:2103.04257, 2021
- “Chestx-ray8: Hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases” In Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 2097–2106
- “Diffusion models for medical anomaly detection” In Medical Image Computing and Computer Assisted Intervention–MICCAI 2022: 25th International Conference, Singapore, September 18–22, 2022, Proceedings, Part VIII, 2022, pp. 35–45 Springer
- “AnoDDPM: Anomaly Detection With Denoising Diffusion Probabilistic Models Using Simplex Noise” In Proceedings of the IEEE/CVF Winter Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2022, pp. 650–656
- “Im-iad: Industrial image anomaly detection benchmark in manufacturing” In arXiv preprint arXiv:2301.13359, 2023
- “Reconstruction student with attention for student-teacher pyramid matching” In arXiv preprint arXiv:2111.15376, 2021
- “Learning semantic context from normal samples for unsupervised anomaly detection” In Proceedings of the AAAI Conference on Artificial Intelligence 35.4, 2021, pp. 3110–3118
- “OpenOOD: Benchmarking Generalized Out-of-Distribution Detection” In Advances in neural information processing systems,Track on Datasets and Benchmarks, 2022
- “Patch svdd: Patch-level svdd for anomaly detection and segmentation” In Proceedings of the Asian Conference on Computer Vision, 2020
- “Adtr: Anomaly detection transformer with feature reconstruction” In Neural Information Processing: 29th International Conference, ICONIP 2022, Virtual Event, November 22–26, 2022, Proceedings, Part III, 2023, pp. 298–310 Springer
- “Fastflow: Unsupervised anomaly detection and localization via 2d normalizing flows” In arXiv preprint arXiv:2111.07677, 2021
- Vitjan Zavrtanik, Matej Kristan and Danijel Skočaj “Draem-a discriminatively trained reconstruction embedding for surface anomaly detection” In Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 8330–8339
- Vitjan Zavrtanik, Matej Kristan and Danijel Skočaj “Reconstruction by inpainting for visual anomaly detection” In Pattern Recognition 112 Elsevier, 2021, pp. 107706
- “Viral pneumonia screening on chest X-rays using confidence-aware anomaly detection” In IEEE transactions on medical imaging 40.3 IEEE, 2020, pp. 879–890
- “Benchmarking unsupervised anomaly detection and localization” In arXiv preprint arXiv:2205.14852, 2022
- Chong Zhou and Randy C Paffenroth “Anomaly detection with robust deep autoencoders” In Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining, 2017, pp. 665–674
- “Encoding structure-texture relation with p-net for anomaly detection in retinal images” In European conference on computer vision, 2020, pp. 360–377 Springer
- “Memorizing structure-texture correspondence for image anomaly detection” In IEEE Transactions on Neural Networks and Learning Systems IEEE, 2021
- “Sparse-gan: Sparsity-constrained generative adversarial network for anomaly detection in retinal oct image” In 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI), 2020, pp. 1227–1231 IEEE