CT-xCOV: a CT-scan based Explainable Framework for COVid-19 diagnosis (2311.14462v1)
Abstract: In this work, CT-xCOV, an explainable framework for COVID-19 diagnosis using Deep Learning (DL) on CT-scans is developed. CT-xCOV adopts an end-to-end approach from lung segmentation to COVID-19 detection and explanations of the detection model's prediction. For lung segmentation, we used the well-known U-Net model. For COVID-19 detection, we compared three different CNN architectures: a standard CNN, ResNet50, and DenseNet121. After the detection, visual and textual explanations are provided. For visual explanations, we applied three different XAI techniques, namely, Grad-Cam, Integrated Gradient (IG), and LIME. Textual explanations are added by computing the percentage of infection by lungs. To assess the performance of the used XAI techniques, we propose a ground-truth-based evaluation method, measuring the similarity between the visualization outputs and the ground-truth infections. The performed experiments show that the applied DL models achieved good results. The U-Net segmentation model achieved a high Dice coefficient (98%). The performance of our proposed classification model (standard CNN) was validated using 5-fold cross-validation (acc of 98.40% and f1-score 98.23%). Lastly, the results of the comparison of XAI techniques show that Grad-Cam gives the best explanations compared to LIME and IG, by achieving a Dice coefficient of 55%, on COVID-19 positive scans, compared to 29% and 24% obtained by IG and LIME respectively. The code and the dataset used in this paper are available in the GitHub repository [1].
- “CT-xCOV” URL: https://github.com/ismailelbouknify/CT-xCOV
- “Weakly supervised deep learning for covid-19 infection detection and classification from ct images” In IEEE Access 8 IEEE, 2020, pp. 118869–118883
- “Sensitivity of chest CT for COVID-19: comparison to RT-PCR” In Radiology Radiological Society of North America, 2020
- Thomas C Kwee and Robert M Kwee “Chest CT in COVID-19: what the radiologist needs to know” In Radiographics 40.7 Radiological Society of North America, 2020, pp. 1848
- “Artificial intelligence in radiology” In Nature Reviews Cancer 18.8 Nature Publishing Group, 2018, pp. 500–510
- “Deep learning model improves radiologists’ performance in detection and classification of breast lesions” In Chinese Journal of Cancer Research 33.6 Beijing Institute for Cancer Research, 2021, pp. 682
- Hajar Hakkoum, Ibtissam Abnane and Ali Idri “Interpretability in the medical field: A systematic mapping and review study” In Applied Soft Computing 117 Elsevier, 2022, pp. 108391
- “Zenodo” URL: https://zenodo.org/record/3757476#.YqBY6KjMLIX
- “Medical segmentation” URL: http://medicalsegmentation.com/covid19/
- “Mosmeddata: Chest ct scans with covid-19 related findings dataset” In arXiv preprint arXiv:2005.06465, 2020
- Olaf Ronneberger, Philipp Fischer and Thomas Brox “U-net: Convolutional networks for biomedical image segmentation” In International Conference on Medical image computing and computer-assisted intervention, 2015, pp. 234–241 Springer
- “Deep residual learning for image recognition” In Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 770–778
- “Densely connected convolutional networks” In Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 4700–4708
- Marco Tulio Ribeiro, Sameer Singh and Carlos Guestrin “" Why should i trust you?" Explaining the predictions of any classifier” In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, 2016, pp. 1135–1144
- “Grad-cam: Visual explanations from deep networks via gradient-based localization” In Proceedings of the IEEE international conference on computer vision, 2017, pp. 618–626
- Mukund Sundararajan, Ankur Taly and Qiqi Yan “Axiomatic attribution for deep networks” In International conference on machine learning, 2017, pp. 3319–3328 PMLR
- “MedSeg” URL: https://htmlsegmentation.s3.eu-north-1.amazonaws.com/index.html
- Gao Huang, Zhuang Liu and Kilian Q. Weinberger “Densely Connected Convolutional Networks” In CoRR abs/1608.06993, 2016 arXiv: http://arxiv.org/abs/1608.06993
- “Deep Residual Learning for Image Recognition” In CoRR abs/1512.03385, 2015 arXiv: http://arxiv.org/abs/1512.03385
- “keras” URL: https://keras.io/api/applications/
- Intisar Rizwan I Haque and Jeremiah Neubert “Deep learning approaches to biomedical image segmentation” In Informatics in Medicine Unlocked 18 Elsevier, 2020, pp. 100297
- “Deep learning based diagnosis of COVID-19 using chest CT-scan images” In 2020 IEEE 23rd International Multitopic Conference (INMIC), 2020, pp. 1–5 IEEE
- “Study of different deep learning approach with explainable ai for screening patients with COVID-19 symptoms: Using ct scan and chest x-ray image dataset” In arXiv preprint arXiv:2007.12525, 2020
- “Sample-efficient deep learning for COVID-19 diagnosis based on CT scans” In medrxiv Cold Spring Harbor Laboratory Press, 2020
- “COVID-19 classification based on Chest X-Ray images using machine learning techniques” In Journal of Computer Science and Technology Studies 2.2, 2020, pp. 01–11
- Mathieu Fauvel, Jocelyn Chanussot and J Benediktsson “A combined support vector machines classification based on decision fusion” In 2006 IEEE International Symposium on Geoscience and Remote Sensing, 2006, pp. 2494–2497 IEEE
- “Explainable COVID-19 detection using chest CT scans and deep learning” In Sensors 21.2 Multidisciplinary Digital Publishing Institute, 2021, pp. 455
- Khalid El Asnaoui, Youness Chawki and Ali Idri “Automated methods for detection and classification pneumonia based on x-ray images using deep learning” In Artificial intelligence and blockchain for future cybersecurity applications Springer, 2021, pp. 257–284
- Qinghao Ye, Jun Xia and Guang Yang “Explainable AI for COVID-19 CT classifiers: an initial comparison study” In 2021 IEEE 34th International Symposium on Computer-Based Medical Systems (CBMS), 2021, pp. 521–526 IEEE
- “COVID-CT-dataset: a CT scan dataset about COVID-19” In arXiv preprint arXiv:2003.13865, 2020
- “Efficientnet: Rethinking model scaling for convolutional neural networks” In International conference on machine learning, 2019, pp. 6105–6114 PMLR
- Joseph Paul Cohen, Paul Morrison and Lan Dao “COVID-19 image data collection” In arXiv preprint arXiv:2003.11597, 2020
- “Clinically applicable AI system for accurate diagnosis, quantitative measurements, and prognosis of COVID-19 pneumonia using computed tomography” In Cell 181.6 Elsevier, 2020, pp. 1423–1433