Pathologist-Like Explanations Unveiled: an Explainable Deep Learning System for White Blood Cell Classification (2310.13279v1)
Abstract: White blood cells (WBCs) play a crucial role in safeguarding the human body against pathogens and foreign substances. Leveraging the abundance of WBC imaging data and the power of deep learning algorithms, automated WBC analysis has the potential for remarkable accuracy. However, the capability of deep learning models to explain their WBC classification remains largely unexplored. In this study, we introduce HemaX, an explainable deep neural network-based model that produces pathologist-like explanations using five attributes: granularity, cytoplasm color, nucleus shape, size relative to red blood cells, and nucleus to cytoplasm ratio (N:C), along with cell classification, localization, and segmentation. HemaX is trained and evaluated on a novel dataset, LeukoX, comprising 467 blood smear images encompassing ten (10) WBC types. The proposed model achieves impressive results, with an average classification accuracy of 81.08% and a Jaccard index of 89.16% for cell localization. Additionally, HemaX performs well in generating the five explanations with a normalized mean square error of 0.0317 for N:C ratio and over 80% accuracy for the other four attributes. Comprehensive experiments comparing against multiple state-of-the-art models demonstrate that HemaX's classification accuracy remains unaffected by its ability to provide explanations. Moreover, empirical analyses and validation by expert hematologists confirm the faithfulness of explanations predicted by our proposed model.
- H. K. Walker, W. D. Hall, and J. W. Hurst, “Clinical methods: the history, physical, and laboratory examinations,” 1990.
- S. H. Rezatofighi and H. Soltanian-Zadeh, “Automatic recognition of five types of white blood cells in peripheral blood,” Computerized Medical Imaging and Graphics, vol. 35, no. 4, pp. 333–343, 2011.
- P. Gómez-Gil, M. Ramírez-Cortés, J. González-Bernal, Á. G. Pedrero, C. I. Prieto-Castro, D. Valencia, R. Lobato, and J. E. Alonso, “A feature extraction method based on morphological operators for automatic classification of leukocytes,” in 2008 Seventh Mexican International Conference on Artificial Intelligence. IEEE, 2008, pp. 227–232.
- D. M. Ushizima, A. C. Lorena, and A. De Carvalho, “Support vector machines applied to white blood cell recognition,” in Fifth International Conference on Hybrid Intelligent Systems (HIS’05). IEEE, 2005, pp. 6–pp.
- S. S. Kulkarni, C. S. Hinge, and A. G. Ambekar, “Classification of rbc and wbc in peripheral blood smear using knn,” Indian J Res, 2013.
- D. Gupta, J. Arora, U. Agrawal, A. Khanna, and V. H. C. de Albuquerque, “Optimized binary bat algorithm for classification of white blood cells,” Measurement, vol. 143, pp. 180–190, 2019.
- S. Tavakoli, A. Ghaffari, Z. M. Kouzehkanan, and R. Hosseini, “New segmentation and feature extraction algorithm for classification of white blood cells in peripheral smear images,” Scientific Reports, vol. 11, no. 1, p. 19428, 2021.
- A. Khashman, “Ibcis: Intelligent blood cell identification system,” Progress in Natural Science, vol. 18, no. 10, pp. 1309–1314, 2008.
- Q. Wang, L. Chang, M. Zhou, Q. Li, H. Liu, and F. Guo, “A spectral and morphologic method for white blood cell classification,” Optics & Laser Technology, vol. 84, pp. 144–148, 2016.
- J. Li, A. Liu, Y. Li, W. Wei, R. Qian, Q. Xie, B. Qiu, and X. Chen, “Rethinking deep supervision for brain tumor segmentation,” IEEE Transactions on Artificial Intelligence, 2023.
- M. B. Abubaker and B. Babayiğit, “Detection of cardiovascular diseases in ecg images using machine learning and deep learning methods,” IEEE Transactions on Artificial Intelligence, vol. 4, no. 2, pp. 373–382, 2022.
- A. Mitani, A. Huang, S. Venugopalan, G. S. Corrado, L. Peng, D. R. Webster, N. Hammel, Y. Liu, and A. V. Varadarajan, “Detection of anaemia from retinal fundus images via deep learning,” Nature Biomedical Engineering, vol. 4, no. 1, pp. 18–27, 2020.
- A. I. Shahin, Y. Guo, K. M. Amin, and A. A. Sharawi, “White blood cells identification system based on convolutional deep neural learning networks,” Computer methods and programs in biomedicine, vol. 168, pp. 69–80, 2019.
- X. Yao, K. Sun, X. Bu, C. Zhao, and Y. Jin, “Classification of white blood cells using weighted optimized deformable convolutional neural networks,” Artificial Cells, Nanomedicine, and Biotechnology, vol. 49, no. 1, pp. 147–155, 2021.
- R. Al-Qudah and C. Y. Suen, “Improving blood cells classification in peripheral blood smears using enhanced incremental training,” Computers in Biology and Medicine, vol. 131, p. 104265, 2021.
- X. Zhou, Z. Li, Y. Xue, S. Chen, M. Zheng, C. Chen, Y. Yu, X. Nie, X. Lin, L. Wang et al., “Cuss-net: a cascaded unsupervised-based strategy and supervised network for biomedical image diagnosis and segmentation,” IEEE Journal of Biomedical and Health Informatics, 2023.
- M. Li, C. Lin, P. Ge, L. Li, S. Song, H. Zhang, L. Lu, X. Liu, F. Zheng, S. Zhang et al., “A deep learning model for detection of leukocytes under various interference factors,” Scientific Reports, vol. 13, no. 1, p. 2160, 2023.
- M. A. Tahiri, A. Bencherqui, H. Karmouni, H. Amakdouf, M. Sayyouri, H. Qjidaa et al., “White blood cell automatic classification using deep learning and optimized quaternion hybrid moments,” Biomedical Signal Processing and Control, vol. 86, p. 105128, 2023.
- B. Leng, C. Wang, M. Leng, M. Ge, and W. Dong, “Deep learning detection network for peripheral blood leukocytes based on improved detection transformer,” Biomedical Signal Processing and Control, vol. 82, p. 104518, 2023.
- M. Toğaçar, B. Ergen, and Z. Cömert, “Classification of white blood cells using deep features obtained from convolutional neural network models based on the combination of feature selection methods,” Applied Soft Computing, vol. 97, p. 106810, 2020.
- Z. Han, H. Huang, D. Lu, Q. Fan, C. Ma, X. Chen, Q. Gu, and Q. Chen, “One-stage and lightweight cnn detection approach with attention: Application to wbc detection of microscopic images,” Computers in Biology and Medicine, vol. 154, p. 106606, 2023.
- A. Rawal, J. McCoy, D. B. Rawat, B. M. Sadler, and R. S. Amant, “Recent advances in trustworthy explainable artificial intelligence: Status, challenges, and perspectives,” IEEE Transactions on Artificial Intelligence, vol. 3, no. 6, pp. 852–866, 2021.
- H. R. Tizhoosh and L. Pantanowitz, “Artificial intelligence and digital pathology: challenges and opportunities,” Journal of pathology informatics, vol. 9, no. 1, p. 38, 2018.
- H. Wu, W. Ruan, J. Wang, D. Zheng, B. Liu, Y. Geng, X. Chai, J. Chen, K. Li, S. Li et al., “Interpretable machine learning for covid-19: An empirical study on severity prediction task,” IEEE Transactions on Artificial Intelligence, 2021.
- M. K. K. Niazi, A. V. Parwani, and M. N. Gurcan, “Digital pathology and artificial intelligence,” Lancet Oncol., vol. 20, no. 5, pp. e253–e261, May 2019.
- A. Esteva, A. Robicquet, B. Ramsundar, V. Kuleshov, M. DePristo, K. Chou, C. Cui, G. Corrado, S. Thrun, and J. Dean, “A guide to deep learning in healthcare,” Nature medicine, vol. 25, no. 1, pp. 24–29, 2019.
- S. Ren, K. He, R. Girshick, and J. Sun, “Faster r-cnn: Towards real-time object detection with region proposal networks,” Advances in neural information processing systems, vol. 28, 2015.
- Z. M. Kouzehkanan, S. Saghari, S. Tavakoli, P. Rostami, M. Abaszadeh, F. Mirzadeh, E. S. Satlsar, M. Gheidishahran, F. Gorgi, S. Mohammadi et al., “A large dataset of white blood cells containing cell locations and types, along with segmented nuclei and cytoplasm,” Scientific Reports, vol. 12, no. 1, pp. 1–14, 2022.
- A. Ozcan, “Mobile phones democratize and cultivate next-generation imaging, diagnostics and measurement tools,” Lab on a Chip, vol. 14, no. 17, pp. 3187–3194, 2014.
- L. Kwon, K. Long, Y. Wan, H. Yu, and B. Cunningham, “Medical diagnostics with mobile devices: Comparison of intrinsic and extrinsic sensing,” Biotechnology advances, vol. 34, no. 3, pp. 291–304, 2016.
- H. Kim, Y. Jung, I.-J. Doh, R. A. Lozano-Mahecha, B. Applegate, and E. Bae, “Smartphone-based low light detection for bioluminescence application,” Scientific reports, vol. 7, no. 1, p. 40203, 2017.
- Y. Jung, J. Kim, O. Awofeso, H. Kim, F. Regnier, and E. Bae, “Smartphone-based colorimetric analysis for detection of saliva alcohol concentration,” Applied optics, vol. 54, no. 31, pp. 9183–9189, 2015.
- I. M. P. de Vargas-Sansalvador, M. M. Erenas, A. Martínez-Olmos, F. Mirza-Montoro, D. Diamond, and L. F. Capitan-Vallvey, “Smartphone based meat freshness detection,” Talanta, vol. 216, p. 120985, 2020.
- S. Dutta, D. Sarma, A. Patel, and P. Nath, “Dye-assisted ph sensing using a smartphone,” IEEE Photonics Technology Letters, vol. 27, no. 22, pp. 2363–2366, 2015.
- F. Chen, H. Han, P. Wan, H. Liao, C. Liu, and D. Zhang, “Joint segmentation and differential diagnosis of thyroid nodule in contrast-enhanced ultrasound images,” IEEE Transactions on Biomedical Engineering, 2023.
- D. Kiyasseh, R. Ma, T. F. Haque, B. J. Miles, C. Wagner, D. A. Donoho, A. Anandkumar, and A. J. Hung, “A vision transformer for decoding surgeon activity from surgical videos,” Nature Biomedical Engineering, pp. 1–17, 2023.
- H. Phan, K. Mikkelsen, O. Y. Chén, P. Koch, A. Mertins, and M. De Vos, “Sleeptransformer: Automatic sleep staging with interpretability and uncertainty quantification,” IEEE Transactions on Biomedical Engineering, vol. 69, no. 8, pp. 2456–2467, 2022.
- A. Shokouhmand, H. Wen, S. Khan, J. A. Puma, A. Patel, P. Green, F. Ayazi, and N. Ebadi, “Diagnosis of coexisting valvular heart diseases using image-to-sequence translation of contact microphone recordings,” IEEE Transactions on Biomedical Engineering, 2023.
- Z. Wang, M. Tang, L. Wang, X. Li, and L. Zhou, “A medical semantic-assisted transformer for radiographic report generation,” in Medical Image Computing and Computer Assisted Intervention–MICCAI 2022: 25th International Conference, Singapore, September 18–22, 2022, Proceedings, Part III. Springer, 2022, pp. 655–664.
- D. You, F. Liu, S. Ge, X. Xie, J. Zhang, and X. Wu, “Aligntransformer: Hierarchical alignment of visual regions and disease tags for medical report generation,” in Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part III 24. Springer, 2021, pp. 72–82.
- N. Carion, F. Massa, G. Synnaeve, N. Usunier, A. Kirillov, and S. Zagoruyko, “End-to-end object detection with transformers,” in Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part I 16. Springer, 2020, pp. 213–229.
- H. W. Kuhn, “The hungarian method for the assignment problem,” Naval research logistics quarterly, vol. 2, no. 1-2, pp. 83–97, 1955.
- H. Rezatofighi, N. Tsoi, J. Gwak, A. Sadeghian, I. Reid, and S. Savarese, “Generalized intersection over union: A metric and a loss for bounding box regression,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019, pp. 658–666.
- S. Jadon, “A survey of loss functions for semantic segmentation,” in 2020 IEEE conference on computational intelligence in bioinformatics and computational biology (CIBCB). IEEE, 2020, pp. 1–7.
- R. Agrawal, T. Imielinski, and A. N. Swami, “Mining association rules between sets of items in large databases,” in ACM SIGMOD, 1993.
- I. Loshchilov and F. Hutter, “Decoupled weight decay regularization,” arXiv preprint arXiv:1711.05101, 2017.
- P. Jaccard, “Distribution de la flore alpine dans le bassin des dranses et dans quelques régions voisines,” Bull Soc Vaudoise Sci Nat, vol. 37, pp. 241–272, 1901.
- T. Sørensen, T. Sørensen, T. Biering-Sørensen, T. Sørensen, and J. T. Sorensen, “A method of establishing group of equal amplitude in plant sociobiology based on similarity of species content and its application to analyses of the vegetation on danish commons,” in Kongelige Danske Videnskabernes Selskab, 1948.