Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
139 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Explainable and Position-Aware Learning in Digital Pathology (2306.08198v1)

Published 14 Jun 2023 in eess.IV, cs.CV, and cs.LG

Abstract: Encoding whole slide images (WSI) as graphs is well motivated since it makes it possible for the gigapixel resolution WSI to be represented in its entirety for the purpose of graph learning. To this end, WSIs can be broken into smaller patches that represent the nodes of the graph. Then, graph-based learning methods can be utilized for the grading and classification of cancer. Message passing among neighboring nodes is the foundation of graph-based learning methods. However, they do not take into consideration any positional information for any of the patches, and if two patches are found in topologically isomorphic neighborhoods, their embeddings are nearly similar to one another. In this work, classification of cancer from WSIs is performed with positional embedding and graph attention. In order to represent the positional embedding of the nodes in graph classification, the proposed method makes use of spline convolutional neural networks (CNN). The algorithm is then tested with the WSI dataset for grading prostate cancer and kidney cancer. A comparison of the proposed method with leading approaches in cancer diagnosis and grading verify improved performance. The identification of cancerous regions in WSIs is another critical task in cancer diagnosis. In this work, the explainability of the proposed model is also addressed. A gradient-based explainbility approach is used to generate the saliency mapping for the WSIs. This can be used to look into regions of WSI that are responsible for cancer diagnosis thus rendering the proposed model explainable.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (47)
  1. “Introduction to digital image analysis in whole-slide imaging: A white paper from the digital pathology association,” J. Pathol. Inform., vol. 10, no. 1, pp. 9, Mar. 2019.
  2. “Multi-instance multi-label learning for multi-class classification of whole slide breast histopathology images,” IEEE Transactions on Medical Imaging, vol. 37, no. 1, pp. 316–325, 2018.
  3. “On combining multiple-instance learning and active learning for computer-aided detection of tuberculosis,” IEEE Transactions on Medical Imaging, vol. 35, pp. 1–1, 12 2015.
  4. “Multiple-instance learning for anomaly detection in digital mammography,” IEEE Transactions on Medical Imaging, vol. 35, no. 7, pp. 1604–1614, 2016.
  5. “Clinical-grade computational pathology using weakly supervised deep learning on whole slide images.,” Nature Medicine, 2019.
  6. “Semi-supervised histology classification using deep multiple instance learning and contrastive predictive coding,” Advances in Neural Information Processing Systems (NeurIPS) Workshop in Machine Learning for Health, 2019.
  7. M. Aryal and N.Y. Soltani, “Context-aware graph-based self-supervised learning of whole slide images,” in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2022.
  8. “Histographs: graphs in histopathology,” in Medical Imaging 2020: Digital Pathology, John E. Tomaszewski and Aaron D. Ward, Eds. International Society for Optics and Photonics, 2020.
  9. “Whole slide images are 2d point clouds: Context-aware survival prediction using patch-based graph convolutional networks,” in Medical Image Computing and Computer Assisted Intervention – MICCAI 2021, pp. 339–349. Springer International Publishing, 2021.
  10. “Feature-enhanced graph networks for genetic mutational prediction using histopathological images in colon cancer,” in MICCAI, 2020.
  11. “Inductive representation learning on large graphs,” in Advances in Neural Information Processing Systems, 2017.
  12. T.N. Kipf and M. Welling, “Semi-supervised classification with graph convolutional networks,” in International Conference on Learning Representations (ICLR), 2017.
  13. “Hierarchical graph representation learning with differentiable pooling,” in Advances in Neural Information Processing Systems, 2018.
  14. “Predicting lymph node metastasis using histopathological images based on multiple instance learning with deep graph convolution,” in 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
  15. “Weakly supervised prostate tma classification via graph convolutional networks,” in ISBI 2020 - 2020 IEEE International Symposium on Biomedical Imaging, Apr. 2020.
  16. “Learning whole-slide segmentation from inexact and incomplete labels using tissue graphs,” 2021.
  17. “Position-aware graph neural networks,” in Proceedings of the 36th International Conference on Machine Learning, Kamalika Chaudhuri and Ruslan Salakhutdinov, Eds., 09–15 Jun 2019.
  18. “Splinecnn: Fast geometric deep learning with continuous b-spline kernels,” in 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
  19. “Grad-cam: Visual explanations from deep networks via gradient-based localization,” in 2017 IEEE International Conference on Computer Vision (ICCV), 2017.
  20. “Hoggles: Visualizing object detection features,” in 2013 IEEE International Conference on Computer Vision, 2013.
  21. M. D. Zeiler and R. Fergus, “Visualizing and understanding convolutional networks,” in Computer Vision – ECCV 2014, 2014.
  22. “Deep inside convolutional networks: Visualising image classification models and saliency maps,” 2013.
  23. “Explainability methods for graph convolutional neural networks,” in 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
  24. “A survey on graph-based deep learning for computational histopathology,” 2021.
  25. “Quantifying explainers of graph neural networks in computational pathology,” 2020.
  26. M. Muja and D. G. Lowe, “Fast approximate nearest neighbors with automatic algorithm configuration,” International Conference on Computer Vision Theory and Applications, pp. 331–340, 2009.
  27. “A simple framework for contrastive learning of visual representations,” Proceedings of the 37th International Conference on Machine Learning, vol. 119, pp. 1597–1607, 13–18 Jul 2020.
  28. “Distributed large-scale natural graph factorization,” in Proceedings of the 22nd International Conference on World Wide Web, New York, NY, USA, 2013.
  29. M. Belkin and P. Niyogi, “Laplacian eigenmaps and spectral techniques for embedding and clustering,” in Proceedings of the 14th International Conference on Neural Information Processing Systems: Natural and Synthetic, Cambridge, MA, USA, 2001.
  30. “Deepwalk: Online learning of social representations,” in Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, NY, USA, 2014.
  31. A. Grover and J. Leskovec, “Node2vec: Scalable feature learning for networks,” in Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, NY, USA, 2016.
  32. “Graph-context attention networks for size-varied deep graph matching,” in 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
  33. “Deep graph matching via blackbox differentiation of combinatorial solvers,” in Computer Vision – ECCV 2020, 2020.
  34. L. Piegl and W. Tiller, The NURBS book, 1996.
  35. W. L. Hamilton, “Graph representation learning,” Synthesis Lectures on Artificial Intelligence and Machine Learning, pp. 1–159, 2020.
  36. “Graph Attention Networks,” International Conference on Learning Representations, 2018.
  37. V. Nair and G. E. Hinton, “Rectified linear units improve restricted boltzmann machines,” in Proceedings of the 27th International Conference on International Conference on Machine Learning, 2010.
  38. “Cancer statistics, 2021,” CA: A Cancer Journal for Clinicians, pp. 7–33, 2021.
  39. “Radiology data from the cancer genome atlas kidney renal clear cell carcinoma [tcga-kirc] collection. the cancer imaging archive.,” 2016.
  40. “Renal cell carcinoma,” Nat. Rev. Dis. Primers, vol. 3, pp. 17009, Mar. 2017.
  41. “Artificial intelligence for diagnosis and gleason grading of prostate cancer: the panda challenge,” NATURE MEDICINE, vol. 28, pp. 154–163, 2022.
  42. N. Chen and Q. Zhou, “The evolving gleason grading system,” Chin. J. Cancer Res., vol. 28, no. 1, pp. 58–64, Feb. 2016.
  43. “Revisiting multiple instance neural networks,” Pattern Recognition, vol. 74, pp. 15–24, Feb 2018.
  44. “An empirical study of training self-supervised vision transformers,” in 2021 IEEE/CVF International Conference on Computer Vision (ICCV), 2021.
  45. “Deep residual learning for image recognition,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2016.
  46. I. Loshchilov and F. Hutter, “Decoupled weight decay regularization,” in International Conference on Learning Representations, 2019.
  47. J. Cohen, “Weighted kappa: Nominal scale agreement with provision for scaled disagreement or partial credit.,” Psychological Bulletin 70 (4), pp. 213–220, 1968.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now