Papers
Topics
Authors
Recent
Search
2000 character limit reached

Automatically Score Tissue Images Like a Pathologist by Transfer Learning

Published 9 Sep 2022 in cs.LG, cs.CV, and eess.IV | (2209.05954v4)

Abstract: Cancer is the second leading cause of death in the world. Diagnosing cancer early on can save many lives. Pathologists have to look at tissue microarray (TMA) images manually to identify tumors, which can be time-consuming, inconsistent and subjective. Existing automatic algorithms either have not achieved the accuracy level of a pathologist or require substantial human involvements. A major challenge is that TMA images with different shapes, sizes, and locations can have the same score. Learning staining patterns in TMA images requires a huge number of images, which are severely limited due to privacy and regulation concerns in medical organizations. TMA images from different cancer types may share certain common characteristics, but combining them directly harms the accuracy due to heterogeneity in their staining patterns. Transfer learning is an emerging learning paradigm that allows borrowing strength from similar problems. However, existing approaches typically require a large sample from similar learning problems, while TMA images of different cancer types are often available in small sample size and further existing algorithms are limited to transfer learning from one similar problem. We propose a new transfer learning algorithm that could learn from multiple related problems, where each problem has a small sample and can have a substantially different distribution from the original one. The proposed algorithm has made it possible to break the critical accuracy barrier (the 75% accuracy level of pathologists), with a reported accuracy of 75.9% on breast cancer TMA images from the Stanford Tissue Microarray Database. It is supported by recent developments in transfer learning theory and empirical evidence in clustering technology. This will allow pathologists to confidently adopt automatic algorithms in recognizing tumors consistently with a higher accuracy in real time.

Authors (1)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (33)
  1. Transfer learning: Survey and classification. In Smart Innovations in Communication and Computational Sciences, pages 145–155, 2021.
  2. L. Breiman. Random Forests. Machine Learning, 45(1):5–32, 2001.
  3. Language models are few-shot learners. In Advances in Neural Information Processing Systems (NeurIPS), 2020.
  4. Accuracy is in the eyes of the pathologist: The visual interpretive process and diagnostic accuracy with digital whole slide images. Journal of Biomedical Informatics, 66:171–179, 2017.
  5. T. Cai and H. Wei. Transfer learning for nonparametric classification: Minimax rate and adaptive classifier. The Annals of Statistics, 49(1):100-128, 2021.
  6. Automated subcellular localization and quantification of protein expression in tissue microarrays. Nature medicine, 8(11):1323–1327, 2002.
  7. A decade of tissue microarrays: progress in the discovery and validation of cancer biomarkers. Journal of Clinical Oncology, 26(34):5630–5637, 2008.
  8. R. Caruana. Multitask learning. Machine Learning, 28:41–75, 1997.
  9. An empirical evaluation of supervised learning in high dimensions. In Proceedings of ICML, pages 96–103, 2008.
  10. C. Cortes and V. N. Vapnik. Support-vector networks. Machine Learning, 20(3):273–297, 1995.
  11. Boosting for transfer learning. In Proceedings of the 24th International Conference on Machine Learning (ICML), 2007.
  12. Bert: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019.
  13. Y. Freund and R. Schapire. Experiments with a new boosting algorithm. In Proceedings of the 13rd International Conference on Machine Learning (ICML), 1996.
  14. Deep Learning. The MIT Press, 2016.
  15. Generative adversarial nets. In Advances in Neural Information Processing Systems (NIPS), 2014.
  16. W. Grace-Jones. Tissue microarray. Theory and Practice of Histological Techniques (6th Edition), pages 527–535, 2012.
  17. R. M. Haralick. Statistical and structural approaches to texture. Proceedings of IEEE, 67(5):786–803, 1979.
  18. The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer, 2001.
  19. An interactive Java statistical image segmentation system: Gemident. Journal of Statistical Software, 30(10):1–20, 2009.
  20. N. Jawhar. Tissue microarray: A rapidly evolving diagnostic and research tool. Annals of Saudi Medicine, 29(2):123–127, 2009.
  21. S. Kpotufe and G. Martinet. Marginal singularity and the benefits of labels in covariate-shift. The Annals of Statistics, 49(6):3299-3323, 2021.
  22. Learning transferable features with deep adaptation networks. In Proceedings of ICML, 2015.
  23. The Stanford tissue microarray database. Nucleic Acids Research, 36:D871–877, 2007.
  24. Learning and transferring mid-level image representations using convolutional neural network. In Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1717–1724, 2014.
  25. Tissue microarrays in studying gynecological cancers. Cancer Genomics, pages 65–76, 2014.
  26. S. Pan and Q. Yang. A survey on transfer learning. IEEE Transaction on Knowledge and Data Engineering, 22(10):1345–1359, 2010.
  27. G. Shafer and V. Vovk. A tutorial on conformal prediction. Journal of Machine Learning Research, 9:371–421, 2008.
  28. A. Singh, R. Nowak and X. Zhu. Unlabeled data: Now it helps, now it doesn’t. In Proceedings of Neural Information Processing Systems (NeurIPS), 21:1513-1520, 2009.
  29. A survey on deep transfer learning. In Proceedings of 27th International Conference on Artificial Neural Networks (ICANN), 2018.
  30. Adversarially robust transfer learning. In International Conference on Learning Representations (ICLR), 2020.
  31. Deep domain confusion: Maximizing for domain invariance. arXiv:1412.3474, 2014.
  32. Automated acquisition of stained tissue microarrays for high throughput evaluation of molecular targets. Journal of Molecular Diagnostics, 5(3):160–167, 2003.
  33. Statistical methods for tissue microarray images–algorithmic scoring and co-training. The Annals of Applied Statistics, 6(3):1280–1305, 2012.

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up