2000 character limit reached
Histopathology Slide Indexing and Search: Are We There Yet?
Published 29 Jun 2023 in eess.IV, cs.CV, and q-bio.TO | (2306.17019v2)
Abstract: The search and retrieval of digital histopathology slides is an important task that has yet to be solved. In this case study, we investigate the clinical readiness of three state-of-the-art histopathology slide search engines, Yottixel, SISH, and RetCCL, on three patients with solid tumors. We provide a qualitative assessment of each model's performance in providing retrieval results that are reliable and useful to pathologists. We found that all three image search engines fail to produce consistently reliable results and have difficulties in capturing granular and subtle features of malignancy, limiting their diagnostic accuracy. Based on our findings, we also propose a minimal set of requirements to further advance the development of accurate and reliable histopathology image search engines for successful clinical adoption.
- “Fast and scalable search of whole-slide images via self-supervised deep learning” Number: 12 Publisher: Nature Publishing Group In Nature Biomedical Engineering 6.12, 2022, pp. 1420–1434 DOI: 10.1038/s41551-022-00929-8
- “A Simple Framework for Contrastive Learning of Visual Representations” arXiv, 2020 DOI: 10.48550/arXiv.2002.05709
- “The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository” In Journal of Digital Imaging 26.6, 2013, pp. 1045–1057 DOI: 10.1007/s10278-013-9622-7
- “Deep learning trained on hematoxylin and eosin tumor region of Interest predicts HER2 status and trastuzumab treatment response in HER2+ breast cancer” In Modern Pathology 35.1 Nature Publishing Group US New York, 2022, pp. 44–51
- “Cancer Digital Slide Archive: an informatics resource to support integrated in silico analysis of TCGA pathology data” In Journal of the American Medical Informatics Association: JAMIA 20.6, 2013, pp. 1091–1098 DOI: 10.1136/amiajnl-2012-001469
- Richard W Hamming “Error detecting and error correcting codes” In The Bell system technical journal 29.2 Nokia Bell Labs, 1950, pp. 147–160
- “Deep Residual Learning for Image Recognition”, 2015 arXiv:1512.03385 [cs.CV]
- “Deep Residual Learning for Image Recognition” arXiv, 2015 DOI: 10.48550/arXiv.1512.03385
- “Momentum Contrast for Unsupervised Visual Representation Learning” arXiv, 2020 DOI: 10.48550/arXiv.1911.05722
- “Similar image search for histopathology: SMILY” Number: 1 Publisher: Nature Publishing Group In npj Digital Medicine 2.1, 2019, pp. 1–9 DOI: 10.1038/s41746-019-0131-z
- “Pan-cancer diagnostic consensus through searching archival histopathology images using artificial intelligence” In NPJ Digital Medicine 3, 2020, pp. 31 DOI: 10.1038/s41746-020-0238-2
- “Yottixel - An Image Search Engine for Large Archives of Histopathology Whole Slide Images” In Medical Image Analysis 65, 2020, pp. 101757 DOI: 10.1016/j.media.2020.101757
- “Content-based multimedia information retrieval: State of the art and challenges” In ACM Transactions on Multimedia Computing, Communications, and Applications 2.1, 2006, pp. 1–19 DOI: 10.1145/1126004.1126005
- “High-Order Correlation-Guided Slide-Level Histology Retrieval With Self-Supervised Hashing” Conference Name: IEEE Transactions on Pattern Analysis and Machine Intelligence In IEEE Transactions on Pattern Analysis and Machine Intelligence 45.9, 2023, pp. 11008–11023 DOI: 10.1109/TPAMI.2023.3269810
- “Large-scale retrieval for medical image analytics: A comprehensive review” In Medical Image Analysis 43, 2018, pp. 66–84 DOI: 10.1016/j.media.2017.09.007
- Aaron van den Oord, Oriol Vinyals and Koray Kavukcuoglu “Neural Discrete Representation Learning” arXiv:1711.00937 [cs] arXiv, 2018 DOI: 10.48550/arXiv.1711.00937
- Aaron van den Oord, Yazhe Li and Oriol Vinyals “Representation Learning with Contrastive Predictive Coding” arXiv:1807.03748 [cs, stat] arXiv, 2019 DOI: 10.48550/arXiv.1807.03748
- “Fine-Tuning and Training of DenseNet for Histopathology Image Representation Using TCGA Diagnostic Slides” arXiv:2101.07903 [eess] arXiv, 2021 DOI: 10.48550/arXiv.2101.07903
- “Very Deep Convolutional Networks for Large-Scale Image Recognition”, 2015 arXiv:1409.1556 [cs.CV]
- H.R. Tizhoosh “Barcode annotations for medical image retrieval: A preliminary investigation” In 2015 IEEE International Conference on Image Processing (ICIP), 2015, pp. 818–822 DOI: 10.1109/ICIP.2015.7350913
- “MinMax Radon Barcodes for Medical Image Retrieval” arXiv:1610.00318 [cs] arXiv, 2016 DOI: 10.48550/arXiv.1610.00318
- P. Emde Boas “Preserving order in a forest in less than logarithmic time and linear space” In Information Processing Letters 6.3, 1977, pp. 80–82 DOI: 10.1016/0020-0190(77)90031-X
- “Virchow: A Million-Slide Digital Pathology Foundation Model”, 2023 arXiv:2309.07778 [eess.IV]
- “RetCCL: Clustering-guided contrastive learning for whole-slide image retrieval” In Medical Image Analysis 83, 2023, pp. 102645 DOI: 10.1016/j.media.2022.102645
- “The Cancer Genome Atlas Pan-Cancer analysis project” Number: 10 Publisher: Nature Publishing Group In Nature Genetics 45.10, 2013, pp. 1113–1120 DOI: 10.1038/ng.2764
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.