Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
167 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

PrPSeg: Universal Proposition Learning for Panoramic Renal Pathology Segmentation (2402.19286v2)

Published 29 Feb 2024 in eess.IV and cs.CV

Abstract: Understanding the anatomy of renal pathology is crucial for advancing disease diagnostics, treatment evaluation, and clinical research. The complex kidney system comprises various components across multiple levels, including regions (cortex, medulla), functional units (glomeruli, tubules), and cells (podocytes, mesangial cells in glomerulus). Prior studies have predominantly overlooked the intricate spatial interrelations among objects from clinical knowledge. In this research, we introduce a novel universal proposition learning approach, called panoramic renal pathology segmentation (PrPSeg), designed to segment comprehensively panoramic structures within kidney by integrating extensive knowledge of kidney anatomy. In this paper, we propose (1) the design of a comprehensive universal proposition matrix for renal pathology, facilitating the incorporation of classification and spatial relationships into the segmentation process; (2) a token-based dynamic head single network architecture, with the improvement of the partial label image segmentation and capability for future data enlargement; and (3) an anatomy loss function, quantifying the inter-object relationships across the kidney.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (51)
  1. Renal biopsy for medical renal disease: indications and contraindications. Can J Urol, 23(1):8121–6, 2016.
  2. Qupath: Open source software for digital pathology image analysis. Scientific reports, 7(1):1–7, 2017.
  3. Digital pathology evaluation in the multicenter nephrotic syndrome study network (neptune). Clinical Journal of the American Society of Nephrology, 8(8):1449–1459, 2013.
  4. Structure instance segmentation in renal tissue: a case study on tubular immune cell detection. In Computational Pathology and Ophthalmic Medical Image Analysis, pages 112–119. Springer, 2018.
  5. Computer-aided diagnostics in digital pathology, 2017.
  6. Deep learning–based segmentation and quantification in experimental kidney histopathology. Journal of the American Society of Nephrology, 32(1):52–68, 2021.
  7. Glomerulosclerosis identification in whole slide images using semantic segmentation. Computer methods and programs in biomedicine, 184:105273, 2020.
  8. Med3d: Transfer learning for 3d medical image analysis. arXiv preprint arXiv:1904.00625, 2019.
  9. Democratizing pathological image segmentation with lay annotators via molecular-empowered learning. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 497–507. Springer, 2023a.
  10. Omni-seg: A scale-aware dynamic network for renal pathological image segmentation. IEEE Transactions on Biomedical Engineering, 2023b.
  11. Multi-scale fully convolutional network for gland segmentation using three-class classification. Neurocomputing, 380:150–161, 2020.
  12. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929, 2020.
  13. Multi-organ segmentation over partially labeled datasets with multi-scale feature abstraction. IEEE Transactions on Medical Imaging, 39(11):3619–3629, 2020.
  14. Artificial intelligence in renal pathology: Current status and future. Bosnian Journal of Basic Medical Sciences, 2022.
  15. Cnn cascades for segmenting whole slide images of the kidney. arxiv 2017. arXiv preprint arXiv:1708.00251.
  16. Glomerulus classification and detection based on convolutional neural networks. Journal of Imaging, 4(1):20, 2018.
  17. Instance-based vision transformer for subtyping of papillary renal cell carcinoma in histopathological image. In Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part VIII 24, pages 299–308. Springer, 2021.
  18. Building robust pathology image analyses with uncertainty quantification. Computer Methods and Programs in Biomedicine, 208:106291, 2021.
  19. Multi-structure segmentation from partially labeled datasets. application to body composition measurements on ct scans. In Image Analysis for Moving Organ, Breast, and Thoracic Images, pages 215–224. Springer, 2018.
  20. Iterative learning to make the most of unlabeled and quickly obtained labeled data in histology. In International Conference on Medical Imaging with Deep Learning–Full Paper Track, 2018.
  21. Evaluating tubulointerstitial compartments in renal biopsy specimens using a deep learning-based approach for classifying normal and abnormal tubules. PloS one, 17(7):e0271161, 2022.
  22. Swin unetr: Swin transformers for semantic segmentation of brain tumors in mri images. In International MICCAI Brainlesion Workshop, pages 272–284. Springer, 2021.
  23. Unetr: Transformers for 3d medical image segmentation. In Proceedings of the IEEE/CVF winter conference on applications of computer vision, pages 574–584, 2022.
  24. Deep learning–based histopathologic assessment of kidney tissue. Journal of the American Society of Nephrology, 30(10):1968–1979, 2019.
  25. Interactions between podocytes, mesangial cells, and glomerular endothelial cells in glomerular diseases. Frontiers in Physiology, page 488, 2022.
  26. Development and evaluation of deep learning–based segmentation of histologic structures in the kidney cortex with multiple histologic stains. Kidney international, 99(1):86–101, 2021.
  27. Mast cell quantification in normal peritoneum and during peritoneal dialysis treatment. Archives of pathology & laboratory medicine, 130(8):1188–1192, 2006.
  28. Segmentation of tumour regions for tubule formation assessment on breast cancer histopathology images. In Proceedings of the 11th International Conference on Robotics, Vision, Signal Processing and Power Applications, pages 170–176. Springer, 2022.
  29. Jeremiah W Johnson. Automatic nucleus segmentation with mask-rcnn. In Science and Information Conference, pages 399–407. Springer, 2019.
  30. imgaug. https://github.com/aleju/imgaug, 2020. Online; accessed 01-Feb-2020.
  31. Segmentation of glomeruli within trichrome images using deep learning. Kidney international reports, 4(7):955–962, 2019.
  32. John A Kellum. Acute kidney injury. Critical care medicine, 36(4):S141–S145, 2008.
  33. A dataset and a technique for generalized nuclear segmentation for computational pathology. IEEE transactions on medical imaging, 36(7):1550–1560, 2017.
  34. U-net ensemble model for segmentation inhistopathology images. 2019.
  35. Adversarial learning with data selection for cross-domain histopathological breast cancer segmentation. Multimedia Tools and Applications, 81(4):5989–6008, 2022.
  36. An integrated iterative annotation technique for easing neural network training in medical image analysis. Nature machine intelligence, 1(2):112–119, 2019.
  37. Automatic evaluation of histological prognostic factors using two consecutive convolutional neural networks on kidney samples. Clinical Journal of the American Society of Nephrology, 17(2):260–270, 2022.
  38. Digital pathology: accurate technique for quantitative assessment of histological features in metabolic-associated fatty liver disease. Alimentary Pharmacology & Therapeutics, 53(1):160–171, 2021.
  39. Cortical thickness: an early morphological marker of atherosclerotic renal disease. Kidney international, 61(2):591–598, 2002.
  40. Evaluating transformer-based semantic segmentation networks for pathological image segmentation. arXiv preprint arXiv:2108.11993, 2021.
  41. Computer aided analysis of prostate histopathology images to support a refined gleason grading system. In Medical Imaging 2017: Image Processing, page 101331V. International Society for Optics and Photonics, 2017.
  42. Automated assessment of glomerulosclerosis and tubular atrophy using deep learning. Computerized Medical Imaging and Graphics, 90:101930, 2021.
  43. Segmenter: Transformer for semantic segmentation. In Proceedings of the IEEE/CVF international conference on computer vision, pages 7262–7272, 2021.
  44. Morphological and clinical findings in sri lankan patients with chronic kidney disease of unknown cause (ckdu): Similarities and differences with mesoamerican nephropathy. PloS one, 13(3):e0193056, 2018.
  45. Tgnet: A task-guided network architecture for multi-organ and tumour segmentation from partially labelled datasets. In 2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI), pages 1–5. IEEE, 2022.
  46. Segformer: Simple and efficient design for semantic segmentation with transformers. Advances in Neural Information Processing Systems, 34:12077–12090, 2021.
  47. Self reinforcing multi-class transformer for kidney glomerular basement membrane segmentation. IEEE Access, 2023.
  48. Identification of glomerular lesions and intrinsic glomerular cell types in kidney diseases via deep learning. The Journal of pathology, 252(1):53–64, 2020.
  49. Dodnet: Learning to segment multi-organ and tumors from multiple partially labeled datasets. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1195–1204, 2021.
  50. Deep-learning–driven quantification of interstitial fibrosis in digitized kidney biopsies. The American journal of pathology, 191(8):1442–1453, 2021.
  51. Unpaired image-to-image translation using cycle-consistent adversarial networks. In Proceedings of the IEEE international conference on computer vision, pages 2223–2232, 2017.
Citations (4)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now