Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
133 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Domain Transfer Through Image-to-Image Translation for Uncertainty-Aware Prostate Cancer Classification (2307.00479v2)

Published 2 Jul 2023 in eess.IV and cs.CV

Abstract: Prostate Cancer (PCa) is a prevalent disease among men, and multi-parametric MRIs offer a non-invasive method for its detection. While MRI-based deep learning solutions have shown promise in supporting PCa diagnosis, acquiring sufficient training data, particularly in local clinics remains challenging. One potential solution is to take advantage of publicly available datasets to pre-train deep models and fine-tune them on the local data, but multi-source MRIs can pose challenges due to cross-domain distribution differences. These limitations hinder the adoption of explainable and reliable deep-learning solutions in local clinics for PCa diagnosis. In this work, we present a novel approach for unpaired image-to-image translation of prostate multi-parametric MRIs and an uncertainty-aware training approach for classifying clinically significant PCa, to be applied in data-constrained settings such as local and small clinics. Our approach involves a novel pipeline for translating unpaired 3.0T multi-parametric prostate MRIs to 1.5T, thereby augmenting the available training data. Additionally, we introduce an evidential deep learning approach to estimate model uncertainty and employ dataset filtering techniques during training. Furthermore, we propose a simple, yet efficient Evidential Focal Loss, combining focal loss with evidential uncertainty, to train our model effectively. Our experiments demonstrate that the proposed method significantly improves the Area Under ROC Curve (AUC) by over 20% compared to the previous work. Our code is available at https://github.com/med-i-lab/DT_UE_PCa

Definition Search Book Streamline Icon: https://streamlinehq.com
References (99)
  1. Federated learning and differential privacy for medical image analysis. Scientific reports, 12(1):1953, 2022.
  2. Diagnostic accuracy of multi-parametric mri and trus biopsy in prostate cancer (promis): a paired validating confirmatory study. The Lancet, 389(10071):815–822, 2017.
  3. Clinically significant prostate cancer detection and segmentation in low-risk patients using a convolutional neural network on multi-parametric mri. European radiology, 30(12):6582–6592, 2020.
  4. Unsupervised medical image translation using cycle-medgan. In 2019 27th European Signal Processing Conference (EUSIPCO), pages 1–5. IEEE, 2019.
  5. Medgan: Medical image translation using gans. Computerized medical imaging and graphics, 79:101684, 2020.
  6. Prostatex challenges for computerized classification of prostate lesions from multiparametric magnetic resonance images. Journal of Medical Imaging, 5(4):044501, 2018.
  7. A closer look at memorization in deep networks. In International conference on machine learning, pages 233–242. PMLR, 2017.
  8. Esur prostate mr guidelines 2012. European radiology, 22(4):746–757, 2012.
  9. Synopsis of the pi-rads v2 guidelines for multiparametric prostate magnetic resonance imaging and recommendations for use. European urology, 69(1):41, 2016.
  10. Promis—prostate mr imaging study: a paired validating cohort study evaluating the role of multi-parametric mri in men with clinical suspicion of prostate cancer. Contemporary clinical trials, 42:26–40, 2015.
  11. Unsupervised pixel-level domain adaptation with generative adversarial networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 3722–3731, 2017.
  12. On symmetric losses for learning from corrupted labels. In International Conference on Machine Learning, pages 961–970. PMLR, 2019.
  13. Heuristic domain adaptation. Advances in Neural Information Processing Systems, 33:7571–7583, 2020.
  14. Arthur P Dempster. A generalization of bayesian inference. Journal of the Royal Statistical Society: Series B (Methodological), 30(2):205–232, 1968.
  15. Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition, pages 248–255. IEEE, 2009.
  16. Robert H. Fletcher. Guideline: Experts recommend against prostate cancer screening with prostate-specific antigen test. Annals of Internal Medicine, 170(2):JC2, 2019. doi: 10.7326/ACPJC-2019-170-2-002. URL https://www.acpjournals.org/doi/abs/10.7326/ACPJC-2019-170-2-002. PMID: 30641553.
  17. Gan-based synthetic medical image augmentation for increased cnn performance in liver lesion classification. Neurocomputing, 321:321–331, 2018.
  18. Bayesian convolutional neural networks with bernoulli approximate variational inference. arXiv preprint arXiv:1506.02158, 2015.
  19. Dropout as a bayesian approximation: Representing model uncertainty in deep learning. In international conference on machine learning, pages 1050–1059. PMLR, 2016.
  20. Unsupervised domain adaptation by backpropagation. In International conference on machine learning, pages 1180–1189. PMLR, 2015.
  21. Domain-adversarial training of neural networks. The journal of machine learning research, 17(1):2096–2030, 2016.
  22. X-ctrsnet: 3d cervical vertebra ct reconstruction and segmentation directly from 2d x-ray images. Knowledge-Based Systems, 236:107680, 2022.
  23. Transfer learning for domain adaptation in mri: Application in brain lesion segmentation. In International conference on medical image computing and computer-assisted intervention, pages 516–524. Springer, 2017.
  24. Quantifying and leveraging classification uncertainty for chest radiograph assessment. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 676–684. Springer, 2019.
  25. Quantifying and leveraging predictive uncertainty for medical image assessment. Medical Image Analysis, 68:101855, 2021.
  26. Towards democratizing ai in mr-based prostate cancer diagnosis: 3.0 to 1.5 tesla. In Medical Imaging 2020: Image-Guided Procedures, Robotic Interventions, and Modeling, volume 11315, pages 184–189. SPIE, 2020.
  27. Spatial decomposition for robust domain adaptation in prostate cancer detection. In 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI), pages 1218–1222. IEEE, 2021.
  28. Co-teaching: Robust training of deep neural networks with extremely noisy labels. Advances in neural information processing systems, 31, 2018.
  29. Identity mappings in deep residual networks. In European conference on computer vision, pages 630–645. Springer, 2016.
  30. Cross-modality image synthesis from unpaired data using cyclegan. In International workshop on simulation and synthesis in medical imaging, pages 31–41. Springer, 2018.
  31. Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531, 2(7), 2015.
  32. Discovering latent domains for multisource domain adaptation. In European Conference on Computer Vision, pages 702–715. Springer, 2012.
  33. Cycada: Cycle-consistent adversarial domain adaptation. In International conference on machine learning, pages 1989–1998. PMLR, 2018.
  34. Conditional generative adversarial network for structured domain adaptation. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1335–1344, 2018.
  35. Xiaobin Hu. Multi-texture gan: Exploring the multi-scale texture translation for brain mr images. arXiv preprint arXiv:2102.07225, 2021.
  36. Enhanced balancing gan: Minority-class image generation. Neural Computing and Applications, pages 1–10, 2021.
  37. Prostate cancer detection using deep learning and traditional techniques. IEEE Access, 9:27085–27100, 2021.
  38. Mentornet: Learning data-driven curriculum for very deep neural networks on corrupted labels. In International conference on machine learning, pages 2304–2313. PMLR, 2018.
  39. Audun Jøsang. Subjective logic, volume 3. Springer, 2016.
  40. Deep learning with noisy labels: Exploring techniques and remedies in medical image analysis. Medical Image Analysis, 65:101759, 2020.
  41. Training generative adversarial networks with limited data. Advances in Neural Information Processing Systems, 33:12104–12114, 2020.
  42. Mri-targeted or standard biopsy for prostate-cancer diagnosis. New England Journal of Medicine, 378(19):1767–1777, 2018.
  43. Imaging prostate cancer using multiparametric magnetic resonance imaging: past, present, and future. In Seminars in Roentgenology, volume 53, pages 200–205. Elsevier, 2018.
  44. Transfer learning with intelligent training data selection for prediction of alzheimer’s disease. IEEE Access, 7:72726–72735, 2019.
  45. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
  46. Mr acquisition-invariant representation learning. arXiv preprint arXiv:1709.07944, 2017.
  47. Unsupervised domain adaptation by matching distributions based on the maximum mean discrepancy via unilateral transformations. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 33, pages 4106–4113, 2019.
  48. Generation of 3d brain mri using auto-encoding generative adversarial networks. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 118–126. Springer, 2019.
  49. Pros and cons of ultra-high-field mri/mrs for human application. Progress in nuclear magnetic resonance spectroscopy, 109:1–50, 2018.
  50. Automated diagnosis of prostate cancer in multi-parametric mri based on multimodal convolutional neural networks. Physics in Medicine & Biology, 62(16):6497, 2017.
  51. Learning invariant representations and risks for semi-supervised domain adaptation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1104–1113, 2021.
  52. Multi-site fmri analysis using privacy-preserving federated learning and domain adaptation: Abide results. Medical Image Analysis, 65:101765, 2020.
  53. Focal loss for dense object detection. In Proceedings of the IEEE international conference on computer vision, pages 2980–2988, 2017.
  54. Computer-aided detection of prostate cancer in mri. IEEE transactions on medical imaging, 33(5):1083–1092, 2014.
  55. Prostatex challenge data. Cancer Imaging Arch, 10:K9TCIA, 2017.
  56. Prostate cancer diagnosis using deep learning with 3d multiparametric mri. In Medical imaging 2017: computer-aided diagnosis, volume 10134, pages 581–584. SPIE, 2017.
  57. Transfer joint matching for unsupervised domain adaptation. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1410–1417, 2014.
  58. Learning transferable features with deep adaptation networks. In International conference on machine learning, pages 97–105. PMLR, 2015.
  59. Unsupervised domain adaptation with residual transfer networks. Advances in neural information processing systems, 29, 2016.
  60. Decoupling" when to update" from" how to update". Advances in neural information processing systems, 30, 2017.
  61. Least squares generative adversarial networks. In Proceedings of the IEEE international conference on computer vision, pages 2794–2802, 2017.
  62. Classification of clinical significance of mri prostate findings using 3d convolutional neural networks. In Medical Imaging 2017: Computer-Aided Diagnosis, volume 10134, page 101342A. International Society for Optics and Photonics, 2017.
  63. Unified deep supervised domain adaptation and generalization. In Proceedings of the IEEE international conference on computer vision, pages 5715–5725, 2017.
  64. The cost-effectiveness of magnetic resonance imaging for patients with equivocal neurological symptoms. International Journal of Technology Assessment in Health Care, 13(1):21–34, 1997. doi: 10.1017/S0266462300010205.
  65. Medical image synthesis with context-aware generative adversarial networks. In International conference on medical image computing and computer-assisted intervention, pages 417–425. Springer, 2017.
  66. Medical image synthesis with deep convolutional adversarial networks. IEEE Transactions on Biomedical Engineering, 65(12):2720–2730, 2018.
  67. Mri to ct synthesis of the lumbar spine from a pseudo-3d cycle gan. In 2020 IEEE 17th international symposium on biomedical imaging (ISBI), pages 1784–1787. IEEE, 2020.
  68. Deep learning for fully automatic detection, segmentation, and gleason grade estimation of prostate cancer in multiparametric magnetic resonance images. Scientific reports, 12(1):1–13, 2022.
  69. Moment matching for multi-source domain adaptation. In Proceedings of the IEEE/CVF international conference on computer vision, pages 1406–1415, 2019.
  70. Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv:1511.06434, 2015.
  71. Deep learning role in early diagnosis of prostate cancer. Technology in cancer research & treatment, 17:1533034618775530, 2018.
  72. End-to-end prostate cancer detection in bpmri via 3d cnns: Effects of attention mechanisms, clinical priori and decoupled false positive reduction. Medical image analysis, 73:102155, 2021.
  73. Maximum classifier discrepancy for unsupervised domain adaptation. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 3723–3732, 2018.
  74. Semi-supervised domain adaptation via minimax entropy. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 8050–8058, 2019.
  75. Evidential deep learning to quantify classification uncertainty. Advances in Neural Information Processing Systems, 31, 2018.
  76. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014.
  77. Identification of clinically significant prostate cancer by prostate-specific antigen screening. Archives of internal medicine, 164(11):1227–1230, 2004.
  78. Learning from noisy labels with deep neural networks: A survey. IEEE Transactions on Neural Networks and Learning Systems, 2022.
  79. Multiparametric mri for prostate cancer diagnosis: current status and future directions. Nature reviews urology, 17(1):41–61, 2020.
  80. Uncertainty measurements for the reliable classification of mammograms. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 495–503. Springer, 2019.
  81. Simultaneous deep transfer across domains and tasks. In Proceedings of the IEEE international conference on computer vision, pages 4068–4076, 2015.
  82. Magnetic resonance imaging of the prostate at 1.5 versus 3.0 t: A prospective comparison study of image quality. European journal of radiology, 90:192–197, 2017.
  83. Memory-efficient gan-based domain translation of high resolution 3d medical images. Computerized Medical Imaging and Graphics, 86:101801, 2020.
  84. Learning with symmetric label noise: The importance of being unhinged. Advances in neural information processing systems, 28, 2015.
  85. Deep visual domain adaptation: A survey. Neurocomputing, 312:135–153, 2018.
  86. Training noise-robust deep neural networks via meta-learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 4524–4533, 2020.
  87. Pi-rads prostate imaging–reporting and data system: 2015, version 2. European urology, 69(1):16–40, 2016.
  88. Deep cocktail network: Multi-source unsupervised domain adaptation with category shift. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 3964–3973, 2018.
  89. Classic works of the Dempster-Shafer theory of belief functions, volume 219. Springer, 2008.
  90. Mind the class weight bias: Weighted maximum mean discrepancy for unsupervised domain adaptation. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 2272–2281, 2017.
  91. Semi-supervised domain adaptation with subspace learning for visual recognition. In Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, pages 2142–2150, 2015.
  92. X2ct-gan: reconstructing ct from biplanar x-rays with generative adversarial networks. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10619–10628, 2019.
  93. Prostate cancer detection using deep convolutional neural networks. Scientific reports, 9(1):1–10, 2019.
  94. How does disagreement help generalization against label corruption? In International Conference on Machine Learning, pages 7164–7173. PMLR, 2019.
  95. Evidential deep neural networks for uncertain data classification. In International Conference on Knowledge Science, Engineering and Management, pages 427–437. Springer, 2020.
  96. Understanding deep learning (still) requires rethinking generalization. Communications of the ACM, 64(3):107–115, 2021.
  97. Generalized cross entropy loss for training deep neural networks with noisy labels. Advances in neural information processing systems, 31, 2018.
  98. Unpaired image-to-image translation using adversarial consistency loss. In European Conference on Computer Vision, pages 800–815. Springer, 2020.
  99. Unpaired image-to-image translation using cycle-consistent adversarial networks. In Proceedings of the IEEE international conference on computer vision, pages 2223–2232, 2017.

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com