Papers
Topics
Authors
Recent
Assistant
AI Research Assistant
Well-researched responses based on relevant abstracts and paper content.
Custom Instructions Pro
Preferences or requirements that you'd like Emergent Mind to consider when generating responses.
Gemini 2.5 Flash
Gemini 2.5 Flash 165 tok/s
Gemini 2.5 Pro 50 tok/s Pro
GPT-5 Medium 41 tok/s Pro
GPT-5 High 33 tok/s Pro
GPT-4o 124 tok/s Pro
Kimi K2 193 tok/s Pro
GPT OSS 120B 443 tok/s Pro
Claude Sonnet 4.5 36 tok/s Pro
2000 character limit reached

Deep Generative Models for 3D Medical Image Synthesis (2410.17664v1)

Published 23 Oct 2024 in eess.IV and cs.CV

Abstract: Deep generative modeling has emerged as a powerful tool for synthesizing realistic medical images, driving advances in medical image analysis, disease diagnosis, and treatment planning. This chapter explores various deep generative models for 3D medical image synthesis, with a focus on Variational Autoencoders (VAEs), Generative Adversarial Networks (GANs), and Denoising Diffusion Models (DDMs). We discuss the fundamental principles, recent advances, as well as strengths and weaknesses of these models and examine their applications in clinically relevant problems, including unconditional and conditional generation tasks like image-to-image translation and image reconstruction. We additionally review commonly used evaluation metrics for assessing image fidelity, diversity, utility, and privacy and provide an overview of current challenges in the field.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (135)
  1. Medical Image Analysis 84, 102688 (2023)
  2. In: International conference on machine learning, pp. 214–223. PMLR (2017)
  3. In: Proceedings of the 27th ACM SIGKDD conference on knowledge discovery & data mining, pp. 2534–2542 (2021)
  4. Scientific data 4(1), 1–13 (2017)
  5. arXiv preprint arXiv:1811.02629 (2018)
  6. arXiv preprint arXiv:2403.07800 (2024)
  7. arXiv preprint arXiv:1801.01973 (2018)
  8. Sensors 22(12), 4640 (2022)
  9. In: Medical Imaging 2022: Image Processing, vol. 12032, pp. 459–469. SPIE (2022)
  10. In: International Conference on Learning Representations (2018)
  11. Advances in Neural Information Processing Systems 34, 27916–27928 (2021)
  12. In: 32nd USENIX Security Symposium (USENIX Security 23), pp. 5253–5270 (2023)
  13. In: proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 6299–6308 (2017)
  14. arXiv preprint arXiv:1904.00625 (2019)
  15. DOI 10.5281/zenodo.7840229
  16. arXiv preprint arXiv:1803.05854 (2018)
  17. IEEE Access 9, 64747–64760 (2021)
  18. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 6070–6079 (2020)
  19. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 22542–22551 (2023)
  20. arXiv preprint arXiv:2402.01054 (2024)
  21. In: 2009 IEEE conference on computer vision and pattern recognition, pp. 248–255. Ieee (2009)
  22. Advances in neural information processing systems 34, 8780–8794 (2021)
  23. In: Medical Imaging with Deep Learning (2022)
  24. IEEE Journal of Biomedical and Health Informatics (2024)
  25. arXiv preprint arXiv:2403.14499 (2024)
  26. In: Medical Imaging with Deep Learning (2023)
  27. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 12873–12883 (2021)
  28. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 132–142. Springer (2023)
  29. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 3–13. Springer (2023)
  30. Advances in neural information processing systems 4 (1991)
  31. Neurocomputing 321, 321–331 (2018)
  32. arXiv preprint arXiv:2402.19043 (2024)
  33. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 112–122. Springer (2023)
  34. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 354–364. Springer (2023)
  35. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 2426–2436 (2023)
  36. Proceedings of the National Academy of Sciences 112(12), 3618–3623 (2015)
  37. arXiv preprint arXiv:2406.12575 (2024)
  38. Advances in neural information processing systems 27 (2014)
  39. European Radiology Experimental 7(1), 70 (2023)
  40. In: Medical Imaging 2021: Image Processing, vol. 11596, pp. 329–335. SPIE (2021)
  41. arXiv preprint arXiv:2310.02664 (2023)
  42. Advances in neural information processing systems 30 (2017)
  43. In: The Eleventh International Conference on Learning Representations (2022)
  44. In: 2023 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 20498–20508. IEEE (2023)
  45. arXiv preprint arXiv:2405.15241 (2024)
  46. Advances in neural information processing systems 33, 6840–6851 (2020)
  47. In: Deep Generative Models, and Data Augmentation, Labelling, and Imperfections: First Workshop, DGM4MICCAI 2021, and First Workshop, DALI 2021, Held in Conjunction with MICCAI 2021, Strasbourg, France, October 1, 2021, Proceedings 1, pp. 24–34. Springer (2021)
  48. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 495–504. Springer (2022)
  49. IEEE Transactions on Medical Imaging 41(1), 145–157 (2021)
  50. arXiv preprint arXiv:2403.08447 (2024)
  51. Medical physics 38(2), 915–931 (2011)
  52. arXiv preprint arXiv:2306.04098 (2023)
  53. Scientific Reports 13(1), 10568 (2023)
  54. arXiv preprint arXiv:2401.06291 (2024)
  55. arXiv preprint arXiv:2301.03588 (2023)
  56. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 8110–8119 (2020)
  57. Scientific Reports 13(1), 7303 (2023)
  58. In: First Workshop on Fine-Grained Visual Categorization, IEEE Conference on Computer Vision and Pattern Recognition (2011)
  59. In: European conference on computer vision, pp. 347–364. Springer (2022)
  60. In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp. 7604–7613 (2024)
  61. arXiv preprint arXiv:1312.6114 (2013)
  62. arXiv preprint arXiv:2402.05210 (2024)
  63. Nature Medicine pp. 1–8 (2024)
  64. URL https://doi.org/10.5281/zenodo.6361846
  65. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 118–126. Springer (2019)
  66. Advances in neural information processing systems 32 (2019)
  67. Magnetic resonance in medicine 86(3), 1718–1733 (2021)
  68. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 10710–10720 (2023)
  69. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 2206–2217 (2023)
  70. Signal Processing: Image Communication 25(7), 517–526 (2010)
  71. arXiv preprint arXiv:2405.16942 (2024)
  72. Computers in Biology and Medicine 168, 107819 (2024)
  73. Frontiers in Neuroscience 15, 646013 (2021)
  74. Computer Methods and Programs in Biomedicine 240, 107685 (2023)
  75. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2837–2845 (2021)
  76. In: Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part VI 24, pp. 276–285. Springer (2021)
  77. arXiv preprint arXiv:1807.10088 (2018)
  78. In: Proceedings of the IEEE international conference on computer vision, pp. 2794–2802 (2017)
  79. Medical physics 44(10), e339–e352 (2017)
  80. URL https://doi.org/10.5281/zenodo.4572640
  81. In: MICCAI Workshop on Deep Generative Models, pp. 97–105. Springer (2022)
  82. IEEE transactions on medical imaging 34(10), 1993–2024 (2014)
  83. arXiv preprint arXiv:1609.03499 (2016)
  84. Scientific Reports 12(1), 14851 (2022)
  85. Medical Physics 51(4), 2538–2548 (2024)
  86. arXiv preprint arXiv:2305.00042 (2023)
  87. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 14–24. Springer (2023)
  88. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10199–10208 (2023)
  89. In: MICCAI Workshop on Deep Generative Models, pp. 117–126. Springer (2022)
  90. Computers in Biology and Medicine 153, 106541 (2023)
  91. arXiv preprint arXiv:2405.03328 (2024)
  92. Journal of medical imaging 4(3), 035501–035501 (2017)
  93. In: International conference on machine learning, pp. 1530–1538. PMLR (2015)
  94. In: International conference on machine learning, pp. 1278–1286. PMLR (2014)
  95. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 10684–10695 (2022)
  96. arXiv preprint arXiv:2308.12453 (2023)
  97. Advances in neural information processing systems 31 (2018)
  98. Advances in neural information processing systems 29 (2016)
  99. In: MICCAI Workshop on Deep Generative Models, pp. 34–44. Springer (2022)
  100. IEEE Transactions on Medical Robotics and Bionics 3(1), 269–272 (2020)
  101. arXiv preprint arXiv:2108.02160 (2021)
  102. In: International conference on machine learning, pp. 2256–2265. PMLR (2015)
  103. arXiv preprint arXiv:2010.02502 (2020)
  104. In: Proceedings of the 40th International Conference on Machine Learning, pp. 32211–32252 (2023)
  105. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 734–744. Springer (2023)
  106. IEEE journal of biomedical and health informatics 26(8), 3966–3975 (2022)
  107. In: 2023 International Conference on Advanced Technologies for Communications (ATC), pp. 305–310. IEEE (2023)
  108. Computerized Medical Imaging and Graphics 86, 101801 (2020)
  109. In: International Conference on Machine Learning, pp. 34793–34808. PMLR (2023)
  110. In: Medical Image Computing and Computer Assisted Intervention–MICCAI 2020: 23rd International Conference, Lima, Peru, October 4–8, 2020, Proceedings, Part VII 23, pp. 657–666. Springer (2020)
  111. Medical Image Analysis 91, 102983 (2024)
  112. Neuroimage 174, 550–562 (2018)
  113. IEEE transactions on image processing 13(4), 600–612 (2004)
  114. In: The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003, vol. 2, pp. 1398–1402. IEEE (2003)
  115. Medical image analysis 58, 101546 (2019)
  116. Journal of Visual Communication and Image Representation 78, 103145 (2021)
  117. arXiv preprint arXiv:2403.11667 (2024)
  118. In: International Conference on Medical image computing and computer-assisted intervention, pp. 35–45. Springer (2022)
  119. In: International Conference on Medical Imaging with Deep Learning, pp. 1336–1348. PMLR (2022)
  120. IEEE transactions on medical imaging 36(12), 2536–2545 (2017)
  121. In: Medical Imaging with Deep Learning, pp. 1623–1639. PMLR (2024)
  122. In: International Conference on Learning Representations (2021)
  123. arXiv preprint arXiv:2311.04248 (2023)
  124. In: 2023 45th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), pp. 1–4. IEEE (2023)
  125. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 754–764. Springer (2023)
  126. IEEE journal of biomedical and health informatics 24(8), 2378–2388 (2020)
  127. In: International Conference on Information Processing in Medical Imaging, pp. 388–400. Springer (2023)
  128. arXiv preprint arXiv:1506.03365 (2015)
  129. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 516–526. Springer (2022)
  130. Computer Methods and Programs in Biomedicine 217, 106676 (2022)
  131. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 586–595 (2018)
  132. In: 2021 40th Chinese Control Conference (CCC), pp. 7229–7234. IEEE (2021)
  133. arXiv preprint arXiv:2403.12852 (2024)
  134. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 592–601. Springer (2023)
  135. arXiv preprint arXiv:2405.10691 (2024)
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
Dice Question Streamline Icon: https://streamlinehq.com

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now
Lightbulb Streamline Icon: https://streamlinehq.com

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now
List To Do Tasks Checklist Streamline Icon: https://streamlinehq.com

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up