Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
184 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Anatomical Conditioning for Contrastive Unpaired Image-to-Image Translation of Optical Coherence Tomography Images (2404.05409v1)

Published 8 Apr 2024 in eess.IV and cs.CV

Abstract: For a unified analysis of medical images from different modalities, data harmonization using image-to-image (I2I) translation is desired. We study this problem employing an optical coherence tomography (OCT) data set of Spectralis-OCT and Home-OCT images. I2I translation is challenging because the images are unpaired, and a bijective mapping does not exist due to the information discrepancy between both domains. This problem has been addressed by the Contrastive Learning for Unpaired I2I Translation (CUT) approach, but it reduces semantic consistency. To restore the semantic consistency, we support the style decoder using an additional segmentation decoder. Our approach increases the similarity between the style-translated images and the target distribution. Importantly, we improve the segmentation of biomarkers in Home-OCT images in an unsupervised domain adaptation scenario. Our data harmonization approach provides potential for the monitoring of diseases, e.g., age related macular disease, using different OCT devices.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (17)
  1. H. Uzunova, J. Ehrhardt, and H. Handels, “Generation of annotated brain tumor MRIs with tumor-induced tissue deformations for training and assessment of neural networks,” in International Conference on Medical Image Computing and Computer-Assisted Intervention.   Springer, Cham, 2020, pp. 501–511.
  2. H.-C. Shin et al., “Medical Image Synthesis for Data Augmentation and Anonymization Using Generative Adversarial Networks,” in Simulation and Synthesis in Medical Imaging, ser. Lecture Notes in Computer Science, A. Gooya et al., Eds.   Cham: Springer International Publishing, 2018, pp. 1–11.
  3. M. Platscher, J. Zopes, and C. Federau, “Image translation for medical image generation: Ischemic stroke lesion segmentation,” Biomedical Signal Processing and Control, vol. 72, p. 103283, Feb. 2022.
  4. Z. Chen, J. Wei, and R. Li, “Unsupervised Multi-Modal Medical Image Registration via Discriminator-Free Image-to-Image Translation,” in Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence.   Vienna, Austria: International Joint Conferences on Artificial Intelligence Organization, Jul. 2022, pp. 834–840.
  5. Y. Pang et al., “Image-to-Image Translation: Methods and Applications,” IEEE Transactions on Multimedia, vol. 24, pp. 3859–3881, 2022.
  6. M. J. Willemink et al., “Preparing Medical Imaging Data for Machine Learning,” Radiology, vol. 295, no. 1, pp. 4–15, Apr. 2020.
  7. A. Gutierrez et al., “Lesion-preserving unpaired image-to-image translation between MRI and CT from ischemic stroke patients,” International Journal of Computer Assisted Radiology and Surgery, vol. 18, no. 5, pp. 827–836, Jan. 2023.
  8. H. Sudkamp et al., “In-vivo retinal imaging with off-axis full-field time-domain optical coherence tomography,” Optics Letters, vol. 41, no. 21, p. 4987, Nov. 2016.
  9. H. Bogunovic et al., “RETOUCH: The Retinal OCT Fluid Detection and Segmentation Benchmark and Challenge,” IEEE Transactions on Medical Imaging, vol. 38, no. 8, pp. 1858–1874, Aug. 2019.
  10. V. Koch et al., “Noise Transfer for Unsupervised Domain Adaptation of Retinal OCT Images,” in Medical Image Computing and Computer Assisted Intervention – MICCAI 2022, ser. Lecture Notes in Computer Science, L. Wang et al., Eds.   Cham: Springer Nature Switzerland, 2022, pp. 699–708.
  11. J.-Y. Zhu et al., “Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks,” in 2017 IEEE International Conference on Computer Vision (ICCV), Oct. 2017, pp. 2242–2251.
  12. K. Armanious et al., “Unsupervised Medical Image Translation Using Cycle-MedGAN,” in 2019 27th European Signal Processing Conference (EUSIPCO), Sep. 2019, pp. 1–5.
  13. T. Park et al., “Contrastive Learning for Unpaired Image-to-Image Translation,” in Computer Vision – ECCV 2020, A. Vedaldi et al., Eds.   Cham: Springer International Publishing, 2020, vol. 12354, pp. 319–345.
  14. J. P. Cohen, M. Luck, and S. Honari, “Distribution Matching Losses Can Hallucinate Features in Medical Image Translation,” in Medical Image Computing and Computer Assisted Intervention – MICCAI 2018, ser. Lecture Notes in Computer Science, A. F. Frangi et al., Eds.   Cham: Springer International Publishing, 2018, pp. 529–536.
  15. C. von der Burchard et al., “Self-Examination Low-Cost Full-Field Optical Coherence Tomography (SELFF-OCT) for neovascular age-related macular degeneration: A cross-sectional diagnostic accuracy study,” BMJ Open, vol. 12, no. 6, p. e055082, Jun. 2022.
  16. M. Tan and Q. Le, “EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks,” in Proceedings of the 36th International Conference on Machine Learning.   PMLR, May 2019, pp. 6105–6114.
  17. M. Heusel et al., “GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium,” in Advances in Neural Information Processing Systems, vol. 30.   Curran Associates, Inc., 2017.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now