Retinal OCT Synthesis with Denoising Diffusion Probabilistic Models for Layer Segmentation (2311.05479v2)
Abstract: Modern biomedical image analysis using deep learning often encounters the challenge of limited annotated data. To overcome this issue, deep generative models can be employed to synthesize realistic biomedical images. In this regard, we propose an image synthesis method that utilizes denoising diffusion probabilistic models (DDPMs) to automatically generate retinal optical coherence tomography (OCT) images. By providing rough layer sketches, the trained DDPMs can generate realistic circumpapillary OCT images. We further find that more accurate pseudo labels can be obtained through knowledge adaptation, which greatly benefits the segmentation task. Through this, we observe a consistent improvement in layer segmentation accuracy, which is validated using various neural networks. Furthermore, we have discovered that a layer segmentation model trained solely with synthesized images can achieve comparable results to a model trained exclusively with real images. These findings demonstrate the promising potential of DDPMs in reducing the need for manual annotations of retinal OCT images.
- Yufan He, Retinal OCT image analysis using deep learning, Ph.D. thesis, Johns Hopkins University, 2021.
- “Generative adversarial nets,” in NeurIPS, 2014, pp. 2672–2680.
- “Open-set OCT image recognition with synthetic learning,” in IEEE ISBI, 2020, pp. 1788–1792.
- “Assessment of generative adversarial networks model for synthetic optical coherence tomography images of retinal disorders,” Transl. Vis. Sci. Technol., vol. 9, no. 2, pp. 29–29, 2020.
- “Variational inference with normalizing flows,” in ICML, 2015, pp. 1530–1538.
- “Denoising diffusion probabilistic models,” in NeurIPS, 2020, pp. 6840–6851.
- “Denoising diffusion probabilistic models for generation of realistic fully-annotated microscopy image datasets,” PLOS Computational Biology, vol. 20, no. 2, pp. e1011890, 2024.
- “Unsupervised denoising of retinal OCT with diffusion probabilistic model,” in Medical Imaging 2022: Image Processing. SPIE, 2022, vol. 12032, pp. 25–34.
- “Diffusion models beat GANs on image synthesis,” in NeurIPS, 2021, pp. 8780–8794.
- “Teacher-student architecture for knowledge learning: A survey,” arXiv/2210.17332, 2022.
- “Dataset and evaluation algorithm design for GOALS challenge,” in MICCAI Workshops, 2022, pp. 135–142.
- “U-Net: Convolutional networks for biomedical image segmentation,” in MICCAI, 2015, pp. 234–241.
- “U2-Net: Going deeper with nested U-structure for salient object detection,” Pattern Recognit., vol. 106, pp. 107404, 2020.
- “Fully convolutional networks for semantic segmentation,” in CVPR, 2015, pp. 3431–3440.
- “Deep residual learning for image recognition,” in CVPR, 2016, pp. 770–778.
- “Encoder-decoder with atrous separable convolution for semantic image segmentation,” in ECCV, 2018, pp. 801–818.
- “TransUNet: Transformers make strong encoders for medical image segmentation,” arXiv/2102.04306, 2021.
- “Improved denoising diffusion probabilistic models,” in ICML, 2021, pp. 8162–8171.
- “Domain adaptation model for retinopathy detection from cross-domain OCT images,” in MIDL, 2020, pp. 795–810.
- “Unsupervised domain adaptation with contrastive learning for OCT segmentation,” in MICCAI, 2022, pp. 351–361.