Iterative-in-Iterative Super-Resolution Biomedical Imaging Using One Real Image (2306.14487v1)
Abstract: Deep learning-based super-resolution models have the potential to revolutionize biomedical imaging and diagnoses by effectively tackling various challenges associated with early detection, personalized medicine, and clinical automation. However, the requirement of an extensive collection of high-resolution images presents limitations for widespread adoption in clinical practice. In our experiment, we proposed an approach to effectively train the deep learning-based super-resolution models using only one real image by leveraging self-generated high-resolution images. We employed a mixed metric of image screening to automatically select images with a distribution similar to ground truth, creating an incrementally curated training data set that encourages the model to generate improved images over time. After five training iterations, the proposed deep learning-based super-resolution model experienced a 7.5\% and 5.49\% improvement in structural similarity and peak-signal-to-noise ratio, respectively. Significantly, the model consistently produces visually enhanced results for training, improving its performance while preserving the characteristics of original biomedical images. These findings indicate a potential way to train a deep neural network in a self-revolution manner independent of real-world human data.
- Qu, X., Wang, J., Zhang, Z., Koop, N., Rahmanzadeh, R., and Hüttmann, G., “Imaging of cancer cells by multiphoton microscopy using gold nanoparticles and fluorescent dyes,” Journal of biomedical optics 13(3), 031217–031217 (2008).
- Razzak, M. I., Naz, S., and Zaib, A., “Deep learning for medical image processing: Overview, challenges and the future,” Classification in BioApps: Automation of Decision Making , 323–350 (2018).
- Fu, S., Shi, W., Luo, T., He, Y., Zhou, L., Yang, J., Yang, Z., Liu, J., Liu, X., Guo, Z., et al., “Field-dependent deep learning enables high-throughput whole-cell 3d super-resolution imaging,” Nature Methods 20(3), 459–468 (2023).
- Xu, C. S., Hayworth, K. J., Lu, Z., Grob, P., Hassan, A. M., García-Cerdán, J. G., Niyogi, K. K., Nogales, E., Weinberg, R. J., and Hess, H. F., “Enhanced fib-sem systems for large-volume 3d imaging,” elife 6, e25916 (2017).
- Wang, J., Fan, J., Zhou, B., Huang, X., and Chen, L., “Hybrid reconstruction of the physical model with the deep learning that improves structured illumination microscopy,” Advanced Photonics Nexus 2(1), 016012 (2023).
- Zhao, H., Ke, Z., Yang, F., Li, K., Chen, N., Song, L., Zheng, C., Liang, D., and Liu, C., “Deep learning enables superior photoacoustic imaging at ultralow laser dosages,” Advanced Science 8(3), 2003097 (2021).
- Zhou, W., Chen, Z., Zhou, Q., and Xing, D., “Optical biopsy of melanoma and basal cell carcinoma progression by noncontact photoacoustic and optical coherence tomography: In vivo multi-parametric characterizing tumor microenvironment,” IEEE transactions on medical imaging 39(6), 1967–1974 (2019).
- Behrenbruch, C., Petroudi, S., Bond, S., Declerck, J., Leong, F., and Brady, J., “Image filtering techniques for medical image post-processing: an overview,” The British journal of radiology 77(suppl_2), S126–S132 (2004).
- Takagi, Y. and Nishimoto, S., “High-resolution image reconstruction with latent diffusion models from human brain activity,” in [Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition ], 14453–14463 (2023).
- Li, Y., Sixou, B., and Peyrin, F., “A review of the deep learning methods for medical images super resolution problems,” Irbm 42(2), 120–133 (2021).
- Ma, Y., Xiong, K., Hou, X., Zhang, W., Chen, X., Li, L., and Yang, S., “Cascade neural approximating for few-shot super-resolution photoacoustic angiography,” Applied Physics Letters 121(10), 103701 (2022).
- Shin, H.-C., Roth, H. R., Gao, M., Lu, L., Xu, Z., Nogues, I., Yao, J., Mollura, D., and Summers, R. M., “Deep convolutional neural networks for computer-aided detection: Cnn architectures, dataset characteristics and transfer learning,” IEEE transactions on medical imaging 35(5), 1285–1298 (2016).
- Farsiu, S., Robinson, M. D., Elad, M., and Milanfar, P., “Fast and robust multiframe super resolution,” IEEE transactions on image processing 13(10), 1327–1344 (2004).
- Shorten, C. and Khoshgoftaar, T. M., “A survey on image data augmentation for deep learning,” Journal of big data 6(1), 1–48 (2019).
- Shin, Y., Yang, J., and Lee, Y. H., “Deep generative adversarial networks: applications in musculoskeletal imaging,” Radiology: Artificial Intelligence 3(3), e200157 (2021).
- Borji, A., “Pros and cons of gan evaluation measures: New developments,” Computer Vision and Image Understanding 215, 103329 (2022).
- Li, H., Yang, Y., Chang, M., Chen, S., Feng, H., Xu, Z., Li, Q., and Chen, Y., “Srdiff: Single image super-resolution with diffusion probabilistic models,” Neurocomputing 479, 47–59 (2022).
- Ho, J., Saharia, C., Chan, W., Fleet, D. J., Norouzi, M., and Salimans, T., “Cascaded diffusion models for high fidelity image generation.,” J. Mach. Learn. Res. 23(47), 1–33 (2022).
- Ma, Y., Zhou, W., Ma, R., Yang, S., Tang, Y., and Guan, X., “Self-similarity-based super-resolution of photoacoustic angiography from hand-drawn doodles,” arXiv preprint arXiv:2305.01165 (2023).
- Ho, J., Jain, A., and Abbeel, P., “Denoising diffusion probabilistic models,” Advances in Neural Information Processing Systems 33, 6840–6851 (2020).
- Yue-Hei Ng, J., Hausknecht, M., Vijayanarasimhan, S., Vinyals, O., Monga, R., and Toderici, G., “Beyond short snippets: Deep networks for video classification,” in [Proceedings of the IEEE conference on computer vision and pattern recognition ], 4694–4702 (2015).
- Zhang, R., Isola, P., Efros, A. A., Shechtman, E., and Wang, O., “The unreasonable effectiveness of deep features as a perceptual metric,” in [Proceedings of the IEEE conference on computer vision and pattern recognition ], 586–595 (2018).