Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
184 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Texture Matching GAN for CT Image Enhancement (2312.13422v1)

Published 20 Dec 2023 in eess.IV, cs.CV, and cs.LG

Abstract: Deep neural networks (DNN) are commonly used to denoise and sharpen X-ray computed tomography (CT) images with the goal of reducing patient X-ray dosage while maintaining reconstruction quality. However, naive application of DNN-based methods can result in image texture that is undesirable in clinical applications. Alternatively, generative adversarial network (GAN) based methods can produce appropriate texture, but naive application of GANs can introduce inaccurate or even unreal image detail. In this paper, we propose a texture matching generative adversarial network (TMGAN) that enhances CT images while generating an image texture that can be matched to a target texture. We use parallel generators to separate anatomical features from the generated texture, which allows the GAN to be trained to match the desired texture without directly affecting the underlying CT image. We demonstrate that TMGAN generates enhanced image quality while also producing image texture that is desirable for clinical application.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (41)
  1. J. Hsieh, Computed tomography: principles, design, artifacts, and recent advances, SPIE press, 3r⁢dsuperscript3𝑟𝑑3^{rd}3 start_POSTSUPERSCRIPT italic_r italic_d end_POSTSUPERSCRIPT edition, 2015.
  2. “Analysis of perceptual expertise in radiology–current knowledge and a new perspective,” Frontiers in Human Neuroscience, vol. 13, pp. 213, 2019.
  3. “Texture analysis and its applications in biomedical imaging: A survey,” IEEE Rev. in Biomedical Eng., vol. 15, pp. 222–246, 2022.
  4. “Practical cone-beam algorithm,” Josa a, vol. 1, pp. 612–619, 1984.
  5. GE HealthCare, “TruefidelityTM: The voice of customers,” Available at https://www.gehealthcare.co.uk/-/jssmedia/syneos/truefidelity/voice-of-customers/booket_truefidelity_the_voice_of_customers.pdf?rev=-1 (2023/09/16).
  6. “Impact on central frequency and noise magnitude ratios by advanced CT image reconstruction techniques,” Medical physics, vol. 47, pp. 480–487, 2020.
  7. “Task-based characterization of a deep learning image reconstruction and comparison with filtered back-projection and a partial model-based iterative reconstruction in abdominal CT: a phantom study,” Physica Medica, vol. 76, pp. 28–37, 2020.
  8. “Image style transfer using convolutional neural networks,” in Proc. IEEE Conf. on comput. vision and pattern recognition, 2016, pp. 2414–2423.
  9. “Texture synthesis using convolutional neural networks,” Advances in neural inform. process. syst., vol. 28, 2015.
  10. “Image decomposition via the combination of sparse representations and a variational approach,” IEEE trans. on image process., vol. 14, no. 10, pp. 1570–1582, 2005.
  11. “Magnetic resonance image denoising algorithm based on cartoon, texture, and residual parts,” Computational and Math. Methods in Medicine, vol. 2020, 2020.
  12. Y. Cheng and Z. Liu, “Image denoising algorithm based on structure and texture part,” in 12th Int. Conf. Computational Intell. and Security (CIS). IEEE, 2016, pp. 147–151.
  13. “A review on self-adaptation approaches and techniques in medical image denoising algorithms,” Multimedia Tools and Applicat., pp. 1–36, 2022.
  14. “A non-local algorithm for image denoising,” in IEEE Comput. Society Conf. on Comput. Vision and Pattern Recognition (CVPR’05), 2005, vol. 2, pp. 60–65.
  15. “Adaptive nonlocal means filtering based on local noise level for CT denoising,” Medical Physics, vol. 41, pp. 011908, 2014.
  16. “Image denoising by sparse 3-D transform-domain collaborative filtering,” IEEE Trans. on Image Process., vol. 16, no. 8, pp. 2080–2095, 2007.
  17. “A three-dimensional statistical approach to improved image quality for multislice helical CT,” Medical Physics, vol. 34, pp. 4526–4544, 2007.
  18. “Iterative reconstruction methods in X-ray CT,” Physica Medica, vol. 28, pp. 94–108, 2012.
  19. “A deep convolutional neural network using directional wavelets for low-dose X-ray CT reconstruction,” Medical Physics, vol. 44, pp. e360–e375, 2017.
  20. “Image super-resolution using deep convolutional networks,” IEEE Trans. on Pattern Analysis and Mach. Intell., vol. 38, no. 2, pp. 295–307, 2016.
  21. “A bias-reducing loss function for CT image denoising,” in IEEE Int. Conf. Acoust., Speech and Signal Process. (ICASSP), 2021, pp. 1175–1179.
  22. “A noise preserving sharpening filter for CT image enhancement,” in IEEE Int. Conf. Image Process. (ICIP), 2022, pp. 2566–2570.
  23. “Generative adversarial networks for noise reduction in low-dose CT,” IEEE Trans. on Medical Imaging, vol. 36, no. 12, pp. 2536–2545, 2017.
  24. “Low-dose ct image denoising using a generative adversarial network with wasserstein distance and perceptual loss,” IEEE Trans. on Medical Imaging, vol. 37, no. 6, pp. 1348–1357, 2018.
  25. “SACNN: Self-attention convolutional neural network for low-dose CT denoising with self-supervised perceptual loss network,” IEEE Trans. on Medical Imaging, vol. 39, no. 7, pp. 2289–2301, 2020.
  26. “CT super-resolution GAN constrained by the identical, residual, and cycle learning ensemble (GAN-CIRCLE),” IEEE Trans. on Medical Imaging, vol. 39, no. 1, pp. 188–203, 2020.
  27. “Distribution Matching Losses Can Hallucinate Features in Medical Image Translation,” in Medical Image Computing and Comput. Assisted Intervention (MICCAI), Cham, 2018, pp. 529–536, Springer Int. Publishing.
  28. “TextureGAN: Controlling deep image synthesis with texture patches,” in Proc. of the IEEE Conf. on computer vision and pattern recognition, 2018, pp. 8456–8465.
  29. “Signature verification using a “siamese” time delay neural network,” Int. J. of Pattern Recognition and Artificial Intell., vol. 7, pp. 669–688, 1993.
  30. “Generative adversarial nets,” in Advances in Neural Inform. Process. Syst., 2014, vol. 27.
  31. Deep Learning, MIT Press, 2016, http://www.deeplearningbook.org.
  32. “Wasserstein generative adversarial networks,” in Int. conf. mach. learning. PMLR, 2017, pp. 214–223.
  33. “Beyond a Gaussian denoiser: residual learning of deep CNN for image denoising,” IEEE Trans. on Image Process., vol. 26, no. 7, pp. 3142–3155, 2017.
  34. “Image-to-image translation with conditional adversarial networks,” in Proc. IEEE Conf. on comput. vision and pattern recognition, 2017, pp. 1125–1134.
  35. “A new era of image reconstruction: Truefidelity™,” Tech. white paper on deep learning image reconstruction, GE Healthcare, 2019.
  36. D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” in 3rd Int. Conf. on Learning Representations, ICLR, 2015.
  37. “TensorFlow: Large-scale machine learning on heterogeneous systems,” 2015, Software available from tensorflow.org.
  38. “Image quality assessment: from error visibility to structural similarity,” IEEE Trans. on Image Process., vol. 13, no. 4, pp. 600–612, 2004.
  39. “Quantitative comparison of noise texture across CT scanners from different manufacturers,” Medical physics, vol. 39, pp. 6048–6055, 2012.
  40. Q. Yang and P. Yan, “Low-dose ct image denoising using a generative adversarial network with wasserstein distance and perceptual loss,” https://github.com/yyqqss09/ldct_denoising, 2019.
  41. “A Review of Deep Learning CT Reconstruction: Concepts, Limitations, and Promise in Clinical Practice,” Current Radiology Rep., vol. 10, pp. 101–115, 2022.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now