Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
173 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

CT respiratory motion synthesis using joint supervised and adversarial learning (2404.00163v1)

Published 29 Mar 2024 in cs.CV

Abstract: Objective: Four-dimensional computed tomography (4DCT) imaging consists in reconstructing a CT acquisition into multiple phases to track internal organ and tumor motion. It is commonly used in radiotherapy treatment planning to establish planning target volumes. However, 4DCT increases protocol complexity, may not align with patient breathing during treatment, and lead to higher radiation delivery. Approach: In this study, we propose a deep synthesis method to generate pseudo respiratory CT phases from static images for motion-aware treatment planning. The model produces patient-specific deformation vector fields (DVFs) by conditioning synthesis on external patient surface-based estimation, mimicking respiratory monitoring devices. A key methodological contribution is to encourage DVF realism through supervised DVF training while using an adversarial term jointly not only on the warped image but also on the magnitude of the DVF itself. This way, we avoid excessive smoothness typically obtained through deep unsupervised learning, and encourage correlations with the respiratory amplitude. Main results: Performance is evaluated using real 4DCT acquisitions with smaller tumor volumes than previously reported. Results demonstrate for the first time that the generated pseudo-respiratory CT phases can capture organ and tumor motion with similar accuracy to repeated 4DCT scans of the same patient. Mean inter-scans tumor center-of-mass distances and Dice similarity coefficients were $1.97$mm and $0.63$, respectively, for real 4DCT phases and $2.35$mm and $0.71$ for synthetic phases, and compares favorably to a state-of-the-art technique (RMSim).

Definition Search Book Streamline Icon: https://streamlinehq.com
References (55)
  1. M. Antonelli et al. The Medical Segmentation Decathlon. Nature Communications, 13(1):4128, July 2022.
  2. Y-H. Cao et al. Image and volume conditioning for respiratory motion synthesis using GANs. In IEEE NSS MIC 2021, Oct 2021.
  3. Y-H. Cao et al. Patient-specific 4DCT respiratory motion synthesis using tumor-aware GANs. In IEEE NSS MIC 2022, Oct 2022.
  4. The diaphragm as an anatomic surrogate for lung tumor motion. Physics in Medicine & Biology, 54(11):3529, may 2009.
  5. Y. Chang et al. A generative adversarial network (GAN)-based technique for synthesizing realistic respiratory motion in the extended cardiac-torso (XCAT) phantoms. Phys. Med. Biol., 66(11):115018, May 2021.
  6. Few-shot learning for deformable image registration in 4DCT images. The British Journal of Radiology, 95(1129):20210819, January 2022.
  7. Image-Guided Radiotherapy of Lung Cancer. September 2007.
  8. S. De Oliveira Duarte et al. Use of 4D-CT for radiotherapy planning and reality in France: Data from a national survey. Cancer/Radiothérapie, 23(5):395–400, September 2019.
  9. Pulmonary CT Registration Through Supervised Learning With Convolutional Neural Networks. IEEE Trans. Med. Imag., 38(5):1097–1105, May 2019.
  10. H. Fayad et al. Patient specific respiratory motion modeling using a 3D patient’s external surface. Med. Phys., 39(6Part1):3386–3395, 2012.
  11. H. Fayad et al. Generation of 4-Dimensional CT Images Based on 4-Dimensional PET–Derived Motion Fields. J. Nucl. Med., 54(4):631–638, April 2013.
  12. Technical Note: Correlation of respiratory motion between external patient surface and internal anatomical landmarks. Med. Phys., 38(6Part1):3157–3164, May 2011.
  13. R. Finnegan et al. Feasibility of multi-atlas cardiac segmentation from thoracic planning CT in a probabilistic framework. Phys. Med. Biol., 64(8):085006, April 2019.
  14. Y. Fu et al. Deep learning in medical image registration: a review. Phys. Med. Biol., 65(20):20TR01, October 2020.
  15. Y. Fu et al. LungRegNet: an unsupervised deformable image registration method for 4D-CT lung. Med. Phys., 47(4):1763–1774, April 2020.
  16. R. Groenendijk et al. On the Benefit of Adversarial Training for Monocular Depth Estimation. Computer Vision and Image Understanding, 190:102848, January 2020.
  17. M. Guckenberger et al. Is a Single Respiratory Correlated 4D-CT Study Sufficient for Evaluation of Breathing Motion? International Journal of Radiation Oncology, Biology, Physics, 67(5):1352–1359, April 2007.
  18. L. Hansen and M. P. Heinrich. GraphRegNet: Deep Graph Regularisation Networks on Sparse Keypoints for Dense Registration of 3D Lung CTs. IEEE Trans. Med. Imag., 40(9):2246–2257, September 2021.
  19. MRF-Based Deformable Registration and Ventilation Estimation of Lung CT. IEEE Trans. Med. Imag., 32(7):1239–1248, July 2013.
  20. M. P. Heinrich and L. Hansen. Voxelmorph++ Going beyond the cranial vault with keypoint supervision and multi-channel instance optimisation. Technical Report arXiv:2203.00046, arXiv, February 2022.
  21. A. Hering et al. Learn2Reg: comprehensive multi-task medical image registration challenge, dataset and evaluation in the era of deep learning. IEEE Trans. Med. Imag., pages 1–1, 2022.
  22. M. Hoffmann et al. SynthMorph: Learning Contrast-Invariant Registration Without Acquired Images. IEEE Trans. Med. Imag., 41(3):543–558, March 2022.
  23. J. Hofmanninger et al. Automatic lung segmentation in routine imaging is primarily a data diversity problem, not a methodology problem. European Radiology Experimental, 4(1):50, December 2020.
  24. X. Huang and S. Belongie. Arbitrary style transfer in real-time with adaptive instance normalization. In ICCV, 2017.
  25. Y. Huang et al. Deep learning-based synthetization of real-time in-treatment 4D images using surface motion and pretreatment images: A proof-of-concept study. Med. Phys., 2022.
  26. G. D. Hugo et al. A longitudinal four-dimensional computed tomography and cone beam computed tomography dataset for image-guided radiation therapy research in lung cancer. Medical physics, 44(2):762–771, 2017.
  27. F. Isensee et al. nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation. Nature Methods, 18(2):203–211, February 2021.
  28. Regularized directional representations for medical image registration. Technical Report arXiv:2111.15509, arXiv, November 2021.
  29. V. Jaouen and D. Visvikis. 4D respiratory motion synchronized image synthesis from static CT images using GANs. In IEEE NSS MIC 2019, page 3, Oct 2019.
  30. Y. Ji et al. AMOS: A Large-Scale Abdominal Multi-Organ Benchmark for Versatile Medical Image Segmentation. Technical Report arXiv:2206.08023, arXiv, September 2022.
  31. Z. Jiang et al. A multi-scale framework with unsupervised joint training of convolutional neural networks for pulmonary deformable image registration. Phys. Med. Biol., 65(1):015011, January 2020.
  32. D. P. Kingma and J. Ba. Adam: A Method for Stochastic Optimization. arXiv:1412.6980 [cs], January 2017.
  33. D. Lee et al. RMSim: controlled respiratory motion simulation on static patient scans. Phys. Med. Biol., 2023.
  34. J. Liu et al. Evaluation of the combined use of two different respiratory monitoring systems for 4D CT simulation and gated treatment. Journal of Applied Clinical Medical Physics, 19(5):666–675, 2018.
  35. A. V. Louie et al. Inter-observer and intra-observer reliability for lung cancer target volume delineation in the 4D-CT era. Radiotherapy and Oncology: Journal of the European Society for Therapeutic Radiology and Oncology, 95(2):166–171, May 2010.
  36. Respiratory motion models: A review. Medical Image Analysis, 17(1):19–42, 2013.
  37. Inter-fraction variations in respiratory motion models. Physics in Medicine & Biology, 56(1):251, dec 2010.
  38. S. Nazir et al. Technical Note: Kinect V2 surface filtering during gantry motion for radiotherapy applications. Med. Phys., 45(4):1400–1407, April 2018.
  39. M. Ranjbar et al. Validation of a CT-based motion model with in-situ fluoroscopy for lung surface deformation estimation. Phys. Med. Biol., 66(4):045035, February 2021.
  40. A. Reinke et al. Common Limitations of Image Processing Metrics: A Picture Story. Technical Report arXiv:2104.05642, arXiv, July 2022.
  41. L. V. Romaguera et al. Probabilistic 4D predictive model from in-room surrogates using conditional generative networks for image-guided radiotherapy. Med. Image Anal., 74:102250, December 2021.
  42. Y. Sang and D. Ruan. A conditional registration network for continuous 4D respiratory motion synthesis. Med. Phys., 2023.
  43. S. Sarudis et al. Systematic evaluation of lung tumor motion using four-dimensional computed tomography. Acta Oncologica, 56(4):525–530, April 2017.
  44. Respiration tracking in radiosurgery. Med. Phys., 31(10):2738–2741, 2004.
  45. G. Sgouros et al. ICRU REPORT 96, Dosimetry-Guided Radiopharmaceutical Therapy. Journal of the ICRU, 21(1):1–212, December 2021.
  46. J. Thariat et al. Past, present, and future of radiotherapy for the benefit of patients. Nature Reviews Clinical Oncology, 10(1):52–60, January 2013.
  47. P. Trémolières et al. Lung stereotactic body radiation therapy: personalized PTV margins according to tumor location and number of four-dimensional CT scans. Radiation Oncology, 17(1):5, January 2022.
  48. R. W. M. Underberg et al. Four-dimensional CT scans for treatment planning in stereotactic radiotherapy for stage I lung cancer. International Journal of Radiation Oncology, Biology, Physics, 60(4):1283–1290, November 2004.
  49. J. R. van Sörnsen de Koste et al. Renal mobility during uncoached quiet respiration: An analysis of 4DCT scans. International Journal of Radiation Oncology, Biology, Physics, 64(3):799–803, March 2006.
  50. I. Vergalasova and J. Cai. A modern review of the uncertainties in volumetric imaging of respiratory-induced target motion in lung radiotherapy. Med. Phys., 47(10):e988–e1008, October 2020.
  51. V. Vishnevskiy et al. Isotropic Total Variation Regularization of Displacements in Parametric Image Registration. IEEE Trans. Med. Imag., 36(2):385–395, February 2017.
  52. D. Wang et al. PLOSL: Population learning followed by one shot learning pulmonary image registration using tissue volume preserving and vesselness constraints. Med. Image Anal., 79:102434, July 2022.
  53. J. M Wolterink et al. Implicit neural representations for deformable image registration. In Medical Imaging with Deep Learning 2022, 2022.
  54. H. Xiao et al. A dual-supervised deformation estimation model (DDEM) for constructing ultra-quality 4D-MRI based on a commercial low-quality 4D-MRI for liver cancer radiation therapy. Med. Phys., 49(5):3159–3170, May 2022.
  55. X. Zhou et al. Automated segmentations of skin, soft-tissue, and skeleton, from torso CT images. In J. Michael Fitzpatrick and Milan Sonka, editors, Medical Imaging 2004: Image Processing, volume 5370, pages 1634 – 1639. International Society for Optics and Photonics, 2004.

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com