X-Recon: Learning-based Patient-specific High-Resolution CT Reconstruction from Orthogonal X-Ray Images (2407.15356v1)
Abstract: Rapid and accurate diagnosis of pneumothorax, utilizing chest X-ray and computed tomography (CT), is crucial for assisted diagnosis. Chest X-ray is commonly used for initial localization of pneumothorax, while CT ensures accurate quantification. However, CT scans involve high radiation doses and can be costly. To achieve precise quantitative diagnosis while minimizing radiation exposure, we proposed X-Recon, a CT ultra-sparse reconstruction network based on ortho-lateral chest X-ray images. X-Recon integrates generative adversarial networks (GANs), including a generator with a multi-scale fusion rendering module and a discriminator enhanced by 3D coordinate convolutional layers, designed to facilitate CT reconstruction. To improve precision, a projective spatial transformer is utilized to incorporate multi-angle projection loss. Additionally, we proposed PTX-Seg, a zero-shot pneumothorax segmentation algorithm, combining image processing techniques with deep-learning models for the segmentation of air-accumulated regions and lung structures. Experiments on a large-scale dataset demonstrate its superiority over existing approaches. X-Recon achieved a significantly higher reconstruction resolution with a higher average spatial resolution and a lower average slice thickness. The reconstruction metrics achieved state-of-the-art performance in terms of several metrics including peak signal-to-noise ratio. The zero-shot segmentation algorithm, PTX-Seg, also demonstrated high segmentation precision for the air-accumulated region, the left lung, and the right lung. Moreover, the consistency analysis for the pneumothorax chest occupancy ratio between reconstructed CT and original CT obtained a high correlation coefficient. Code will be available at: https://github.com/wangyunpengbio/X-Recon
- O. Bintcliffe and N. Maskell, “Spontaneous pneumothorax,” BMJ, vol. 348, May. 2014. [Online]. Available: https://www.bmj.com/content/348/bmj.g2928
- A. Bobbio et al., “Epidemiology of spontaneous pneumothorax: gender-related differences,” Thorax, vol. 70, no. 7, pp. 653–658, Jul. 2015.
- F. Urooj, S. Akbar, S. A. Hassan, S. Firdous, and M. J. Bashir, “Computer-aided diagnosis of pneumothorax through X-ray images using deep Learning—A review,” in Prognostic models in healthcare: AI and statistical approaches. Singapore: Springer, 2022, pp. 403–432.
- C. H. McCollough, J. T. Bushberg, J. G. Fletcher, and L. J. Eckel, “Answers to common questions about the use and safety of ct scans,” Mayo Clin Proc, vol. 90, no. 10, pp. 1380–92, Oct. 2015.
- E. Atlı, S. A. Uyanık, U. Öğüşlü, H. Çevik Cenkeri, B. Yılmaz, and B. Gümüş, “Radiation doses from head, neck, chest and abdominal ct examinations: An institutional dose report,” Diagn. Interv. Radiol., vol. 27, no. 1, p. 147, Jan. 2021.
- B. Mildenhall, P. P. Srinivasan, M. Tancik, J. T. Barron, R. Ramamoorthi, and R. Ng, “Nerf: Representing scenes as neural radiance fields for view synthesis,” Commun. ACM, vol. 65, no. 1, pp. 99–106, Dec. 2021.
- P. Henzler, V. Rasche, T. Ropinski, and T. Ritschel, “Single-image tomography: 3d volumes from 2d cranial x-rays,” in Comput. Graph. Forum, vol. 37, no. 2, May. 2018, pp. 377–388.
- Y. Kasten, D. Doktofsky, and I. Kovler, “End-to-end convolutional neural network for 3d reconstruction of knee bones from bi-planar x-ray images,” in Proc. Int. Workshop Mach. Learn. Med. Image Reconstruction, Oct. 2020, pp. 123–133.
- L. Shen, W. Zhao, and L. Xing, “Patient-specific reconstruction of volumetric computed tomography images from a single projection view via deep learning,” Nat. Biomed. Eng., vol. 3, no. 11, pp. 880–888, Nov. 2019.
- A. Pumarola, E. Corona, G. Pons-Moll, and F. Moreno-Noguer, “D-nerf: Neural radiance fields for dynamic scenes,” in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recog. (CVPR), 2021, pp. 10 318–10 327.
- H. Xu, T. Alldieck, and C. Sminchisescu, “H-nerf: Neural radiance fields for rendering and temporal reconstruction of humans in motion,” in Proc. Adv. Neur. Info. Proces. Syst. (NeurIPS), Nov. 2021, pp. 14 955–14 966.
- K. Gao, Y. Gao, H. He, D. Lu, L. Xu, and J. Li, “Nerf: Neural radiance field in 3d vision, a comprehensive review,” arXiv:2210.00379, 2022.
- F. Kharfi, “Mathematics and physics of computed tomography (ct): Demonstrations and practical examples,” in Imaging and Radioanalytical Techniques in Interdisciplinary Research. Croatia: IntechOpen, 2013.
- G. Chen, J. Tang, and S. Leng, “Prior image constrained compressed sensing (piccs): a method to accurately reconstruct dynamic ct images from highly undersampled projection data sets,” Med. Phys., vol. 35, no. 2, pp. 660–663, Feb. 2008.
- H. Yu and G. Wang, “Compressed sensing based interior tomography,” Phys. Med. Biol., vol. 54, no. 9, p. 2791, Apr. 2009.
- K. Choi, J. Wang, L. Zhu, T.-S. Suh, S. Boyd, and L. Xing, “Compressed sensing based cone-beam computed tomography reconstruction with a first-order method,” Med. Phys., vol. 37, no. 9, pp. 5113–5125, Aug. 2010.
- Z. Zhu, K. A. Wahid, and P. Babyn, “Ct image reconstruction from partial angular measurements via compressed sensing,” in Proc. IEEE Canadian Conf. Elect. Comput. Eng. (CCECE), Oct. 2012, pp. 1–4.
- J. A. Fessler and W. L. Rogers, “Spatial resolution properties of penalized-likelihood image reconstruction: space-invariant tomographs,” IEEE Trans. Image Process., vol. 5, no. 9, pp. 1346–1358, Sept. 1996.
- J. W. Stayman and J. A. Fessler, “Regularization for uniform spatial resolution properties in penalized-likelihood image reconstruction,” IEEE Trans. Med. Imaging, vol. 19, no. 6, pp. 601–615, Jun. 2000.
- J. Wang, T. Li, H. Lu, and Z. Liang, “Penalized weighted least-squares approach to sinogram noise reduction and image reconstruction for low-dose x-ray computed tomography,” IEEE Trans. Med. Imaging, vol. 25, no. 10, pp. 1272–1283, Oct. 2006.
- Q. Xu, H. Yu, X. Mou, L. Zhang, J. Hsieh, and G. Wang, “Low-dose x-ray ct reconstruction via dictionary learning,” IEEE Trans. Med. Imaging, vol. 31, no. 9, pp. 1682–1697, Sept. 2012.
- P. Isola, J.-Y. Zhu, T. Zhou, and A. A. Efros, “Image-to-image translation with conditional adversarial networks,” in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recog. (CVPR), 2017, pp. 1125–1134.
- R. Liu et al., “An intriguing failing of convolutional neural networks and the CoordConv solution,” in Proc. Adv. Neural Inf. Process. Syst.(NeurIPS), vol. 31, 2018.
- J. Hofmanninger, F. Prayer, J. Pan, S. Röhrich, H. Prosch, and G. Langs, “Automatic lung segmentation in routine imaging is primarily a data diversity problem, not a methodology problem,” Eur. Radiol. Exp., vol. 4, no. 1, pp. 1–13, Dec. 2020.
- C. Gao et al., “Generalizing spatial transformers to projective geometry with applications to 2d/3d registration,” in Proc. Int. Conf. Med. Image Comput. Comput.-Assisted Intervent. (MICCAI), 2020, pp. 329–339.
- I. Goodfellow et al., “Generative adversarial networks,” Commun. ACM, vol. 63, no. 11, pp. 139–144, Oct. 2020.
- M. Mirza and S. Osindero, “Conditional generative adversarial nets,” arXiv:1411.1784, 2014.
- E. L. Chaney, J. S. Thorn, G. Tracton, T. Cullip, J. G. Rosenman, and J. E. Tepper, “A portable software tool for computing digitally reconstructed radiographs,” Int. J. Radiat. Oncol. Biol. Phys., vol. 32, no. 2, pp. 491–497, May. 1995.