Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
110 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
44 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Fast and accurate sparse-view CBCT reconstruction using meta-learned neural attenuation field and hash-encoding regularization (2312.01689v2)

Published 4 Dec 2023 in eess.IV and cs.CV

Abstract: Cone beam computed tomography (CBCT) is an emerging medical imaging technique to visualize the internal anatomical structures of patients. During a CBCT scan, several projection images of different angles or views are collectively utilized to reconstruct a tomographic image. However, reducing the number of projections in a CBCT scan while preserving the quality of a reconstructed image is challenging due to the nature of an ill-posed inverse problem. Recently, a neural attenuation field (NAF) method was proposed by adopting a neural radiance field algorithm as a new way for CBCT reconstruction, demonstrating fast and promising results using only 50 views. However, decreasing the number of projections is still preferable to reduce potential radiation exposure, and a faster reconstruction time is required considering a typical scan time. In this work, we propose a fast and accurate sparse-view CBCT reconstruction (FACT) method to provide better reconstruction quality and faster optimization speed in the minimal number of view acquisitions ($<$ 50 views). In the FACT method, we meta-trained a neural network and a hash-encoder using a few scans (= 15), and a new regularization technique is utilized to reconstruct the details of an anatomical structure. In conclusion, we have shown that the FACT method produced better, and faster reconstruction results over the other conventional algorithms based on CBCT scans of different body parts (chest, head, and abdomen) and CT vendors (Siemens, Phillips, and GE).

Definition Search Book Streamline Icon: https://streamlinehq.com
References (49)
  1. Simultaneous algebraic reconstruction technique (sart): a superior implementation of the art algorithm. Ultrasonic imaging 6, 81–94.
  2. Lose the views: Limited angle ct reconstruction via implicit sinogram completion, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 6343–6352.
  3. The lung image database consortium (lidc) and image database resource initiative (idri): a completed reference database of lung nodules on ct scans. Medical physics 38, 915–931.
  4. Tigre: a matlab-gpu toolbox for cbct image reconstruction. Biomedical Physics & Engineering Express 2, 055010.
  5. Dedicated cone-beam ct system for extremity imaging. Radiology 270, 816–824.
  6. Mvsnerf: Fast generalizable radiance field reconstruction from multi-view stereo, in: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 14124–14133.
  7. Multiplicative fourier level of detail, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1808–1817.
  8. Practical cone-beam algorithm. Josa a 1, 612–619.
  9. Model-agnostic meta-learning for fast adaptation of deep networks, in: International conference on machine learning, PMLR. pp. 1126–1135.
  10. Meta-learning with warped gradient descent. arXiv preprint arXiv:1909.00025 .
  11. Low-dose x-ray computed tomography image reconstruction with a combined low-mas and sparse-view protocol. Optics express 22, 15190–15210.
  12. Convolutional neural networks with intermediate loss for 3d super-resolution of ct and mri scans. IEEE Access 8, 49112–49124.
  13. Cone beam computertomography (cbct) in interventional chest medicine-high feasibility for endobronchial realtime navigation. Journal of Cancer 5, 231.
  14. Hybrid-domain neural network processing for sparse-view ct reconstruction. IEEE Transactions on Radiation and Plasma Medical Sciences 5, 88–98.
  15. Impact of introducing extremity cone-beam ct in an emergency radiology department: a population-based study. Orthopaedics & Traumatology: Surgery & Research 107, 102834.
  16. Putting nerf on a diet: Semantically consistent few-shot view synthesis, in: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 5885–5894.
  17. Deep convolutional neural network for inverse problems in imaging. IEEE transactions on image processing 26, 4509–4522.
  18. Radiation dose from cone beam computed tomography for image-guided radiation therapy. International Journal of Radiation Oncology* Biology* Physics 70, 272–279.
  19. Cone beam ct vs. fan beam ct: a comparison of image quality and dose delivered between two differing ct imaging modalities. Cureus 8.
  20. Deep-neural-network-based sinogram synthesis for sparse-view ct image reconstruction. IEEE Transactions on Radiation and Plasma Medical Sciences 3, 109–119.
  21. Gradient-based meta-learning with learned layerwise metric and subspace, in: International Conference on Machine Learning, PMLR. pp. 2927–2936.
  22. Dudonet: Dual domain network for ct metal artifact reduction, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10512–10521.
  23. Tomogan: low-dose synchrotron x-ray tomography with generative adversarial networks: discussion. JOSA A 37, 422–434.
  24. Abdomenct-1k: Is abdominal organ segmentation a solved problem? IEEE Transactions on Pattern Analysis and Machine Intelligence 44, 6695–6714.
  25. Nerf: Representing scenes as neural radiance fields for view synthesis. Communications of the ACM 65, 99–106.
  26. Instant neural graphics primitives with a multiresolution hash encoding. ACM Transactions on Graphics (ToG) 41, 1–15.
  27. On first-order meta-learning algorithms. arXiv preprint arXiv:1803.02999 .
  28. Regnerf: Regularizing neural radiance fields for view synthesis from sparse inputs, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 5480–5490.
  29. Deepsdf: Learning continuous signed distance functions for shape representation, in: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 165–174.
  30. On the spectral bias of neural networks, in: International Conference on Machine Learning, PMLR. pp. 5301–5310.
  31. Meta-learning with implicit gradients. Advances in neural information processing systems 32.
  32. The convergence rate of neural networks for learned functions of different frequencies. Advances in Neural Information Processing Systems 32.
  33. What is cone-beam ct and how does it work? Dental Clinics of North America 52, 707–730.
  34. Clinical applications of cone-beam computed tomography in dental practice. Journal-Canadian Dental Association 72, 75.
  35. Image reconstruction in circular cone-beam computed tomography by constrained, total-variation minimization. Physics in Medicine & Biology 53, 4777.
  36. Neural geometric level of detail: Real-time rendering with implicit 3d shapes, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 11358–11367.
  37. Learned initializations for optimizing coordinate-based neural representations, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2846–2855.
  38. Fourier features let networks learn high frequency functions in low dimensional domains. Advances in Neural Information Processing Systems 33, 7537–7547.
  39. Projection super-resolution based on convolutional neural network for computed tomography, in: 15th International Meeting on Fully Three-Dimensional Image Reconstruction in Radiology and Nuclear Medicine, SPIE. pp. 537–541.
  40. Correction of patient positioning errors based on in-line cone beam cts: clinical implementation and first experiences. Radiation Oncology 1, 1–9.
  41. Radiomics strategies for risk assessment of tumour failure in head-and-neck cancer. Scientific reports 7, 10117.
  42. Improving generalizability in limited-angle ct reconstruction with sinogram extrapolation, in: Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part VI 24, Springer. pp. 86–96.
  43. Drone: Dual-domain residual-based optimization network for sparse-view ct reconstruction. IEEE Transactions on Medical Imaging 40, 3002–3014.
  44. Freenerf: Improving few-shot neural rendering with free frequency regularization, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 8254–8263.
  45. pixelnerf: Neural radiance fields from one or few images, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 4578–4587.
  46. Intratomo: self-supervised learning-based tomography via sinogram synthesis and prediction, in: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 1960–1970.
  47. Naf: neural attenuation fields for sparse-view cbct reconstruction, in: International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer. pp. 442–452.
  48. A sparse-view ct reconstruction method based on combination of densenet and deconvolution. IEEE transactions on medical imaging 37, 1407–1417.
  49. Dudodr-net: Dual-domain data consistent recurrent network for simultaneous sparse view and metal artifact reduction in computed tomography. Medical Image Analysis 75, 102289.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (6)
  1. Heejun Shin (6 papers)
  2. Taehee Kim (25 papers)
  3. Jongho Lee (38 papers)
  4. Seungryung Cho (1 paper)
  5. Dongmyung Shin (9 papers)
  6. Se Young Chun (50 papers)

Summary

We haven't generated a summary for this paper yet.