Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
153 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

MARformer: An Efficient Metal Artifact Reduction Transformer for Dental CBCT Images (2311.09590v2)

Published 16 Nov 2023 in eess.IV and cs.CV

Abstract: Cone Beam Computed Tomography (CBCT) plays a key role in dental diagnosis and surgery. However, the metal teeth implants could bring annoying metal artifacts during the CBCT imaging process, interfering diagnosis and downstream processing such as tooth segmentation. In this paper, we develop an efficient Transformer to perform metal artifacts reduction (MAR) from dental CBCT images. The proposed MAR Transformer (MARformer) reduces computation complexity in the multihead self-attention by a new Dimension-Reduced Self-Attention (DRSA) module, based on that the CBCT images have globally similar structure. A Patch-wise Perceptive Feed Forward Network (P2FFN) is also proposed to perceive local image information for fine-grained restoration. Experimental results on CBCT images with synthetic and real-world metal artifacts show that our MARformer is efficient and outperforms previous MAR methods and two restoration Transformers.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (42)
  1. Cone beam computed tomography in oral and maxillofacial surgery: an evidence-based review. Dentistry journal, 7(2):52, 2019.
  2. SD Kapila and JM Nervina. Cbct in orthodontics: assessment of treatment outcomes and indications for its use. Dentomaxillofacial radiology, 44(1):20140282, 2015.
  3. Correlation between bone quality evaluated by cone-beam computerized tomography and implant primary stability. International Journal of Oral & Maxillofacial Implants, 24(1), 2009.
  4. An experimental survey of metal artefact reduction in computed tomography. Journal of X-ray Science and Technology, 21(2):193–226, 2013.
  5. Metaformer is actually what you need for vision. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10819–10829, 2022.
  6. Reduction of ct artifacts caused by metallic implants. Radiology, 164(2):576–577, 1987.
  7. A wavelet method for metal artifact reduction with multiple metallic objects in the field of view. Journal of X-ray Science and Technology, 10(1-2):67–76, 2002.
  8. Normalized metal artifact reduction (nmar) in computed tomography. Medical physics, 37(10):5482–5493, 2010.
  9. A new ct metal artifacts reduction algorithm based on fractional-order sinogram inpainting. Journal of X-ray science and technology, 19(3):373–384, 2011a.
  10. Iterative deblurring for ct metal artifact reduction. IEEE transactions on medical imaging, 15(5):657–664, 1996.
  11. Metal artifact reduction in x-ray computed tomography (ct) by constrained optimization. Medical physics, 38(2):701–711, 2011b.
  12. Suppression of metal artifacts in ct using a reconstruction procedure that combines map and projection completion. IEEE transactions on medical imaging, 28(2):250–260, 2008.
  13. Conditional generative adversarial networks for metal artifact reduction in ct images of the ear. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 3–11. Springer, 2018.
  14. Adn: artifact disentanglement network for unsupervised metal artifact reduction. IEEE Transactions on Medical Imaging, 39(3):634–643, 2019.
  15. Fast enhanced ct metal artifact reduction using data domain deep learning. IEEE Transactions on Computational Imaging, 6:181–193, 2019.
  16. Convolutional neural network based metal artifact reduction in x-ray computed tomography. IEEE transactions on medical imaging, 37(6):1370–1381, 2018.
  17. Dudonet: Dual domain network for ct metal artifact reduction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 10512–10521, 2019.
  18. Dual-domain adaptive-scaling non-local network for ct metal artifact reduction. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 243–253. Springer, 2021a.
  19. Distributed optimization and statistical learning via the alternating direction method of multipliers. Foundations and Trends® in Machine learning, 3(1):1–122, 2011.
  20. Attention is all you need. Advances in neural information processing systems, 30, 2017.
  21. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929, 2020.
  22. Restormer: Efficient transformer for high-resolution image restoration. In CVPR, 2022.
  23. Uformer: A general u-shaped transformer for image restoration. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 17683–17693, 2022.
  24. Vitae: Vision transformer advanced by exploring intrinsic inductive bias. Advances in Neural Information Processing Systems, 34:28522–28535, 2021.
  25. Iterative x-ray cone-beam tomography for metal artifact reduction and local region reconstruction. Microscopy and microanalysis, 5(1):58–65, 1999.
  26. X-ray ct metal artifact reduction using wavelet domain l⁢_𝑙_l\_italic_l _{00} sparse regularization. IEEE transactions on medical imaging, 32(9):1707–1722, 2013.
  27. Prior-guided metal artifact reduction for iterative x-ray computed tomography. IEEE transactions on medical imaging, 38(6):1532–1542, 2018.
  28. Deep residual learning enabled metal artifact reduction in ct. In Medical Imaging 2018: Physics of Medical Imaging, volume 10573, page 105733O. International Society for Optics and Photonics, 2018.
  29. Indudonet: An interpretable dual domain network for ct metal artifact reduction. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 107–118. Springer, 2021b.
  30. Swinir: Image restoration using swin transformer. In 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW), pages 1833–1844, 2021. doi: 10.1109/ICCVW54120.2021.00210.
  31. Swin transformer: Hierarchical vision transformer using shifted windows. In 2021 IEEE/CVF International Conference on Computer Vision (ICCV), pages 9992–10002, 2021. doi: 10.1109/ICCV48922.2021.00986.
  32. Pyramid vision transformer: A versatile backbone for dense prediction without convolutions. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 568–578, 2021c.
  33. Levit: a vision transformer in convnet’s clothing for faster inference. In Proceedings of the IEEE/CVF international conference on computer vision, pages 12259–12269, 2021.
  34. Escaping the big data paradigm with compact transformers. 2021. URL https://arxiv.org/abs/2104.05704.
  35. Mobilevit: Light-weight, general-purpose, and mobile-friendly vision transformer. arXiv preprint arXiv:2110.02178, 2021.
  36. Image quality assessment: from error visibility to structural similarity. IEEE transactions on image processing, 13(4):600–612, 2004.
  37. Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1874–1883, 2016.
  38. Gaussian error linear units (gelus). arXiv preprint arXiv:1606.08415, 2016.
  39. Sgdr: Stochastic gradient descent with warm restarts. arXiv preprint arXiv:1608.03983, 2016.
  40. Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems, 32, 2019.
  41. U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention, pages 234–241. Springer, 2015.
  42. Photo-realistic single image super-resolution using a generative adversarial network. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 4681–4690, 2017.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now