Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
162 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Teeth-SEG: An Efficient Instance Segmentation Framework for Orthodontic Treatment based on Anthropic Prior Knowledge (2404.01013v1)

Published 1 Apr 2024 in cs.CV and cs.AI

Abstract: Teeth localization, segmentation, and labeling in 2D images have great potential in modern dentistry to enhance dental diagnostics, treatment planning, and population-based studies on oral health. However, general instance segmentation frameworks are incompetent due to 1) the subtle differences between some teeth' shapes (e.g., maxillary first premolar and second premolar), 2) the teeth's position and shape variation across subjects, and 3) the presence of abnormalities in the dentition (e.g., caries and edentulism). To address these problems, we propose a ViT-based framework named TeethSEG, which consists of stacked Multi-Scale Aggregation (MSA) blocks and an Anthropic Prior Knowledge (APK) layer. Specifically, to compose the two modules, we design 1) a unique permutation-based upscaler to ensure high efficiency while establishing clear segmentation boundaries with 2) multi-head self/cross-gating layers to emphasize particular semantics meanwhile maintaining the divergence between token embeddings. Besides, we collect 3) the first open-sourced intraoral image dataset IO150K, which comprises over 150k intraoral photos, and all photos are annotated by orthodontists using a human-machine hybrid algorithm. Experiments on IO150K demonstrate that our TeethSEG outperforms the state-of-the-art segmentation models on dental image segmentation.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (47)
  1. Dental biometrics: Computer aided human identification system using the dental panoramic radiographs. In 2013 international conference on communication and signal processing, pages 717–721. IEEE, 2013.
  2. Semi-supervised segmentation of tooth from 3d scanned dental arches. In Medical Imaging 2022: Image Processing, pages 766–771. SPIE, 2022.
  3. Anonymous. LLaMA-excitor: General instruction tuning via indirect feature interaction. In Conference on Computer Vision and Pattern Recognition 2024, 2024a.
  4. Anonymous. Videodistill: Language-aware vision distillation for video question answering. In Conference on Computer Vision and Pattern Recognition 2024, 2024b.
  5. Beit: Bert pre-training of image transformers. arXiv preprint arXiv:2106.08254, 2021.
  6. 3dteethseg’22: 3d teeth scan segmentation and labeling challenge. arXiv preprint arXiv:2305.18277, 2023.
  7. End-to-end object detection with transformers. In European conference on computer vision, pages 213–229. Springer, 2020.
  8. Prevalence of dental malocclusions in different geographical areas: scoping review. Dentistry Journal, 9(10):117, 2021.
  9. Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE transactions on pattern analysis and machine intelligence, 40(4):834–848, 2017.
  10. Vision transformer adapter for dense predictions. arXiv preprint arXiv:2205.08534, 2022.
  11. Ctooth+: A large-scale dental cone beam computed tomography dataset and benchmark for tooth volume segmentation. In MICCAI Workshop on Data Augmentation, Labelling, and Imperfections, pages 64–73. Springer, 2022a.
  12. Ctooth: a fully annotated 3d dataset and benchmark for tooth volume segmentation on cone beam computed tomography images. In International Conference on Intelligent Robotics and Applications, pages 191–200. Springer, 2022b.
  13. Tsegnet: An efficient and accurate tooth segmentation network on 3d dental model. Medical Image Analysis, 69:101949, 2021.
  14. FDI World Dental Federation. Malocclusion in orthodontics and oral health: Adopted by the general assembly: September 2019, san francisco, united states of america. International Dental Journal, 70(1):11, 2020.
  15. Automated identification of cephalometric landmarks: Part 2-might it be better than human? The Angle Orthodontist, 90(1):69–76, 2020.
  16. Accuracy and efficiency of automatic tooth segmentation in digital dental models using deep learning. Scientific reports, 12(1):9429, 2022.
  17. S Keiser-Nielsen. Fédération dentaire internationale two-digit system of designating teeth. Int Dent J, 21:104–106, 1971.
  18. Accuracy of automated identification of lateral cephalometric landmarks using cascade convolutional neural networks on lateral cephalograms from nationwide multi-centres. Orthodontics & Craniofacial Research, 24:59–67, 2021.
  19. Segment anything. arXiv preprint arXiv:2304.02643, 2023.
  20. Artificial intelligence-driven novel tool for tooth detection and segmentation on panoramic radiographs. Clinical oral investigations, 25:2257–2267, 2021.
  21. Agmb-transformer: Anatomy-guided multi-branch transformer network for automated evaluation of root canal therapy. IEEE Journal of Biomedical and Health Informatics, 26(4):1684–1695, 2021.
  22. Swin transformer: Hierarchical vision transformer using shifted windows. In Proceedings of the IEEE/CVF international conference on computer vision, pages 10012–10022, 2021.
  23. Hierarchical self-supervised learning for 3d tooth segmentation in intra-oral mesh scans. IEEE Transactions on Medical Imaging, 42(2):467–480, 2022.
  24. How much deep learning is enough for automatic identification to be reliable? a cephalometric example. The Angle Orthodontist, 90(6):823–830, 2020.
  25. Personal computer-based cephalometric landmark detection with deep learning, using cephalograms on the internet. Journal of Craniofacial Surgery, 30(1):91–95, 2019.
  26. Automated identification of cephalometric landmarks: Part 1—comparisons between the latest deep-learning methods yolov3 and ssd. The Angle Orthodontist, 89(6):903–909, 2019.
  27. Integrating spatial configuration into heatmap regression based cnns for landmark localization. Medical image analysis, 54:207–219, 2019.
  28. Contemporary orthodontics-e-book. Elsevier Health Sciences, 2018.
  29. Darch: Dental arch prior-assisted 3d tooth instance segmentation with weak annotations. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 20752–20761, 2022.
  30. Vision transformers for dense prediction. In Proceedings of the IEEE/CVF international conference on computer vision, pages 12179–12188, 2021.
  31. Automatic segmenting teeth in x-ray images: Trends, a novel data set, benchmarking and future perspectives. Expert Systems with Applications, 107:15–31, 2018.
  32. Segmenter: Transformer for semantic segmentation. In Proceedings of the IEEE/CVF international conference on computer vision, pages 7262–7272, 2021.
  33. Automatic tooth segmentation and dense correspondence of 3d dental model. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 703–712. Springer, 2020a.
  34. Tooth segmentation and labeling from digital dental casts. In 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI), pages 669–673. IEEE, 2020b.
  35. Automatic classification and segmentation of teeth on 3d dental model using hierarchical deep learning networks. IEEE Access, 7:84817–84828, 2019.
  36. Attention is all you need. Advances in neural information processing systems, 30, 2017.
  37. A benchmark for comparison of dental radiography analysis algorithms. Medical image analysis, 31:63–76, 2016.
  38. Segformer: Simple and efficient design for semantic segmentation with transformers. Advances in Neural Information Processing Systems, 34:12077–12090, 2021.
  39. 3d tooth segmentation and labeling using deep convolutional neural networks. IEEE transactions on visualization and computer graphics, 25(7):2336–2348, 2018.
  40. Mask-mcnet: Instance segmentation in 3d point cloud of intra-oral scans. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 128–136. Springer, 2019.
  41. Automatic 3d tooth segmentation using convolutional neural networks in harmonic parameter space. Graphical Models, 109:101071, 2020.
  42. Tsgcnet: Discriminative geometric feature learning with two-stream graph convolutional network for 3d dental model segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 6699–6708, 2021.
  43. Shaofeng Zhang. Fusionanalyser: A novel measurement method and software tool for dental model analysis in orthodontics. Proceedings of Measurement Science and Technology, 2023.
  44. Two-stream graph convolutional network for intra-oral scanner image segmentation. IEEE Transactions on Medical Imaging, 41(4):826–835, 2021.
  45. Rethinking semantic segmentation from a sequence-to-sequence perspective with transformers. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 6881–6890, 2021.
  46. An attention-guided deep regression model for landmark detection in cephalograms. In Medical Image Computing and Computer Assisted Intervention–MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13–17, 2019, Proceedings, Part VI 22, pages 540–548. Springer, 2019.
  47. Spaceclip: A vision-language pretraining framework with spatial reconstruction on text. In Proceedings of the 31st ACM International Conference on Multimedia, pages 519–528, 2023.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now