Papers
Topics
Authors
Recent
Search
2000 character limit reached

ViSTooth: A Visualization Framework for Tooth Segmentation on Panoramic Radiograph

Published 14 May 2024 in cs.HC | (2405.08573v1)

Abstract: Tooth segmentation is a key step for computer aided diagnosis of dental diseases. Numerous machine learning models have been employed for tooth segmentation on dental panoramic radiograph. However, it is a difficult task to achieve accurate tooth segmentation due to complex tooth shapes, diverse tooth categories and incomplete sample set for machine learning. In this paper, we propose ViSTooth, a visualization framework for tooth segmentation on dental panoramic radiograph. First, we employ Mask R-CNN to conduct preliminary tooth segmentation, and a set of domain metrics are proposed to estimate the accuracy of the segmented teeth, including tooth shape, tooth position and tooth angle. Then, we represent the teeth with high-dimensional vectors and visualize their distribution in a low-dimensional space, in which experts can easily observe those teeth with specific metrics. Further, we expand the sample set with the expert-specified teeth and train the tooth segmentation model iteratively. Finally, we conduct case study and expert study to demonstrate the effectiveness and usability of our ViSTooth, in aiding experts to implement accurate tooth segmentation guided by expert knowledge.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (53)
  1. Accuracy of panoramic radiograph for diagnosing periodontitis comparing to clinical examination. Journal of Clinical Medicine, 9(7), 2020.
  2. Stsn-net: Simultaneous tooth segmentation and numbering method in crowded environments with deep learning. Diagnostics, 14(5), 2024.
  3. Automated dental image analysis by deep learning on small dataset. pages 492–497, 2018.
  4. A comprehensive review of recent advances in artificial intelligence for dentistry e-health. 2023.
  5. Developing deep learning methods for classification of teeth in dental panoramic radiography. 2023.
  6. Teeth segmentation on dental panoramic radiographs using decimation-free directional filter bank thresholding and multistage adaptive thresholding. In 2015 International Conference on Information & Communication Technology and Systems (ICTS), pages 49–54, 2015.
  7. Region of adaptive threshold segmentation between mean, median and otsu threshold for dental age assessment. pages 353–356, 2014.
  8. Sobel and canny edges segmentations for the dental age assessment. In 2014 International Conference on Computer Assisted System in Health, pages 62–66. IEEE, 2014.
  9. N Senthilkumaran. Fuzzy logic approach to edge detection for dental x-ray image segmentation. International Journal of Computer Science and Information Technologies, 3(5):5236–5238, 2012.
  10. Semantic graph attention with explicit anatomical association modeling for tooth segmentation from cbct images. IEEE Transactions on Medical Imaging, 41(11):3116–3127, 2022.
  11. Automatic segmenting teeth in x-ray images: Trends, a novel data set, benchmarking and future perspectives. Expert Systems with Applications, 107:15–31, 2018.
  12. Teeth u-net: A segmentation model of dental panoramic x-ray images for context semantics and contrast enhancement. Computers in Biology and Medicine, 152:106296, 2023.
  13. Accurate segmentation of dental panoramic radiographs with u-nets. pages 15–19, 2019.
  14. A deep learning approach to automatic teeth detection and numbering based on object detection in dental periapical films. Scientific reports, 9(1):3840, 2019.
  15. Automatic tooth detection and numbering using a combination of a cnn and heuristic algorithm. Applied Sciences, 10(16):5624, 2020.
  16. A study on tooth segmentation and numbering using end-to-end deep neural networks. pages 164–171, 2020.
  17. Krois J. Artificial Schwendicke F, Samek W. Intelligence in dentistry: Chances and challenges. Journal of Dental Research, pages 769–774, 2020.
  18. Artificial intelligence-driven novel tool for tooth detection and segmentation on panoramic radiographs. Clinical oral investigations, 25:2257–2267, 2021.
  19. Mask r-cnn. pages 2980–2988, 2017.
  20. Labor: Labeling only if required for domain adaptive semantic segmentation. CoRR, abs/2108.05570, 2021.
  21. A simple and novel algorithm for automatic selection of roi for dental radiograph segmentation. In 2011 24th Canadian Conference on Electrical and Computer Engineering(CCECE), pages 000504–000507, 2011.
  22. Mutasem K Alsmadi. A hybrid fuzzy c-means and neutrosophic for jaw lesions segmentation. Ain Shams Engineering Journal, 9(4):697–706, 2018.
  23. Automatic segmentation of jaw from panoramic dental x-ray images using gvf snakes. 2016 World Automation Congress (WAC), pages 1–6, 2016.
  24. Watershed algorithm based on morphology for dental x-ray images segmentation. 2012 IEEE 11th International Conference on Signal Processing, 2:877–880, 2012.
  25. Segmenting tooth components in dental x-ray images using gaussian kernel- based conditional spatial fuzzy c-means clustering algorithm. International Journal of Intelligent Engineering and Systems, 2019.
  26. Deep instance segmentation of teeth in panoramic x-ray images. pages 400–407, 2018.
  27. A. Almalki and L. Latecki. Self-supervised learning with masked image modeling for teeth numbering, detection of dental restorations, and instance segmentation in dental panoramic radiographs. pages 5583–5592, jan 2023.
  28. An effective teeth recognition method using label tree with cascade network structure. Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society, 68:61–70, 2018.
  29. Tooth instance segmentation on panoramic dental radiographs using u-nets and morphological processing. Düzce Üniversitesi Bilim ve Teknoloji Dergisi, 10(1):39–50, 2022.
  30. Tooth detection and numbering in panoramic radiographs using convolutional neural networks. Dentomaxillofacial Radiology, 48(4):20180051, 2019.
  31. A comprehensive survey of deep learning algorithms and applications in dental radiograph analysis. Healthcare Analytics, page 100282, 2023.
  32. Vis+ai: integrating visualization with artificial intelligence for efficient data analysis. Frontiers of Computer Science, 17, 06 2023.
  33. Chart decoder: Generating textual and numeric information from chart images automatically. Journal of Visual Languages & Computing, 48:101–109, 2018.
  34. Oodanalyzer: Interactive analysis of out-of-distribution samples. IEEE Transactions on Visualization and Computer Graphics, 27(7):3335–3349, jul 2021.
  35. Profiler: Integrated statistical analysis and visualization for data quality assessment. pages 547–554, 2012.
  36. Analyzing the training processes of deep generative models. IEEE transactions on visualization and computer graphics, 24(1):77–87, 2017.
  37. Analyzing the noise robustness of deep neural networks. IEEE Transactions on Visualization and Computer Graphics, 27(7):3289–3304, 2020.
  38. Cnn explainer: Learning convolutional neural networks with interactive visualization. IEEE Transactions on Visualization and Computer Graphics, 27(2):1396–1406, 2021.
  39. Understanding deep image representations by inverting them. pages 5188–5196, 2015.
  40. Grad-cam: Visual explanations from deep networks via gradient-based localization. pages 618–626, 2017.
  41. A unified interactive model evaluation for classification, object detection, and instance segmentation in computer vision. IEEE Transactions on Visualization and Computer Graphics, 2023.
  42. Fairsight: Visual analytics for fairness in decision making. IEEE transactions on visualization and computer graphics, 26(1):1086–1095, 2019.
  43. Semantic segmentation using convolutional neural networks. 10:31–34, 06 2023.
  44. Deep residual learning for image recognition. pages 770–778, 2016.
  45. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014.
  46. Ming-Kuei Hu. Visual pattern recognition by moment invariants. IRE transactions on information theory, 8(2):179–187, 1962.
  47. A micro-xrt image analysis and machine learning methodology for the characterisation of multi-particulate capsule formulations. International Journal of Pharmaceutics: X, 2:100041, 2020.
  48. Latent dirichlet allocation. Journal of machine Learning research, 3(Jan):993–1022, 2003.
  49. OpenAI. Introducing chatgpt.
  50. Segment anything. pages 4015–4026, 2023.
  51. Radiomics and machine learning in oral healthcare. PROTEOMICS–Clinical Applications, 14(3):1900040, 2020.
  52. A novel deep learning-based approach for segmentation of different type caries lesions on panoramic radiographs. Diagnostics, 13(2):202, 2023.
  53. Deep learning in diagnosis of dental anomalies and diseases: A systematic review. Diagnostics, 13(15):2512, 2023.

Summary

No one has generated a summary of this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Summarize

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up for Free