Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
162 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Deep Learning-Based Segmentation of Tumors in PET/CT Volumes: Benchmark of Different Architectures and Training Strategies (2404.09761v1)

Published 15 Apr 2024 in eess.IV, cs.CV, and cs.LG

Abstract: Cancer is one of the leading causes of death globally, and early diagnosis is crucial for patient survival. Deep learning algorithms have great potential for automatic cancer analysis. Artificial intelligence has achieved high performance in recognizing and segmenting single lesions. However, diagnosing multiple lesions remains a challenge. This study examines and compares various neural network architectures and training strategies for automatically segmentation of cancer lesions using PET/CT images from the head, neck, and whole body. The authors analyzed datasets from the AutoPET and HECKTOR challenges, exploring popular single-step segmentation architectures and presenting a two-step approach. The results indicate that the V-Net and nnU-Net models were the most effective for their respective datasets. The results for the HECKTOR dataset ranged from 0.75 to 0.76 for the aggregated Dice coefficient. Eliminating cancer-free cases from the AutoPET dataset was found to improve the performance of most models. In the case of AutoPET data, the average segmentation efficiency after training only on images containing cancer lesions increased from 0.55 to 0.66 for the classic Dice coefficient and from 0.65 to 0.73 for the aggregated Dice coefficient. The research demonstrates the potential of artificial intelligence in precise oncological diagnostics and may contribute to the development of more targeted and effective cancer assessment techniques.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (39)
  1. https://github.com/MIC-DKFZ/nnUNetUNETR. Accessed: 21.08.2023.
  2. https://hecktor.grand-challenge.org/Data/Accessed: 2023-12-03.
  3. https://github.com/voreille/hecktor/blob/master/notebooks/evaluate_segmentation2022.ipynb. Accessed: 16.08.2023.
  4. Overview of the hecktor challenge at miccai 2022: Automatic head and neck tumor segmentation and outcome prediction in pet/ct. volume 13626, pages 1–30. 03 2023.
  5. Overview of the hecktor challenge at miccai 2021: automatic head and neck tumor segmentation and outcome prediction in pet/ct images. In 3D head and neck tumor segmentation in PET/CT challenge, pages 1–37. Springer, 2021.
  6. Overview of the hecktor challenge at miccai 2020: automatic head and neck tumor segmentation in pet/ct. In Head and Neck Tumor Segmentation: First Challenge, HECKTOR 2020, Held in Conjunction with MICCAI 2020, Lima, Peru, October 4, 2020, Proceedings 1, pages 1–21. Springer, 2021.
  7. Medical image segmentation review: The success of u-net. arXiv preprint arXiv:2211.14830, 2022.
  8. Automated measurement of uptake in cerebellum, liver, and aortic arch in full-body fdg pet/ct scans. Medical physics, 39(6Part1):3112–3123, 2012.
  9. The ever-increasing importance of cancer as a leading cause of premature death worldwide. Cancer, 127(16):3029–3030, 2021.
  10. L. Q. Chow. Head and neck cancer. New England Journal of Medicine, 382(1):60–72, 2020.
  11. M. Contributors. Unetr implementation in monai, 2023. Accessed: 21.08.2023.
  12. Current and emerging trends in medical image segmentation with deep learning. IEEE Transactions on Radiation and Plasma Medical Sciences, 2023.
  13. B. Efron and R. J. Tibshirani. An introduction to the bootstrap. CRC press, 1994.
  14. Enhancing radiotherapy workflow for head and neck cancer with artificial intelligence: A systematic review. Journal of Personalized Medicine, 13(6):946, 2023.
  15. The autopet challenge: Towards fully automated lesion segmentation in oncologic pet/ct imaging. 2023.
  16. A whole-body fdg-pet/ct dataset with manually annotated tumor lesions. Scientific Data, 9(1):601, 2022.
  17. M. Illimoottil and D. Ginat. Recent advances in deep learning and medical imaging for head and neck cancer treatment: Mri, ct, and pet scans. Cancers, 15(13):3267, 2023.
  18. nnu-net: a self-configuring method for deep learning-based biomedical image segmentation. Nature methods, 18(2):203–211, 2021.
  19. A review of deep learning-based multiple-lesion recognition from medical images: classification, detection and segmentation. Computers in Biology and Medicine, page 106726, 2023.
  20. Application of pet/ct-based deep learning radiomics in head and neck cancer prognosis: a systematic review. Radiology Science, 2022.
  21. Deep neural networks for medical image segmentation. Journal of Healthcare Engineering, 2022, 2022.
  22. E. McCrum-Gardner. Which is the correct statistical test to use? British Journal of Oral and Maxillofacial Surgery, 46(1):38–41, 2008.
  23. V-net: Fully convolutional neural networks for volumetric medical image segmentation. In 2016 fourth international conference on 3D vision (3DV), pages 565–571. Ieee, 2016.
  24. Review the state-of-the-art technologies of semantic segmentation based on deep learning. Neurocomputing, 493:626–646, 2022.
  25. Cancer diagnosis using deep learning: a bibliographic review. Cancers, 11(9):1235, 2019.
  26. Bootstrap-based tests for trends in hydrological time series, with application to ice phenology data. Journal of Hydrology, 410(3-4):150–161, 2011.
  27. Head and neck tumor segmentation in pet/ct: the hecktor challenge. Medical image analysis, 77:102336, 2022.
  28. Torchio: a python library for efficient loading, preprocessing, augmentation and patch-based sampling of medical images in deep learning. Computer Methods and Programs in Biomedicine, 208:106236, 2021.
  29. Simplicity is all you need: out-of-the-box nnunet followed by binary-weighted radiomic model for segmentation and outcome prediction in head and neck pet/ct. In 3D Head and Neck Tumor Segmentation in PET/CT Challenge, pages 121–134. Springer, 2022.
  30. U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18, pages 234–241. Springer, 2015.
  31. Deep learning empowered volume delineation of whole-body organs-at-risk for accelerated radiotherapy. Nature Communications, 13(1):6566, 2022.
  32. Information fusion for fully automated segmentation of head and neck tumors from pet and ct images. Medical Physics, 51(1):319–333, 2024.
  33. Semantic segmentation using vision transformers: A survey. Engineering Applications of Artificial Intelligence, 126:106669, 2023.
  34. Deep learning in cancer diagnosis, prognosis and treatment selection. Genome Medicine, 13(1):1–17, 2021.
  35. X. Wang and B.-b. Li. Deep learning in head and neck tumor multiomics diagnosis and analysis: review of the literature. Frontiers in Genetics, 12:624820, 2021.
  36. Comparison of deep learning networks for fully automated head and neck tumor delineation on multi-centric pet/ct images. Radiation Oncology, 19(1):3, 2024.
  37. Transformers in medical image segmentation: A review. Biomedical Signal Processing and Control, 84:104791, 2023.
  38. Multi-modal tumor segmentation methods based on deep learning: a narrative review. Quantitative Imaging in Medicine and Surgery, 14(1):1122, 2024.
  39. Deep learning of the sectional appearances of 3d ct images for anatomical structure segmentation based on an fcn voting method. Medical physics, 44(10):5221–5233, 2017.

Summary

We haven't generated a summary for this paper yet.