Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
169 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

IODeep: an IOD for the introduction of deep learning in the DICOM standard (2311.16163v4)

Published 10 Nov 2023 in eess.IV, cs.CV, and cs.HC

Abstract: Background and Objective: In recent years, AI and in particular Deep Neural Networks (DNN) became a relevant research topic in biomedical image segmentation due to the availability of more and more data sets along with the establishment of well known competitions. Despite the popularity of DNN based segmentation on the research side, these techniques are almost unused in the daily clinical practice even if they could support effectively the physician during the diagnostic process. Apart from the issues related to the explainability of the predictions of a neural model, such systems are not integrated in the diagnostic workflow, and a standardization of their use is needed to achieve this goal. Methods: This paper presents IODeep a new DICOM Information Object Definition (IOD) aimed at storing both the weights and the architecture of a DNN already trained on a particular image dataset that is labeled as regards the acquisition modality, the anatomical region, and the disease under investigation. Results: The IOD architecture is presented along with a DNN selection algorithm from the PACS server based on the labels outlined above, and a simple PACS viewer purposely designed for demonstrating the effectiveness of the DICOM integration, while no modifications are required on the PACS server side. Also a service based architecture in support of the entire workflow has been implemented. Conclusion: IODeep ensures full integration of a trained AI model in a DICOM infrastructure, and it is also enables a scenario where a trained model can be either fine-tuned with hospital data or trained in a federated learning scheme shared by different hospitals. In this way AI models can be tailored to the real data produced by a Radiology ward thus improving the physician decision making process. Source code is freely available at https://github.com/CHILab1/IODeep.git

Definition Search Book Streamline Icon: https://streamlinehq.com
References (42)
  1. Deep learning for brain MRI segmentation: State of the art and future directions. Journal of Digital Imaging, 30(4):449–459, June 2017.
  2. Automatic liver and tumor segmentation of ct and mri volumes using cascaded fully convolutional neural networks, 2017.
  3. David A Clunie. DICOM structured reporting. PixelMed publishing, 2000.
  4. Federated learning in medical imaging: part i: toward multicentral health care ecosystems. Journal of the American College of Radiology, 19(8):969–974, 2022.
  5. Integrating AI into radiology workflow: levels of research, production, and feedback maturity. Journal of Medical Imaging, 7(01):1, February 2020.
  6. An image is worth 16x16 words: Transformers for image recognition at scale, Jun 2021. arXiv:2010.11929 [cs].
  7. 3d anisotropic hybrid network: Translating convolutional neural networks for 3d medical image segmentation. IEEE Transactions on Medical Imaging, 39(5):1462–1473, 2020.
  8. National cancer institute imaging data commons: Toward transparency, reproducibility, and scalability in imaging artificial intelligence. RadioGraphics, 43(12):e230180, 2023.
  9. Dual attention network for scene segmentation. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 3146–3154, 2019.
  10. A framework for data-driven adaptive GUI generation based on DICOM. J. Biomed. Inform., 88:37–52, 2018.
  11. Federated learning for medical image analysis: A survey, 2023.
  12. Implementing the dicom standard for digital pathology. Journal of Pathology Informatics, 9(1):37, 2018.
  13. The vendor-agnostic empaia platform for integrating ai applications into digital pathology infrastructures. Future Gener. Comput. Syst., 140(C):209–224, mar 2023.
  14. Personalizable ai platform for universal access to research and diagnosis in digital pathology. Computer Methods and Programs in Biomedicine, 242:107787, December 2023.
  15. Adaptive support for user interface customization: a study in radiology. Int. J. Hum. Comput. Stud., 77:1–9, 2015.
  16. A DICOM framework for machine learning and processing pipelines against real-time radiology images. Journal of Digital Imaging, 34(4):1005–1013, August 2021.
  17. Optimum web viewer application for dicom whole slide image visualization in anatomical pathology. Computer Methods and Programs in Biomedicine, 179:104983, October 2019.
  18. BroadCAM: Outcome-agnostic Class Activation Mapping for Small-scale Weakly Supervised Applications, September 2023. arXiv:2309.03509 [cs].
  19. V-net family: Convolutional networks for volumetric medical image segmentation. IEEE Transactions on Medical Imaging, 40(5):1256–1268, 2021.
  20. Integration of machine learning models in pacs systems to support diagnostic in radiology services. In Juan Carlos Figueroa-García, Fabián Steven Garay-Rairán, Germán Jairo Hernández-Pérez, and Yesid Díaz-Gutierrez, editors, Applied Computer Sciences in Engineering, pages 233–244, Cham, 2020. Springer International Publishing.
  21. Dicom imaging router: An open deep learning framework for classification of body parts from dicom x-ray scans, 2021.
  22. Modality specific u-net variants for biomedical image segmentation: a survey. Artificial Intelligence Review, 55(7):5845–5889, Oct 2022.
  23. Surgical planning of pelvic tumor using multi-view CNN with relation-context representation learning. Medical Image Analysis, 69:101954, April 2021.
  24. Integrating artificial intelligence into the clinical practice of radiology: challenges and recommendations. European Radiology, 30(6):3576–3584, February 2020.
  25. U-net: Convolutional networks for biomedical image segmentation. In Nassir Navab, Joachim Hornegger, William M. Wells, and Alejandro F. Frangi, editors, Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015, Lecture Notes in Computer Science, page 234–241, Cham, 2015. Springer International Publishing.
  26. Deeporgan: Multi-level deep convolutional networks for automated pancreas segmentation. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part I 18, pages 556–564. Springer, 2015.
  27. Recent advances of HCI in decision-making tasks for optimized clinical workflows and precision medicine. Journal of Biomedical Informatics, 108:103479, August 2020.
  28. Neil Savage. How AI is improving cancer diagnostics. Nature, 579(7800):S14–S16, March 2020.
  29. Attention u-net: Learning where to look for the pancreas. Medical Image Analysis, 52:201–211, 2019.
  30. A survey on label-efficient deep image segmentation: Bridging the gap between weak supervision and dense prediction, 2023.
  31. Oau-net: Outlined attention u-net for biomedical image segmentation. Biomedical Signal Processing and Control, 79:104038, Jan 2023.
  32. Skin cancer risk self-assessment using ai as a mass screening tool. Informatics in Medicine Unlocked, 38:101223, 2023.
  33. Explainable artificial intelligence (xai) in deep learning-based medical image analysis. Medical Image Analysis, 79:102470, 2022.
  34. Attention is all you need, 2017.
  35. Tired in the reading room: The influence of fatigue in radiology. Journal of the American College of Radiology, 14(2):191–197, 2017.
  36. Abdominal multi-organ segmentation with organ-attention networks and statistical fusion. Medical Image Analysis, 55:88–102, July 2019.
  37. Multi-scale u-like network with attention mechanism for automatic pancreas segmentation. PLOS ONE, 16(5):e0252287, May 2021.
  38. Weakly supervised object localization and detection: A survey. CoRR, abs/2104.07918, 2021.
  39. Mdu-net: multi-scale densely connected u-net for biomedical image segmentation. Health Information Science and Systems, 11(1):13, Mar 2023.
  40. Learning deep features for discriminative localization. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 2921–2929, Los Alamitos, CA, USA, jun 2016. IEEE Computer Society.
  41. Medical image classification using light-weight cnn with spiking cortical model based attention module. IEEE Journal of Biomedical and Health Informatics, 27(4):1991–2002, Apr 2023.
  42. U-net++: A nested u-net architecture for medical image segmentation. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 839–848, 2018.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now