Building Brain Tumor Segmentation Networks with User-Assisted Filter Estimation and Selection (2403.12748v1)
Abstract: Brain tumor image segmentation is a challenging research topic in which deep-learning models have presented the best results. However, the traditional way of training those models from many pre-annotated images leaves several unanswered questions. Hence methodologies, such as Feature Learning from Image Markers (FLIM), have involved an expert in the learning loop to reduce human effort in data annotation and build models sufficiently deep for a given problem. FLIM has been successfully used to create encoders, estimating the filters of all convolutional layers from patches centered at marker voxels. In this work, we present Multi-Step (MS) FLIM - a user-assisted approach to estimating and selecting the most relevant filters from multiple FLIM executions. MS-FLIM is used only for the first convolutional layer, and the results already indicate improvement over FLIM. For evaluation, we build a simple U-shaped encoder-decoder network, named sU-Net, for glioblastoma segmentation using T1Gd and FLAIR MRI scans, varying the encoder's training method, using FLIM, MS-FLIM, and backpropagation algorithm. Also, we compared these sU-Nets with two State-Of-The-Art (SOTA) deep-learning models using two datasets. The results show that the sU-Net based on MS-FLIM outperforms the other training methods and achieves effectiveness within the standard deviations of the SOTA models.
- Q. T. Ostrom, H. Gittleman, J. Fulop, M. Liu, R. Blanda, C. Kromer, Y. Wolinsky, C. Kruchko, and J. S. Barnholtz-Sloan, “Cbtrus statistical report: primary brain and central nervous system tumors diagnosed in the united states in 2008-2012,” Neuro-oncology 17(suppl.4), pp. iv1–iv62, 2015.
- V. Simi and J. Joseph, “Segmentation of glioblastoma multiforme from mr images–a comprehensive review,” The Egyptian Journal of Radiology and Nuclear Medicine 46(4), pp. 1105–1110, 2015.
- C. Dupont, N. Betrouni, N. Reyns, and M. Vermandel, “On image segmentation methods applied to glioblastoma: state of art and new trends,” IRBM 37(3), pp. 131–143, 2016.
- B. H. Menze, A. Jakab, S. Bauer, J. Kalpathy-Cramer, K. Farahani, J. Kirby, Y. Burren, N. Porz, J. Slotboom, R. Wiest, et al., “The multimodal brain tumor image segmentation benchmark (brats),” IEEE transactions on medical imaging 34(10), pp. 1993–2024, 2015.
- S. Bakas, H. Akbari, A. Sotiras, M. Bilello, M. Rozycki, J. S. Kirby, J. B. Freymann, K. Farahani, and C. Davatzikos, “Advancing the cancer genome atlas glioma mri collections with expert segmentation labels and radiomic features,” Scientific data 4(1), pp. 1–13, 2017.
- S. Bakas, M. Reyes, A. Jakab, S. Bauer, M. Rempfler, A. Crimi, R. T. Shinohara, C. Berger, S. M. Ha, M. Rozycki, et al., “Identifying the best machine learning algorithms for brain tumor segmentation, progression assessment, and overall survival prediction in the brats challenge,” arXiv preprint arXiv:1811.02629 , 2018.
- A. Wadhwa, A. Bhardwaj, and V. S. Verma, “A review on brain tumor segmentation of mri images,” Magnetic resonance imaging 61, pp. 247–259, 2019.
- I. E. de Souza and A. X. Falcão, “Learning cnn filters from user-drawn image markers for coconut-tree image classification,” IEEE Geoscience and Remote Sensing Letters 19, pp. 1–5, 2020.
- O. Ronneberger, P. Fischer, and T. Brox, “U-net: Convolutional networks for biomedical image segmentation,” in International Conference on Medical image computing and computer-assisted intervention, pp. 234–241, Springer, 2015.
- K. Kamnitsas, C. Ledig, V. F. Newcombe, J. P. Simpson, A. D. Kane, D. K. Menon, D. Rueckert, and B. Glocker, “Efficient multi-scale 3d cnn with fully connected crf for accurate brain lesion segmentation,” Medical image analysis 36, pp. 61–78, 2017.
- K. Kamnitsas, E. Ferrante, S. Parisot, C. Ledig, A. V. Nori, A. Criminisi, D. Rueckert, and B. Glocker, “Deepmedic for brain tumor segmentation,” in International workshop on Brainlesion: Glioma, multiple sclerosis, stroke and traumatic brain injuries, pp. 138–149, Springer, 2016.
- Z. Jiang, C. Ding, M. Liu, and D. Tao, “Two-stage cascaded u-net: 1st place solution to brats challenge 2019 segmentation task,” in International MICCAI Brainlesion Workshop, pp. 231–241, Springer, 2019.
- A. Myronenko, “3d mri brain tumor segmentation using autoencoder regularization,” in International MICCAI Brainlesion Workshop, pp. 311–320, Springer, 2018.
- L. Zhong, T. Li, H. Shu, C. Huang, J. M. Johnson, D. F. Schomer, H.-L. Liu, Q. Feng, W. Yang, and H. Zhu, “2wm: Tumor segmentation and tract statistics for assessing white matter integrity with applications to glioblastoma patients,” NeuroImage 223, p. 117368, 2020.
- A. Jungo, R. McKinley, R. Meier, U. Knecht, L. Vera, J. Pérez-Beteta, D. Molina-García, V. M. Pérez-García, R. Wiest, and M. Reyes, “Towards uncertainty-assisted brain tumor segmentation and survival prediction,” in International MICCAI Brainlesion Workshop, pp. 474–485, Springer, 2017.
- G. Wang, W. Li, S. Ourselin, and T. Vercauteren, “Automatic brain tumor segmentation using cascaded anisotropic convolutional neural networks,” in International MICCAI brainlesion workshop, pp. 178–190, Springer, 2017.
- F. Isensee, P. F. Jaeger, S. A. Kohl, J. Petersen, and K. H. Maier-Hein, “nnu-net: a self-configuring method for deep learning-based biomedical image segmentation,” Nature methods 18(2), pp. 203–211, 2021.
- F. Isensee, P. F. Jäger, P. M. Full, P. Vollmuth, and K. H. Maier-Hein, “nnu-net for brain tumor segmentation,” in International MICCAI Brainlesion Workshop, pp. 118–132, Springer, 2020.
- P. Mlynarski, H. Delingette, A. Criminisi, and N. Ayache, “Deep learning with mixed supervision for brain tumor segmentation,” Journal of Medical Imaging 6(3), p. 034002, 2019.
- Z. Ji, Y. Shen, C. Ma, and M. Gao, “Scribble-based hierarchical weakly supervised learning for brain tumor segmentation,” in International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 175–183, Springer, 2019.
- I. E. de Souza, B. C. Benato, and A. X. Falcao, “Feature learning from image markers for object delineation,” in 2020 33rd SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), pp. 116–123, IEEE, 2020.
- D. Sculley, “Web-scale k-means clustering,” in Proceedings of the 19th international conference on World wide web, pp. 1177–1178, 2010.
- S. B. Martins, J. Bragantini, A. X. Falcão, and C. L. Yasuda, “An adaptive probabilistic atlas for anomalous brain segmentation in mr images,” Medical physics 46(11), pp. 4940–4950, 2019.