LESEN: Label-Efficient deep learning for Multi-parametric MRI-based Visual Pathway Segmentation (2401.01654v1)
Abstract: Recent research has shown the potential of deep learning in multi-parametric MRI-based visual pathway (VP) segmentation. However, obtaining labeled data for training is laborious and time-consuming. Therefore, it is crucial to develop effective algorithms in situations with limited labeled samples. In this work, we propose a label-efficient deep learning method with self-ensembling (LESEN). LESEN incorporates supervised and unsupervised losses, enabling the student and teacher models to mutually learn from each other, forming a self-ensembling mean teacher framework. Additionally, we introduce a reliable unlabeled sample selection (RUSS) mechanism to further enhance LESEN's effectiveness. Our experiments on the human connectome project (HCP) dataset demonstrate the superior performance of our method when compared to state-of-the-art techniques, advancing multimodal VP segmentation for comprehensive analysis in clinical and research settings. The implementation code will be available at: https://github.com/aldiak/Semi-Supervised-Multimodal-Visual-Pathway- Delineation.
- Two parallel stages deep learning network for anterior visual pathway segmentation. In Computational Diffusion MRI: International MICCAI Workshop, Lima, Peru, October 2020, pages 279–290. Springer, 2021.
- Deep learning guided partitioned shape model for anterior visual pathway segmentation. IEEE transactions on medical imaging, 35(8):1856–1865, 2016. ISSN 0278-0062.
- Spatial probabilistic distribution map based 3D FCN for visual pathway segmentation. In Image and Graphics: 10th International Conference, ICIG 2019, Beijing, China, August 23–25, 2019, Proceedings, Part II 10, pages 509–518. Springer, 2019. ISBN 3030341097.
- Deep Multimodal Fusion Network for the Retinogeniculate Visual Pathway Segmentation. In The 42nd Chinese Control Conference (CCC 2023), 2023a.
- Bidirectional Copy-Paste for Semi-Supervised Medical Image Segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 11514–11524, 2023.
- Uncertainty-aware self-ensembling model for semi-supervised 3d left atrium segmentation. In Medical Image Computing and Computer Assisted Intervention–MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13–17, 2019, Proceedings, Part II 22, pages 605–613. Springer, 2019.
- U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18, pages 234–241. Springer, 2015. ISBN 3319245732.
- Learning cross-modal deep representations for multi-modal MR image segmentation. In Medical Image Computing and Computer Assisted Intervention–MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13–17, 2019, Proceedings, Part II 22, pages 57–65. Springer, 2019. ISBN 3030322440.
- Temporal ensembling for semi-supervised learning. arXiv preprint arXiv:1610.02242, 2016.
- The human connectome project: a data acquisition perspective. Neuroimage, 62(4):2222–2231, 2012.
- CNTSeg: A multimodal deep-learning-based network for cranial nerves tract segmentation. Medical Image Analysis, 86:102766, 2023b. ISSN 1361-8415.
- Transattunet: Multi-level attention-guided u-net with transformer for medical image segmentation. IEEE Transactions on Emerging Topics in Computational Intelligence, 2023.