Scribble-supervised Cell Segmentation Using Multiscale Contrastive Regularization (2306.14136v1)
Abstract: Current state-of-the-art supervised deep learning-based segmentation approaches have demonstrated superior performance in medical image segmentation tasks. However, such supervised approaches require fully annotated pixel-level ground-truth labels, which are labor-intensive and time-consuming to acquire. Recently, Scribble2Label (S2L) demonstrated that using only a handful of scribbles with self-supervised learning can generate accurate segmentation results without full annotation. However, owing to the relatively small size of scribbles, the model is prone to overfit and the results may be biased to the selection of scribbles. In this work, we address this issue by employing a novel multiscale contrastive regularization term for S2L. The main idea is to extract features from intermediate layers of the neural network for contrastive loss so that structures at various scales can be effectively separated. To verify the efficacy of our method, we conducted ablation studies on well-known datasets, such as Data Science Bowl 2018 and MoNuSeg. The results show that the proposed multiscale contrastive loss is effective in improving the performance of S2L, which is comparable to that of the supervised learning segmentation method.
- E. Meijering, “Cell segmentation: 50 years down the road [life sciences],” IEEE Signal Processing Magazine, vol. 29, pp. 140–145, August 2012.
- “What’s the point: Semantic segmentation with point supervision,” in Eur. Conf. Comput. Vis. Springer, 2016, vol. 9911, pp. 549–565.
- “Measuring the objectness of image windows,” IEEE Trans. Pattern Anal. and Mach. Intell., vol. 34, no. 11, pp. 2189–2202, 2012.
- “Pseudoedgenet: Nuclei segmentation only with point annotations,” in Proc. Int. Conf. Med. Image Comput. and Comp.-Assist. Intervent. Springer, 2019, vol. 11764, pp. 731–739.
- “Weakly supervised histopathology image segmentation with sparse point annotations,” IEEE Journal of Biomed. and Health Inform., vol. 25, pp. 1673–1685, May 2021.
- T. Zhao and Z. Yin, “Weakly supervised cell segmentation by point annotation,” IEEE Trans. Med. Imag., vol. 40, pp. 2736–2747, December 2021.
- “Scribblesup: Scribble-supervised convolutional networks for semantic segmentation,” in Proc. IEEE Conf. Comput. Vis. Pattern Recoginit., 2016, pp. 3159–3167.
- H. Lee and W. K. Jeong, “Scribble2label: Scribble-supervised cell segmentation via self-generating pseudo-labels with consistency,” in Proc. Int. Conf. Med. Image Comput. and Computer-Assisted Intervention. Springer, 2020, vol. 12261, pp. 14–23.
- “A simple framework for contrastive learning of visual representations,” in Proc. 37th Int. Conf. Mach. Learn., 2020, vol. 119, pp. 1597–1607.
- “Supervised contrastive learning,” Advances in neural information processing systems, vol. 33, pp. 18661–18673, 2020.
- “Pixel contrastive-consistent semi-supervised semantic segmentation,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 7273–7282.
- “Contrastive learning of global and local features for medical image segmentation with limited annotations,” in Adv. Neural Inf. Process. Syst., 2020, vol. 33, pp. 12546–12558.
- “Nucleus segmentation across imaging experiments: the 2018 data science bowl,” Nature Methods, vol. 16, pp. 1247–1253, Dec 2019.
- “A dataset and a technique for generalized nuclear segmentation for computational pathology,” IEEE Trans. Med. Imag., vol. 36, pp. 1550–1560, March 2017.
- “U-net: Convolutional networks for biomedical image segmentation,” in Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18. Springer, 2015, pp. 234–241.
- “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 770–778.
- “Understanding the behaviour of contrastive loss,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021, pp. 2495–2504.
- “Weakly supervised cell instance segmentation by propagating from detection response,” in Medical Image Computing and Computer Assisted Intervention–MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13–17, 2019, Proceedings, Part I 22. Springer, 2019, pp. 649–657.