Papers
Topics
Authors
Recent
Search
2000 character limit reached

SCPMan: Shape Context and Prior Constrained Multi-scale Attention Network for Pancreatic Segmentation

Published 26 Dec 2023 in cs.CV | (2312.15859v1)

Abstract: Due to the poor prognosis of Pancreatic cancer, accurate early detection and segmentation are critical for improving treatment outcomes. However, pancreatic segmentation is challenged by blurred boundaries, high shape variability, and class imbalance. To tackle these problems, we propose a multiscale attention network with shape context and prior constraint for robust pancreas segmentation. Specifically, we proposed a Multi-scale Feature Extraction Module (MFE) and a Mixed-scale Attention Integration Module (MAI) to address unclear pancreas boundaries. Furthermore, a Shape Context Memory (SCM) module is introduced to jointly model semantics across scales and pancreatic shape. Active Shape Model (ASM) is further used to model the shape priors. Experiments on NIH and MSD datasets demonstrate the efficacy of our model, which improves the state-of-the-art Dice Score for 1.01% and 1.03% respectively. Our architecture provides robust segmentation performance, against the blurry boundaries, and variations in scale and shape of pancreas.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (48)
  1. P. Ghaneh, E. Costello, and J. P. Neoptolemos, “Biology and management of pancreatic cancer,” Postgraduate medical journal, vol. 84, no. 995, pp. 478–497, 2008.
  2. Y. Liu, M. Feng, H. Chen, G. Yang, J. Qiu, F. Zhao, Z. Cao, W. Luo, J. Xiao, L. You et al., “Mechanistic target of rapamycin in the tumor microenvironment and its potential as a therapeutic target for pancreatic cancer,” Cancer letters, vol. 485, pp. 1–13, 2020.
  3. L. Song, H. Wang, and Z. J. Wang, “Bridging the gap between 2d and 3d contexts in ct volume for liver and tumor segmentation,” IEEE Journal of Biomedical and Health Informatics, vol. 25, no. 9, pp. 3450–3459, 2021.
  4. N. Heller, F. Isensee, K. H. Maier-Hein, X. Hou, C. Xie, F. Li, Y. Nan, G. Mu, Z. Lin, M. Han et al., “The state of the art in kidney and kidney tumor segmentation in contrast-enhanced ct imaging: Results of the kits19 challenge,” Medical image analysis, vol. 67, p. 101821, 2021.
  5. M. Antonelli, A. Reinke, S. Bakas, K. Farahani, A. Kopp-Schneider, B. A. Landman, G. Litjens, B. Menze, O. Ronneberger, R. M. Summers et al., “The medical segmentation decathlon,” Nature communications, vol. 13, no. 1, p. 4128, 2022.
  6. X. Li, H. Chen, X. Qi, Q. Dou, C.-W. Fu, and P.-A. Heng, “H-denseunet: hybrid densely connected unet for liver and tumor segmentation from ct volumes,” IEEE transactions on medical imaging, vol. 37, no. 12, pp. 2663–2674, 2018.
  7. C. Zhao, Y. Xu, Z. He, J. Tang, Y. Zhang, J. Han, Y. Shi, and W. Zhou, “Lung segmentation and automatic detection of covid-19 using radiomic features from chest ct images,” Pattern Recognition, vol. 119, p. 108071, 2021.
  8. N. Bouteldja, B. M. Klinkhammer, R. D. Bülow, P. Droste, S. W. Otten, S. F. von Stillfried, J. Moellmann, S. M. Sheehan, R. Korstanje, S. Menzel et al., “Deep learning–based segmentation and quantification in experimental kidney histopathology,” Journal of the American Society of Nephrology: JASN, vol. 32, no. 1, p. 52, 2021.
  9. R. Pohle and K. D. Toennies, “Segmentation of medical images using adaptive region growing,” in Medical Imaging 2001: Image Processing, vol. 4322.   SPIE, 2001, pp. 1337–1346.
  10. J. Gao, B. Wang, Z. Wang, Y. Wang, and F. Kong, “A wavelet transform-based image segmentation method,” Optik, vol. 208, p. 164123, 2020.
  11. D.-P. Fan, G.-P. Ji, M.-M. Cheng, and L. Shao, “Concealed object detection,” IEEE transactions on pattern analysis and machine intelligence, vol. 44, no. 10, pp. 6024–6042, 2021.
  12. Y. Pang, X. Zhao, L. Zhang, and H. Lu, “Multi-scale interactive network for salient object detection,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 9413–9422.
  13. Y. Pang, X. Zhao, T.-Z. Xiang, L. Zhang, and H. Lu, “Zoom in and out: A mixed-scale triplet network for camouflaged object detection,” in Proceedings of the IEEE/CVF Conference on computer vision and pattern recognition, 2022, pp. 2160–2170.
  14. Z. Huang, H. Dai, T.-Z. Xiang, S. Wang, H.-X. Chen, J. Qin, and H. Xiong, “Feature shrinkage pyramid for camouflaged object detection with transformers,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 5557–5566.
  15. D. Zhang, J. Zhang, Q. Zhang, J. Han, S. Zhang, and J. Han, “Automatic pancreas segmentation based on lightweight dcnn modules and spatial prior propagation,” Pattern Recognition, vol. 114, p. 107762, 2021.
  16. H. Chen, Y. Liu, and Z. Shi, “Fpf-net: feature propagation and fusion based on attention mechanism for pancreas segmentation,” Multimedia systems, vol. 29, no. 2, pp. 525–538, 2023.
  17. W. Li, S. Qin, F. Li, and L. Wang, “Mad-unet: A deep u-shaped network combined with an attention mechanism for pancreas segmentation in ct images,” Medical Physics, vol. 48, no. 1, pp. 329–341, 2021.
  18. A. Davradou, “Detection and segmentation of pancreas using morphological snakes and deep convolutional neural networks,” arXiv preprint arXiv:2302.06356, 2023.
  19. Q. Yu, L. Xie, Y. Wang, Y. Zhou, E. K. Fishman, and A. L. Yuille, “Recurrent saliency transformation network: Incorporating multi-stage visual cues for small organ segmentation,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 8280–8289.
  20. Y. Zhou, L. Xie, W. Shen, Y. Wang, E. K. Fishman, and A. L. Yuille, “A fixed-point model for pancreas segmentation in abdominal ct scans,” in International conference on medical image computing and computer-assisted intervention.   Springer, 2017, pp. 693–701.
  21. T. D. Tam and N. T. Binh, “Efficient pancreas segmentation in computed tomography based on region-growing,” in Nature of Computation and Communication: International Conference, ICTCC 2014, Ho Chi Minh City, Vietnam, November 24-25, 2014, Revised Selected Papers 1.   Springer, 2015, pp. 332–340.
  22. X. Shan, C. Du, Y. Chen, A. Nandi, X. Gong, C. Ma, and P. Yang, “Threshold algorithm for pancreas segmentation in dixon water magnetic resonance images,” in 2017 13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD).   IEEE, 2017, pp. 2367–2371.
  23. N. Ostu, “A threshold selection method from gray-level histograms.” IEEE Trans SMC, vol. 9, p. 62, 1979.
  24. M. Erdt, M. Kirschner, K. Drechsler, S. Wesarg, M. Hammon, and A. Cavallaro, “Automatic pancreas segmentation in contrast enhanced ct data using learned spatial anatomy and texture descriptors,” in 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.   IEEE, 2011, pp. 2076–2082.
  25. K. Karasawa, M. Oda, T. Kitasaka, K. Misawa, M. Fujiwara, C. Chu, G. Zheng, D. Rueckert, and K. Mori, “Multi-atlas pancreas segmentation: atlas selection based on vessel structure,” Medical image analysis, vol. 39, pp. 18–28, 2017.
  26. J. Long, E. Shelhamer, and T. Darrell, “Fully convolutional networks for semantic segmentation,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2015, pp. 3431–3440.
  27. O. Ronneberger, P. Fischer, and T. Brox, “U-net: Convolutional networks for biomedical image segmentation,” in Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18.   Springer, 2015, pp. 234–241.
  28. S. Aydın, “Deep learning classification of neuro-emotional phase domain complexity levels induced by affective video film clips,” IEEE Journal of Biomedical and Health Informatics, vol. 24, no. 6, pp. 1695–1702, 2019.
  29. M. Li, F. Lian, and S. Guo, “Automatic pancreas segmentation using double adversarial networks with pyramidal pooling module,” IEEE Access, vol. 9, pp. 140 965–140 974, 2021.
  30. K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 770–778.
  31. L.-C. Chen, G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille, “Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs,” IEEE transactions on pattern analysis and machine intelligence, vol. 40, no. 4, pp. 834–848, 2017.
  32. E. H. Adelson, C. H. Anderson, J. R. Bergen, P. J. Burt, and J. M. Ogden, “Pyramid methods in image processing,” RCA engineer, vol. 29, no. 6, pp. 33–41, 1984.
  33. T.-Y. Lin, P. Dollár, R. Girshick, K. He, B. Hariharan, and S. Belongie, “Feature pyramid networks for object detection,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 2117–2125.
  34. S. Ren, K. He, R. Girshick, and J. Sun, “Faster r-cnn: Towards real-time object detection with region proposal networks,” Advances in neural information processing systems, vol. 28, 2015.
  35. X. Zhao, Y. Pang, J. Yang, L. Zhang, and H. Lu, “Multi-source fusion and automatic predictor selection for zero-shot video object segmentation,” in Proceedings of the 29th ACM international conference on multimedia, 2021, pp. 2645–2653.
  36. Z. Zhou, M. M. Rahman Siddiquee, N. Tajbakhsh, and J. Liang, “Unet++: A nested u-net architecture for medical image segmentation,” in Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support: 4th International Workshop, DLMIA 2018, and 8th International Workshop, ML-CDS 2018, Held in Conjunction with MICCAI 2018, Granada, Spain, September 20, 2018, Proceedings 4.   Springer, 2018, pp. 3–11.
  37. D.-P. Fan, G.-P. Ji, T. Zhou, G. Chen, H. Fu, J. Shen, and L. Shao, “Pranet: Parallel reverse attention network for polyp segmentation,” in International conference on medical image computing and computer-assisted intervention.   Springer, 2020, pp. 263–273.
  38. X. Qin, Z. Zhang, C. Huang, C. Gao, M. Dehghan, and M. Jagersand, “Basnet: Boundary-aware salient object detection,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019, pp. 7479–7489.
  39. J. Wei, S. Wang, and Q. Huang, “F3superscript𝐹3F^{3}italic_F start_POSTSUPERSCRIPT 3 end_POSTSUPERSCRIPTnet: fusion, feedback and focus for salient object detection,” in Proceedings of the AAAI conference on artificial intelligence, vol. 34, no. 07, 2020, pp. 12 321–12 328.
  40. H. R. Roth, L. Lu, A. Farag, H.-C. Shin, J. Liu, E. B. Turkbey, and R. M. Summers, “Deeporgan: Multi-level deep convolutional networks for automated pancreas segmentation,” in Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part I 18.   Springer, 2015, pp. 556–564.
  41. Y. Zhang, J. Wu, Y. Liu, Y. Chen, W. Chen, E. X. Wu, C. Li, and X. Tang, “A deep learning framework for pancreas segmentation with multi-atlas registration and 3d level-set,” Medical Image Analysis, vol. 68, p. 101884, 2021.
  42. H. Chen, Y. Liu, Z. Shi, and Y. Lyu, “Pancreas segmentation by two-view feature learning and multi-scale supervision,” Biomedical Signal Processing and Control, vol. 74, p. 103519, 2022.
  43. J. Li, X. Lin, H. Che, H. Li, and X. Qian, “Pancreas segmentation with probabilistic map guided bi-directional recurrent unet,” Physics in Medicine & Biology, vol. 66, no. 11, p. 115010, 2021.
  44. P. Hu, X. Li, Y. Tian, T. Tang, T. Zhou, X. Bai, S. Zhu, T. Liang, and J. Li, “Automatic pancreas segmentation in ct images with distance-based saliency-aware denseaspp network,” IEEE journal of biomedical and health informatics, vol. 25, no. 5, pp. 1601–1611, 2020.
  45. H. Li, J. Li, X. Lin, and X. Qian, “A model-driven stack-based fully convolutional network for pancreas segmentation,” in 2020 5th International Conference on Communication, Image and Signal Processing (CCISP).   IEEE, 2020, pp. 288–293.
  46. F. Li, W. Li, Y. Shu, S. Qin, B. Xiao, and Z. Zhan, “Multiscale receptive field based on residual network for pancreas segmentation in ct images,” Biomedical Signal Processing and Control, vol. 57, p. 101828, 2020.
  47. C. Qiu, Z. Liu, Y. Song, J. Yin, K. Han, Y. Zhu, Y. Liu, and V. S. Sheng, “Rtunet: Residual transformer unet specifically for pancreas segmentation,” Biomedical Signal Processing and Control, vol. 79, p. 104173, 2023.
  48. S. Dai, Y. Zhu, X. Jiang, F. Yu, J. Lin, and D. Yang, “Td-net: Trans-deformer network for automatic pancreas segmentation,” Neurocomputing, vol. 517, pp. 279–293, 2023.

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up