Papers
Topics
Authors
Recent
Search
2000 character limit reached

Automated Sperm Morphology Analysis Based on Instance-Aware Part Segmentation

Published 31 Jul 2024 in cs.CV | (2408.00112v1)

Abstract: Traditional sperm morphology analysis is based on tedious manual annotation. Automated morphology analysis of a high number of sperm requires accurate segmentation of each sperm part and quantitative morphology evaluation. State-of-the-art instance-aware part segmentation networks follow a "detect-then-segment" paradigm. However, due to sperm's slim shape, their segmentation suffers from large context loss and feature distortion due to bounding box cropping and resizing during ROI Align. Moreover, morphology measurement of sperm tail is demanding because of the long and curved shape and its uneven width. This paper presents automated techniques to measure sperm morphology parameters automatically and quantitatively. A novel attention-based instance-aware part segmentation network is designed to reconstruct lost contexts outside bounding boxes and to fix distorted features, by refining preliminary segmented masks through merging features extracted by feature pyramid network. An automated centerline-based tail morphology measurement method is also proposed, in which an outlier filtering method and endpoint detection algorithm are designed to accurately reconstruct tail endpoints. Experimental results demonstrate that the proposed network outperformed the state-of-the-art top-down RP-R-CNN by 9.2% [AP]_volp, and the proposed automated tail morphology measurement method achieved high measurement accuracies of 95.34%,96.39%,91.2% for length, width and curvature, respectively.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (34)
  1. K. S. Murray et al., “The effect of the new 2010 world health organization criteria for semen analyses on male infertility,” Fertility and sterility, vol. 98, no. 6, pp. 1428–1431, 2012.
  2. W. H. Organization, “Who laboratory manual for the examination and processing of human semen,” Geneva, Switzerland: WHO Press, 2010.
  3. L. Yang, , et al., “Parsing r-cnn for instance-level human analysis,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019, pp. 364–373.
  4. L. Yang et al., “Renovating parsing r-cnn for accurate multiple human parsing,” in European Conference on Computer Vision.   Springer, 2020, pp. 421–437.
  5. S. Zhang et al., “Aiparsing: anchor-free instance-level human parsing,” IEEE Transactions on Image Processing, vol. 31, pp. 5599–5612, 2022.
  6. S. Ren et al., “Faster r-cnn: Towards real-time object detection with region proposal networks,” Advances in neural information processing systems, vol. 28, 2015.
  7. C. S. Dai et al., “Automated non-invasive measurement of sperm motility and morphology parameters,” in 2018 IEEE International Conference on Robotics and Automation (ICRA).   IEEE, 2018, pp. 2682–2687.
  8. C. Dai et al., “Staining-free, automated sperm analysis for in vitro fertilization lab use,” The Journal of Urology, vol. 208, no. 6, pp. 1303–1312, 2022.
  9. R. Usamentiaga et al., “Fast and robust laser stripe extraction for 3d reconstruction in industrial environments,” Machine Vision and Applications, vol. 23, pp. 179–196, 2012.
  10. Y. Li et al., “Sub-pixel extraction of laser stripe center using an improved gray-gravity method,” Sensors, vol. 17, no. 4, p. 814, 2017.
  11. C. Steger, “An unbiased detector of curvilinear structures,” IEEE Transactions on pattern analysis and machine intelligence, vol. 20, no. 2, pp. 113–125, 1998.
  12. R. Yang et al., “Robust and accurate surface measurement using structured light,” IEEE Transactions on Instrumentation and Measurement, vol. 57, no. 6, pp. 1275–1280, 2008.
  13. K. Gong et al., “Instance-level human parsing via part grouping network,” in Proceedings of the European conference on computer vision (ECCV), 2018, pp. 770–785.
  14. H. He et al., “Grapy-ml: Graph pyramid mutual learning for cross-dataset human parsing,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, no. 07, 2020, pp. 10 949–10 956.
  15. K. Gong et al., “Graphonomy: Universal human parsing via graph transfer learning,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019, pp. 7450–7459.
  16. Z. Min, F. J. Bianco, Q. Yang, R. Rodell, W. Yan, D. Barratt, and Y. Hu, “Controlling false positive/negative rates for deep-learning-based prostate cancer detection on multiparametric mr images,” in Medical Image Understanding and Analysis: 25th Annual Conference, MIUA 2021, Oxford, United Kingdom, July 12–14, 2021, Proceedings 25.   Springer, 2021, pp. 56–70.
  17. W. Yan, Q. Yang, T. Syer, Z. Min, S. Punwani, M. Emberton, D. Barratt, B. Chiu, and Y. Hu, “The impact of using voxel-level segmentation metrics on evaluating multifocal prostate cancer localisation,” in International Workshop on Applications of Medical AI.   Springer, 2022, pp. 128–138.
  18. K. He et al., “Mask r-cnn,” in Proceedings of the IEEE international conference on computer vision, 2017, pp. 2961–2969.
  19. Z. Tian et al., “Fcos: A simple and strong anchor-free object detector,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 44, no. 4, pp. 1922–1933, 2020.
  20. Z. Zhang et al., “Quantitative selection of single human sperm with high dna integrity for intracytoplasmic sperm injection,” Fertility and Sterility, vol. 116, no. 5, pp. 1308–1318, 2021.
  21. J.-H. Jang and K.-S. Hong, “Detection of curvilinear structures and reconstruction of their regions in gray-scale images,” Pattern Recognition, vol. 35, no. 4, pp. 807–824, 2002.
  22. L. Haijun et al., “A method for fast detecting the center of structured light stripe,” JOURNAL-HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY NATURE SCIENCE CHINESE EDITION, vol. 31, no. 1, pp. 74–76, 2003.
  23. L. He et al., “Robust laser stripe extraction for three-dimensional reconstruction based on a cross-structured light sensor,” Applied Optics, vol. 56, no. 4, pp. 823–832, 2017.
  24. X. Xu et al., “Line structured light calibration method and centerline extraction: A review,” Results in Physics, vol. 19, p. 103637, 2020.
  25. T.-Y. Lin et al., “Feature pyramid networks for object detection,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 2117–2125.
  26. J. Hu et al., “Squeeze-and-excitation networks,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 7132–7141.
  27. S. Woo et al., “Cbam: Convolutional block attention module,” in Proceedings of the European conference on computer vision (ECCV), 2018, pp. 3–19.
  28. F. Yu and V. Koltun, “Multi-scale context aggregation by dilated convolutions,” arXiv preprint arXiv:1511.07122, 2015.
  29. O. Ronneberger et al., “U-net: Convolutional networks for biomedical image segmentation,” in Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18.   Springer, 2015, pp. 234–241.
  30. F. Milletari et al., “V-net: Fully convolutional neural networks for volumetric medical image segmentation,” in 2016 fourth international conference on 3D vision (3DV).   Ieee, 2016, pp. 565–571.
  31. I. Sutskever et al., “On the importance of initialization and momentum in deep learning,” in International conference on machine learning.   PMLR, 2013, pp. 1139–1147.
  32. L.-C. Chen et al., “Encoder-decoder with atrous separable convolution for semantic image segmentation,” in Proceedings of the European conference on computer vision (ECCV), 2018, pp. 801–818.
  33. J. Long et al., “Fully convolutional networks for semantic segmentation,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2015, pp. 3431–3440.
  34. J. Zhao et al., “Understanding humans in crowded scenes: Deep nested adversarial learning and a new benchmark for multi-human parsing,” in Proceedings of the 26th ACM international conference on Multimedia, 2018, pp. 792–800.

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up

Tweets

Sign up for free to view the 2 tweets with 0 likes about this paper.

Sign Up for Free