Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
149 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

AxonCallosumEM Dataset: Axon Semantic Segmentation of Whole Corpus Callosum cross section from EM Images (2307.02464v1)

Published 5 Jul 2023 in eess.IV and cs.CV

Abstract: The electron microscope (EM) remains the predominant technique for elucidating intricate details of the animal nervous system at the nanometer scale. However, accurately reconstructing the complex morphology of axons and myelin sheaths poses a significant challenge. Furthermore, the absence of publicly available, large-scale EM datasets encompassing complete cross sections of the corpus callosum, with dense ground truth segmentation for axons and myelin sheaths, hinders the advancement and evaluation of holistic corpus callosum reconstructions. To surmount these obstacles, we introduce the AxonCallosumEM dataset, comprising a 1.83 times 5.76mm EM image captured from the corpus callosum of the Rett Syndrome (RTT) mouse model, which entail extensive axon bundles. We meticulously proofread over 600,000 patches at a resolution of 1024 times 1024, thus providing a comprehensive ground truth for myelinated axons and myelin sheaths. Additionally, we extensively annotated three distinct regions within the dataset for the purposes of training, testing, and validation. Utilizing this dataset, we develop a fine-tuning methodology that adapts Segment Anything Model (SAM) to EM images segmentation tasks, called EM-SAM, enabling outperforms other state-of-the-art methods. Furthermore, we present the evaluation results of EM-SAM as a baseline.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (50)
  1. High-resolution, high-throughput imaging with a multibeam scanning electron microscope. Journal of Microscopy, 2018.
  2. U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention, pages 234–241. Springer, 2015.
  3. Superhuman accuracy on the snemi3d connectomics challenge. arXiv preprint arXiv:1706.00120, 2017.
  4. Supervoxel-based segmentation of mitochondria in em image stacks with learned shape features. IEEE transactions on medical imaging, 31(2):474–486, 2011.
  5. Mitoem dataset: large-scale 3d mitochondria instance segmentation from em images. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 66–76. Springer, 2020.
  6. Axonem dataset: 3d axon instance segmentation of brain cortical regions. In Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part I 24, pages 175–185. Springer, 2021.
  7. Deepacson automated segmentation of white matter in 3d electron microscopy. Communications biology, 4(1):179, 2021.
  8. Treating rett syndrome: from mouse models to human therapies. Mammalian Genome, 30, 2019.
  9. Segment anything. arXiv preprint arXiv:2304.02643, 2023.
  10. Automatic segmentation and measurement of axons in microscopic images. In Medical Imaging 1999: Image Processing, volume 3661, pages 920–929. SPIE, 1999.
  11. Automatic morphometry of nerve histological sections. Journal of neuroscience methods, 97(2):111–122, 2000.
  12. A semi-automated method for identifying and measuring myelinated nerve fibers in scanning electron microscope images. Journal of neuroscience methods, 201(1):149–158, 2011.
  13. Automatic identification and morphometry of optic nerve fibers in electron microscopy images. Computerized Medical Imaging and Graphics, 34(3):179–184, 2010.
  14. Serge Beucher. The watershed transformation applied to image segmentation. Scanning Microscopy, 1992(6):28, 1992.
  15. Segmentation of nerve fibers using multi-level gradient watershed and fuzzy systems. Artificial intelligence in medicine, 54(3):189–200, 2012.
  16. Automated method for the segmentation and morphometry of nerve fibers in large-scale cars images of spinal cord tissue. Biomedical optics express, 5(12):4145–4161, 2014.
  17. Axonseg: open source software for axon and myelin segmentation and morphometric analysis. Frontiers in neuroinformatics, 10:37, 2016.
  18. Feature pyramid networks for object detection. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 936–944, 2017.
  19. Nucmm dataset: 3d neuronal nuclei instance segmentation at sub-cubic millimeter scale. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 164–174. Springer, 2021.
  20. Axondeepseg: automatic axon and myelin segmentation from microscopy data using convolutional neural networks. Scientific reports, 8(1):3816, 2018.
  21. Dense connectomic reconstruction in layer 4 of the somatosensory cortex. Science, 366(6469):eaay3134, 2019.
  22. Attention is all you need. In NeurIPS, 2017.
  23. An image is worth 16x16 words: Transformers for image recognition at scale. In ICLR, 2021.
  24. Unetr: Transformers for 3d medical image segmentation. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 574–584, 2022.
  25. Swin unetr: Swin transformers for semantic segmentation of brain tumors in mri images. In International MICCAI Brainlesion Workshop, pages 272–284. Springer, 2022.
  26. Self-supervised pre-training of swin transformers for 3d medical image analysis. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 20730–20740, 2022.
  27. Learning the heterogeneous representation of brain’s structure from serial sem images using a masked autoencoder. Frontiers in Neuroinformatics, 17:1118419, 2023.
  28. Swin transformer: Hierarchical vision transformer using shifted windows. In Proceedings of the IEEE/CVF international conference on computer vision, pages 10012–10022, 2021.
  29. Extracting and composing robust features with denoising autoencoders. In Proceedings of the 25th international conference on Machine learning, pages 1096–1103, 2008.
  30. Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. Journal of machine learning research, 11(12), 2010.
  31. Masked autoencoders are scalable vision learners. In arXiv, 2021.
  32. Beit: Bert pre-training of image transformers. arXiv preprint arXiv:2106.08254, 2021.
  33. Beit v2: Masked image modeling with vector-quantized visual tokenizers. arXiv preprint arXiv:2208.06366, 2022.
  34. ibot: Image bert pre-training with online tokenizer. arXiv preprint arXiv:2111.07832, 2021.
  35. Masked feature prediction for self-supervised visual pre-training. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 14668–14678, June 2022.
  36. Simmim: A simple framework for masked image modeling. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 9653–9663, 2022.
  37. Emerging properties in self-supervised vision transformers. In Proceedings of the International Conference on Computer Vision (ICCV), 2021.
  38. Dinov2: Learning robust visual features without supervision, 2023.
  39. Merged magnetic resonance and light sheet microscopy of the whole mouse brain. Proceedings of the National Academy of Sciences, 120(17):e2218617120, 2023.
  40. Vast (volume annotation and segmentation tool): efficient manual and semi-automatic labeling of large 3d image stacks. Frontiers in neural circuits, 12:88, 2018.
  41. Experimental studies of g-ratio mri in ex vivo mouse brain. Neuroimage, 167:366–371, 2018.
  42. Tnfα𝛼\alphaitalic_α promotes proliferation of oligodendrocyte progenitors and remyelination. Nature neuroscience, 4(11):1116–1122, 2001.
  43. Episodic demyelination and subsequent remyelination within the murine central nervous system: changes in axonal calibre. Neuropathology and applied neurobiology, 27(1):50–58, 2001.
  44. Jun Ma and Bo Wang. Segment anything in medical images. arXiv preprint arXiv:2304.12306, 2023.
  45. Medical sam adapter: Adapting segment anything model for medical image segmentation. arXiv preprint arXiv:2304.12620, 2023.
  46. Sgdr: Stochastic gradient descent with warm restarts. arXiv preprint arXiv:1608.03983, 2016.
  47. Accurate, large minibatch sgd: Training imagenet in 1 hour. In CVPR, 2017.
  48. Transfusion: Understanding transfer learning for medical imaging. Advances in neural information processing systems, 32, 2019.
  49. Improving the segmentation of anatomical structures in chest radiographs using u-net with an imagenet pre-trained encoder. In Image Analysis for Moving Organ, Breast, and Thoracic Images: Third International Workshop, RAMBO 2018, Fourth International Workshop, BIA 2018, and First International Workshop, TIA 2018, Held in Conjunction with MICCAI 2018, Granada, Spain, September 16 and 20, 2018, Proceedings 3, pages 159–168. Springer, 2018.
  50. Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition, pages 248–255. Ieee, 2009.
Citations (2)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now