Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
126 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Joint Learning Neuronal Skeleton and Brain Circuit Topology with Permutation Invariant Encoders for Neuron Classification (2312.14518v2)

Published 22 Dec 2023 in q-bio.NC, cs.CV, and eess.IV

Abstract: Determining the types of neurons within a nervous system plays a significant role in the analysis of brain connectomics and the investigation of neurological diseases. However, the efficiency of utilizing anatomical, physiological, or molecular characteristics of neurons is relatively low and costly. With the advancements in electron microscopy imaging and analysis techniques for brain tissue, we are able to obtain whole-brain connectome consisting neuronal high-resolution morphology and connectivity information. However, few models are built based on such data for automated neuron classification. In this paper, we propose NeuNet, a framework that combines morphological information of neurons obtained from skeleton and topological information between neurons obtained from neural circuit. Specifically, NeuNet consists of three components, namely Skeleton Encoder, Connectome Encoder, and Readout Layer. Skeleton Encoder integrates the local information of neurons in a bottom-up manner, with a one-dimensional convolution in neural skeleton's point data; Connectome Encoder uses a graph neural network to capture the topological information of neural circuit; finally, Readout Layer fuses the above two information and outputs classification results. We reprocess and release two new datasets for neuron classification task from volume electron microscopy(VEM) images of human brain cortex and Drosophila brain. Experiments on these two datasets demonstrated the effectiveness of our model with accuracy of 0.9169 and 0.9363, respectively. Code and data are available at: https://github.com/WHUminghui/NeuNet.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (60)
  1. Towards the automatic classification of neurons. Trends in Neurosciences, 38(5): 307–318.
  2. The wiring diagram of a glomerular olfactory system. Elife, 5.
  3. Molecular, structural, and functional characterization of Alzheimer’s disease: evidence for a relationship between default activity, amyloid, and memory. Journal of Neuroscience, 25(34): 7709–7717.
  4. Automatic detection of synaptic partners in a whole-brain Drosophila electron microscopy data set. Nature Methods, 18(7): 771–774.
  5. Simple and deep graph convolutional networks. In International Conference on Machine Learning (ICML), 1725–1735. PMLR.
  6. Three-dimensional reconstruction of brain-wide wiring networks in Drosophila at single-cell resolution. Current Biology, 21(1): 1–11.
  7. neuPrint: analysis tools for EM connectomics. BioRxiv.
  8. NBLAST: rapid, sensitive comparison of neuronal structure and construction of neuron family databases. Neuron, 91(2): 293–311.
  9. High-resolution, high-throughput imaging with a multibeam scanning electron microscope. Journal of Microscopy, 259(2): 114–120.
  10. A platform for brain-wide imaging and reconstruction of individual neurons. Elife, 5: e10566.
  11. A transcriptional signature of hub connectivity in the mouse connectome. Proceedings of the National Academy of Sciences, 113(5): 1435–1440.
  12. Predict then Propagate: Graph Neural Networks meet Personalized PageRank. In International Conference on Learning Representations (ICLR).
  13. Topological characterization of neuronal arbor morphology via sequence representation: I-motif analysis. BMC Bioinformatics, 16: 1–15.
  14. Continuously tracing brain-wide long-distance axonal projections in mice at a one-micron voxel resolution. Neuroimage, 74: 87–98.
  15. Analogous convergence of sustained and transient inputs in parallel on and off pathways for retinal motion computation. Cell Reports, 14(8): 1892–1900.
  16. Inductive representation learning on large graphs. In Conference on Neural Information Processing Systems (NeurIPS), volume 30.
  17. Ultrastructurally smooth thick partitioning and volume stitching for large-scale connectomics. Nature Methods, 12(4): 319–322.
  18. Fully-automatic synapse prediction and validation on a large data set. Frontiers in Neural Circuits, 12: 87.
  19. Fully-automatic synapse prediction and validation on a large data set. Frontiers in neural circuits, 12: 87.
  20. Accelerated EM connectome reconstruction using 3D visualization and segmentation graphs. BioRxiv, 2020–01.
  21. High-precision automated reconstruction of neurons with flood-filling networks. Nature Methods, 15(8): 605–610.
  22. A GAL4-driver line resource for Drosophila neurobiology. Cell Reports, 2(4): 991–1001.
  23. A GAL4-driver line resource for Drosophila neurobiology. Cell reports, 2(4): 991–1001.
  24. Coupling deformable models for multi-object segmentation. In Biomedical Simulation: 4th International Symposium, ISBMS 2008, London, UK, July 7-8, 2008 Proceedings 4, 69–78. Springer.
  25. Objective morphological classification of neocortical pyramidal cells. Cerebral Cortex, 29(4): 1719–1735.
  26. Joint deformable registration of large EM image volumes: A matrix solver approach. arXiv preprint arXiv:1804.10019.
  27. Imagenet classification with deep convolutional neural networks. In Conference on Neural Information Processing Systems (NeurIPS), volume 25.
  28. Backpropagation applied to handwritten zip code recognition. Neural Computation, 1(4): 541–551.
  29. Anatomy and function of an excitatory network in the visual cortex. Nature, 532(7599): 370–374.
  30. An adjustable farthest point sampling method for approximately-sorted point cloud data. In IEEE Workshop on Signal Processing Systems (SiPS), 1–6. IEEE.
  31. En bloc preparation of Drosophila brains enables high-throughput FIB-SEM connectomics. Frontiers in Neural Circuits, 16: 917251.
  32. Reconstruction and simulation of neocortical microcircuitry. Cell, 163(2): 456–492.
  33. The fuzzy logic of network connectivity in mouse visual thalamus. Cell, 165(1): 192–206.
  34. BigNeuron: large-scale 3D neuron reconstruction from optical microscopy images. Neuron, 87(2): 252–256.
  35. Adaptive histogram equalization and its variations. Computer vision, Graphics, and Image processing, 39(3): 355–368.
  36. Pointnet: Deep learning on point sets for 3d classification and segmentation. In Computer Vision and Pattern Recognition (CVPR), 652–660.
  37. Pointnet++: Deep hierarchical feature learning on point sets in a metric space. In Conference on Neural Information Processing Systems (NeurIPS), volume 30.
  38. Visualization of cortical, subcortical and deep brain neural circuit dynamics during naturalistic mammalian behavior with head-mounted microscopes and chronically implanted lenses. Nature Protocols, 11(3): 566–597.
  39. A connectome and analysis of the adult Drosophila central brain. Elife, 9: e57443.
  40. Learning cellular morphology with neural networks. Nature Communications, 10(1): 1–12.
  41. A connectomic study of a petascale fragment of human cerebral cortex. BioRxiv, 2021–05.
  42. Connectomics-based analysis of information flow in the Drosophila brain. Current Biology, 25(10): 1249–1258.
  43. A genetic and computational approach to structurally classify neuronal types. Nature Communications, 5(1): 1–12.
  44. A visual motion detection circuit suggested by Drosophila connectomics. Nature, 500(7461): 175–181.
  45. Attention-based graph neural network for semi-supervised learning. arXiv preprint arXiv:1803.03735.
  46. The impact of neuron morphology on cortical network architecture. Cell Reports, 39(2).
  47. Visualizing data using t-SNE. Journal of Machine Learning Research, 9(11).
  48. Graph Attention Networks. In International Conference on Learning Representations (ICLR).
  49. Revealing the vectors of cellular identity with single-cell genomics. Nature Biotechnology, 34(11): 1145–1160.
  50. Dynamic graph cnn for learning on point clouds. ACM Transactions On Graphics, 38(5): 1–12.
  51. Semi-supervised classification with graph convolutional networks. In International Conference on Learning Representations (ICLR).
  52. Simplifying graph convolutional networks. In International Conference on Machine Learning (ICML), 6861–6871.
  53. Enhanced FIB-SEM systems for large-volume 3D imaging. Elife, 6: e25916.
  54. Enabling FIB-SEM systems for large volume connectomics and cell biology. bioRxiv, 852863.
  55. How Powerful are Graph Neural Networks? In International Conference on Learning Representations (ICLR).
  56. Point transformer. In IEEE International Conference on Computer Vision (ICCV), 16259–16268.
  57. NeuTu: software for collaborative, Large-Scale, Segmentation-Based connectome reconstruction. Frontiers in Neural Circuits, 12: 101.
  58. A complete electron microscopy volume of the brain of adult Drosophila melanogaster. Cell, 174(3): 730–743.
  59. Unpaired image-to-image translation using cycle-consistent adversarial networks. In IEEE International Conference on Computer Vision (ICCV), 2223–2232.
  60. MorphoGNN: Morphological embedding for single neuron with graph neural networks. bioRxiv, 2022–05.
Citations (2)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now