realSEUDO for real-time calcium imaging analysis (2405.15701v1)
Abstract: Closed-loop neuroscience experimentation, where recorded neural activity is used to modify the experiment on-the-fly, is critical for deducing causal connections and optimizing experimental time. A critical step in creating a closed-loop experiment is real-time inference of neural activity from streaming recordings. One challenging modality for real-time processing is multi-photon calcium imaging (CI). CI enables the recording of activity in large populations of neurons however, often requires batch processing of the video data to extract single-neuron activity from the fluorescence videos. We use the recently proposed robust time-trace estimator-Sparse Emulation of Unused Dictionary Objects (SEUDO) algorithm-as a basis for a new on-line processing algorithm that simultaneously identifies neurons in the fluorescence video and infers their time traces in a way that is robust to as-yet unidentified neurons. To achieve real-time SEUDO (realSEUDO), we optimize the core estimator via both algorithmic improvements and an fast C-based implementation, and create a new cell finding loop to enable realSEUDO to also identify new cells. We demonstrate comparable performance to offline algorithms (e.g., CNMF), and improved performance over the current on-line approach (OnACID) at speeds of 120 Hz on average.
- Automatic neuron detection in calcium imaging data using convolutional networks. Advances in neural information processing systems, 29:3270–3278, 2016.
- Sergey A Babkin. The practice of parallel programming. Createspace, 2010.
- Segmentation of neurons from fluorescence calcium recordings beyond real time. Nature Machine Intelligence, pages 1–11, 2021.
- A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM journal on imaging sciences, 2(1):183–202, 2009.
- Templates for convex cone problems with applications to sparse signal recovery. Mathematical programming computation, 3:165–218, 2011.
- Review of data processing of functional optical microscopy for neuroscience. Neurophotonics, 9(4):041402, 2022.
- Fiola: an accelerated pipeline for fluorescence imaging online analysis. Nature Methods, 20(9):1417–1425, 2023.
- Graft: Graph filtered temporal dictionary learning for functional neural imaging. IEEE Transactions on Image Processing, 31:3509–3524, 2022.
- Dethroning the fano factor: a flexible, model-based approach to partitioning neural variability. Neural computation, 30(4):1012–1045, 2018.
- F. Diego and F. A. Hamprecht. Sparse space-time deconvolution for calcium image analysis. In NIPS, pages 64–72, 2014.
- Detecting and correcting false transients in calcium imaging. Nature Methods, 19(4):470–478, 2022.
- CaImAn an open source tool for scalable calcium imaging data analysis. Elife, 8:e38173, 2019.
- Onacid: online analysis of calcium imaging data in real time. In Proceedings of the 31st International Conference on Neural Information Processing Systems, pages 2378–2388, 2017.
- Structured low-rank matrix factorization: Global optimality, algorithms, and applications. IEEE transactions on pattern analysis and machine intelligence, 42(6):1468–1482, 2019.
- Robust estimation of neural signals in calcium imaging. In NIPS, pages 2905–2914, 2017.
- Sima: Python software for analysis of dynamic fluorescence imaging data. Frontiers in Neuroinformatics, 8, 2014.
- Disco: Deep learning, instance segmentation, and correlations for cell segmentation in calcium imaging. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 151–162. Springer, 2020.
- Fast, simple calcium imaging segmentation with fully convolutional networks. In Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support, pages 285–293. Springer, 2017.
- Detecting cells using non-negative matrix factorization on calcium imaging data. Neural Networks, 55:11–19, 2014.
- Learning spatially-correlated temporal dictionaries for calcium imaging. In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP-2019), pages 1065–1069. IEEE, 2019.
- Automated cellular structure extraction in biological images with applications to calcium imaging data. bioRxiv, page 313981, 2018.
- Suite2p: beyond 10,000 neurons with standard two-photon microscopy. bioRxiv, 2016.
- Extracting regions of interest from biological images with convolutional sparse block coding. Advances in Neural Information Processing Systems, pages 1745–1753, 2013.
- Scalpel: Extracting neurons from calcium imaging data. The annals of applied statistics, 12(4):2430, 2018.
- Simultaneous denoising, deconvolution, and demixing of calcium imaging data. Neuron, 89(2):285–299, 2016.
- ABLE: An activity-based level set segmentation algorithm for two-photon calcium imaging data. eNeuro, 2017.
- Fast and robust active neuron segmentation in two-photon calcium imaging using spatiotemporal deep learning. Proceedings of the National Academy of Sciences, 116(17):8554–8563, 2019.
- Volumetric two-photon imaging of neurons using stereoscopy (vTwINS). Nature methods, 14(4):420, 2017.
- Neural anatomy and optical microscopy (naomi) simulation for evaluating calcium imaging methods. Journal of neuroscience methods, 358:109173, 2021.
- HNCcorr: a novel combinatorial approach for cell identification in calcium-imaging movies. Eneuro, 6(2), 2019.
- Robert Tibshirani. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B (Methodological), 58(1):267–288, 1996.
- Fast and sensitive gcamp calcium indicators for imaging neural populations. Nature, pages 1–8, 2023.
- Iuliia Dmitrieva (1 paper)
- Sergey Babkin (1 paper)
- Adam S. Charles (18 papers)