Calibration of stochastic, agent-based neuron growth models with Approximate Bayesian Computation (2405.13905v1)
Abstract: Understanding how genetically encoded rules drive and guide complex neuronal growth processes is essential to comprehending the brain's architecture, and agent-based models (ABMs) offer a powerful simulation approach to further develop this understanding. However, accurately calibrating these models remains a challenge. Here, we present a novel application of Approximate Bayesian Computation (ABC) to address this issue. ABMs are based on parametrized stochastic rules that describe the time evolution of small components -- the so-called agents -- discretizing the system, leading to stochastic simulations that require appropriate treatment. Mathematically, the calibration defines a stochastic inverse problem. We propose to address it in a Bayesian setting using ABC. We facilitate the repeated comparison between data and simulations by quantifying the morphological information of single neurons with so-called morphometrics and resort to statistical distances to measure discrepancies between populations thereof. We conduct experiments on synthetic as well as experimental data. We find that ABC utilizing Sequential Monte Carlo sampling and the Wasserstein distance finds accurate posterior parameter distributions for representative ABMs. We further demonstrate that these ABMs capture specific features of pyramidal cells of the hippocampus (CA1). Overall, this work establishes a robust framework for calibrating agent-based neuronal growth models and opens the door for future investigations using Bayesian techniques for model building, verification, and adequacy assessment.
- Shun-ichi Amari. Information Geometry and Its Applications, volume 194. Springer Japan, 2016. ISBN 978-4-431-55977-1. https://doi.org/10.1007/978-4-431-55978-8.
- Computer generation and quantitative morphometric analysis of virtual neurons. Anatomy and Embryology, 204:283–301, 10 2001. ISSN 03402061. https://doi.org/10.1007/s004290100201.
- Neuromorpho.org: A central resource for neuronal morphologies. Journal of Neuroscience, 27:9247–9251, 8 2007. ISSN 0270-6474. https://doi.org/10.1523/JNEUROSCI.2055-07.2007.
- Equal numbers of neuronal and nonneuronal cells make the human brain an isometrically scaled‐up primate brain. Journal of Comparative Neurology, 513:532–541, 4 2009. ISSN 0021-9967. https://doi.org/10.1002/cne.21974.
- Developmental origin of patchy axonal connectivity in the neocortex: A computational model. Cerebral Cortex, 24:487–500, 2 2014a. ISSN 1460-2199. https://doi.org/10.1093/cercor/bhs327.
- Developmental self-construction and -configuration of functional neocortical neuronal networks. PLoS Computational Biology, 10:e1003994, 12 2014b. ISSN 1553-7358. https://doi.org/10.1371/journal.pcbi.1003994.
- Creative destruction: A basic computational model of cortical layer formation. Cerebral Cortex, 31:3237–3253, 7 2021. ISSN 14602199. https://doi.org/10.1093/cercor/bhab003.
- Bayesian Statistics 7, chapter The Variational Bayesian EM Algorithm for Incomplete Data: With Application to Scoring Graphical Model Structures, pages 453–463. Oxford University PressOxford, 7 2003. https://doi.org/10.1093/oso/9780198526155.003.0025.
- Mark A. Beaumont. Approximate bayesian computation in evolution and ecology. Annual Review of Ecology, Evolution, and Systematics, 41:379–406, 12 2010. ISSN 1543-592X. https://doi.org/10.1146/annurev-ecolsys-102209-144621.
- Approximate bayesian computation in population genetics. Genetics, 162:2025–2035, 12 2002. ISSN 1943-2631. https://doi.org/10.1093/genetics/162.4.2025.
- Differential structure of hippocampal ca1 pyramidal neurons in the human and mouse. Cerebral Cortex, 7 2019. ISSN 1047-3211. https://doi.org/10.1093/cercor/bhz122.
- Approximate bayesian computation with the wasserstein distance. Journal of the Royal Statistical Society Series B: Statistical Methodology, 81:235–269, 4 2019. ISSN 1369-7412. https://doi.org/10.1111/rssb.12312.
- Variational inference: A review for statisticians. Journal of the American Statistical Association, 112:859–877, 4 2017. ISSN 0162-1459. https://doi.org/10.1080/01621459.2017.1285773.
- Displacement interpolation using lagrangian mass transport. In Proceedings of the 2011 SIGGRAPH Asia Conference, pages 1–12. ACM, 12 2011. ISBN 9781450308076. https://doi.org/10.1145/2024156.2024192.
- Biodynamo: a modular platform for high-performance agent-based simulation. Bioinformatics, 9 2021. ISSN 1367-4803. https://doi.org/10.1093/bioinformatics/btab649.
- High-performance and scalable agent-based simulation with biodynamo. In Proceedings of the 28th ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming, pages 174–188. ACM, 2 2023. ISBN 9798400700156. https://doi.org/10.1145/3572848.3577480.
- Handbook of Markov Chain Monte Carlo. Chapman and Hall/CRC, 5 2011. ISBN 9780429138508. https://doi.org/10.1201/b10905.
- Modelling directional guidance and motility regulation in cell migration. Bulletin of Mathematical Biology, 68:25–52, 1 2006. ISSN 0092-8240. https://doi.org/10.1007/s11538-005-9028-x.
- Random walk models in biology. Journal of The Royal Society Interface, 5:813–834, 8 2008. ISSN 1742-5689. https://doi.org/10.1098/rsif.2008.0014.
- Approximate bayesian computation (ABC) in practice. Trends in Ecology & Evolution, 25:410–418, 7 2010. ISSN 01695347. https://doi.org/10.1016/j.tree.2010.04.001.
- One rule to grow them all: A general theory of neuronal branching and its practical application. PLoS Computational Biology, 6:e1000877, 8 2010. ISSN 1553-7358. https://doi.org/10.1371/journal.pcbi.1000877.
- Javier DeFelipe. Types of neurons, synaptic connections and chemical characteristics of cells immunoreactive for calbindin-d28k, parvalbumin and calretinin in the neocortex. Journal of Chemical Neuroanatomy, 14:1–19, 12 1997. ISSN 08910618. https://doi.org/10.1016/S0891-0618(97)10013-8.
- The pyramidal neuron of the cerebral cortex: Morphological and chemical characteristics of the synaptic inputs. Progress in Neurobiology, 39:563–607, 12 1992. ISSN 03010082. https://doi.org/10.1016/0301-0082(92)90015-7.
- Comprehensive morpho-electrotonic analysis shows 2 distinct classes of l2 and l3 pyramidal neurons in human temporal cortex. Cerebral Cortex, 27:5398–5414, 11 2017. ISSN 1047-3211. https://doi.org/10.1093/cercor/bhx226.
- Sequential monte carlo samplers. Journal of the Royal Statistical Society Series B: Statistical Methodology, 68:411–436, 6 2006. ISSN 1369-7412. https://doi.org/10.1111/j.1467-9868.2006.00553.x.
- An adaptive sequential monte carlo method for approximate bayesian computation. Statistics and Computing, 22:1009–1020, 9 2012. ISSN 0960-3174. https://doi.org/10.1007/s11222-011-9271-y.
- The fréchet distance between multivariate normal distributions. Journal of Multivariate Analysis, 12:450–455, 9 1982. ISSN 0047259X. https://doi.org/10.1016/0047-259X(82)90077-X.
- Abcpy : A high-performance computing perspective to approximate bayesian computation. Journal of Statistical Software, 100, 2021. ISSN 1548-7660. https://doi.org/10.18637/jss.v100.i07.
- Elston. Pyramidal cells in prefrontal cortex of primates: marked differences in neuronal structure among species. Frontiers in Neuroanatomy, 2011. ISSN 16625129. https://doi.org/10.3389/fnana.2011.00002.
- Pot: Python optimal transport. Journal of Machine Learning Research, 22(78):1–8, 2021.
- γ𝛾\gammaitalic_γ-abc: Outlier-robust approximate bayesian computation based on a robust divergence estimator. In Arindam Banerjee and Kenji Fukumizu, editors, Proceedings of The 24th International Conference on Artificial Intelligence and Statistics, volume 130 of Proceedings of Machine Learning Research, pages 1783–1791. PMLR, 13–15 Apr 2021.
- Alan E. Gelfand and Adrian F. M. Smith. Sampling-based approaches to calculating marginal densities. Journal of the American Statistical Association, 85:398, 6 1990. ISSN 01621459. https://doi.org/10.2307/2289776.
- Stochastic relaxation, gibbs distributions, and the bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-6:721–741, 11 1984. ISSN 0162-8828. https://doi.org/10.1109/TPAMI.1984.4767596.
- Learning generative models with sinkhorn divergences. In Amos Storkey and Fernando Perez-Cruz, editors, Proceedings of the Twenty-First International Conference on Artificial Intelligence and Statistics, volume 84 of Proceedings of Machine Learning Research, pages 1608–1617. PMLR, 09–11 Apr 2018.
- Predicting axonal response to molecular gradients with a computational model of filopodial dynamics. Neural Computation, 16:2221–2243, 11 2004. ISSN 0899-7667. https://doi.org/10.1162/0899766041941934.
- Bruce P Graham and Arjen van Ooyen. Mathematical modelling and numerical simulation of the morphological development of neurons. BMC Neuroscience, 7:S9, 10 2006. ISSN 1471-2202. https://doi.org/10.1186/1471-2202-7-S1-S9.
- Dynamics of outgrowth in a continuum model of neurite elongation. Journal of Computational Neuroscience, 20:43–60, 2 2006. ISSN 0929-5313. https://doi.org/10.1007/s10827-006-5330-3.
- P. Hamilton. A language to describe the growth of neurites. Biological Cybernetics, 68:559–565, 4 1993. ISSN 0340-1200. https://doi.org/10.1007/BF00200816.
- A unifying theory of branching morphogenesis. Cell, 171:242–255.e27, 9 2017. ISSN 00928674. https://doi.org/10.1016/j.cell.2017.08.026.
- Beyond molecular codes: Simple rules to wire complex brains. Cell, 163:285–291, 10 2015. ISSN 00928674. https://doi.org/10.1016/j.cell.2015.09.031.
- W. K. Hastings. Monte carlo sampling methods using markov chains and their applications. Biometrika, 57:97, 4 1970. ISSN 00063444. https://doi.org/10.2307/2334940.
- Suzana Herculano-Houzel. The human brain in numbers: a linearly scaled-up primate brain. Frontiers in Human Neuroscience, 3, 2009. ISSN 16625161. https://doi.org/10.3389/neuro.09.031.2009.
- Salib: An open-source python library for sensitivity analysis. The Journal of Open Source Software, 2:97, 1 2017. ISSN 2475-9066. https://doi.org/10.21105/joss.00097.
- Kinesin superfamily motor proteins and intracellular transport. Nature Reviews Molecular Cell Biology, 10:682–696, 10 2009. ISSN 1471-0072. https://doi.org/10.1038/nrm2774.
- Molecular motors in neurons: Transport mechanisms and roles in brain function, development, and disease. Neuron, 68:610–638, 11 2010. ISSN 08966273. https://doi.org/10.1016/j.neuron.2010.09.039.
- Competitive dynamics during resource-driven neurite outgrowth. PLoS ONE, 9:e86741, 2 2014. ISSN 1932-6203. https://doi.org/10.1371/journal.pone.0086741.
- A quantitative description of membrane current and its application to conduction and excitation in nerve. The Journal of Physiology, 117, 8 1952. ISSN 0022-3751. https://doi.org/10.1113/jphysiol.1952.sp004764.
- Bai Jiang. Approximate bayesian computation with kullback-leibler divergence as data discrepancy. In Amos Storkey and Fernando Perez-Cruz, editors, Proceedings of the Twenty-First International Conference on Artificial Intelligence and Statistics, volume 84 of Proceedings of Machine Learning Research, pages 1711–1721. PMLR, 09–11 Apr 2018.
- An introduction to variational methods for graphical models. Machine Learning, 37(2):183–233, 1999.
- Axonal transport of amyloid precursor protein is mediated by direct binding to the kinesin light chain subunit of kinesin-i. Neuron, 28:449–459, 11 2000. ISSN 08966273. https://doi.org/10.1016/S0896-6273(00)00124-0.
- A generative growth model for thalamocortical axonal branching in primary visual cortex. PLOS Computational Biology, 16:e1007315, 2 2020. ISSN 1553-7358. https://doi.org/10.1371/journal.pcbi.1007315.
- Biologically plausible models of neurite outgrowth. In Development, Dynamics and Pathiology of Neuronal Networks: from Molecules to Functional Circuits, volume 147 of Progress in Brain Research, pages 67–80. Elsevier, 2005. https://doi.org/10.1016/S0079-6123(04)47006-X.
- Johannes K. Krottje and Arjen van Ooyen. A mathematical framework for modeling axon guidance. Bulletin of Mathematical Biology, 69:3–31, 1 2007. ISSN 0092-8240. https://doi.org/10.1007/s11538-006-9142-4.
- Bayesian inference of agent-based models: a tool for studying kidney branching morphogenesis. Journal of Mathematical Biology, 76:1673–1697, 6 2018. ISSN 0303-6812. https://doi.org/10.1007/s00285-018-1208-z.
- Deep learning. Nature, 521:436–444, 5 2015. ISSN 0028-0836. https://doi.org/10.1038/nature14539.
- A. Lee and K. Latuszynski. Variance bounding and geometric ergodicity of markov chain monte carlo kernels for approximate bayesian computation. Biometrika, 101:655–671, 9 2014. ISSN 0006-3444. https://doi.org/10.1093/biomet/asu027.
- Anthony Lee. On the choice of mcmc kernels for approximate bayesian computation with smc samplers. In Proceedings of the 2012 Winter Simulation Conference (WSC), pages 1–12. IEEE, 12 2012. ISBN 978-1-4673-4782-2. https://doi.org/10.1109/WSC.2012.6465212.
- Calibration of multi-parameter models of avascular tumor growth using time resolved microscopy data. Scientific Reports, 8:14558, 9 2018. ISSN 2045-2322. https://doi.org/10.1038/s41598-018-32347-9.
- Aristid Lindenmayer. Mathematical models for cellular interactions in development i. filaments with one-sided inputs. Journal of Theoretical Biology, 18:280–299, 3 1968. ISSN 00225193. https://doi.org/10.1016/0022-5193(68)90079-9.
- R. Linsker. From basic network principles to neural architecture: emergence of spatial-opponent cells. Proceedings of the National Academy of Sciences, 83:7508–7512, 10 1986. ISSN 0027-8424. https://doi.org/10.1073/pnas.83.19.7508.
- Kif1b is essential for mrna localization in oligodendrocytes and development of myelinated axons. Nature Genetics, 41:854–858, 7 2009. ISSN 1061-4036. https://doi.org/10.1038/ng.376.
- Markov chain monte carlo without likelihoods. Proceedings of the National Academy of Sciences, 100:15324–15328, 12 2003. ISSN 0027-8424. https://doi.org/10.1073/pnas.0306899100.
- Interneurons of the neocortical inhibitory system. Nature Reviews Neuroscience, 5:793–807, 10 2004. ISSN 1471-003X. https://doi.org/10.1038/nrn1519.
- Computing bayes: Bayesian computation from 1763 to the 21st century. 4 2020.
- Approximating Bayes in the 21st Century. Statistical Science, 39(1):20 – 45, 2024. https://doi.org/10.1214/22-STS875.
- Continuum model for tubulin-driven neurite elongation. Neurocomputing, 58-60:511–516, 6 2004. ISSN 09252312. https://doi.org/10.1016/j.neucom.2004.01.088.
- Equation of state calculations by fast computing machines. The Journal of Chemical Physics, 21:1087–1092, 6 1953. ISSN 0021-9606. https://doi.org/10.1063/1.1699114.
- Approximate bayesian computation with the sliced-wasserstein distance. In ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 5470–5474, 2020. https://doi.org/10.1109/ICASSP40776.2020.9054735.
- Encyclopedia of Computational Mechanics Second Edition, chapter Predictive Computational Science: Computer Predictions in the Presence of Uncertainty, pages 1–26. John Wiley & Sons, Ltd, 12 2017. https://doi.org/10.1002/9781119176817.ecm2101.
- Bluebrain/neurom: v3.1.0, 10 2021.
- K2-abc: Approximate bayesian computation with kernel embeddings. In Arthur Gretton and Christian C. Robert, editors, Proceedings of the 19th International Conference on Artificial Intelligence and Statistics, volume 51 of Proceedings of Machine Learning Research, pages 398–407, Cadiz, Spain, 09–11 May 2016. PMLR.
- Bayesian synthetic likelihood. Journal of Computational and Graphical Statistics, 27:1–11, 1 2018. ISSN 1061-8600. https://doi.org/10.1080/10618600.2017.1302882. doi: 10.1080/10618600.2017.1302882.
- Population growth of human y chromosomes: a study of y chromosome microsatellites. Molecular Biology and Evolution, 16:1791–1798, 12 1999. ISSN 0737-4038. https://doi.org/10.1093/oxfordjournals.molbev.a026091.
- Modeling neuron growth using isogeometric collocation based phase field method. Scientific Reports, 12:8120, 5 2022. ISSN 2045-2322. https://doi.org/10.1038/s41598-022-12073-z.
- Lack of confidence in approximate bayesian computation model choice. Proceedings of the National Academy of Sciences, 108:15112–15117, 9 2011. ISSN 0027-8424. https://doi.org/10.1073/pnas.1102900108.
- Bayesian inference using gaussian process surrogates in cancer modeling. Computer Methods in Applied Mechanics and Engineering, 399:115412, 9 2022. ISSN 00457825. https://doi.org/10.1016/j.cma.2022.115412.
- Approximate bayesian inference for latent gaussian models by using integrated nested laplace approximations. Journal of the Royal Statistical Society Series B: Statistical Methodology, 71:319–392, 4 2009. ISSN 1369-7412. https://doi.org/10.1111/j.1467-9868.2008.00700.x.
- Graphical simulation of early development of the cerebral cortex. Computer Methods and Programs in Biomedicine, 59:107–114, 5 1999. ISSN 01692607. https://doi.org/10.1016/S0169-2607(98)00096-0.
- A critical role for myosin iib in dendritic spine morphology and synaptic function. Neuron, 49:175–182, 1 2006. ISSN 08966273. https://doi.org/10.1016/j.neuron.2005.12.017.
- Andrea Saltelli. Making best use of model evaluations to compute sensitivity indices. Computer Physics Communications, 145:280–297, 5 2002. ISSN 00104655. https://doi.org/10.1016/S0010-4655(02)00280-1.
- Global Sensitivity Analysis: The Primer, volume 1. John Wiley and Sons Ltd, 1 edition, 2 2008.
- Variance based sensitivity analysis of model output. design and estimator for the total sensitivity index. Computer Physics Communications, 181:259–270, 2 2010. ISSN 00104655. https://doi.org/10.1016/j.cpc.2009.09.018.
- The origin of neuronal polarization: a model of axon formation. Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences, 351:1147–1156, 9 1996. ISSN 0962-8436. https://doi.org/10.1098/rstb.1996.0099.
- Spatial control of branching within dendritic arbors by dynein-dependent transport of rab5-endosomes. Nature Cell Biology, 10:1164–1171, 10 2008. ISSN 1465-7392. https://doi.org/10.1038/ncb1776.
- Troy Shinbrot. Simulated morphogenesis of developmental folds due to proliferative pressure. Journal of Theoretical Biology, 242:764–773, 10 2006. ISSN 00225193. https://doi.org/10.1016/j.jtbi.2006.04.021.
- Dynamic instability of dendrite tips generates the highly branched morphologies of sensory neurons. Science Advances, 8, 7 2022. ISSN 2375-2548. https://doi.org/10.1126/sciadv.abn0080.
- Sequential monte carlo without likelihoods. Proceedings of the National Academy of Sciences, 104:1760–1765, 2 2007. ISSN 0027-8424. https://doi.org/10.1073/pnas.0607208104.
- Handbook of Approximate Bayesian Computation. CRC Press, 1st edition, 2019.
- I.M Sobol. Global sensitivity indices for nonlinear mathematical models and their monte carlo estimates. Mathematics and Computers in Simulation, 55:271–280, 2 2001. ISSN 03784754. https://doi.org/10.1016/S0378-4754(00)00270-6.
- Inferring coalescence times from dna sequence data. Genetics, 145:505–518, 2 1997. ISSN 1943-2631. https://doi.org/10.1093/genetics/145.2.505.
- The Computing Dendrite, chapter Introduction to Dendritic Morphology, pages 3–22. Springer, New York, NY, 2014. https://doi.org/10.1007/978-1-4614-8094-5_1.
- Non-parametric algorithmic generation of neuronal morphologies. Neuroinformatics, 6:257–277, 12 2008. ISSN 1539-2791. https://doi.org/10.1007/s12021-008-9026-x.
- Changes in the proportion of inhibitory interneuron types from sensory to executive areas of the primate neocortex: Implications for the origins of working memory representations. Cerebral Cortex, 30:4544–4562, 6 2020. ISSN 1047-3211. https://doi.org/10.1093/cercor/bhaa056.
- Competition for tubulin between growing neurites during development. Neurocomputing, 38-40:73–78, 6 2001. ISSN 09252312. https://doi.org/10.1016/S0925-2312(01)00487-8.
- Cling – the new interactive interpreter for root 6. Journal of Physics: Conference Series, 396:052071, 12 2012. ISSN 1742-6588. https://doi.org/10.1088/1742-6596/396/5/052071.
- Calibration of agent based models for monophasic and biphasic tumour growth using approximate bayesian computation. Journal of Mathematical Biology, 88:28, 3 2024. ISSN 0303-6812. https://doi.org/10.1007/s00285-024-02045-4.
- Anthony M. Zador. A critique of pure learning and what artificial neural networks can learn from animal brains. Nature Communications, 10, 12 2019. ISSN 2041-1723. https://doi.org/10.1038/s41467-019-11786-6.
- Dynein is required for polarized dendritic transport and uniform microtubule orientation in axons. Nature Cell Biology, 10:1172–1180, 10 2008. ISSN 1465-7392. https://doi.org/10.1038/ncb1777.
- A framework for modeling the growth and development of neurons and networks. Frontiers in Computational Neuroscience, 3, 2009. ISSN 16625188. https://doi.org/10.3389/neuro.10.025.2009.
- Tobias Duswald (4 papers)
- Lukas Breitwieser (7 papers)
- Thomas Thorne (7 papers)
- Barbara Wohlmuth (100 papers)
- Roman Bauer (9 papers)