Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
143 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Confidence and second-order errors in cortical circuits (2309.16046v3)

Published 27 Sep 2023 in q-bio.NC and cs.NE

Abstract: Minimization of cortical prediction errors has been considered a key computational goal of the cerebral cortex underlying perception, action and learning. However, it is still unclear how the cortex should form and use information about uncertainty in this process. Here, we formally derive neural dynamics that minimize prediction errors under the assumption that cortical areas must not only predict the activity in other areas and sensory streams but also jointly project their confidence (inverse expected uncertainty) in their predictions. In the resulting neuronal dynamics, the integration of bottom-up and top-down cortical streams is dynamically modulated based on confidence in accordance with the Bayesian principle. Moreover, the theory predicts the existence of cortical second-order errors, comparing confidence and actual performance. These errors are propagated through the cortical hierarchy alongside classical prediction errors and are used to learn the weights of synapses responsible for formulating confidence. We propose a detailed mapping of the theory to cortical circuitry, discuss entailed functional interpretations and provide potential directions for experimental work.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (70)
  1. “Statistically optimal perception and learning: from behavior to neural representations” In Trends in cognitive sciences 14.3 Elsevier, 2010, pp. 119–130
  2. “Probabilistic brains: knowns and unknowns” In Nature neuroscience 16.9 Nature Publishing Group US New York, 2013, pp. 1170–1178
  3. Ádám Koblinger, József Fiser and Máté Lengyel “Representations of uncertainty: where art thou?” In Current Opinion in Behavioral Sciences 38 Elsevier, 2021, pp. 150–162
  4. Marc O Ernst and Martin S Banks “Humans integrate visual and haptic information in a statistically optimal fashion” In Nature 415.6870 Nature Publishing Group, 2002, pp. 429–433
  5. Barry E Stein and Terrence R Stanford “Multisensory integration: current issues from the perspective of the single neuron” In Nature reviews neuroscience 9.4 Nature Publishing Group UK London, 2008, pp. 255–266
  6. Roozbeh Kiani and Michael N Shadlen “Representation of confidence associated with a decision by neurons in the parietal cortex” In Science 324.5928 American Association for the Advancement of Science, 2009, pp. 759–764
  7. Konrad P Körding and Daniel M Wolpert “Bayesian integration in sensorimotor learning” In Nature 427.6971 Nature Publishing Group UK London, 2004, pp. 244–247
  8. Timothy R Darlington, Jeffrey M Beck and Stephen G Lisberger “Neural implementation of Bayesian inference in a sensorimotor behavior” In Nature neuroscience 21.10 Nature Publishing Group US New York, 2018, pp. 1442–1451
  9. “Dynamic reweighting of visual and vestibular cues during self-motion perception” In Journal of Neuroscience 29.49 Soc Neuroscience, 2009, pp. 15601–15612
  10. “Trial-to-trial, uncertainty-based adjustment of decision boundaries in visual categorization” In Proceedings of the National Academy of Sciences 110.50 National Acad Sciences, 2013, pp. 20332–20337
  11. Uta Noppeney “Perceptual inference, learning, and attention in a multisensory world” In Annual review of neuroscience 44 Annual Reviews, 2021, pp. 449–473
  12. Floris P De Lange, Micha Heilbron and Peter Kok “How do expectations shape perception?” In Trends in cognitive sciences 22.9 Elsevier, 2018, pp. 764–779
  13. Rajesh PN Rao and Dana H Ballard “Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects” In Nature neuroscience 2.1 Nature Publishing Group, 1999, pp. 79–87
  14. Karl Friston “A theory of cortical responses” In Philosophical transactions of the Royal Society B: Biological sciences 360.1456 The Royal Society London, 2005, pp. 815–836
  15. Georg B Keller and Thomas D Mrsic-Flogel “Predictive processing: a canonical cortical computation” In Neuron 100.2 Elsevier, 2018, pp. 424–435
  16. Andy Clark “Whatever next? Predictive brains, situated agents, and the future of cognitive science” In Behavioral and brain sciences 36.3 Cambridge University Press, 2013, pp. 181–204
  17. Andy Clark “The many faces of precision” In Frontiers in psychology 4 Frontiers Media SA, 2013, pp. 270
  18. Karl Friston “Does predictive coding have a future?” In Nature neuroscience 21.8 Nature Publishing Group US New York, 2018, pp. 1019–1021
  19. Daniel Yon and Chris D Frith “Precision and the Bayesian brain” In Current Biology 31.17 Elsevier, 2021, pp. R1026–R1032
  20. “Attention, uncertainty, and free-energy” In Frontiers in human neuroscience 4 Frontiers, 2010, pp. 215
  21. “Attention reverses the effect of prediction in silencing sensory signals” In Cerebral cortex 22.9 Oxford University Press, 2012, pp. 2197–2206
  22. Jiefeng Jiang, Christopher Summerfield and Tobias Egner “Attention sharpens the distinction between expected and unexpected percepts in the visual brain” In Journal of Neuroscience 33.47 Soc Neuroscience, 2013, pp. 18438–18447
  23. “Precise minds in uncertain worlds: predictive coding in autism.” In Psychological review 121.4 American Psychological Association, 2014, pp. 649
  24. “The predictive coding account of psychosis” In Biological psychiatry 84.9 Elsevier, 2018, pp. 634–643
  25. “Hallucinations and strong priors” In Trends in cognitive sciences 23.2 Elsevier, 2019, pp. 114–127
  26. Karl Friston “Computational psychiatry: from synapses to sentience” In Molecular Psychiatry Nature Publishing Group, 2022, pp. 1–13
  27. “Cerebral hierarchies: predictive processing, precision and the pulvinar” In Philosophical Transactions of the Royal Society B: Biological Sciences 370.1668 The Royal Society, 2015, pp. 20140169
  28. “The computational, pharmacological, and physiological determinants of sensory learning under uncertainty” In Current Biology 31.1 Elsevier, 2021, pp. 163–172
  29. “Precision weighting of cortical unsigned prediction error signals benefits learning, is mediated by dopamine, and is impaired in psychosis” In Molecular psychiatry 26.9 Nature Publishing Group, 2021, pp. 5320–5333
  30. “Expectations about precision bias metacognition and awareness.” In Journal of Experimental Psychology: General American Psychological Association, 2023
  31. Beren Millidge, Anil Seth and Christopher L Buckley “Predictive coding: a theoretical and experimental review” In arXiv preprint arXiv:2107.12979, 2021
  32. “The neural coding framework for learning generative models” In Nature communications 13.1 Nature Publishing Group UK London, 2022, pp. 2064
  33. Radford M Neal and Geoffrey E Hinton “A view of the EM algorithm that justifies incremental, sparse, and other variants” In Learning in graphical models Springer, 1998, pp. 355–368
  34. “On the choice of metric in gradient-based theories of brain function” In PLoS computational biology 16.4 Public Library of Science San Francisco, CA USA, 2020, pp. e1007640
  35. “Dendritic cortical microcircuits approximate the backpropagation algorithm” In Advances in neural information processing systems 31, 2018
  36. “Layer 6b is driven by intracortical long-range projection neurons” In Cell reports 30.10 Elsevier, 2020, pp. 3492–3505
  37. “Anatomy of hierarchy: feedforward and feedback pathways in macaque visual cortex” In Journal of Comparative Neurology 522.1 Wiley Online Library, 2014, pp. 225–259
  38. Caspar M Schwiedrzik and Winrich A Freiwald “High-level prediction signals in a low-level area of the macaque face-processing hierarchy” In Neuron 96.1 Elsevier, 2017, pp. 89–97
  39. David M Schneider, Janani Sundararajan and Richard Mooney “A cortical filter that learns to suppress the acoustic consequences of movement” In Nature 561.7723 Nature Publishing Group UK London, 2018, pp. 391–395
  40. Aleena R Garner and Georg B Keller “A cortical circuit for audio-visual predictions” In Nature neuroscience 25.1 Nature Publishing Group US New York, 2022, pp. 98–105
  41. Pawel Zmarz and Georg B Keller “Mismatch receptive fields in mouse visual cortex” In Neuron 92.4 Elsevier, 2016, pp. 766–772
  42. Rebecca Jordan and Georg B Keller “Opposing influence of top-down and bottom-up input on excitatory layer 2/3 neurons in mouse primary visual cortex” In Neuron 108.6 Elsevier, 2020, pp. 1194–1206
  43. Debora Ledergerber and Matthew Evan Larkum “Properties of layer 6 pyramidal neuron apical dendrites” In Journal of Neuroscience 30.39 Soc Neuroscience, 2010, pp. 13031–13044
  44. “Where is the error? Hierarchical predictive coding through dendritic error computation” In Trends in Neurosciences Elsevier, 2022
  45. “Cortical interneurons that specialize in disinhibitory control” In Nature 503.7477 Nature Publishing Group, 2013, pp. 521–524
  46. “A disinhibitory circuit mediates motor integration in the somatosensory cortex” In Nature neuroscience 16.11 Nature Publishing Group, 2013, pp. 1662–1670
  47. “Long-range and local circuits for top-down modulation of visual cortex processing” In Science 345.6197 American Association for the Advancement of Science, 2014, pp. 660–665
  48. Helen C Barron, Ryszard Auksztulewicz and Karl Friston “Prediction and memory: A predictive coding account” In Progress in neurobiology 192 Elsevier, 2020, pp. 101821
  49. “Top-down input modulates visual context processing through an interneuron-specific circuit” In Cell reports 42.9 Elsevier, 2023
  50. “Layer-specific modulation of neocortical dendritic inhibition during active wakefulness” In Science 355.6328 American Association for the Advancement of Science, 2017, pp. 954–959
  51. “Uncertainty-modulated prediction errors in cortical microcircuits” In bioRxiv Cold Spring Harbor Laboratory, 2023, pp. 2023–05
  52. “Principles of connectivity among morphologically defined cell types in adult neocortex” In Science 350.6264 American Association for the Advancement of Science, 2015, pp. aac9462
  53. “Dendritic NMDA receptors in parvalbumin neurons enable strong and stable neuronal assemblies” In Elife 8 eLife Sciences Publications, Ltd, 2019
  54. “Pyramidal neurons in prefrontal cortex receive subtype-specific forms of excitation and inhibition” In Neuron 81.1 Elsevier, 2014, pp. 61–68
  55. “Cell-type-specific inhibitory circuitry from a connectomic census of mouse visual cortex” In bioRxiv Cold Spring Harbor Laboratory Preprints, 2023
  56. Sean M O’Toole, Hassana K Oyibo and Georg B Keller “Molecularly targetable cell types in mouse visual cortex have distinguishable prediction error responses” In Neuron 111.18 Elsevier, 2023, pp. 2918–2928
  57. “Adaptive whitening in neural populations with gain-modulating interneurons” In International Conference on Machine Learning, 2023, pp. 8902–8921 PMLR
  58. “Latent Equilibrium: Arbitrarily fast computation with arbitrarily slow neurons” In Advances in Neural Information Processing Systems 34, 2021
  59. Charles D Gilbert and Wu Li “Top-down influences on visual processing” In Nature Reviews Neuroscience 14.5 Nature Publishing Group UK London, 2013, pp. 350–363
  60. “Distinct feedforward and feedback effects of microstimulation in visual cortex reveal neural mechanisms of texture segregation” In Neuron 95.1 Elsevier, 2017, pp. 209–220
  61. “Learning efficient backprojections across cortical hierarchies in real time” In International Conference on Artificial Neural Networks, 2023, pp. 556–559 Springer
  62. “Learning on arbitrary graph topologies via predictive coding” In Advances in neural information processing systems 35, 2022, pp. 38232–38244
  63. Mototaka Suzuki, Cyriel M.A. Pennartz and Jaan Aru “How deep is the brain? The shallow brain hypothesis” In Nature Reviews Neuroscience, 2023 DOI: 10.1038/s41583-023-00756-z
  64. “Attention is all you need” In Advances in neural information processing systems 30, 2017
  65. “Opening holes in the blanket of inhibition: localized lateral disinhibition by VIP interneurons” In Journal of neuroscience 36.12 Soc Neuroscience, 2016, pp. 3471–3480
  66. “Efficient coding theory of dynamic attentional modulation” In PLoS Biology 20.12 Public Library of Science San Francisco, CA USA, 2022, pp. e3001889
  67. J-F Cardoso “Infomax and maximum likelihood for blind source separation” In IEEE Signal processing letters 4.4 IEEE, 1997, pp. 112–114
  68. “A review of uncertainty quantification in deep learning: Techniques, applications and challenges” In Information fusion 76 Elsevier, 2021, pp. 243–297
  69. Oscar Marín “Interneuron dysfunction in psychiatric disorders” In Nature Reviews Neuroscience 13.2 Nature Publishing Group UK London, 2012, pp. 107–120
  70. Vikaas S Sohal and John LR Rubenstein “Excitation-inhibition balance as a framework for investigating mechanisms in neuropsychiatric disorders” In Molecular psychiatry 24.9 Nature Publishing Group, 2019, pp. 1248–1257
Citations (1)

Summary

We haven't generated a summary for this paper yet.

Github Logo Streamline Icon: https://streamlinehq.com