Confidence and second-order errors in cortical circuits (2309.16046v3)
Abstract: Minimization of cortical prediction errors has been considered a key computational goal of the cerebral cortex underlying perception, action and learning. However, it is still unclear how the cortex should form and use information about uncertainty in this process. Here, we formally derive neural dynamics that minimize prediction errors under the assumption that cortical areas must not only predict the activity in other areas and sensory streams but also jointly project their confidence (inverse expected uncertainty) in their predictions. In the resulting neuronal dynamics, the integration of bottom-up and top-down cortical streams is dynamically modulated based on confidence in accordance with the Bayesian principle. Moreover, the theory predicts the existence of cortical second-order errors, comparing confidence and actual performance. These errors are propagated through the cortical hierarchy alongside classical prediction errors and are used to learn the weights of synapses responsible for formulating confidence. We propose a detailed mapping of the theory to cortical circuitry, discuss entailed functional interpretations and provide potential directions for experimental work.
- “Statistically optimal perception and learning: from behavior to neural representations” In Trends in cognitive sciences 14.3 Elsevier, 2010, pp. 119–130
- “Probabilistic brains: knowns and unknowns” In Nature neuroscience 16.9 Nature Publishing Group US New York, 2013, pp. 1170–1178
- Ádám Koblinger, József Fiser and Máté Lengyel “Representations of uncertainty: where art thou?” In Current Opinion in Behavioral Sciences 38 Elsevier, 2021, pp. 150–162
- Marc O Ernst and Martin S Banks “Humans integrate visual and haptic information in a statistically optimal fashion” In Nature 415.6870 Nature Publishing Group, 2002, pp. 429–433
- Barry E Stein and Terrence R Stanford “Multisensory integration: current issues from the perspective of the single neuron” In Nature reviews neuroscience 9.4 Nature Publishing Group UK London, 2008, pp. 255–266
- Roozbeh Kiani and Michael N Shadlen “Representation of confidence associated with a decision by neurons in the parietal cortex” In Science 324.5928 American Association for the Advancement of Science, 2009, pp. 759–764
- Konrad P Körding and Daniel M Wolpert “Bayesian integration in sensorimotor learning” In Nature 427.6971 Nature Publishing Group UK London, 2004, pp. 244–247
- Timothy R Darlington, Jeffrey M Beck and Stephen G Lisberger “Neural implementation of Bayesian inference in a sensorimotor behavior” In Nature neuroscience 21.10 Nature Publishing Group US New York, 2018, pp. 1442–1451
- “Dynamic reweighting of visual and vestibular cues during self-motion perception” In Journal of Neuroscience 29.49 Soc Neuroscience, 2009, pp. 15601–15612
- “Trial-to-trial, uncertainty-based adjustment of decision boundaries in visual categorization” In Proceedings of the National Academy of Sciences 110.50 National Acad Sciences, 2013, pp. 20332–20337
- Uta Noppeney “Perceptual inference, learning, and attention in a multisensory world” In Annual review of neuroscience 44 Annual Reviews, 2021, pp. 449–473
- Floris P De Lange, Micha Heilbron and Peter Kok “How do expectations shape perception?” In Trends in cognitive sciences 22.9 Elsevier, 2018, pp. 764–779
- Rajesh PN Rao and Dana H Ballard “Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects” In Nature neuroscience 2.1 Nature Publishing Group, 1999, pp. 79–87
- Karl Friston “A theory of cortical responses” In Philosophical transactions of the Royal Society B: Biological sciences 360.1456 The Royal Society London, 2005, pp. 815–836
- Georg B Keller and Thomas D Mrsic-Flogel “Predictive processing: a canonical cortical computation” In Neuron 100.2 Elsevier, 2018, pp. 424–435
- Andy Clark “Whatever next? Predictive brains, situated agents, and the future of cognitive science” In Behavioral and brain sciences 36.3 Cambridge University Press, 2013, pp. 181–204
- Andy Clark “The many faces of precision” In Frontiers in psychology 4 Frontiers Media SA, 2013, pp. 270
- Karl Friston “Does predictive coding have a future?” In Nature neuroscience 21.8 Nature Publishing Group US New York, 2018, pp. 1019–1021
- Daniel Yon and Chris D Frith “Precision and the Bayesian brain” In Current Biology 31.17 Elsevier, 2021, pp. R1026–R1032
- “Attention, uncertainty, and free-energy” In Frontiers in human neuroscience 4 Frontiers, 2010, pp. 215
- “Attention reverses the effect of prediction in silencing sensory signals” In Cerebral cortex 22.9 Oxford University Press, 2012, pp. 2197–2206
- Jiefeng Jiang, Christopher Summerfield and Tobias Egner “Attention sharpens the distinction between expected and unexpected percepts in the visual brain” In Journal of Neuroscience 33.47 Soc Neuroscience, 2013, pp. 18438–18447
- “Precise minds in uncertain worlds: predictive coding in autism.” In Psychological review 121.4 American Psychological Association, 2014, pp. 649
- “The predictive coding account of psychosis” In Biological psychiatry 84.9 Elsevier, 2018, pp. 634–643
- “Hallucinations and strong priors” In Trends in cognitive sciences 23.2 Elsevier, 2019, pp. 114–127
- Karl Friston “Computational psychiatry: from synapses to sentience” In Molecular Psychiatry Nature Publishing Group, 2022, pp. 1–13
- “Cerebral hierarchies: predictive processing, precision and the pulvinar” In Philosophical Transactions of the Royal Society B: Biological Sciences 370.1668 The Royal Society, 2015, pp. 20140169
- “The computational, pharmacological, and physiological determinants of sensory learning under uncertainty” In Current Biology 31.1 Elsevier, 2021, pp. 163–172
- “Precision weighting of cortical unsigned prediction error signals benefits learning, is mediated by dopamine, and is impaired in psychosis” In Molecular psychiatry 26.9 Nature Publishing Group, 2021, pp. 5320–5333
- “Expectations about precision bias metacognition and awareness.” In Journal of Experimental Psychology: General American Psychological Association, 2023
- Beren Millidge, Anil Seth and Christopher L Buckley “Predictive coding: a theoretical and experimental review” In arXiv preprint arXiv:2107.12979, 2021
- “The neural coding framework for learning generative models” In Nature communications 13.1 Nature Publishing Group UK London, 2022, pp. 2064
- Radford M Neal and Geoffrey E Hinton “A view of the EM algorithm that justifies incremental, sparse, and other variants” In Learning in graphical models Springer, 1998, pp. 355–368
- “On the choice of metric in gradient-based theories of brain function” In PLoS computational biology 16.4 Public Library of Science San Francisco, CA USA, 2020, pp. e1007640
- “Dendritic cortical microcircuits approximate the backpropagation algorithm” In Advances in neural information processing systems 31, 2018
- “Layer 6b is driven by intracortical long-range projection neurons” In Cell reports 30.10 Elsevier, 2020, pp. 3492–3505
- “Anatomy of hierarchy: feedforward and feedback pathways in macaque visual cortex” In Journal of Comparative Neurology 522.1 Wiley Online Library, 2014, pp. 225–259
- Caspar M Schwiedrzik and Winrich A Freiwald “High-level prediction signals in a low-level area of the macaque face-processing hierarchy” In Neuron 96.1 Elsevier, 2017, pp. 89–97
- David M Schneider, Janani Sundararajan and Richard Mooney “A cortical filter that learns to suppress the acoustic consequences of movement” In Nature 561.7723 Nature Publishing Group UK London, 2018, pp. 391–395
- Aleena R Garner and Georg B Keller “A cortical circuit for audio-visual predictions” In Nature neuroscience 25.1 Nature Publishing Group US New York, 2022, pp. 98–105
- Pawel Zmarz and Georg B Keller “Mismatch receptive fields in mouse visual cortex” In Neuron 92.4 Elsevier, 2016, pp. 766–772
- Rebecca Jordan and Georg B Keller “Opposing influence of top-down and bottom-up input on excitatory layer 2/3 neurons in mouse primary visual cortex” In Neuron 108.6 Elsevier, 2020, pp. 1194–1206
- Debora Ledergerber and Matthew Evan Larkum “Properties of layer 6 pyramidal neuron apical dendrites” In Journal of Neuroscience 30.39 Soc Neuroscience, 2010, pp. 13031–13044
- “Where is the error? Hierarchical predictive coding through dendritic error computation” In Trends in Neurosciences Elsevier, 2022
- “Cortical interneurons that specialize in disinhibitory control” In Nature 503.7477 Nature Publishing Group, 2013, pp. 521–524
- “A disinhibitory circuit mediates motor integration in the somatosensory cortex” In Nature neuroscience 16.11 Nature Publishing Group, 2013, pp. 1662–1670
- “Long-range and local circuits for top-down modulation of visual cortex processing” In Science 345.6197 American Association for the Advancement of Science, 2014, pp. 660–665
- Helen C Barron, Ryszard Auksztulewicz and Karl Friston “Prediction and memory: A predictive coding account” In Progress in neurobiology 192 Elsevier, 2020, pp. 101821
- “Top-down input modulates visual context processing through an interneuron-specific circuit” In Cell reports 42.9 Elsevier, 2023
- “Layer-specific modulation of neocortical dendritic inhibition during active wakefulness” In Science 355.6328 American Association for the Advancement of Science, 2017, pp. 954–959
- “Uncertainty-modulated prediction errors in cortical microcircuits” In bioRxiv Cold Spring Harbor Laboratory, 2023, pp. 2023–05
- “Principles of connectivity among morphologically defined cell types in adult neocortex” In Science 350.6264 American Association for the Advancement of Science, 2015, pp. aac9462
- “Dendritic NMDA receptors in parvalbumin neurons enable strong and stable neuronal assemblies” In Elife 8 eLife Sciences Publications, Ltd, 2019
- “Pyramidal neurons in prefrontal cortex receive subtype-specific forms of excitation and inhibition” In Neuron 81.1 Elsevier, 2014, pp. 61–68
- “Cell-type-specific inhibitory circuitry from a connectomic census of mouse visual cortex” In bioRxiv Cold Spring Harbor Laboratory Preprints, 2023
- Sean M O’Toole, Hassana K Oyibo and Georg B Keller “Molecularly targetable cell types in mouse visual cortex have distinguishable prediction error responses” In Neuron 111.18 Elsevier, 2023, pp. 2918–2928
- “Adaptive whitening in neural populations with gain-modulating interneurons” In International Conference on Machine Learning, 2023, pp. 8902–8921 PMLR
- “Latent Equilibrium: Arbitrarily fast computation with arbitrarily slow neurons” In Advances in Neural Information Processing Systems 34, 2021
- Charles D Gilbert and Wu Li “Top-down influences on visual processing” In Nature Reviews Neuroscience 14.5 Nature Publishing Group UK London, 2013, pp. 350–363
- “Distinct feedforward and feedback effects of microstimulation in visual cortex reveal neural mechanisms of texture segregation” In Neuron 95.1 Elsevier, 2017, pp. 209–220
- “Learning efficient backprojections across cortical hierarchies in real time” In International Conference on Artificial Neural Networks, 2023, pp. 556–559 Springer
- “Learning on arbitrary graph topologies via predictive coding” In Advances in neural information processing systems 35, 2022, pp. 38232–38244
- Mototaka Suzuki, Cyriel M.A. Pennartz and Jaan Aru “How deep is the brain? The shallow brain hypothesis” In Nature Reviews Neuroscience, 2023 DOI: 10.1038/s41583-023-00756-z
- “Attention is all you need” In Advances in neural information processing systems 30, 2017
- “Opening holes in the blanket of inhibition: localized lateral disinhibition by VIP interneurons” In Journal of neuroscience 36.12 Soc Neuroscience, 2016, pp. 3471–3480
- “Efficient coding theory of dynamic attentional modulation” In PLoS Biology 20.12 Public Library of Science San Francisco, CA USA, 2022, pp. e3001889
- J-F Cardoso “Infomax and maximum likelihood for blind source separation” In IEEE Signal processing letters 4.4 IEEE, 1997, pp. 112–114
- “A review of uncertainty quantification in deep learning: Techniques, applications and challenges” In Information fusion 76 Elsevier, 2021, pp. 243–297
- Oscar Marín “Interneuron dysfunction in psychiatric disorders” In Nature Reviews Neuroscience 13.2 Nature Publishing Group UK London, 2012, pp. 107–120
- Vikaas S Sohal and John LR Rubenstein “Excitation-inhibition balance as a framework for investigating mechanisms in neuropsychiatric disorders” In Molecular psychiatry 24.9 Nature Publishing Group, 2019, pp. 1248–1257