Dice Question Streamline Icon: https://streamlinehq.com

Mechanism for adjusting a learned decision boundary under changing context

Determine the mechanism by which an agent that has learned a decision boundary subsequently adjusts that boundary in response to changes in task context.

Information Square Streamline Icon: https://streamlinehq.com

Background

Empirical studies show that agents flexibly trade speed and accuracy when payoff structures or task statistics change, implying adjustments to decision strategy after learning. Theoretical accounts based on accumulation-to-bound models posit boundary shifts, but neurophysiological evidence has struggled to identify corresponding changes in putative boundary neurons. The paper highlights that the mechanism for post-learning boundary adjustment is not yet clarified.

References

Theoretically, once the agent has learned a given decision boundary, it is not clear through what mechanism the boundary is subsequently adjusted in response to new contexts.

Sequential sampling without comparison to boundary through model-free reinforcement learning (2408.06080 - Esmaily et al., 12 Aug 2024) in Introduction