Dice Question Streamline Icon: https://streamlinehq.com

Dependence of the inferred dreaming parameter λ on pattern loading α

Determine the functional dependence of the inferred Hebbian unlearning parameter λ on the pattern-loading ratio α in the discrete Hopfield model when configurations are generated by the proposed non-Markovian active spin-flip dynamics and fitted using the deep hybrid Restricted Boltzmann Machine representation of the Hebbian-unlearned Hamiltonian. Clarify how λ varies with α across loading regimes to characterize the relationship λ(α).

Information Square Streamline Icon: https://streamlinehq.com

Background

The paper introduces an active, non-Markovian spin-flip dynamics for the discrete Hopfield model to mimic persistent noise, and uses a deep hybrid Restricted Boltzmann Machine (RBM) to infer an effective Hebbian-unlearned Hamiltonian characterized by the parameter λ, which quantifies the extent of "dreaming" or unlearning.

Across experiments varying temperature T, activity parameter a, and loading α, the authors report clear trends for λ with a (increasing) and weak sensitivity to T, but they explicitly state that the dependence of λ on α remains unclear, identifying it as a direction for future work.

References

The dependence of λ on the pattern loading, α is unclear and understanding it is one of our future directions.

A correspondence between Hebbian unlearning and steady states generated by nonequilibrium dynamics (2410.06269 - Behera et al., 8 Oct 2024) in Section 4 (Numerical inference schemes reveal signatures of Hebbian unlearning in active dynamics), paragraph accompanying Figure 6 (LambdaVsa)