Uniform growing-state and learned-model extensions

Establish rates uniform over growing state counts K=K(q) and extend the vanishing-predictive-KL phenomenon to learned sequence models.

Background

The main theorems fix the number of latent states K before taking the rare-switching limit q→0, and their constants may deteriorate as K grows or emission means become nearly coincident. The construction also concerns explicit mathematical filters rather than models obtained through training. Consequently, the paper leaves unresolved both a joint or uniform asymptotic theory when the state count grows with q and extensions of the phenomenon to learned recurrent or state-space sequence models.

References

It does not show that this failure of gap transfer is prevalent in learned models or provide a converse criterion; uniform growing-$K$ rates and extensions to learned sequence models remain open.

How Wrong Can a Good Predictor Be? Diverging Updates with Vanishing Predictive KL  (2609.11132 - Wen et al., 10 Sep 2026) in Section Conclusion