Theoretical understanding of input-dependent LTV SSM dynamics
Develop a theoretical characterization of linear time-varying state-space models whose dynamic matrices depend on the current input, as used in selective SSM architectures such as S6/Mamba and RG-LRU, clarifying their fundamental properties and implications for sequence modeling.
References
However, in the SSM literature the theoretical properties arising from these dynamics remains poorly understood.
                — State Space Models as Foundation Models: A Control Theoretic Overview
                
                (2403.16899 - Alonso et al., 25 Mar 2024) in Section 5, Conclusion and Future Opportunities