Papers
Topics
Authors
Recent
Search
2000 character limit reached

Hybrid LSTM-KAN Model Overview

Updated 5 July 2026
  • Hybrid LSTM-KAN models are neural architectures that integrate LSTM’s temporal memory with KAN’s adaptive univariate function approximations for enhanced time-series analysis.
  • They employ diverse integration patterns—post-recurrent heads, intrinsic gating, and composite encoder-decoder designs—to effectively address various forecasting and classification tasks.
  • Empirical studies demonstrate these models excel in parameter efficiency and improved prediction accuracy across domains like financial risk, respiratory sound detection, and cyber-security.

Searching arXiv for hybrid LSTMKAN and closely related TKAN/KAN time-series papers. Hybrid LSTM-KAN models are neural architectures that combine Long Short-Term Memory (LSTM) sequence modeling with Kolmogorov-Arnold Networks (KANs), a class of networks in which learnable univariate functions are placed on edges rather than fixed activations on nodes. In the recent literature, the term denotes not a single canonical network but a family of designs that couple LSTM-style memory and gating with KAN-style functional approximation. The hybridization appears in at least three forms: a KAN used as a post-recurrent prediction head, a recurrent cell in which KAN computations are integrated into the gating or state-update mechanism, and larger composite systems in which LSTM-derived sequence encoders and KAN projection layers are embedded inside encoder-decoder pipelines (Genet et al., 2024). The hybrid idea is motivated by standalone evidence that KANs can outperform similarly shaped MLPs in time-series forecasting with fewer learnable parameters (Vaca-Rubio et al., 2024).

1. Theoretical basis and defining components

The KAN component is grounded in the Kolmogorov-Arnold representation theorem, written in the time-series literature as

f(x)=i=12n+1Φi(j=1nϕi,j(xj)),f(\mathbf{x})=\sum_{i=1}^{2n+1}\Phi_i\left(\sum_{j=1}^n \phi_{i,j}(x_j)\right),

or equivalently,

f(x1,,xn)=q=12n+1Φq(p=1nϕq,p(xp)).f(x_1,\dots,x_n)=\sum_{q=1}^{2n+1}\Phi_q\left(\sum_{p=1}^n \phi_{q,p}(x_p)\right).

In KAN-based models, this theorem is interpreted as a network whose nonlinearities are carried by trainable univariate edge functions rather than by fixed node activations. A KAN layer is therefore a matrix of functions Φ\mathbf{\Phi}, and the forward rule can be written as

xl+1,j=i=1nlϕl,j,i(xl,i),xl+1=Φlxl.x_{l+1,j}=\sum_{i=1}^{n_l}\phi_{l,j,i}(x_{l,i}), \qquad \mathbf{x}_{l+1}=\mathbf{\Phi}_l\mathbf{x}_l.

In the time-series forecasting work on satellite traffic, these edge functions are approximated with B-splines, with spline order kk and grid size GG, and the network is trained by backpropagation because the construction is fully differentiable (Vaca-Rubio et al., 2024).

The LSTM component contributes stateful temporal memory through gated recurrence. In the loan-default formulation, the standard update is

ft=σ(Wf[ht1]+bf),it=σ(Wi[ht1,xt]+bi),f_t = \sigma(W_f[h_{t-1}]+b_f),\quad i_t = \sigma(W_i[h_{t-1},x_t]+b_i),

c~t=tanh(Wc[ht1,xt]+bc),ct=ftct1+itc~t,\tilde{c}_t = \tanh(W_c[h_{t-1},x_t]+b_c),\quad c_t = f_t \odot c_{t-1} + i_t \odot \tilde{c}_t,

ot=σ(Wo[ht1,xt]+bo),ht=ottanh(ct).o_t = \sigma(W_o[h_{t-1},x_t]+b_o),\quad h_t = o_t \odot \tanh(c_t).

This mechanism preserves useful historical information while filtering irrelevant past states (Yang et al., 18 Jul 2025).

The hybrid rationale is explicit across the literature: LSTM is used for temporal dependency capture and memory management, while KAN is used for more expressive nonlinear transformation after, within, or around the recurrent state evolution. This suggests a division of labor in which recurrence handles sequence structure and KAN handles adaptive feature-to-output mapping.

2. Architectural patterns

The literature suggests three recurring integration patterns.

Pattern Representative structure Example papers
Post-recurrent KAN head recurrent encoder \rightarrow KAN f(x1,,xn)=q=12n+1Φq(p=1nϕq,p(xp)).f(x_1,\dots,x_n)=\sum_{q=1}^{2n+1}\Phi_q\left(\sum_{p=1}^n \phi_{q,p}(x_p)\right).0 classifier/regressor (Yang et al., 18 Jul 2025, K. et al., 7 Jan 2026)
Intrinsic recurrent hybrid KAN or RKAN inside LSTM-style gating/state update (Genet et al., 2024, Hsu et al., 4 Dec 2025)
Composite encoder-decoder hybrid LSTM-derived backbone with KAN projection blocks (Guo et al., 13 Jan 2025, Hassanin, 30 Mar 2026)

In the post-recurrent design, the LSTM acts as a feature extractor and the KAN replaces the usual dense decision head. The loan-default model uses preprocessing, masking, two stacked LSTM layers, Batch Normalization, a KAN layer, a dense layer, Dropout, and a sigmoid output layer; the first LSTM has 128 units with return_sequences=True, the second has 64 units with return_sequences=False, and the KAN is specified with output_dim=1 and num_functions=10 (Yang et al., 18 Jul 2025). A related respiratory-sound classifier uses a BiLSTM with hidden size f(x1,,xn)=q=12n+1Φq(p=1nϕq,p(xp)).f(x_1,\dots,x_n)=\sum_{q=1}^{2n+1}\Phi_q\left(\sum_{p=1}^n \phi_{q,p}(x_p)\right).1, Dropout f(x1,,xn)=q=12n+1Φq(p=1nϕq,p(xp)).f(x_1,\dots,x_n)=\sum_{q=1}^{2n+1}\Phi_q\left(\sum_{p=1}^n \phi_{q,p}(x_p)\right).2, and a KAN back-end with one hidden KAN layer of f(x1,,xn)=q=12n+1Φq(p=1nϕq,p(xp)).f(x_1,\dots,x_n)=\sum_{q=1}^{2n+1}\Phi_q\left(\sum_{p=1}^n \phi_{q,p}(x_p)\right).3 neurons and an output layer of f(x1,,xn)=q=12n+1Φq(p=1nϕq,p(xp)).f(x_1,\dots,x_n)=\sum_{q=1}^{2n+1}\Phi_q\left(\sum_{p=1}^n \phi_{q,p}(x_p)\right).4 neurons, using cubic splines of order f(x1,,xn)=q=12n+1Φq(p=1nϕq,p(xp)).f(x_1,\dots,x_n)=\sum_{q=1}^{2n+1}\Phi_q\left(\sum_{p=1}^n \phi_{q,p}(x_p)\right).5 and grid size f(x1,,xn)=q=12n+1Φq(p=1nϕq,p(xp)).f(x_1,\dots,x_n)=\sum_{q=1}^{2n+1}\Phi_q\left(\sum_{p=1}^n \phi_{q,p}(x_p)\right).6 (K. et al., 7 Jan 2026).

In the intrinsic recurrent hybrid, the KAN machinery is folded into the recurrent dynamics themselves. TKAN introduces Recurrent Kolmogorov-Arnold Network (RKAN) layers together with LSTM-like gates and cell state, so that KAN computations become temporally aware through per-layer memory variables and the output gate is driven by an RKAN-based composite representation rather than by a standard affine map (Genet et al., 2024). QKAN-LSTM pushes this further by replacing the affine gate pre-activations with sums of KAN-like quantum-inspired variational activation functions, while preserving the external LSTM gate structure (Hsu et al., 4 Dec 2025).

In the composite encoder-decoder pattern, hybridization is distributed across a larger architecture. UNETVL replaces ViT encoder blocks in a UNETR-like 3D segmentation system with Vision-LSTM blocks and then replaces MLP-style up- and down-projection layers inside the modified ViL block with Chebyshev KAN layers (Guo et al., 13 Jan 2025). In IoT threat detection, the reported KAN-LSTM architecture is explicitly Preprocessing → 2 [CNN](https://www.emergentmind.com/topics/condensed-nearest-neighbour-cnn) layers → 1 LSTM layer → 2 KAN layers → classifier/output, assigning local feature extraction to CNN, temporal encoding to LSTM, and adaptive nonlinear decision mapping to KAN (Hassanin, 30 Mar 2026).

3. Mathematical forms of hybridization

A direct post-recurrent hybrid is summarized in the loan-default work as

f(x1,,xn)=q=12n+1Φq(p=1nϕq,p(xp)).f(x_1,\dots,x_n)=\sum_{q=1}^{2n+1}\Phi_q\left(\sum_{p=1}^n \phi_{q,p}(x_p)\right).7

where f(x1,,xn)=q=12n+1Φq(p=1nϕq,p(xp)).f(x_1,\dots,x_n)=\sum_{q=1}^{2n+1}\Phi_q\left(\sum_{p=1}^n \phi_{q,p}(x_p)\right).8 is the predicted default probability (Yang et al., 18 Jul 2025). In this formulation, the recurrent block compresses the sequence into a hidden representation and the KAN transforms that representation using learnable univariate nonlinear functions before final classification.

TKAN uses a deeper integration. Its RKAN update is written as

f(x1,,xn)=q=12n+1Φq(p=1nϕq,p(xp)).f(x_1,\dots,x_n)=\sum_{q=1}^{2n+1}\Phi_q\left(\sum_{p=1}^n \phi_{q,p}(x_p)\right).9

with recurrent memory

Φ\mathbf{\Phi}0

The LSTM-style gates remain largely standard,

Φ\mathbf{\Phi}1

Φ\mathbf{\Phi}2

but the output gate becomes

Φ\mathbf{\Phi}3

where Φ\mathbf{\Phi}4 is the RKAN-based composite representation, and the hidden state is

Φ\mathbf{\Phi}5

The defining feature is therefore a dual memory structure: RKAN memory inside KAN layers for short-term temporal context and LSTM cell state for long-term dependency management (Genet et al., 2024).

QKAN-LSTM retains the LSTM shell while replacing each gate pre-activation with a KAN-like sum of learned functional units. For gate Φ\mathbf{\Phi}6, with Φ\mathbf{\Phi}7, the paper defines

Φ\mathbf{\Phi}8

and then

Φ\mathbf{\Phi}9

xl+1,j=i=1nlϕl,j,i(xl,i),xl+1=Φlxl.x_{l+1,j}=\sum_{i=1}^{n_l}\phi_{l,j,i}(x_{l,i}), \qquad \mathbf{x}_{l+1}=\mathbf{\Phi}_l\mathbf{x}_l.0

This formulation makes the hybridization occur directly at the gate level rather than in a separate readout head (Hsu et al., 4 Dec 2025).

In Chebyshev-KAN-based Vision-LSTM, the KAN module is defined through polynomial basis expansion rather than B-splines. The basis recursion is

xl+1,j=i=1nlϕl,j,i(xl,i),xl+1=Φlxl.x_{l+1,j}=\sum_{i=1}^{n_l}\phi_{l,j,i}(x_{l,i}), \qquad \mathbf{x}_{l+1}=\mathbf{\Phi}_l\mathbf{x}_l.1

and the output is formed by Einstein summation over basis tensor xl+1,j=i=1nlϕl,j,i(xl,i),xl+1=Φlxl.x_{l+1,j}=\sum_{i=1}^{n_l}\phi_{l,j,i}(x_{l,i}), \qquad \mathbf{x}_{l+1}=\mathbf{\Phi}_l\mathbf{x}_l.2 and coefficient tensor xl+1,j=i=1nlϕl,j,i(xl,i),xl+1=Φlxl.x_{l+1,j}=\sum_{i=1}^{n_l}\phi_{l,j,i}(x_{l,i}), \qquad \mathbf{x}_{l+1}=\mathbf{\Phi}_l\mathbf{x}_l.3. This is a distinct KAN instantiation but preserves the central idea of edge-wise functional approximation (Guo et al., 13 Jan 2025).

4. Empirical record across domains

In time-series forecasting, the empirical basis for hybrid LSTM-KAN models begins with standalone KAN results. On satellite traffic forecasting, a 4-depth KAN with architecture xl+1,j=i=1nlϕl,j,i(xl,i),xl+1=Φlxl.x_{l+1,j}=\sum_{i=1}^{n_l}\phi_{l,j,i}(x_{l,i}), \qquad \mathbf{x}_{l+1}=\mathbf{\Phi}_l\mathbf{x}_l.4, using B-spline activations with xl+1,j=i=1nlϕl,j,i(xl,i),xl+1=Φlxl.x_{l+1,j}=\sum_{i=1}^{n_l}\phi_{l,j,i}(x_{l,i}), \qquad \mathbf{x}_{l+1}=\mathbf{\Phi}_l\mathbf{x}_l.5 and xl+1,j=i=1nlϕl,j,i(xl,i),xl+1=Φlxl.x_{l+1,j}=\sum_{i=1}^{n_l}\phi_{l,j,i}(x_{l,i}), \qquad \mathbf{x}_{l+1}=\mathbf{\Phi}_l\mathbf{x}_l.6, reports MSE xl+1,j=i=1nlϕl,j,i(xl,i),xl+1=Φlxl.x_{l+1,j}=\sum_{i=1}^{n_l}\phi_{l,j,i}(x_{l,i}), \qquad \mathbf{x}_{l+1}=\mathbf{\Phi}_l\mathbf{x}_l.7, RMSE xl+1,j=i=1nlϕl,j,i(xl,i),xl+1=Φlxl.x_{l+1,j}=\sum_{i=1}^{n_l}\phi_{l,j,i}(x_{l,i}), \qquad \mathbf{x}_{l+1}=\mathbf{\Phi}_l\mathbf{x}_l.8, MAE xl+1,j=i=1nlϕl,j,i(xl,i),xl+1=Φlxl.x_{l+1,j}=\sum_{i=1}^{n_l}\phi_{l,j,i}(x_{l,i}), \qquad \mathbf{x}_{l+1}=\mathbf{\Phi}_l\mathbf{x}_l.9, MAPE kk0, and kk1k parameters; the compared 3-depth and 4-depth MLPs use kk2k and kk3k parameters, respectively, with worse error metrics (Vaca-Rubio et al., 2024). This does not yet constitute a hybrid model, but it provides the empirical premise for replacing MLP heads in recurrent systems.

TKAN supplies the first explicit recurrent KAN-LSTM synthesis for multi-step forecasting. On Bitcoin market traded notional values, its kk4 is kk5 at 1-step ahead, slightly below GRU at kk6, but at 6 steps ahead TKAN reaches kk7 while GRU drops to kk8 and LSTM to kk9; at 12 and 15 steps ahead, GRU and LSTM are negative while TKAN remains positive at GG0 and GG1 (Genet et al., 2024). The reported training and validation curves are also described as much closer together for TKAN than for GRU or LSTM.

In financial risk modeling, LSTM-KAN and GRU-KAN are evaluated for loan-default early prediction on the Freddie Mac Single-Family Loan-Level dataset. The abstract reports over GG2 accuracy three months in advance and over GG3 accuracy eight months in advance. Within the early-prediction analysis, the best AUC at the 3-month blank interval is reported for LSTM-KAN with average AUC GG4, and the paper states that the proposed models can achieve at a 5-month blank interval roughly the same accuracy, recall, and F1 that baseline models achieve at 3 months, implying about 2 additional months of warning time (Yang et al., 18 Jul 2025).

In imbalanced respiratory sound classification on the ICBHI 2017 Respiratory Sound Database, the Hybrid LSTM-KAN model reports GG5 accuracy, macro precision GG6, macro recall GG7, macro-F1 GG8, and weighted-F1 GG9, with the dominant COPD class comprising about ft=σ(Wf[ht1]+bf),it=σ(Wi[ht1,xt]+bi),f_t = \sigma(W_f[h_{t-1}]+b_f),\quad i_t = \sigma(W_i[h_{t-1},x_t]+b_i),0 of the filtered dataset. The ablation study reports a baseline cross-entropy system at ft=σ(Wf[ht1]+bf),it=σ(Wi[ht1,xt]+bi),f_t = \sigma(W_f[h_{t-1}]+b_f),\quad i_t = \sigma(W_i[h_{t-1},x_t]+b_i),1 accuracy and macro-F1 ft=σ(Wf[ht1]+bf),it=σ(Wi[ht1,xt]+bi),f_t = \sigma(W_f[h_{t-1}]+b_f),\quad i_t = \sigma(W_i[h_{t-1},x_t]+b_i),2, rising to ft=σ(Wf[ht1]+bf),it=σ(Wi[ht1,xt]+bi),f_t = \sigma(W_f[h_{t-1}]+b_f),\quad i_t = \sigma(W_i[h_{t-1},x_t]+b_i),3 and ft=σ(Wf[ht1]+bf),it=σ(Wi[ht1,xt]+bi),f_t = \sigma(W_f[h_{t-1}]+b_f),\quad i_t = \sigma(W_i[h_{t-1},x_t]+b_i),4 when focal loss, class-specific augmentation, and SMOTE are combined. Per-class F1 for the proposed model is ft=σ(Wf[ht1]+bf),it=σ(Wi[ht1,xt]+bi),f_t = \sigma(W_f[h_{t-1}]+b_f),\quad i_t = \sigma(W_i[h_{t-1},x_t]+b_i),5 for Bronchiectasis, ft=σ(Wf[ht1]+bf),it=σ(Wi[ht1,xt]+bi),f_t = \sigma(W_f[h_{t-1}]+b_f),\quad i_t = \sigma(W_i[h_{t-1},x_t]+b_i),6 for Pneumonia, ft=σ(Wf[ht1]+bf),it=σ(Wi[ht1,xt]+bi),f_t = \sigma(W_f[h_{t-1}]+b_f),\quad i_t = \sigma(W_i[h_{t-1},x_t]+b_i),7 for URTI, and ft=σ(Wf[ht1]+bf),it=σ(Wi[ht1,xt]+bi),f_t = \sigma(W_f[h_{t-1}]+b_f),\quad i_t = \sigma(W_i[h_{t-1},x_t]+b_i),8 for Bronchiolitis (K. et al., 7 Jan 2026).

In cyber-security threat detection, KAN-LSTM is benchmarked on UNSW-NB15, NSL-KDD, CICIDS2017, and a combined Tri-IDS dataset. Reported results are ft=σ(Wf[ht1]+bf),it=σ(Wi[ht1,xt]+bi),f_t = \sigma(W_f[h_{t-1}]+b_f),\quad i_t = \sigma(W_i[h_{t-1},x_t]+b_i),9 accuracy, c~t=tanh(Wc[ht1,xt]+bc),ct=ftct1+itc~t,\tilde{c}_t = \tanh(W_c[h_{t-1},x_t]+b_c),\quad c_t = f_t \odot c_{t-1} + i_t \odot \tilde{c}_t,0 precision, c~t=tanh(Wc[ht1,xt]+bc),ct=ftct1+itc~t,\tilde{c}_t = \tanh(W_c[h_{t-1},x_t]+b_c),\quad c_t = f_t \odot c_{t-1} + i_t \odot \tilde{c}_t,1 recall, and c~t=tanh(Wc[ht1,xt]+bc),ct=ftct1+itc~t,\tilde{c}_t = \tanh(W_c[h_{t-1},x_t]+b_c),\quad c_t = f_t \odot c_{t-1} + i_t \odot \tilde{c}_t,2 F1 on UNSW-NB15; c~t=tanh(Wc[ht1,xt]+bc),ct=ftct1+itc~t,\tilde{c}_t = \tanh(W_c[h_{t-1},x_t]+b_c),\quad c_t = f_t \odot c_{t-1} + i_t \odot \tilde{c}_t,3, c~t=tanh(Wc[ht1,xt]+bc),ct=ftct1+itc~t,\tilde{c}_t = \tanh(W_c[h_{t-1},x_t]+b_c),\quad c_t = f_t \odot c_{t-1} + i_t \odot \tilde{c}_t,4, c~t=tanh(Wc[ht1,xt]+bc),ct=ftct1+itc~t,\tilde{c}_t = \tanh(W_c[h_{t-1},x_t]+b_c),\quad c_t = f_t \odot c_{t-1} + i_t \odot \tilde{c}_t,5, and c~t=tanh(Wc[ht1,xt]+bc),ct=ftct1+itc~t,\tilde{c}_t = \tanh(W_c[h_{t-1},x_t]+b_c),\quad c_t = f_t \odot c_{t-1} + i_t \odot \tilde{c}_t,6 on NSL-KDD; c~t=tanh(Wc[ht1,xt]+bc),ct=ftct1+itc~t,\tilde{c}_t = \tanh(W_c[h_{t-1},x_t]+b_c),\quad c_t = f_t \odot c_{t-1} + i_t \odot \tilde{c}_t,7, c~t=tanh(Wc[ht1,xt]+bc),ct=ftct1+itc~t,\tilde{c}_t = \tanh(W_c[h_{t-1},x_t]+b_c),\quad c_t = f_t \odot c_{t-1} + i_t \odot \tilde{c}_t,8, c~t=tanh(Wc[ht1,xt]+bc),ct=ftct1+itc~t,\tilde{c}_t = \tanh(W_c[h_{t-1},x_t]+b_c),\quad c_t = f_t \odot c_{t-1} + i_t \odot \tilde{c}_t,9, and ot=σ(Wo[ht1,xt]+bo),ht=ottanh(ct).o_t = \sigma(W_o[h_{t-1},x_t]+b_o),\quad h_t = o_t \odot \tanh(c_t).0 on CICIDS2017; and ot=σ(Wo[ht1,xt]+bo),ht=ottanh(ct).o_t = \sigma(W_o[h_{t-1},x_t]+b_o),\quad h_t = o_t \odot \tanh(c_t).1, ot=σ(Wo[ht1,xt]+bo),ht=ottanh(ct).o_t = \sigma(W_o[h_{t-1},x_t]+b_o),\quad h_t = o_t \odot \tanh(c_t).2, ot=σ(Wo[ht1,xt]+bo),ht=ottanh(ct).o_t = \sigma(W_o[h_{t-1},x_t]+b_o),\quad h_t = o_t \odot \tanh(c_t).3, and ot=σ(Wo[ht1,xt]+bo),ht=ottanh(ct).o_t = \sigma(W_o[h_{t-1},x_t]+b_o),\quad h_t = o_t \odot \tanh(c_t).4 on Tri-IDS (Hassanin, 30 Mar 2026).

Beyond 1D sequence tasks, hybridization also appears in 3D medical image segmentation. UNETVL reports mean Dice ot=σ(Wo[ht1,xt]+bo),ht=ottanh(ct).o_t = \sigma(W_o[h_{t-1},x_t]+b_o),\quad h_t = o_t \odot \tanh(c_t).5 on ACDC versus ot=σ(Wo[ht1,xt]+bo),ht=ottanh(ct).o_t = \sigma(W_o[h_{t-1},x_t]+b_o),\quad h_t = o_t \odot \tanh(c_t).6 for UNETR, and ot=σ(Wo[ht1,xt]+bo),ht=ottanh(ct).o_t = \sigma(W_o[h_{t-1},x_t]+b_o),\quad h_t = o_t \odot \tanh(c_t).7 on AMOS2022 versus ot=σ(Wo[ht1,xt]+bo),ht=ottanh(ct).o_t = \sigma(W_o[h_{t-1},x_t]+b_o),\quad h_t = o_t \odot \tanh(c_t).8 for UNETR. In the ablation table, the ViL-only configuration at ot=σ(Wo[ht1,xt]+bo),ht=ottanh(ct).o_t = \sigma(W_o[h_{t-1},x_t]+b_o),\quad h_t = o_t \odot \tanh(c_t).9 gives \rightarrow0 Dice on ACDC and \rightarrow1 on AMOS, while the KAN-enabled version at the same width improves to \rightarrow2 and \rightarrow3 (Guo et al., 13 Jan 2025).

5. Interpretability, efficiency, and limitations

Interpretability is a recurring argument for KAN-based hybrids. Because KAN replaces fixed activations and scalar weights with learnable univariate functions, the learned edge functions can in principle be inspected. The satellite-traffic paper explicitly contrasts this with opaque dense weight matrices, and the respiratory-sound study similarly presents KAN’s spline functions as offering insight into feature-to-class mappings (Vaca-Rubio et al., 2024). This interpretability claim is architectural rather than fully validated across all applications.

Efficiency claims are more conditional. In standalone forecasting, KAN can be markedly more parameter-efficient than matched MLP baselines, as in the \rightarrow4k-parameter KAN versus \rightarrow5k and \rightarrow6k MLPs on satellite traffic (Vaca-Rubio et al., 2024). In respiratory-sound classification, the reported Hybrid LSTM-KAN has \rightarrow7k parameters, training time \rightarrow8 min/epoch, inference time \rightarrow9 ms/sample, about f(x1,,xn)=q=12n+1Φq(p=1nϕq,p(xp)).f(x_1,\dots,x_n)=\sum_{q=1}^{2n+1}\Phi_q\left(\sum_{p=1}^n \phi_{q,p}(x_p)\right).00 MB GPU memory during training, and about f(x1,,xn)=q=12n+1Φq(p=1nϕq,p(xp)).f(x_1,\dots,x_n)=\sum_{q=1}^{2n+1}\Phi_q\left(\sum_{p=1}^n \phi_{q,p}(x_p)\right).01 MB during inference (K. et al., 7 Jan 2026). QKAN-LSTM reports a stronger parameter-efficiency result on Urban Telecommunication, with f(x1,,xn)=q=12n+1Φq(p=1nϕq,p(xp)).f(x_1,\dots,x_n)=\sum_{q=1}^{2n+1}\Phi_q\left(\sum_{p=1}^n \phi_{q,p}(x_p)\right).02 total trainable parameters for QKAN-LSTM versus f(x1,,xn)=q=12n+1Φq(p=1nϕq,p(xp)).f(x_1,\dots,x_n)=\sum_{q=1}^{2n+1}\Phi_q\left(\sum_{p=1}^n \phi_{q,p}(x_p)\right).03 for LSTM, corresponding to the paper’s headline f(x1,,xn)=q=12n+1Φq(p=1nϕq,p(xp)).f(x_1,\dots,x_n)=\sum_{q=1}^{2n+1}\Phi_q\left(\sum_{p=1}^n \phi_{q,p}(x_p)\right).04 reduction (Hsu et al., 4 Dec 2025).

Yet KAN does not uniformly reduce cost. In UNETVL, enabling KAN at f(x1,,xn)=q=12n+1Φq(p=1nϕq,p(xp)).f(x_1,\dots,x_n)=\sum_{q=1}^{2n+1}\Phi_q\left(\sum_{p=1}^n \phi_{q,p}(x_p)\right).05 increases parameters from f(x1,,xn)=q=12n+1Φq(p=1nϕq,p(xp)).f(x_1,\dots,x_n)=\sum_{q=1}^{2n+1}\Phi_q\left(\sum_{p=1}^n \phi_{q,p}(x_p)\right).06M to f(x1,,xn)=q=12n+1Φq(p=1nϕq,p(xp)).f(x_1,\dots,x_n)=\sum_{q=1}^{2n+1}\Phi_q\left(\sum_{p=1}^n \phi_{q,p}(x_p)\right).07M while improving Dice. The paper explicitly frames this as a tradeoff between expressiveness and model complexity (Guo et al., 13 Jan 2025). The lesson is that parameter efficiency depends on where KAN is inserted and which basis functions and widths are used.

The limitations are likewise consistent across papers. TKAN is not especially superior at very short horizons, where GRU can be slightly better, and its ablation study does not fully isolate the incremental contribution of RKAN versus the gate modifications (Genet et al., 2024). The standalone KAN forecasting study notes that robustness across diverse datasets is not yet fully established and that the architecture has not yet been shown to compete directly with more advanced temporal models such as LSTMs, GRUs, CNNs, or attention-based methods (Vaca-Rubio et al., 2024). The cyber-security study acknowledges slow processing, limited scalability, expensive training, and some stability issues for KANs (Hassanin, 30 Mar 2026). The respiratory-sound work notes that rare classes remain difficult, feature aggregation may lose fine-grained temporal information, only one public dataset is used, and no real-world clinical validation has yet been conducted (K. et al., 7 Jan 2026).

6. Research trajectory and conceptual boundaries

A common misconception is that “Hybrid LSTM-KAN” names a settled, standardized architecture. The literature indicates otherwise. TKAN is a recurrent KAN with explicit LSTM-like memory control; the loan-default and respiratory-sound systems are LSTM encoders with KAN heads; UNETVL is a Vision-LSTM plus Chebyshev-KAN encoder module inside a 3D segmentation pipeline; and QKAN-LSTM replaces affine gate transforms with KAN-like quantum-inspired activations. These are related by design philosophy rather than by a unique blueprint.

The broader research trajectory reinforces this point. In deep state-space recurrent modeling for Bitcoin regime prediction, the switching TKAN variant, m-TKAN, reports accuracy f(x1,,xn)=q=12n+1Φq(p=1nϕq,p(xp)).f(x_1,\dots,x_n)=\sum_{q=1}^{2n+1}\Phi_q\left(\sum_{p=1}^n \phi_{q,p}(x_p)\right).08 versus f(x1,,xn)=q=12n+1Φq(p=1nϕq,p(xp)).f(x_1,\dots,x_n)=\sum_{q=1}^{2n+1}\Phi_q\left(\sum_{p=1}^n \phi_{q,p}(x_p)\right).09 for m-LSTM and f(x1,,xn)=q=12n+1Φq(p=1nϕq,p(xp)).f(x_1,\dots,x_n)=\sum_{q=1}^{2n+1}\Phi_q\left(\sum_{p=1}^n \phi_{q,p}(x_p)\right).10 for m-GRU, together with the strongest reported in-sample and out-of-sample risk-adjusted backtesting metrics among the three switching models (Inzirillo, 2024). In option pricing, by contrast, the literature provides a complementary result: KAN outperforms MLP and TDNN as a nonlinear approximator, while the best overall model is an LSTM-GRU hybrid RNN with attention, and the authors explicitly identify integrating LSTM or GRU layers and attention mechanisms into MLP and KAN models as future work (Ter-Avanesov et al., 2024). This suggests that the current field treats KAN and recurrent modeling as complementary rather than mutually exclusive.

A plausible implication is that the appropriate hybrid design depends on the bottleneck of the target problem. If the main difficulty lies in mapping a recurrent latent state to a complex output manifold, a KAN head may be sufficient. If the difficulty lies inside the recurrent transition itself, an intrinsic recurrent-KAN design such as TKAN or QKAN-LSTM is more directly aligned with the problem. If long-range context, local structure, and dense reconstruction must all be handled simultaneously, as in 3D segmentation or network-traffic analysis, composite hybrids become more natural.

Hybrid LSTM-KAN modeling therefore designates a developing research area rather than a finalized architecture class. Its unifying theme is the attempt to combine recurrent memory control with adaptive edge-wise function approximation, while negotiating a recurring tradeoff among expressiveness, parameter count, training stability, and implementation complexity.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Hybrid LSTM-KAN Model.