Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
127 tokens/sec
GPT-4o
11 tokens/sec
Gemini 2.5 Pro Pro
53 tokens/sec
o3 Pro
5 tokens/sec
GPT-4.1 Pro
4 tokens/sec
DeepSeek R1 via Azure Pro
33 tokens/sec
2000 character limit reached

DTMamba : Dual Twin Mamba for Time Series Forecasting (2405.07022v1)

Published 11 May 2024 in cs.LG and cs.DB

Abstract: We utilized the Mamba model for time series data prediction tasks, and the experimental results indicate that our model performs well.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (40)
  1. Ali Behrouz and Farnoosh Hashemi. 2024. Graph Mamba: Towards Learning on Graphs with State Space Models. CoRR abs/2402.08678 (2024).
  2. George EP Box and Gwilym M Jenkins. 1968. Some recent advances in forecasting and control. Journal of the Royal Statistical Society. Series C (Applied Statistics) 17, 2 (1968), 91–109.
  3. TSMixer: An all-MLP Architecture for Time Series Forecasting. CoRR abs/2303.06053 (2023).
  4. Long-term Forecasting with TiDE: Time-series Dense Encoder. CoRR abs/2304.08424 (2023).
  5. Mean squared error of empirical predictor. (2004).
  6. Jeffrey L. Elman. 1990. Finding Structure in Time. Cogn. Sci. 14, 2 (1990), 179–211.
  7. Albert Gu and Tri Dao. 2023. Mamba: Linear-Time Sequence Modeling with Selective State Spaces. CoRR abs/2312.00752 (2023).
  8. Efficiently Modeling Long Sequences with Structured State Spaces. In ICLR. OpenReview.net.
  9. Deep Residual Learning for Image Recognition. In CVPR. IEEE Computer Society, 770–778.
  10. Identity Mappings in Deep Residual Networks. In ECCV (4) (Lecture Notes in Computer Science, Vol. 9908). Springer, 630–645.
  11. Temporal convolutional neural (TCN) network for an effective weather forecasting using time-series data from the local weather station. Soft Comput. 24, 21 (2020), 16453–16482.
  12. Improving neural networks by preventing co-adaptation of feature detectors. CoRR abs/1207.0580 (2012).
  13. Zahra Karevan and Johan A. K. Suykens. 2020. Transductive LSTM for time-series prediction: An application to weather forecasting. Neural Networks 125 (2020), 1–9.
  14. Reversible Instance Normalization for Accurate Time-Series Forecasting against Distribution Shift. In ICLR. OpenReview.net.
  15. Yoon Kim. 2014. Convolutional Neural Networks for Sentence Classification. In EMNLP. ACL, 1746–1751.
  16. Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In ICLR (Poster).
  17. Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networks. In SIGIR. ACM, 95–104.
  18. VideoMamba: State Space Model for Efficient Video Understanding. CoRR abs/2403.06977 (2024).
  19. Revisiting Long-term Time Series Forecasting: An Investigation on Linear Mapping. CoRR abs/2305.10721 (2023).
  20. Jamba: A Hybrid Transformer-Mamba Language Model. CoRR abs/2403.19887 (2024).
  21. SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interaction. In NeurIPS.
  22. iTransformer: Inverted Transformers Are Effective for Time Series Forecasting. CoRR abs/2310.06625 (2023).
  23. Non-stationary transformers: Exploring the stationarity in time series forecasting. Advances in Neural Information Processing Systems 35 (2022), 9881–9893.
  24. U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentation. CoRR abs/2401.04722 (2024).
  25. Rishabh Madan and Mangipudi Partha Sarathi. 2018. Predicting Computer Network Traffic: A Time Series Forecasting Approach Using DWT, ARIMA and RNN. In IC3. IEEE Computer Society, 1–5.
  26. Time Series Prediction Using Deep Learning Methods in Healthcare. ACM Trans. Manag. Inf. Syst. 14, 1 (2023), 2:1–2:29.
  27. A Time Series is Worth 64 Words: Long-term Forecasting with Transformers. In ICLR. OpenReview.net.
  28. Massimo Pacella and Gabriele Papadia. 2021. Evaluation of deep learning with long short-term memory networks for time series forecasting in supply chain management. Procedia CIRP 99 (2021), 604–609.
  29. PyTorch: An Imperative Style, High-Performance Deep Learning Library. In NeurIPS. 8024–8035.
  30. William Toner and Luke Darlow. 2024. An Analysis of Linear Time Series Forecasting Models. CoRR abs/2403.14587 (2024).
  31. Attention is All you Need. In NIPS. 5998–6008.
  32. Evaluation of forecasting methods for decision support. International journal of forecasting 2, 2 (1986), 139–152.
  33. TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysis. In ICLR. OpenReview.net.
  34. Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting. In NeurIPS. 22419–22430.
  35. Hongju Yan and Hongbing Ouyang. 2018. Financial Time Series Prediction Based on Deep Learning. Wirel. Pers. Commun. 102, 2 (2018), 683–700.
  36. Recurrent Neural Network Regularization. CoRR abs/1409.2329 (2014).
  37. Are Transformers Effective for Time Series Forecasting?. In AAAI. AAAI Press, 11121–11128.
  38. Yunhao Zhang and Junchi Yan. 2023. Crossformer: Transformer Utilizing Cross-Dimension Dependency for Multivariate Time Series Forecasting. In ICLR. OpenReview.net.
  39. FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecasting. In ICML (Proceedings of Machine Learning Research, Vol. 162). PMLR, 27268–27286.
  40. Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model. CoRR abs/2401.09417 (2024).
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now