Incremental Learning of Stock Trends via Meta-Learning with Dynamic Adaptation (2401.03865v3)
Abstract: Forecasting the trend of stock prices is an enduring topic at the intersection of finance and computer science. Periodical updates to forecasters have proven effective in handling concept drifts arising from non-stationary markets. However, the existing methods neglect either emerging patterns in recent data or recurring patterns in historical data, both of which are empirically advantageous for future forecasting. To address this issue, we propose meta-learning with dynamic adaptation (MetaDA) for the incremental learning of stock trends, which periodically performs dynamic model adaptation utilizing the emerging and recurring patterns simultaneously. We initially organize the stock trend forecasting into meta-learning tasks and train a forecasting model following meta-learning protocols. During model adaptation, MetaDA efficiently adapts the forecasting model with the latest data and a selected portion of historical data, which is dynamically identified by a task inference module. The task inference module first extracts task-level embeddings from the historical tasks, and then identifies the informative data with a task inference network. MetaDA has been evaluated on real-world stock datasets, achieving state-of-the-art performance with satisfactory efficiency.
- Predicting stock returns in an efficient market. The Journal of Finance, 45(4):1109–1128, 1990.
- Online fast adaptation and knowledge accumulation (osaka): a new approach to continual learning. In Advances in Neural Information Processing Systems, volume 33, pages 16532–16545, 2020.
- Empirical evaluation of gated recurrent neural networks on sequence modeling. In NIPS 2014 Workshop on Deep Learning, December 2014, 2014.
- Janez Demšar. Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research, 7(1):1–30, 2006.
- Rethinking importance weighting for deep learning under distribution shift. In Advances in Neural Information Processing Systems, volume 33, pages 11996–12007, 2020.
- Model-agnostic meta-learning for fast adaptation of deep networks. In Proceedings of the 34th International Conference on Machine Learning, pages 1126–1135. PMLR, 06–11 Aug 2017.
- Online meta-learning. In Proceedings of the 36th International Conference on Machine Learning, volume 97, pages 1920–1930. PMLR, 09–15 Jun 2019.
- A survey on concept drift adaptation. ACM Computing Surveys, 46(4), mar 2014.
- A survey on concept drift adaptation. ACM Computing Surveys (CSUR), 46(4), mar 2014.
- Stockformer: Learning hybrid trading machines with predictive coding. In Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, IJCAI-23, pages 4766–4774, 8 2023.
- Adaptive conformal inference under distribution shift. In Advances in Neural Information Processing Systems, volume 34, pages 1660–1672, 2021.
- Survey on online streaming continual learning. In Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, IJCAI-23, pages 6628–6637, 8 2023.
- Task agnostic continual learning via meta learning. In 4th Lifelong Machine Learning Workshop at ICML 2020, 2020.
- Long short-term memory. Neural Computation, 9(8):1735–1780, 1997.
- Overcoming catastrophic forgetting in neural networks. Proceedings of the National Academy of Sciences, 114(13):3521–3526, 2017.
- Ddg-da: Data distribution generation for predictable concept drift adaptation. Proceedings of the AAAI Conference on Artificial Intelligence, 36(4):4092–4100, Jun. 2022.
- An adaptive news-driven method for cvar-sensitive online portfolio selection in non-stationary financial markets. In Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI-21, pages 2708–2715, 8 2021.
- A structured self-attentive sentence embedding. In International Conference on Learning Representations, 2017.
- Learning multiple stock trading patterns with temporal routing adaptor and optimal transport. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, page 1017–1026, 2021.
- Learning under concept drift: A review. IEEE Transactions on Knowledge and Data Engineering, 31(12):2346–2363, 2019.
- A survey on machine learning for recurring concept drifting data streams. Expert Systems with Applications, 213:118934, 2023.
- Three types of incremental learning. Nature Machine Intelligence, 4(12):1185–1197, 2022.
- Laurens van der Maaten and Geoffrey Hinton. Visualizing data using t-sne. Journal of Machine Learning Research, 9(86):2579–2605, 2008.
- Attention is all you need. In Advances in Neural Information Processing Systems, volume 30, 2017.
- Rest: Relational event-driven stock trend forecasting. In Proceedings of the Web Conference 2021, WWW ’21, page 1–10, 2021.
- A unifying framework for detecting outliers and change points from non-stationary time series data. In Proceedings of the 8th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, page 676–681, 2002.
- Qlib: An ai-oriented quantitative investment platform. arXiv preprint arXiv:2009.11189, 2020.
- Simple stochastic and online gradient descent algorithms for pairwise learning. In Advances in Neural Information Processing Systems, volume 34, pages 20160–20171, 2021.
- Meta-adaptive stock movement prediction with two-stage representation learning. In NeurIPS 2022 Workshop on Distribution Shifts: Connecting Methods and Applications, 2022.
- Handling concept drift via model reuse. Machine learning, 109:533–568, 2020.
- Doubleadapt: A meta-learning approach to incremental learning for stock trend forecasting. In Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, page 3492–3503, 2023.
- An overview of concept drift applications. Big data analysis: new algorithms for a new society, pages 91–114, 2016.
- Shiluo Huang (1 paper)
- Zheng Liu (312 papers)
- Qing Li (430 papers)
- Ye deng (9 papers)