Deep Optimal Timing Strategies for Time Series (2310.05479v1)
Abstract: Deciding the best future execution time is a critical task in many business activities while evolving time series forecasting, and optimal timing strategy provides such a solution, which is driven by observed data. This solution has plenty of valuable applications to reduce the operation costs. In this paper, we propose a mechanism that combines a probabilistic time series forecasting task and an optimal timing decision task as a first systematic attempt to tackle these practical problems with both solid theoretical foundation and real-world flexibility. Specifically, it generates the future paths of the underlying time series via probabilistic forecasting algorithms, which does not need a sophisticated mathematical dynamic model relying on strong prior knowledge as most other common practices. In order to find the optimal execution time, we formulate the decision task as an optimal stopping problem, and employ a recurrent neural network structure (RNN) to approximate the optimal times. Github repository: \url{github.com/ChenPopper/optimal_timing_TSF}.
- S. Becker, P. Cheridito, and A. Jentzen, “Deep optimal stopping, Journal of Machine Learning Research”, vol. 20, pp. 1–25, 2019.
- S. Becker, P. Cheridito, A. Jentzen, and T. Welti, “Solving high-dimensional optimal stopping problems using deep learning”, European Journal of Applied Mathematics, vol. 32, pp. 470–514, 2021.
- C. Hure, H. Pham, A. Bachouch, and N. Langrene, “Deep neural networks algorithms for stochastic control problems on finite horizon: convergence analysis”, https://arxiv.org/pdf/1812.04300, 2018.
- H. Ery and L. Michel, “Solving optimal stopping problems with deep Q-learning”, https://arxiv.org/pdf/1812.04300, 2021.
- Q. Ma and J. Stachurski, “Optimal timing of decisions: a general theory based on continuation values”, Journal of Economic Dynamics and Control, vol. 101, pp.62–81, 2019.
- A. Fathan and E. Delage, “Deep reinforcement learning for optimal stopping with applications in financial engineering”, https://arxiv.org/abs/2105.08877v1, 2021.
- D. Egloff, “Monte Carlo algorithms for optimal timing and statistical learning”, The Annals of Applied Probability, vol. 15, pp. 1–37, 2005.
- D. Salinas, V. Flunkert, J. Gasthaus, and T. Januschowski, “DeepAR: probabilistic forecasting with autoregressive recurrent networks”, International Journal of Forecasting, vol. 36, pp. 1181–1191, 2020.
- S. Agrawal and R. Jia, “Learning in structured MDPs with convex cost functions: improved regret bounds for inventory management”, https://arxiv.org/pdf/1905.04337.pdf, 2019.
- M. Bijvank and I. F. A. Vis, “Lost-sales inventory theory: a review”, European Journal of Operational Research, vol. 215, 1–13, 2011.
- S. Chen, A. M. Devraj, A. Bušić, and S. P. Meyn, “Zap Q-learning for optimal stopping time problems”, https://arXiv:1904.11538, 2019.
- D. F. Ciocan and V. V. Misic, “Interpretable optimal stopping”, https://arxiv.org/abs/1812.07211, 2018.
- C. Cheng, F. Tan, and Z. Wei, “DeepVar: an end-to-end deep learning approach for genomic variant recognition in biomedical literature”, AAAI Conference on Artificial Intelligence, 2020.
- B. Lim, S. O. Arik, N. Loeff, and T. Pfister, “Temporal fusion transformers for interpretable multi-horizon time series forecasting”, International Journal of Forecasting, vol. 37, October–December 2021, pp. 1748–1764, 2021.
- N. Wu, B. Green, X. Ben, and S. O’Banion, “Deep Transformer Models for Time Series Forecasting: The Influenza Prevalence Case”, https://arxiv.org/abs/2001.08317, 2020.
- J. Chung, C. Gulcehre, K. Cho, and Y. Bengio, “Empirical evaluation of gated recurrent neural networks on sequence modeling”, arxiv.org/abs/1412.3555.
- K. Dwarakanath, D. Dervovic, P. Tavallali, S. S. Vyetrenko, and T. Balch, “Optimal stopping with Gaussian processes”, Proceedings of the Third ACM International Conference on AI in Finance, pp. 497–-505, Nov. 2022.
- F. Heinz and R. Madlener, “Generalized optimal stopping for decision making in energy markets”, Annual International Real Options Conference, 2023.
- A. Iwayemi, P. Yi, X. Dong, and C. Zhou, “Knowing when to act: an optimal stopping method for smart grid demand response”, IEEE Network, vol. 25, pp. 44–49, 2011.
- L. Bird, M. Milligan, and D. Lew, “Integrating variable renewable energy: chanllenges and solutions”, Technical Report of the National Renewable Energy Laboratory, NREL/TP-6A20-60451, www.nrel.gov/publications, Sept. 2013.
- O. Smith, O. Cattell, E. Farcot, R. D. O’dea, and K. I. Hopcraft, “The effect of renewable energy incorporation on power grid stability and resilience”, Science Advances, vol. 8, 2022.
- Shi, Xiaoming and Xue, Siqiao and Wang, Kangrui and Zhou, Fan and Zhang, James Y and Zhou, Jun and Tan, Chenhao and Mei, Hongyuan, “Language Models Can Improve Event Prediction by Few-Shot Abductive Reasoning”, Advances in Neural Information Processing Systems (NeurIPS), 2023.
- Xue, Siqiao and Shi, Xiaoming and Zhang, Y James and Mei, Hongyuan, “HYPRO: A Hybridly Normalized Probabilistic Model for Long-Horizon Prediction of Event Sequences”, Advances in Neural Information Processing Systems (NeurIPS), 2022.
- Chao Qu and Xiaoyu Tan and Siqiao Xue and Xiaoming Shi and James Zhang and Hongyuan Mei, “Bellman Meets Hawkes: Model-Based Reinforcement Learning via Temporal Point Processes”, Proceedings of the AAAI Conference on Artificial Intelligence, 2022.
- Xue, Siqiao and Shi, Xiaoming and Hao, Hongyan and Ma, Lintao and Zhang, James and Wang, Shiyu and Wang, Shijun, “A Graph Regularized Point Process Model For Event Propagation Sequence”, International Joint Conference on Neural Networks (IJCNN), 2021.
- Yan Wang and Zhixuan Chu and Tao Zhou and Caigao Jiang and Hongyan Hao and Minjie Zhu and Xindong Cai and Qing Cui and Longfei Li and James Y Zhang and Siqiao Xue and Jun Zhou, “Enhancing Event Sequence Modeling with Contrastive Relational Inference”, ICDM, 2023.
- Siqiao Xue and Chao Qu and Xiaoming Shi and Cong Liao and Shiyi Zhu and Xiaoyu Tan and Lintao Ma and Shiyu Wang and Shijun Wang and Yun Hu and Lei Lei and Yangfei Zheng and Jianguo Li and James Zhang, “A Meta Reinforcement Learning Approach for Predictive Autoscaling in the Cloud”, The 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2022.
- Hongyan Hao, Zhixuan Chu, Shiyi Zhu, Gangwei Jiang, Yan Wang, Caigao Jiang, James Zhang, Wei Jiang, Siqiao Xue, Jun Zhou, “Continual Learning in Predictive Autoscaling”, CIKM, 2023.
- Siqiao Xue and Xiaoming Shi and Zhixuan Chu and Yan Wang and Fan Zhou and Hongyan Hao and Caigao Jiang and Chen Pan and Yi Xu and James Y. Zhang and Qingsong Wen and Jun Zhou and Hongyuan Mei, “EasyTPP: Towards Open Benchmarking the Temporal Point Processes”, Arxiv, 2023.
- Shuai Xiao, Chen Pan, Min Wang, Xinxin Zhu, Siqiao Xue, Jing Wang, Yunhua Hu, James Zhang, Jinghua Feng, “Automatic Deduction Path Learning via Reinforcement Learning with Environmental Correction”, Arxiv, 2023.