Towards Invariant Time Series Forecasting in Smart Cities (2405.05430v1)
Abstract: In the transformative landscape of smart cities, the integration of the cutting-edge web technologies into time series forecasting presents a pivotal opportunity to enhance urban planning, sustainability, and economic growth. The advancement of deep neural networks has significantly improved forecasting performance. However, a notable challenge lies in the ability of these models to generalize well to out-of-distribution (OOD) time series data. The inherent spatial heterogeneity and domain shifts across urban environments create hurdles that prevent models from adapting and performing effectively in new urban environments. To tackle this problem, we propose a solution to derive invariant representations for more robust predictions under different urban environments instead of relying on spurious correlation across urban environments for better generalizability. Through extensive experiments on both synthetic and real-world data, we demonstrate that our proposed method outperforms traditional time series forecasting models when tackling domain shifts in changing urban environments. The effectiveness and robustness of our method can be extended to diverse fields including climate modeling, urban planning, and smart city resource management.
- Invariant risk minimization. In International Conference on Machine Learning. PMLR, 215–223.
- Self-Supervised Representations of Geolocated Weather Time Series-an Evaluation and Analysis. (2022).
- Learning long-term dependencies with gradient descent is difficult. IEEE Transactions on Neural Networks 5, 2 (1994), 157–166.
- Time series analysis: forecasting and control. Time series analysis: forecasting and control 734 (1976).
- Geographically weighted regression. Journal of the Royal Statistical Society: Series D (The Statistician) 47, 3 (1998), 431–443.
- Learning phrase representations using RNN encoder–decoder for statistical machine translation. arXiv preprint arXiv:1406.1078 (2014).
- Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation 9, 8 (1997), 1735–1780.
- Do Deep Learning Models Generalize to Overhead Imagery from Novel Geographic Domains? The xGD Benchmark Problem. In IGARSS 2020 - 2020 IEEE International Geoscience and Remote Sensing Symposium. 1476–1479. https://doi.org/10.1109/IGARSS39084.2020.9323080
- A reinforcement learning-based routing algorithm for large street networks. International Journal of Geographical Information Science 38, 2 (2024), 183–215.
- Pavel Ostyakov and Sergey I. Nikolenko. 2019. Adapting Convolutional Neural Networks for Geographical Domain Shift. arXiv:1901.06345 [cs.CV]
- Learning representations by back-propagating errors. Nature 323, 6088 (1986), 533–536.
- Attention is all you need. In Advances in Neural Information Processing Systems. 5998–6008.
- Co-clustering geo-referenced time series: exploring spatio-temporal patterns in Dutch temperature data. International Journal of Geographical Information Science (2015).
- Location-Aware Social Network Recommendation via Temporal Graph Networks. In Proceedings of the 7th ACM SIGSPATIAL Workshop on Location-based Recommendations, Geosocial Networks and Geoadvertising. 58–61.
- U-air: When urban air quality inference meets big data. In Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining. 1436–1444.