Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
184 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Towards Invariant Time Series Forecasting in Smart Cities (2405.05430v1)

Published 8 May 2024 in cs.LG

Abstract: In the transformative landscape of smart cities, the integration of the cutting-edge web technologies into time series forecasting presents a pivotal opportunity to enhance urban planning, sustainability, and economic growth. The advancement of deep neural networks has significantly improved forecasting performance. However, a notable challenge lies in the ability of these models to generalize well to out-of-distribution (OOD) time series data. The inherent spatial heterogeneity and domain shifts across urban environments create hurdles that prevent models from adapting and performing effectively in new urban environments. To tackle this problem, we propose a solution to derive invariant representations for more robust predictions under different urban environments instead of relying on spurious correlation across urban environments for better generalizability. Through extensive experiments on both synthetic and real-world data, we demonstrate that our proposed method outperforms traditional time series forecasting models when tackling domain shifts in changing urban environments. The effectiveness and robustness of our method can be extended to diverse fields including climate modeling, urban planning, and smart city resource management.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (15)
  1. Invariant risk minimization. In International Conference on Machine Learning. PMLR, 215–223.
  2. Self-Supervised Representations of Geolocated Weather Time Series-an Evaluation and Analysis. (2022).
  3. Learning long-term dependencies with gradient descent is difficult. IEEE Transactions on Neural Networks 5, 2 (1994), 157–166.
  4. Time series analysis: forecasting and control. Time series analysis: forecasting and control 734 (1976).
  5. Geographically weighted regression. Journal of the Royal Statistical Society: Series D (The Statistician) 47, 3 (1998), 431–443.
  6. Learning phrase representations using RNN encoder–decoder for statistical machine translation. arXiv preprint arXiv:1406.1078 (2014).
  7. Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation 9, 8 (1997), 1735–1780.
  8. Do Deep Learning Models Generalize to Overhead Imagery from Novel Geographic Domains? The xGD Benchmark Problem. In IGARSS 2020 - 2020 IEEE International Geoscience and Remote Sensing Symposium. 1476–1479. https://doi.org/10.1109/IGARSS39084.2020.9323080
  9. A reinforcement learning-based routing algorithm for large street networks. International Journal of Geographical Information Science 38, 2 (2024), 183–215.
  10. Pavel Ostyakov and Sergey I. Nikolenko. 2019. Adapting Convolutional Neural Networks for Geographical Domain Shift. arXiv:1901.06345 [cs.CV]
  11. Learning representations by back-propagating errors. Nature 323, 6088 (1986), 533–536.
  12. Attention is all you need. In Advances in Neural Information Processing Systems. 5998–6008.
  13. Co-clustering geo-referenced time series: exploring spatio-temporal patterns in Dutch temperature data. International Journal of Geographical Information Science (2015).
  14. Location-Aware Social Network Recommendation via Temporal Graph Networks. In Proceedings of the 7th ACM SIGSPATIAL Workshop on Location-based Recommendations, Geosocial Networks and Geoadvertising. 58–61.
  15. U-air: When urban air quality inference meets big data. In Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining. 1436–1444.
Citations (4)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com