Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
119 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

TransGlow: Attention-augmented Transduction model based on Graph Neural Networks for Water Flow Forecasting (2312.05961v1)

Published 10 Dec 2023 in cs.LG

Abstract: The hydrometric prediction of water quantity is useful for a variety of applications, including water management, flood forecasting, and flood control. However, the task is difficult due to the dynamic nature and limited data of water systems. Highly interconnected water systems can significantly affect hydrometric forecasting. Consequently, it is crucial to develop models that represent the relationships between other system components. In recent years, numerous hydrological applications have been studied, including streamflow prediction, flood forecasting, and water quality prediction. Existing methods are unable to model the influence of adjacent regions between pairs of variables. In this paper, we propose a spatiotemporal forecasting model that augments the hidden state in Graph Convolution Recurrent Neural Network (GCRN) encoder-decoder using an efficient version of the attention mechanism. The attention layer allows the decoder to access different parts of the input sequence selectively. Since water systems are interconnected and the connectivity information between the stations is implicit, the proposed model leverages a graph learning module to extract a sparse graph adjacency matrix adaptively based on the data. Spatiotemporal forecasting relies on historical data. In some regions, however, historical data may be limited or incomplete, making it difficult to accurately predict future water conditions. Further, we present a new benchmark dataset of water flow from a network of Canadian stations on rivers, streams, and lakes. Experimental results demonstrate that our proposed model TransGlow significantly outperforms baseline methods by a wide margin.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (36)
  1. Ö. Kişi, “Stream flow forecasting using neuro-wavelet technique,” Hydrological Processes: An International Journal, vol. 22, no. 20, pp. 4142–4152, 2008.
  2. Z. Hao, V. P. Singh, and Y. Xia, “Seasonal drought prediction: advances, challenges, and future prospects,” Reviews of Geophysics, vol. 56, no. 1, pp. 108–141, 2018.
  3. Z. Hao, A. AghaKouchak, N. Nakhjiri, and A. Farahmand, “Global integrated drought monitoring and prediction system,” Scientific data, vol. 1, no. 1, pp. 1–10, 2014.
  4. Z. Hao, X. Yuan, Y. Xia, F. Hao, and V. P. Singh, “An overview of drought monitoring and prediction systems at regional and global scales,” Bulletin of the American Meteorological Society, vol. 98, no. 9, pp. 1879–1896, 2017.
  5. P. Nayak, K. Sudheer, D. Rangan, and K. Ramasastri, “Short-term flood forecasting with a neurofuzzy model,” Water Resources Research, vol. 41, no. 4, 2005.
  6. S. K. Jain, P. Mani, S. K. Jain, P. Prakash, V. P. Singh, D. Tullos, S. Kumar, S. Agarwal, and A. Dimri, “A brief review of flood forecasting techniques and their applications,” International Journal of River Basin Management, vol. 16, no. 3, pp. 329–344, 2018.
  7. C. Karyotis, T. Maniak, F. Doctor, R. Iqbal, V. Palade, and R. Tang, “Deep learning for flood forecasting and monitoring in urban environments,” in 2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA).   IEEE, 2019, pp. 1392–1397.
  8. A. N. Ahmed, F. B. Othman, H. A. Afan, R. K. Ibrahim, C. M. Fai, M. S. Hossain, M. Ehteram, and A. Elshafie, “Machine learning methods for better water quality prediction,” Journal of Hydrology, vol. 578, p. 124084, 2019.
  9. A. H. Haghiabi, A. H. Nasrolahi, and A. Parsaie, “Water quality prediction using machine learning methods,” Water Quality Research Journal, vol. 53, no. 1, pp. 3–13, 2018.
  10. S. Mohr, K. Drainas, and J. Geist, “Assessment of neural networks for stream-water-temperature prediction,” in 2021 20th IEEE International Conference on Machine Learning and Applications (ICMLA).   IEEE, 2021, pp. 891–896.
  11. A. Zeng, M. Chen, L. Zhang, and Q. Xu, “Are transformers effective for time series forecasting?” in Proceedings of the AAAI conference on artificial intelligence, vol. 37, no. 9, 2023, pp. 11 121–11 128.
  12. L. R. Medsker and L. Jain, “Recurrent neural networks,” Design and Applications, vol. 5, no. 64-67, p. 2, 2001.
  13. A. Graves and A. Graves, “Long short-term memory,” Supervised sequence labelling with recurrent neural networks, pp. 37–45, 2012.
  14. R. Dey and F. M. Salem, “Gate-variants of gated recurrent unit (gru) neural networks,” in 2017 IEEE 60th international midwest symposium on circuits and systems (MWSCAS).   IEEE, 2017, pp. 1597–1600.
  15. T. Mikolov and G. Zweig, “Context dependent recurrent neural network language model,” in 2012 IEEE Spoken Language Technology Workshop (SLT).   IEEE, 2012, pp. 234–239.
  16. D. Datta, P. E. David, D. Mittal, and A. Jain, “Neural machine translation using recurrent neural network,” International Journal of Engineering and Advanced Technology, vol. 9, no. 4, pp. 1395–1400, 2020.
  17. H. Zhou, S. Zhang, J. Peng, S. Zhang, J. Li, H. Xiong, and W. Zhang, “Informer: Beyond efficient transformer for long sequence time-series forecasting,” in Proceedings of the AAAI conference on artificial intelligence, vol. 35, no. 12, 2021, pp. 11 106–11 115.
  18. W. L. Hamilton, “Graph representation learning,” Synthesis Lectures on Artifical Intelligence and Machine Learning, vol. 14, no. 3, pp. 1–159, 2020.
  19. T. N. Kipf and M. Welling, “Semi-supervised classification with graph convolutional networks,” arXiv preprint arXiv:1609.02907, 2016.
  20. Y. Li, R. Yu, C. Shahabi, and Y. Liu, “Diffusion convolutional recurrent neural network: Data-driven traffic forecasting,” arXiv preprint arXiv:1707.01926, 2017.
  21. G. of Canada, “Environment and natural resources,” Jan 2018, last Modified: 2023-07-11. [Online]. Available: https://www.canada.ca/en/services/environment.html
  22. E. Zivot and J. Wang, “Vector autoregressive models for multivariate time series,” Modeling financial time series with S-PLUS®, pp. 385–429, 2006.
  23. Y. Lai and D. A. Dzombak, “Use of the autoregressive integrated moving average (arima) model to forecast near-term regional temperature and precipitation,” Weather and Forecasting, vol. 35, no. 3, pp. 959–976, 2020.
  24. K. Narasimha Murthy, R. Saravana, and K. Vijaya Kumar, “Modeling and forecasting rainfall patterns of southwest monsoons in north–east india as a sarima process,” Meteorology and Atmospheric Physics, vol. 130, pp. 99–106, 2018.
  25. A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, “Attention is all you need,” Advances in neural information processing systems, vol. 30, 2017.
  26. M. Xu, W. Dai, C. Liu, X. Gao, W. Lin, G.-J. Qi, and H. Xiong, “Spatial-temporal transformer networks for traffic flow forecasting,” arXiv preprint arXiv:2001.02908, 2020.
  27. Y. Liang, Y. Xia, S. Ke, Y. Wang, Q. Wen, J. Zhang, Y. Zheng, and R. Zimmermann, “Airformer: Predicting nationwide air quality in china with transformers,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 37, no. 12, 2023, pp. 14 329–14 337.
  28. X. Ma, Z. Dai, Z. He, J. Ma, Y. Wang, and Y. Wang, “Learning traffic as images: a deep convolutional neural network for large-scale transportation network speed prediction,” Sensors, vol. 17, no. 4, p. 818, 2017.
  29. Z. Wu, S. Pan, G. Long, J. Jiang, X. Chang, and C. Zhang, “Connecting the dots: Multivariate time series forecasting with graph neural networks,” in Proceedings of the 26th ACM SIGKDD international conference on knowledge discovery & data mining, 2020, pp. 753–763.
  30. L. Bai, L. Yao, C. Li, X. Wang, and C. Wang, “Adaptive graph convolutional recurrent network for traffic forecasting,” arXiv preprint arXiv:2007.02842, 2020.
  31. J. G. Makin, D. A. Moses, and E. F. Chang, “Machine translation of cortical activity to text with an encoder–decoder framework,” Nature neuroscience, vol. 23, no. 4, pp. 575–582, 2020.
  32. C. Zheng, X. Fan, C. Wang, and J. Qi, “Gman: A graph multi-attention network for traffic prediction,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, no. 01, 2020, pp. 1234–1241.
  33. R. Jiang, Z. Wang, J. Yong, P. Jeph, Q. Chen, Y. Kobayashi, X. Song, S. Fukushima, and T. Suzumura, “Spatio-temporal meta-graph learning for traffic forecasting,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 37, no. 7, 2023, pp. 8078–8086.
  34. Environment and C. C. Canada. (2023) Hydrometric statistics data. [Online]. Available: https://wateroffice.ec.gc.ca/search/statistics_e.html
  35. Z. Zhou and X. Li, “Graph convolution: A high-order and adaptive approach,” arXiv preprint arXiv:1706.09916, 2017.
  36. C. Shang, J. Chen, and J. Bi, “Discrete graph structure learning for forecasting multiple time series,” arXiv preprint arXiv:2101.06861, 2021.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (4)
  1. Naghmeh Shafiee Roudbari (3 papers)
  2. Charalambos Poullis (22 papers)
  3. Zachary Patterson (10 papers)
  4. Ursula Eicker (3 papers)
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now