Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
143 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Adaptive Least Mean Squares Graph Neural Networks and Online Graph Signal Estimation (2401.15304v1)

Published 27 Jan 2024 in cs.LG and eess.SP

Abstract: The online prediction of multivariate signals, existing simultaneously in space and time, from noisy partial observations is a fundamental task in numerous applications. We propose an efficient Neural Network architecture for the online estimation of time-varying graph signals named the Adaptive Least Mean Squares Graph Neural Networks (LMS-GNN). LMS-GNN aims to capture the time variation and bridge the cross-space-time interactions under the condition that signals are corrupted by noise and missing values. The LMS-GNN is a combination of adaptive graph filters and Graph Neural Networks (GNN). At each time step, the forward propagation of LMS-GNN is similar to adaptive graph filters where the output is based on the error between the observation and the prediction similar to GNN. The filter coefficients are updated via backpropagation as in GNN. Experimenting on real-world temperature data reveals that our LMS-GNN achieves more accurate online predictions compared to graph-based methods like adaptive graph filters and graph convolutional neural networks.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (28)
  1. “Weather forecasting using deep learning techniques,” in ICACSIS, 2015, pp. 281–285.
  2. “Network modelling methods for fmri,” NeuroImage, vol. 54, no. 2, pp. 875–891, 2011.
  3. F. Zhao and E. E. Kuruoglu, “Sequential monte carlo graph convolutional network for dynamic brain connectivity,” arXiv, 2023.
  4. “Traffic flow prediction with big data: A deep learning approach,” IEEE Trans. Intell. Transp. Syst., vol. 16, no. 2, pp. 865–873, 2015.
  5. “When weather matters: Iot-based electrical load forecasting for smart grid,” IEEE Commun. Mag., vol. 55, no. 10, pp. 46–51, 2017.
  6. “The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains,” IEEE Signal Process. Mag., vol. 30, no. 3, pp. 83–98, 2013.
  7. “Graph signal processing: Overview, challenges, and applications,” Proc. IEEE, vol. 106, no. 5, pp. 808–828, 2018.
  8. “Graph signal processing for machine learning: A review and new perspectives,” IEEE Signal processing magazine, vol. 37, no. 6, pp. 117–127, 2020.
  9. A. Sandryhaila and J. M.F. Moura, “Big data analysis with signal processing on graphs: Representation and processing of massive data sets with irregular structure,” IEEE Signal Process. Mag., vol. 31, no. 5, pp. 80 – 90, 2014.
  10. J. Mei and J. M. F. Moura, “Signal processing on graphs: Causal modeling of unstructured data,” IEEE Trans. Signal Process., vol. 65, no. 8, pp. 2077–2092, 2017.
  11. “Autoregressive moving average graph filtering,” IEEE Trans. Signal Process., vol. 65, no. 2, pp. 274–288, 2017.
  12. “Multivariate time series forecasting with garch models on graphs,” IEEE Trans. Signal Inf. Process. Netw., vol. 9, pp. 557–568, 2023.
  13. “Adaptive least mean squares estimation of graph signals,” IEEE Trans. Signal Inf. Process. Netw., vol. 2, no. 4, pp. 555 – 568, 2016.
  14. “Normalized lms algorithm and data-selective strategies for adaptive graph signal estimation,” Signal Processing, vol. 167, pp. 107326, 2020.
  15. “Adaptive estimation and sparse sampling for graph signals in alpha-stable noise,” Digital Signal Processing, vol. 105, pp. 102782, 2020.
  16. “Graph normalized-lmp algorithm for signal estimation under impulsive noise,” J. Signal Process. Syst., pp. 1–12, 2022.
  17. “Adaptive sign algorithm for graph signal processing,” Signal Processing, vol. 200, 2022.
  18. “A graph diffusion lms strategy for adaptive graph signal processing,” Asilomar, 2017.
  19. Y. Yan and E. E. Kuruoglu, “Fast and robust wind speed prediction under impulsive noise via adaptive graph-sign diffusion,” in IEEE CAI, 2023, pp. 302–305.
  20. T. Kipf and M. Welling, “Semi-supervised classification with graph convolutional networks,” ICLR, 2016.
  21. “Convolutional neural networks on graphs with fast localized spectral filtering,” Advances in neural information processing systems, vol. 29, 2016.
  22. “Spectral networks and locally connected networks on graphs,” ICLR, 2014.
  23. “Spatio-temporal graph convolutional networks: A deep learning framework for traffic forecasting,” in IJCAI, 2018.
  24. “Spatial-temporal synchronous graph convolutional networks: A new framework for spatial-temporal network data forecasting,” in Proceedings of the AAAI conference on artificial intelligence, 2020, vol. 34, pp. 914–921.
  25. M. Li and Z. Zhu, “Spatial-temporal fusion graph neural networks for traffic flow forecasting,” in Proceedings of the AAAI conference on artificial intelligence, 2021, vol. 35, pp. 4189–4196.
  26. “Joint forecasting and interpolation of time-varying graph signals using deep learning,” IEEE Trans. Signal Inf. Process. Netw., vol. 6, pp. 761–773, 2020.
  27. “Spectral temporal graph neural network for multivariate time-series forecasting,” Advances in neural information processing systems, vol. 33, pp. 17766–17778, 2020.
  28. “U.S. climate normals 2020: U.S. hourly climate normals (1991-2020),” NOAA National Centers for Environmental Information, 2020.
Citations (1)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets