Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
169 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Coupling Graph Neural Networks with Fractional Order Continuous Dynamics: A Robustness Study (2401.04331v2)

Published 9 Jan 2024 in cs.LG and cs.AI

Abstract: In this work, we rigorously investigate the robustness of graph neural fractional-order differential equation (FDE) models. This framework extends beyond traditional graph neural (integer-order) ordinary differential equation (ODE) models by implementing the time-fractional Caputo derivative. Utilizing fractional calculus allows our model to consider long-term memory during the feature updating process, diverging from the memoryless Markovian updates seen in traditional graph neural ODE models. The superiority of graph neural FDE models over graph neural ODE models has been established in environments free from attacks or perturbations. While traditional graph neural ODE models have been verified to possess a degree of stability and resilience in the presence of adversarial attacks in existing literature, the robustness of graph neural FDE models, especially under adversarial conditions, remains largely unexplored. This paper undertakes a detailed assessment of the robustness of graph neural FDE models. We establish a theoretical foundation outlining the robustness characteristics of graph neural FDE models, highlighting that they maintain more stringent output perturbation bounds in the face of input and graph topology disturbances, compared to their integer-order counterparts. Our empirical evaluations further confirm the enhanced robustness of graph neural FDE models, highlighting their potential in adversarially robust applications.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (63)
  1. Discrete and Continuous Deep Residual Learning Over Graphs. arXiv:1911.09554.
  2. Caputo, M. 1967. Linear models of dissipation whose Q is almost frequency independent—II. Geophysical Journal International, 13(5): 529–539.
  3. Beltrami flow and neural diffusion on graphs. In Adv. Neural Inform. Process. Syst., 1594–1609.
  4. GRAND: Graph Neural Diffusion. In Proc. Int. Conf. Mach. Learn.
  5. Fast Gradient Attack on Network Embedding. arXiv:1809.02797.
  6. Neural ordinary differential equations. In Adv. Neural Inform. Process. Syst.
  7. Understanding and Improving Graph Injection Attack by Promoting Unnoticeability. In Proc. Int. Conf. Learn. Represent.
  8. GREAD: Graph Neural Reaction-Diffusion Networks. In Proc. Int. Conf. Mach. Learn.
  9. A Comprehensive Survey on Trustworthy Graph Neural Networks: Privacy, Robustness, Fairness, and Explainability. arXiv:2204.08570.
  10. Adversarial attack on graph structured data. In Proc. Int. Conf. Mach. Learn., 1115–1124.
  11. GARNET: Reduced-Rank Topology Learning for Robust and Scalable Graph Neural Networks. In Learning on Graphs Conference, 3–1. PMLR.
  12. The analysis of fractional differential equations. Lect. Notes Math, 2004: 3–12.
  13. Detailed error analysis for a fractional Adams method. Numer. Algorithms, 36: 31–52.
  14. Topology Adaptive Graph Convolutional Networks. arXiv:1710.10370.
  15. Augmented neural odes. In Adv. Neural Inform. Process. Syst., 1–11.
  16. All You Need Is Low (Rank): Defending Against Adversarial Attacks on Graphs. In Proc. Int. Conf. Web Search Data Mining, 169–177.
  17. Single-node attacks for fooling graph neural networks. Neurocomputing, 513: 1–12.
  18. Robustness of Graph Neural Networks at Scale. In Adv. Neural Inform. Process. Syst.
  19. Graph-based Molecular Representation Learning. arXiv:2207.04869.
  20. Stable architectures for deep neural networks. Inverse Problems, 34(1): 1–23.
  21. Inductive Representation Learning on Large Graphs. In Adv. Neural Inform. Process. Syst.
  22. From Continuous Dynamics to Graph Neural Networks: Neural Diffusion and Beyond. arXiv:2310.10121.
  23. Knowledge-aware coupled graph neural network for social recommendation. In Proc. AAAI Conf. Artificial Intell., volume 35, 4115–4122.
  24. Adversarial Inter-Group Link Injection Degrades the Fairness of Graph Neural Networks. In IEEE International Conference on Data Mining (ICDM). IEEE.
  25. Leveraging Label Non-Uniformity for Node Classification in Graph Neural Networks. In Proc. Int. Conf. Mach. Learn., volume 202, 14869–14885.
  26. Graph structure learning for robust graph neural networks. In Proc. Int. Conf. Knowl. Discovery Data Mining, 66–74.
  27. Stable neural ODE with Lyapunov-stable equilibrium points for defending against adversarial attacks. In Adv. Neural Inform. Process. Syst.
  28. Unleashing the Potential of Fractional Calculus in Graph Neural Networks. In Adv. Neural Inform. Process. Syst. Workshop on Machine Learning and the Physical Sciences.
  29. Node Embedding from Neural Hamiltonian Orbits in Graph Neural Networks. In Proc. Int. Conf. Mach. Learn., 15786–15808.
  30. Advancing Graph Neural Networks Through Joint Time-Space Dynamics. In Adv. Neural Inform. Process. Syst. Workshop on The Symbiosis of Deep Learning and Differential Equations III.
  31. Semi-Supervised Classification with Graph Convolutional Networks. In Proc. Int. Conf. Learn. Represent.
  32. SGAT: Simplicial Graph Attention Network. In Proc. Inter. Joint Conf. Artificial Intell.
  33. DeepRobust: A PyTorch Library for Adversarial Attacks and Defenses. arXiv:2005.06149.
  34. Adversarial Attack on Graph Neural Networks as An Influence Maximization Problem. In Proc. of the 15th ACM Int. Conf. Web Search and Data Min., 675–685.
  35. Towards more practical adversarial attacks on graph neural networks. In Adv. Neural Inform. Process. Syst., 4756–4766.
  36. Graph Adversarial Attack via Rewiring. In Proc. Int. Conf. Knowl. Discovery Data Mining, 1161–1169.
  37. Towards deep learning models resistant to adversarial attacks. In Proc. Int. Conf. Learn. Represent.
  38. OpenAI. 2022. ChatGPT-4. Available at: https://www.openai.com (Accessed: 26 September 2023).
  39. Graph Neural Ordinary Differential Equations. arXiv:1911.07532.
  40. Graph-coupled oscillator networks. In Proc. Int. Conf. Mach. Learn., 18888–18909. PMLR.
  41. Graph-Coupled Oscillator Networks. In Proc. Int. Conf. Mach. Learn.
  42. Image Patch-Matching With Graph-Based Learning in Street Scenes. IEEE Trans. Image Process., 32: 3465–3480.
  43. A general framework for low level vision. IEEE Trans. Image Process., 7(3): 310–318.
  44. On the Robustness of Graph Neural Diffusion to Topology Perturbations. In Adv. Neural Inform. Process. Syst. New Orleans, USA.
  45. Adversarial Attacks on Graph Neural Networks via Node Injections: A Hierarchical Reinforcement Learning Approach. In Proc. Web Conf., 673–683.
  46. GRAND++: Graph neural diffusion with a source term. In Proc. Int. Conf. Learn. Represent.
  47. Attention is all you need. In Adv. Neural Inform. Process. Syst.
  48. Graph attention networks. In Proc. Int. Conf. Learn. Represent., 1–12.
  49. A semi-supervised graph attentive network for financial fraud detection. In IEEE International Conference on Data Mining (ICDM), 598–607. IEEE.
  50. Scalable attack on graph data by injecting vicious nodes. Data Mining and Knowledge Discovery, 34: 1363–1389.
  51. ACMP: Allen-Cahn Message Passing with Attractive and Repulsive Forces for Graph Neural Networks. In Proc.Int. Conf. Learn. Represent.
  52. Hiding individuals and communities in a social network. Nature Human Behaviour, 2(1): 139–147.
  53. Weinan, E. 2017. A proposal on machine learning via dynamical systems. Commun. Math. Statist., 1(5): 1–11.
  54. Continuous graph neural networks. In Proc. Int. Conf. Mach. Learn., 10432–10441.
  55. On robustness of neural ordinary differential equations. In Adv. Neural Inform. Process. Syst., 1–13.
  56. Gnnguard: Defending graph neural networks against adversarial attacks. Adv. Neural Inform. Process. Syst., 33: 9263–9275.
  57. Adversarial Robustness in Graph Neural Networks: A Hamiltonian Energy Conservation Approach. In Adv. Neural Inform. Process. Syst. New Orleans, USA.
  58. Graph neural convection-diffusion with heterophily. In Proc. Inter. Joint Conf. Artificial Intell. Macao, China.
  59. Graph Robustness Benchmark: Benchmarking the Adversarial Robustness of Graph Machine Learning. Adv. Neural Inform. Process. Syst. Track Datasets Benchmarks.
  60. Robust graph convolutional networks against adversarial attacks. In Proc. Int. Conf. Knowl. Discovery Data Mining, 1399–1407.
  61. TDGIA: Effective Injection Attacks on Graph Neural Networks. In Proc. Int. Conf. Knowl. Discovery Data Mining, 2461–2471.
  62. Adversarial Attacks on Neural Networks for Graph Data. In Proc. Int. Conf. Knowl. Discovery Data Mining.
  63. Adversarial Attacks on Graph Neural Networks via Meta Learning. In Proc. Int. Conf. Learn. Represent.
Citations (2)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets