Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
139 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Spatial Heterophily Aware Graph Neural Networks (2306.12139v1)

Published 21 Jun 2023 in cs.LG and cs.SI

Abstract: Graph Neural Networks (GNNs) have been broadly applied in many urban applications upon formulating a city as an urban graph whose nodes are urban objects like regions or points of interest. Recently, a few enhanced GNN architectures have been developed to tackle heterophily graphs where connected nodes are dissimilar. However, urban graphs usually can be observed to possess a unique spatial heterophily property; that is, the dissimilarity of neighbors at different spatial distances can exhibit great diversity. This property has not been explored, while it often exists. To this end, in this paper, we propose a metric, named Spatial Diversity Score, to quantitatively measure the spatial heterophily and show how it can influence the performance of GNNs. Indeed, our experimental investigation clearly shows that existing heterophilic GNNs are still deficient in handling the urban graph with high spatial diversity score. This, in turn, may degrade their effectiveness in urban applications. Along this line, we propose a Spatial Heterophily Aware Graph Neural Network (SHGNN), to tackle the spatial diversity of heterophily of urban graphs. Based on the key observation that spatially close neighbors on the urban graph present a more similar mode of difference to the central node, we first design a rotation-scaling spatial aggregation module, whose core idea is to properly group the spatially close neighbors and separately process each group with less diversity inside. Then, a heterophily-sensitive spatial interaction module is designed to adaptively capture the commonality and diverse dissimilarity in different spatial groups. Extensive experiments on three real-world urban datasets demonstrate the superiority of our SHGNN over several its competitors.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (56)
  1. Mixhop: Higher-order graph convolutional architectures via sparsified neighborhood mixing. In ICML. PMLR, 21–29.
  2. Beyond low-frequency information in graph convolutional networks. In AAAI, Vol. 35. 3950–3957.
  3. Simple and deep graph convolutional networks. In ICML. PMLR, 1725–1735.
  4. Points-of-interest relationship inference with spatial-enriched graph neural networks. PVLDB 15, 3 (2021), 504–512.
  5. Adaptive Universal Generalized PageRank Graph Neural Network. In ICLR.
  6. Marco Cuturi. 2013. Sinkhorn distances: Lightspeed computation of optimal transport. NeurIPS 26 (2013).
  7. Label-Wise Graph Convolutional Network for Heterophilic Graphs. In LoG. PMLR, 26–1.
  8. GBK-GNN: Gated Bi-Kernel Graph Neural Networks for Modeling Both Homophily and Heterophily. In WWW. 1550–1558.
  9. Spatial-temporal graph ode networks for traffic flow forecasting. In SIGKDD. 364–373.
  10. Semi-Supervised Air Quality Forecasting via Self-Supervised Hierarchical Graph Neural Network. TKDE (2022).
  11. Block modeling-guided graph convolutional neural networks. In AAAI, Vol. 36. 4022–4029.
  12. Measuring and Improving the Use of Graph Information in Graph Neural Networks. In ICLR.
  13. Relational fusion networks: Graph convolutional networks for road networks. TITS 23, 1 (2020), 418–429.
  14. Junteng Jia and Austion R Benson. 2020. Residual correlation in graph neural network regression. In SIGKDD. 588–598.
  15. Universal graph convolutional networks. NeurIPS 34 (2021), 10654–10664.
  16. Node similarity preserving graph convolutional networks. In WSDM. 148–156.
  17. Dongkwan Kim and Alice Oh. 2020. How to Find Your Friendly Neighborhood: Graph Attention Design with Self-Supervision. In ICLR.
  18. Thomas N Kipf and Max Welling. 2016. Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 (2016).
  19. A Data-Driven Spatial-Temporal Graph Neural Network for Docked Bike Prediction. In ICDE. IEEE, 713–726.
  20. Competitive analysis for points of interest. In SIGKDD. 1265–1274.
  21. Finding global homophily in graph neural networks when meeting heterophily. In ICML. PMLR, 13242–13256.
  22. Fine-grained urban flow prediction. In WWW. 1833–1845.
  23. Large scale learning on non-homophilous graphs: New benchmarks and strong simple methods. NeurIPS 34 (2021), 20887–20902.
  24. New benchmarks for learning on non-homophilous graphs. arXiv preprint arXiv:2104.01404 (2021).
  25. Practical Adversarial Attacks on Spatiotemporal Traffic Forecasting Models. In NeurIPS, Vol. 35. 19035–19047.
  26. Non-local graph neural networks. TPAMI (2021).
  27. Knowledge-infused contrastive learning for urban imagery-based socioeconomic prediction. In WWW. 4150–4160.
  28. Is Heterophily A Real Nightmare For Graph Neural Networks To Do Node Classification? arXiv preprint arXiv:2109.05641 (2021).
  29. Geom-GCN: Geometric Graph Convolutional Networks. In ICLR.
  30. Deepwalk: Online learning of social representations. In SIGKDD. 701–710.
  31. FOGS: First-Order Gradient Supervision with Learning-based Graph for Traffic Flow Forecasting. In IJCAI.
  32. Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014).
  33. Spatial-temporal synchronous graph convolutional networks: A new framework for spatial-temporal network data forecasting. In AAAI, Vol. 34. 914–921.
  34. Breaking the Limit of Graph Neural Networks by Improving the Assortativity of Graphs with Local Mixing Patterns. In SIGKDD. 1541–1551.
  35. Waldo R Tobler. 1970. A computer movie simulating urban growth in the Detroit region. Economic geography 46, sup1 (1970), 234–240.
  36. Graph Attention Networks. In ICLR.
  37. Event-Aware Multimodal Mobility Nowcasting. In AAAI, Vol. 36. 4228–4236.
  38. Simplifying graph convolutional networks. In ICML. PMLR, 6861–6871.
  39. Learning effective road network representation with hierarchical graph neural networks. In SIGKDD. 6–14.
  40. Multi-Graph Fusion Networks for Urban Region Embedding. In IJCAI.
  41. Beyond low-pass filtering: Graph convolutional networks with automatic filtering. TKDE (2022).
  42. Beyond the First Law of Geography: Learning Representations of Satellite Imagery by Leveraging Point-of-Interests. In WWW. 3308–3316.
  43. 3dgcn: 3-dimensional dynamic graph convolutional network for citywide crowd flow prediction. TKDD 15, 6 (2021), 1–21.
  44. A Contextual Master-Slave Framework on Urban Region Graph for Urban Village Detection. In ICDE.
  45. Attentional multi-graph convolutional network for regional economy prediction with open migration data. In SIGKDD. 2225–2233.
  46. Two sides of the same coin: Heterophily and oversmoothing in graph convolutional neural networks. arXiv preprint arXiv:2102.06462 (2021).
  47. Diverse message passing for attribute with heterophily. NeurIPS 34 (2021), 4751–4763.
  48. Graph neural networks inspired by classical iterative algorithms. In ICML. PMLR, 11773–11783.
  49. Neural Network based Continuous Conditional Random Field for Fine-grained Crime Prediction.. In IJCAI. 4157–4163.
  50. An effective joint prediction model for travel demands and traffic flows. In ICDE. IEEE, 348–359.
  51. Multi-view joint graph representation learning for urban region embedding. In IJCAI. 4431–4437.
  52. Neighborhood Pattern Is Crucial for Graph Convolutional Networks Performing Node Classification. TNNLS (2022).
  53. Graph neural networks for graphs with heterophily: A survey. arXiv preprint arXiv:2202.07082 (2022).
  54. Competitive relationship prediction for points of interest: A neural graphlet based approach. TKDE 34, 12 (2021), 5681–5692.
  55. Graph neural networks with heterophily. In AAAI, Vol. 35. 11168–11176.
  56. Beyond homophily in graph neural networks: Current limitations and effective designs. NeurIPS 33 (2020), 7793–7804.
Citations (1)

Summary

We haven't generated a summary for this paper yet.