Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
125 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Attentive Graph Enhanced Region Representation Learning (2307.03212v3)

Published 6 Jul 2023 in cs.CV, cs.AI, cs.CY, and cs.LG

Abstract: Representing urban regions accurately and comprehensively is essential for various urban planning and analysis tasks. Recently, with the expansion of the city, modeling long-range spatial dependencies with multiple data sources plays an important role in urban region representation. In this paper, we propose the Attentive Graph Enhanced Region Representation Learning (ATGRL) model, which aims to capture comprehensive dependencies from multiple graphs and learn rich semantic representations of urban regions. Specifically, we propose a graph-enhanced learning module to construct regional graphs by incorporating mobility flow patterns, point of interests (POIs) functions, and check-in semantics with noise filtering. Then, we present a multi-graph aggregation module to capture both local and global spatial dependencies between regions by integrating information from multiple graphs. In addition, we design a dual-stage fusion module to facilitate information sharing between different views and efficiently fuse multi-view representations for urban region embedding using an improved linear attention mechanism. Finally, extensive experiments on real-world datasets for three downstream tasks demonstrate the superior performance of our model compared to state-of-the-art methods.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (27)
  1. Watch Your Step: Learning Node Embeddings via Graph Attention. arXiv:1710.09599 [cs, stat]
  2. Bruce F Berg. 2007. New York City Politics : Governing Gotham. Rutgers University Press (2007), 352. https://doi.org/10.36019/9780813586694
  3. Understanding User’s Travel Behavior and City Region Functions from Station-Free Shared Bike Usage Data. Transportation Research Part F: Traffic Psychology and Behaviour 72 (July 2020), 81–95. https://doi.org/10.1016/j.trf.2020.03.018
  4. A Survey on Network Embedding. arXiv:1711.08752 [cs]
  5. Efficient Region Embedding with Multi-View Spatial Networks: A Perspective of Locality-Constrained Spatial Autocorrelations. Proceedings of the AAAI Conference on Artificial Intelligence 33, 01 (July 2019), 906–913. https://doi.org/10.1609/aaai.v33i01.3301906
  6. Neural Message Passing for Quantum Chemistry. arXiv:1704.01212 [cs]
  7. Aditya Grover and Jure Leskovec. 2016. Node2vec: Scalable Feature Learning for Networks. arXiv:1607.00653 [cs, stat]
  8. Beyond Self-attention: External Attention Using Two Linear Layers for Visual Tasks. arXiv:2105.02358 [cs]
  9. LSGCN: Long Short-Term Traffic Prediction with Graph Convolutional Networks. In Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence. International Joint Conferences on Artificial Intelligence Organization, Yokohama, Japan, 2355–2361. https://doi.org/10.24963/ijcai.2020/326
  10. Predicting Economic Growth by Region Embedding: A Multigraph Convolutional Network Approach. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management. ACM, Virtual Event Ireland, 555–564. https://doi.org/10.1145/3340531.3411882
  11. Tile2Vec: Unsupervised Representation Learning for Spatially Distributed Data. arXiv:1805.02855 [cs, stat]
  12. Thomas N. Kipf and Max Welling. 2016. Variational Graph Auto-Encoders. arXiv:1611.07308 [cs, stat]
  13. Joint Representation Learning for Multi-Modal Transportation Recommendation. Proceedings of the AAAI Conference on Artificial Intelligence 33, 01 (July 2019), 1036–1043. https://doi.org/10.1609/aaai.v33i01.33011036
  14. Urban Region Profiling via A Multi-Graph Representation Learning Framework. arXiv:2202.02074 [cs]
  15. Urban Region Profiling via Multi-Graph Representation Learning. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management (Atlanta, GA, USA) (CIKM ’22). Association for Computing Machinery, New York, NY, USA, 4294–4298. https://doi.org/10.1145/3511808.3557720
  16. LINE: Large-Scale Information Network Embedding. In Proceedings of the 24th International Conference on World Wide Web (Florence, Italy) (WWW ’15). International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE, 1067–1077. https://doi.org/10.1145/2736277.2741093
  17. Robert Tibshirani. 1996. Regression Shrinkage and Selection via the Lasso. Journal of the Royal Statistical Society. Series B (Methodological) 58, 1 (1996), 267–288. https://doi.org/10.1111/j.2517-6161.1996.tb02080.x arXiv:2346178
  18. Attention Is All You Need. arXiv:1706.03762 [cs]
  19. Graph Attention Networks. arXiv:1710.10903 [cs, stat]
  20. Automated Feature-Topic Pairing: Aligning Semantic and Embedding Spaces in Spatial Representation Learning. In Proceedings of the 29th International Conference on Advances in Geographic Information Systems (Beijing, China) (SIGSPATIAL ’21). Association for Computing Machinery, New York, NY, USA, 450–453. https://doi.org/10.1145/3474717.3484212
  21. Towards Semantically-Rich Spatial Network Representation Learning via Automated Feature Topic Pairing. Frontiers in Big Data 4 (Oct. 2021), 762899. https://doi.org/10.3389/fdata.2021.762899
  22. Hongjian Wang and Zhenhui Li. 2017. Region Representation Learning via Mobility Flow. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management. ACM, Singapore Singapore, 237–246. https://doi.org/10.1145/3132847.3133006
  23. Urban2Vec: Incorporating Street View Imagery and POIs for Multi-Modal Urban Neighborhood Embedding. arXiv:2001.11101 [cs, stat]
  24. Multi-Graph Fusion Networks for Urban Region Embedding. arXiv:2201.09760 [cs]
  25. Representing Urban Functions through Zone Embedding with Human Mobility Patterns. In Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence. International Joint Conferences on Artificial Intelligence Organization, Stockholm, Sweden, 3919–3925. https://doi.org/10.24963/ijcai.2018/545
  26. Regions, Periods, Activities: Uncovering Urban Dynamics via Cross-Modal Representation Learning. In Proceedings of the 26th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, Perth Australia, 361–370. https://doi.org/10.1145/3038912.3052601
  27. Multi-View Joint Graph Representation Learning for Urban Region Embedding. In Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence. International Joint Conferences on Artificial Intelligence Organization, Yokohama, Japan, 4431–4437. https://doi.org/10.24963/ijcai.2020/611
Citations (2)

Summary

We haven't generated a summary for this paper yet.