Edge Graph Intelligence: Reciprocally Empowering Edge Networks with Graph Intelligence (2407.15320v2)
Abstract: Recent years have witnessed a thriving growth of computing facilities connected at the network edge, cultivating edge networks as a fundamental infrastructure for supporting miscellaneous intelligent services.Meanwhile, AI frontiers have extrapolated to the graph domain and promoted Graph Intelligence (GI). Given the inherent relation between graphs and networks, the interdiscipline of graph learning and edge networks, i.e., Edge GI or EGI, has revealed a novel interplay between them -- GI aids in optimizing edge networks, while edge networks facilitate GI model deployment. Driven by this delicate closed-loop, EGI is recognized as a promising solution to fully unleash the potential of edge computing power and is garnering growing attention. Nevertheless, research on EGI remains nascent, and there is a soaring demand within both the communications and AI communities for a dedicated venue to share recent advancements. To this end, this paper promotes the concept of EGI, explores its scope and core principles, and conducts a comprehensive survey concerning recent research efforts on this emerging field. Specifically, this paper introduces and discusses: 1) fundamentals of edge computing and graph learning,2) emerging techniques centering on the closed loop between graph intelligence and edge networks, and 3) open challenges and research opportunities of future EGI. By bridging the gap across communication, networking, and graph learning areas, we believe that this survey can garner increased attention, foster meaningful discussions, and inspire further research ideas in EGI.
- T. Qiu, J. Chi, X. Zhou, Z. Ning, M. Atiquzzaman, and D. O. Wu, “Edge computing in industrial internet of things: Architecture, advances and challenges,” IEEE Communications Surveys & Tutorials, vol. 22, no. 4, pp. 2462–2488, 2020.
- K. Cao, S. Hu, Y. Shi, A. W. Colombo, S. Karnouskos, and X. Li, “A survey on edge and edge-cloud computing assisted cyber-physical systems,” IEEE Transactions on Industrial Informatics, vol. 17, no. 11, pp. 7806–7819, 2021.
- R. Xu, S. Razavi, and R. Zheng, “Edge video analytics: A survey on applications, systems and enabling techniques,” IEEE Communications Surveys & Tutorials, 2023.
- Y. Siriwardhana, P. Porambage, M. Liyanage, and M. Ylianttila, “A survey on mobile augmented reality with 5g mobile edge computing: Architectures, applications, and technical aspects,” IEEE Communications Surveys & Tutorials, vol. 23, no. 2, pp. 1160–1192, 2021.
- P. McEnroe, S. Wang, and M. Liyanage, “A survey on the convergence of edge computing and ai for uavs: Opportunities and challenges,” IEEE Internet of Things Journal, vol. 9, no. 17, pp. 15 435–15 459, 2022.
- B. Ji, X. Zhang, S. Mumtaz, C. Han, C. Li, H. Wen, and D. Wang, “Survey on the internet of vehicles: Network architectures and applications,” IEEE Communications Standards Magazine, vol. 4, no. 1, pp. 34–41, 2020.
- W. Shi, J. Cao, Q. Zhang, Y. Li, and L. Xu, “Edge computing: Vision and challenges,” IEEE internet of things journal, vol. 3, no. 5, pp. 637–646, 2016.
- Z. Zhou, X. Chen, E. Li, L. Zeng, K. Luo, and J. Zhang, “Edge intelligence: Paving the last mile of artificial intelligence with edge computing,” Proceedings of the IEEE, vol. 107, no. 8, pp. 1738–1762, 2019.
- Z. Wu, S. Pan, F. Chen, G. Long, C. Zhang, and S. Y. Philip, “A comprehensive survey on graph neural networks,” IEEE transactions on neural networks and learning systems, 2020.
- J. Zhou, G. Cui, S. Hu, Z. Zhang, C. Yang, Z. Liu, L. Wang, C. Li, and M. Sun, “Graph neural networks: A review of methods and applications,” AI Open, vol. 1, pp. 57–81, 2020.
- S. Abadal, A. Jain, R. Guirado, J. López-Alonso, and E. Alarcón, “Computing graph neural networks: A survey from algorithms to accelerators,” ACM Computing Surveys (CSUR), vol. 54, no. 9, pp. 1–38, 2021.
- M. Besta and T. Hoefler, “Parallel and distributed graph neural networks: An in-depth concurrency analysis,” arXiv preprint arXiv:2205.09702, 2022.
- Z. Zhang, P. Cui, and W. Zhu, “Deep learning on graphs: A survey,” IEEE Transactions on Knowledge and Data Engineering, 2020.
- I. R. Ward, J. Joyner, C. Lickfold, Y. Guo, and M. Bennamoun, “A practical tutorial on graph neural networks,” ACM Computing Surveys (CSUR), vol. 54, no. 10s, pp. 1–35, 2022.
- D. R.-J. G.-J. Rydning, J. Reinsel, and J. Gantz, “The digitization of the world from edge to core,” Framingham: International Data Corporation, vol. 16, pp. 1–28, 2018.
- T. N. Kipf and M. Welling, “Semi-supervised classification with graph convolutional networks,” in International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings. OpenReview.net, 2017.
- E. Li, L. Zeng, Z. Zhou, and X. Chen, “Edge ai: On-demand accelerating deep neural network inference via edge computing,” IEEE Transactions on Wireless Communications, vol. 19, no. 1, pp. 447–457, 2019.
- X. Wang, Y. Han, C. Wang, Q. Zhao, X. Chen, and M. Chen, “In-edge ai: Intelligentizing mobile edge computing, caching and communication by federated learning,” Ieee Network, vol. 33, no. 5, pp. 156–165, 2019.
- Y. Li, R. Yu, C. Shahabi, and Y. Liu, “Diffusion convolutional recurrent neural network: Data-driven traffic forecasting,” in 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings. OpenReview.net, 2018.
- X. Wang, Y. Ma, Y. Wang, W. Jin, X. Wang, J. Tang, C. Jia, and J. Yu, “Traffic flow prediction via spatial temporal graph neural network,” in Proceedings of The Web Conference 2020, 2020, pp. 1082–1092.
- T. Zhong, S. Zhang, F. Zhou, K. Zhang, G. Trajcevski, and J. Wu, “Hybrid graph convolutional networks with multi-head attention for location recommendation,” World Wide Web, pp. 1–27, 2020.
- B. Chang, G. Jang, S. Kim, and J. Kang, “Learning graph-based geographical latent representation for point-of-interest recommendation,” in Proceedings of the 29th ACM International Conference on Information & Knowledge Management, 2020, pp. 135–144.
- H. Jeon, D. Kum, and J. Choi, “Scale-net: Scalable vehicle trajectory prediction network under random number of interacting vehicles via edge-enhanced graph convolutional neural network,” in IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE/RSJ, 2020.
- H. Zhou, D. Ren, H. Xia, M. Fan, X. Yang, and H. Huang, “Ast-gnn: An attention-based spatio-temporal graph neural network for interaction-aware pedestrian trajectory prediction,” Neurocomputing, vol. 445, pp. 298–308, 2021.
- W. Jiang and J. Luo, “Graph neural network for traffic forecasting: A survey,” Expert Systems with Applications, vol. 207, p. 117921, 2022.
- K.-H. N. Bui, J. Cho, and H. Yi, “Spatial-temporal graph neural network for traffic forecasting: An overview and open research issues,” Applied Intelligence, vol. 52, no. 3, pp. 2763–2774, 2022.
- S. Rahmani, A. Baghbani, N. Bouguila, and Z. Patterson, “Graph neural networks for intelligent transportation systems: A survey,” IEEE Transactions on Intelligent Transportation Systems, 2023.
- W. Liao, B. Bak-Jensen, J. R. Pillai, Y. Wang, and Y. Wang, “A review of graph neural networks and their applications in power systems,” arXiv preprint arXiv:2101.10025, 2021.
- M. Abdelmalak, V. Venkataramanan, and R. Macwan, “A survey of cyber-physical power system modeling methods for future energy systems,” IEEE Access, 2022.
- B. Huang and J. Wang, “Applications of physics-informed neural networks in power systems-a review,” IEEE Transactions on Power Systems, vol. 38, no. 1, pp. 572–588, 2022.
- S. He, S. Xiong, Y. Ou, J. Zhang, J. Wang, Y. Huang, and Y. Zhang, “An overview on the application of graph neural networks in wireless networks,” IEEE Open Journal of the Communications Society, 2021.
- G. Dong, M. Tang, Z. Wang, J. Gao, S. Guo, L. Cai, R. Gutierrez, B. Campbel, L. E. Barnes, and M. Boukhechba, “Graph neural networks in iot: a survey,” ACM Transactions on Sensor Networks, vol. 19, no. 2, pp. 1–50, 2023.
- Y. Li, D. Yu, Z. Liu, M. Zhang, X. Gong, and L. Zhao, “Graph neural network for spatiotemporal data: methods and applications,” arXiv preprint arXiv:2306.00012, 2023.
- X. Wang, Y. Han, V. C. Leung, D. Niyato, X. Yan, and X. Chen, “Convergence of edge computing and deep learning: A comprehensive survey,” IEEE Communications Surveys & Tutorials, vol. 22, no. 2, pp. 869–904, 2020.
- M. S. Murshed, C. Murphy, D. Hou, N. Khan, G. Ananthanarayanan, and F. Hussain, “Machine learning at the network edge: A survey,” ACM Computing Surveys (CSUR), vol. 54, no. 8, pp. 1–37, 2021.
- D. Liu, H. Kong, X. Luo, W. Liu, and R. Subramaniam, “Bringing ai to edge: From deep learning’s perspective,” Neurocomputing, vol. 485, pp. 297–320, 2022.
- H. Hua, Y. Li, T. Wang, N. Dong, W. Li, and J. Cao, “Edge computing with artificial intelligence: A machine learning perspective,” ACM Computing Surveys, vol. 55, no. 9, pp. 1–35, 2023.
- J. Zhou, G. Cui, Z. Zhang, C. Yang, Z. Liu, and M. Sun, “Graph neural networks: A review of methods and applications,” arXiv preprint arXiv:1812.08434, 2018.
- W. L. Hamilton, R. Ying, and J. Leskovec, “Inductive representation learning on large graphs,” in Proceedings of the 31st International Conference on Neural Information Processing Systems, 2017, pp. 1025–1035.
- P. Velickovic, G. Cucurull, A. Casanova, A. Romero, P. Liò, and Y. Bengio, “Graph attention networks,” in 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings. OpenReview.net, 2018.
- C. Sun, C. Li, X. Lin, T. Zheng, F. Meng, X. Rui, and Z. Wang, “Attention-based graph neural networks: a survey,” Artificial Intelligence Review, vol. 56, no. Suppl 2, pp. 2263–2310, 2023.
- G. Jin, Y. Liang, Y. Fang, Z. Shao, J. Huang, J. Zhang, and Y. Zheng, “Spatio-temporal graph neural networks for predictive learning in urban computing: A survey,” IEEE Transactions on Knowledge and Data Engineering, 2023.
- Z. A. Sahili and M. Awad, “Spatio-temporal graph neural networks: A survey,” arXiv preprint arXiv:2301.10569, 2023.
- S. Yun, M. Jeong, R. Kim, J. Kang, and H. J. Kim, “Graph transformer networks,” Advances in neural information processing systems, vol. 32, 2019.
- Z. Hu, Y. Dong, K. Wang, and Y. Sun, “Heterogeneous graph transformer,” in Proceedings of the web conference 2020, 2020, pp. 2704–2710.
- L. Rampášek, M. Galkin, V. P. Dwivedi, A. T. Luu, G. Wolf, and D. Beaini, “Recipe for a general, powerful, scalable graph transformer,” Advances in Neural Information Processing Systems, vol. 35, pp. 14 501–14 515, 2022.
- E. Min, R. Chen, Y. Bian, T. Xu, K. Zhao, W. Huang, P. Zhao, J. Huang, S. Ananiadou, and Y. Rong, “Transformer for graphs: An overview from architecture perspective,” arXiv preprint arXiv:2202.08455, 2022.
- J. Liu, C. Yang, Z. Lu, J. Chen, Y. Li, M. Zhang, T. Bai, Y. Fang, L. Sun, P. S. Yu et al., “Towards graph foundation models: A survey and beyond,” arXiv preprint arXiv:2310.11829, 2023.
- Z. Zhang, H. Li, Z. Zhang, Y. Qin, X. Wang, and W. Zhu, “Large graph models: A perspective,” arXiv preprint arXiv:2308.14522, 2023.
- L. Xia, B. Kao, and C. Huang, “Opengraph: Towards open graph foundation models,” arXiv preprint arXiv:2403.01121, 2024.
- Y. Chong, Y. Ding, Q. Yan, and S. Pan, “Graph-based semi-supervised learning: A review,” Neurocomputing, vol. 408, pp. 216–230, 2020.
- Z. Song, X. Yang, Z. Xu, and I. King, “Graph-based semi-supervised learning: A comprehensive review,” IEEE Transactions on Neural Networks and Learning Systems, 2022.
- Q. Zhu, C. Yang, Y. Xu, H. Wang, C. Zhang, and J. Han, “Transfer learning of graph neural networks with ego-graph information maximization,” Advances in Neural Information Processing Systems, vol. 34, pp. 1766–1779, 2021.
- X. Han, Z. Huang, B. An, and J. Bai, “Adaptive transfer learning on graph neural networks,” in Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, 2021, pp. 565–574.
- Y. You, T. Chen, Y. Sui, T. Chen, Z. Wang, and Y. Shen, “Graph contrastive learning with augmentations,” Advances in neural information processing systems, vol. 33, pp. 5812–5823, 2020.
- Y. Zhu, Y. Xu, F. Yu, Q. Liu, S. Wu, and L. Wang, “Graph Contrastive Learning with Adaptive Augmentation,” in Proceedings of The Web Conference 2021, 2021, pp. 2069–2080.
- Y. Zhu, Y. Xu, Q. Liu, and S. Wu, “An Empirical Study of Graph Contrastive Learning,” in Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks, vol. 1, 2021.
- C. Chen, Z. Xu, W. Hu, Z. Zheng, and J. Zhang, “Fedgl: Federated graph learning framework with global self-supervision,” Information Sciences, vol. 657, p. 119976, 2024.
- F. Chen, P. Li, T. Miyazaki, and C. Wu, “Fedgraph: Federated graph learning with intelligent sampling,” IEEE Transactions on Parallel and Distributed Systems, vol. 33, no. 8, pp. 1775–1786, 2021.
- Z. Wang, W. Kuang, Y. Xie, L. Yao, Y. Li, B. Ding, and J. Zhou, “Federatedscope-gnn: Towards a unified, comprehensive and efficient package for federated graph learning,” in Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2022, pp. 4110–4120.
- S. Munikoti, D. Agarwal, L. Das, M. Halappanavar, and B. Natarajan, “Challenges and opportunities in deep reinforcement learning with graph neural networks: A comprehensive review of algorithms and applications,” IEEE Transactions on Neural Networks and Learning Systems, 2023.
- M. Nie, D. Chen, and D. Wang, “Reinforcement learning on graphs: A survey,” IEEE Transactions on Emerging Topics in Computational Intelligence, 2023.
- S. Wang, X. Zhang, Y. Zhang, L. Wang, J. Yang, and W. Wang, “A survey on mobile edge networks: Convergence of computing, caching and communications,” Ieee Access, vol. 5, pp. 6757–6779, 2017.
- M. Pooyandeh and I. Sohn, “Edge network optimization based on ai techniques: A survey,” Electronics, vol. 10, no. 22, p. 2830, 2021.
- Y. Yang, “Multi-tier computing networks for intelligent iot,” Nature Electronics, vol. 2, no. 1, pp. 4–5, 2019.
- Maxim Integrated, “Ds18b20 programmable resolution 1-wire digital thermometer,” Datasheet, accessed: 2024-01-31. [Online]. Available: https://datasheets.maximintegrated.com/en/ds/DS18B20.pdf
- TDK InvenSense, “Mpu-6050 six-axis (gyro + accelerometer) mems motiontracking devices,” Datasheet, accessed: 2024-01-31. [Online]. Available: https://invensense.tdk.com/wp-content/uploads/2015/02/MPU-6000-Datasheet1.pdf
- “Mq-2 semiconductor sensor for combustible gas,” Datasheet, accessed: 2024-01-31. [Online]. Available: http://gas-sensor.ru/pdf/combustible-gas-sensor.pdf
- Arduino, “Arduino uno rev3,” Product Information, accessed: 2024-01-31. [Online]. Available: https://store.arduino.cc/products/arduino-uno-rev3
- STMicroelectronics, “Stm32f103c8t6 microcontroller,” Datasheet, accessed: 2024-01-31. [Online]. Available: https://www.st.com/resource/en/datasheet/stm32f103c8.pdf
- Espressif Systems, “Esp8266 wi-fi module,” Datasheet, accessed: 2024-01-31. [Online]. Available: https://www.espressif.com/sites/default/files/documentation/0a-esp8266ex_datasheet_en.pdf
- Raspberry Pi Foundation, “Raspberry pi,” Official Product Page, accessed: 2024-01-31. [Online]. Available: https://www.raspberrypi.org/products/
- NVIDIA Corporation, “Nvidia jetson series: Ai and machine learning processors,” Official Product Page, accessed: 2024-01-31. [Online]. Available: https://developer.nvidia.com/embedded/jetson-modules
- Apple Inc., “iphone,” Official Product Page, accessed: 2024-01-31. [Online]. Available: https://www.apple.com/iphone/
- Samsung Electronics, “Samsung galaxy smartphone,” Official Product Page, accessed: 2024-01-31. [Online]. Available: https://www.samsung.com/mobile/
- Apple Inc., “Apple watch,” Official Product Page, accessed: 2024-01-31. [Online]. Available: https://www.apple.com/apple-watch-series-7/
- Fitbit Inc., “Fitbit smartwatch,” Official Product Page, accessed: 2024-01-31. [Online]. Available: https://www.fitbit.com/global/us/products/smartwatches
- D. Silvera-Tawil, “Robotics in healthcare: A survey,” SN Computer Science, vol. 5, no. 1, p. 189, 2024.
- J. Palacín, E. Rubies, R. Bitriá, and E. Clotet, “Path planning of a mobile delivery robot operating in a multi-story building based on a predefined navigation tree,” Sensors, vol. 23, no. 21, p. 8795, 2023.
- S. A. H. Mohsan, M. A. Khan, F. Noor, I. Ullah, and M. H. Alsharif, “Towards the unmanned aerial vehicles (uavs): A comprehensive review,” Drones, vol. 6, no. 6, p. 147, 2022.
- Tesla, Inc., “Tesla model 3 specifications,” Official Product Page, accessed: 2024-01-31. [Online]. Available: https://www.tesla.com/model3
- DJI Technology Co., Ltd., “Dji air 3 drone specifications,” Official Product Page, accessed: 2024-01-31. [Online]. Available: https://www.dji.com/products/camera-drones#air-series
- Dell Technologies, “Dell poweredge server series,” Official Product Page, accessed: 2024-01-31. [Online]. Available: https://www.dell.com/en-us/shop/ipovw/poweredge-r350
- Lenovo Group Ltd., “Lenovo thinksystem server series,” Official Product Page, accessed: 2024-01-31. [Online]. Available: https://www.lenovo.com/us/en/p/servers-storage/servers/edge/thinksystem-se350/7d1xa029na
- M. Xu, L. Zhang, and S. Wang, “Position paper: Renovating edge servers with arm socs,” in 2022 IEEE/ACM 7th Symposium on Edge Computing (SEC). IEEE, 2022, pp. 216–223.
- Amazon, “Aws for the edge,” Official Product Page, accessed: 2024-01-31. [Online]. Available: https://aws.amazon.com/edge/
- Google, “Google distributed cloud edge,” Official Product Page, accessed: 2024-01-31. [Online]. Available: https://cloud.google.com/distributed-cloud-edge
- B. Zolfaghari, G. Srivastava, S. Roy, H. R. Nemati, F. Afghah, T. Koshiba, A. Razi, K. Bibak, P. Mitra, and B. K. Rai, “Content delivery networks: State of the art, trends, and future roadmap,” ACM Computing Surveys (CSUR), vol. 53, no. 2, pp. 1–34, 2020.
- M. Hu, X. Luo, J. Chen, Y. C. Lee, Y. Zhou, and D. Wu, “Virtual reality: A survey of enabling technologies and its applications in iot,” Journal of Network and Computer Applications, vol. 178, p. 102970, 2021.
- C. Bayılmış, M. A. Ebleme, Ü. Çavuşoğlu, K. Kücük, and A. Sevin, “A survey on communication protocols and performance evaluations for internet of things,” Digital Communications and Networks, vol. 8, no. 6, pp. 1094–1104, 2022.
- E. A. Shammar and A. T. Zahary, “The internet of things (iot): a survey of techniques, operating systems, and trends,” Library Hi Tech, vol. 38, no. 1, pp. 5–66, 2020.
- Orangesoft, “Top programming languages for iot projects,” Orangesoft Blog, January 2024, accessed: 2024-01-31. [Online]. Available: https://orangesoft.co/blog/top-programming-languages-for-iot-projects
- Linux Foundation, “Edgex foundry: An open framework for iot edge computing,” Official Website, accessed: 2024-01-31. [Online]. Available: https://www.edgexfoundry.org/
- Eclipse Foundation, “Eclipse kura: Open source iot edge framework,” Official Website, accessed: 2024-01-31. [Online]. Available: https://www.eclipse.org/kura/
- The Apache Software Foundation, “Apache edgent,” Official Website, accessed: 2024-01-31. [Online]. Available: https://incubator.apache.org/projects/edgent.html
- Redis, “Redisedge: A dedicated iot database for edge computing,” Official Website, accessed: 2024-01-31. [Online]. Available: https://redis.com/blog/redisedge-iot-database-for-edge-computing/
- TensorFlow, “On-device training with tensorflow lite,” Official Website, accessed: 2024-01-31. [Online]. Available: https://www.tensorflow.org/lite/examples/on_device_training/overview
- X. Jiang, H. Wang, Y. Chen, Z. Wu, L. Wang, B. Zou, Y. Yang, Z. Cui, Y. Cai, T. Yu et al., “Mnn: A universal and efficient inference engine,” Proceedings of Machine Learning and Systems, vol. 2, pp. 1–13, 2020.
- C. N. C. Foundation, “Kubeedge: Kubernetes native edge computing framework,” Official Website, accessed: 2024-01-31. [Online]. Available: https://kubeedge.io/en/
- L. F. Edge, “Openedge: Extend cloud computing, data and service seamlessly to edge devices,” GitHub Repository, accessed: 2024-01-31. [Online]. Available: https://github.com/baetyl/baetyl
- C. N. C. Foundation, “Kubernetes: Production-grade container orchestration,” Official Website, accessed: 2024-01-31. [Online]. Available: https://kubernetes.io/
- Microsoft Corporation, “Azure iot edge: Extend cloud intelligence and analytics to edge devices,” Official Website, accessed: 2024-01-31. [Online]. Available: https://azure.microsoft.com/en-us/products/iot-edge/
- Amazon Web Services, Inc., “Aws iot greengrass: Bring local compute, messaging, data caching, sync, and ml inference capabilities to edge devices,” Official Website, accessed: 2024-01-31. [Online]. Available: https://aws.amazon.com/greengrass/
- E. P. Authors, “Edgecloudsim: An environment for performance evaluation of edge computing systems,” GitHub Repository, accessed: 2024-01-31. [Online]. Available: https://github.com/CagataySonmez/EdgeCloudSim
- Cloudslab, “Cloudsim: A framework for modeling and simulation of cloud computing infrastructures and services,” GitHub Repository, accessed: 2024-01-31. [Online]. Available: https://github.com/Cloudslab/cloudsim
- Cloudslab, “ifogsim: odeling and simulation of resource management techniques in internet of things, edge and fog computing environments.” GitHub Repository, accessed: 2024-01-31. [Online]. Available: https://github.com/Cloudslab/iFogSim
- YAFS Project Authors, “Yafs: Yet another fog simulator,” GitHub Repository, accessed: 2024-01-31. [Online]. Available: https://github.com/acsicuib/YAFS
- S. Ye, L. Zeng, X. Chu, G. Xing, and X. Chen, “Asteroid: Resource-efficient hybrid pipeline parallelism for collaborative dnn training on heterogeneous edge devices,” in Proceedings of the 30th Annual International Conference on Mobile Computing and Networking, 2024, pp. 1–15.
- D. Cai, Y. Wu, S. Wang, F. X. Lin, and M. Xu, “Efficient federated learning for modern nlp,” in Proceedings of the 29th Annual International Conference on Mobile Computing and Networking, 2023, pp. 1–16.
- D. Xu, M. Xu, Q. Wang, S. Wang, Y. Ma, K. Huang, G. Huang, X. Jin, and X. Liu, “Mandheling: Mixed-precision on-device dnn training with dsp offloading,” in Proceedings of the 28th Annual International Conference on Mobile Computing And Networking, 2022, pp. 214–227.
- S. Ye, J. Du, L. Zeng, W. Ou, X. Chu, Y. Lu, and X. Chen, “Galaxy: A resource-efficient collaborative edge ai system for in-situ transformer inference,” in IEEE INFOCOM 2024-IEEE Conference on Computer Communications. IEEE, 2024.
- F. Jia, D. Zhang, T. Cao, S. Jiang, Y. Liu, J. Ren, and Y. Zhang, “Codl: efficient cpu-gpu co-execution for deep learning inference on mobile devices,” in Proceedings of the 20th Annual International Conference on Mobile Systems, Applications and Services. Association for Computing Machinery New York, NY, USA, 2022, pp. 209–221.
- D. Xu, W. Yin, X. Jin, Y. Zhang, S. Wei, M. Xu, and X. Liu, “Llmcad: Fast and scalable on-device large language model inference,” arXiv preprint arXiv:2309.04255, 2023.
- Rolypolyman@Wikipedia, “United states power grid,” [EB/OL], https://en.wikipedia.org/wiki/File:UnitedStatesPowerGrid.jpg Accessed December 4, 2023.
- M. Hosseinzadeh, Y. Latif, T. Pham, N. Suenderhauf, and I. Reid, “Structure aware slam using quadrics and planes,” in Computer Vision–ACCV 2018: 14th Asian Conference on Computer Vision, Perth, Australia, December 2–6, 2018, Revised Selected Papers, Part III 14. Springer, 2019, pp. 410–426.
- B. Yu, H. Yin, and Z. Zhu, “Spatio-temporal graph convolutional networks: a deep learning framework for traffic forecasting,” in IJCAI, 2018, pp. 3634–3640.
- Uber Technologies, Inc., “Uber company information,” Official Website, 2024, available: https://www.uber.com.
- DiDi Chuxing, “Didi company information,” Official Website, 2024, available: https://www.didiglobal.com.
- Lyft, Inc., “Lyft company information,” Official Website, 2024, available: https://www.lyft.com.
- Y. Wang, H. Yin, T. Chen, C. Liu, B. Wang, T. Wo, and J. Xu, “Gallat: A spatiotemporal graph attention network for passenger demand prediction,” in 2021 IEEE 37th International Conference on Data Engineering (ICDE). IEEE, 2021, pp. 2129–2134.
- Y. Lu, H. Ding, S. Ji, N. Sze, and Z. He, “Dual attentive graph neural network for metro passenger flow prediction,” Neural Computing and Applications, vol. 33, pp. 13 417–13 431, 2021.
- A. A. Makhdomi and I. A. Gillani, “Gnn-based passenger request prediction,” arXiv preprint arXiv:2301.02515, 2023.
- Y. Wang, X. Lin, J. Wu, A. K. Bashir, W. Yang, J. Li, and M. Imran, “Contrastive gnn-based traffic anomaly analysis against imbalanced dataset in iot-based its,” in GLOBECOM 2022-2022 IEEE Global Communications Conference. IEEE, 2022, pp. 3557–3562.
- Z. Yu and M. Hu, “Deep reinforcement learning with graph representation for vehicle repositioning,” IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 8, pp. 13 094–13 107, 2021.
- W. Liao, D. Yang, Y. Wang, and X. Ren, “Fault diagnosis of power transformers using graph convolutional network,” CSEE Journal of Power and Energy Systems, vol. 7, no. 2, pp. 241–249, 2020.
- Y. Liu, N. Zhang, D. Wu, A. Botterud, R. Yao, and C. Kang, “Searching for critical power system cascading failures with graph convolutional network,” IEEE Transactions on Control of Network Systems, vol. 8, no. 3, pp. 1304–1313, 2021.
- O. Boyaci, M. R. Narimani, K. Davis, and E. Serpedin, “Cyberattack detection in large-scale smart grids using chebyshev graph convolutional networks,” in 2022 9th International Conference on Electrical and Electronics Engineering (ICEEE). IEEE, 2022, pp. 217–221.
- A. M. Karimi, Y. Wu, M. Koyuturk, and R. H. French, “Spatiotemporal graph neural network for performance prediction of photovoltaic power systems,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, no. 17, 2021, pp. 15 323–15 330.
- M. Khodayar, S. Mohammadi, M. E. Khodayar, J. Wang, and G. Liu, “Convolutional graph autoencoder: A generative deep neural network for probabilistic spatio-temporal solar irradiance forecasting,” IEEE Transactions on Sustainable Energy, vol. 11, no. 2, pp. 571–583, 2019.
- M. Khodayar, G. Liu, J. Wang, O. Kaynak, and M. E. Khodayar, “Spatiotemporal behind-the-meter load and pv power forecasting via deep graph dictionary learning,” IEEE transactions on neural networks and learning systems, vol. 32, no. 10, pp. 4713–4727, 2020.
- L. Chen, J. Xu, B. Wu, and J. Huang, “Group-aware graph neural network for nationwide city air quality forecasting,” ACM Transactions on Knowledge Discovery from Data, vol. 18, no. 3, pp. 1–20, 2023.
- X. Gao and W. Li, “A graph-based lstm model for pm2. 5 forecasting,” Atmospheric Pollution Research, vol. 12, no. 9, p. 101150, 2021.
- W. Mao, L. Jiao, W. Wang, J. Wang, X. Tong, and S. Zhao, “A hybrid integrated deep learning model for predicting various air pollutants,” GIScience & Remote Sensing, vol. 58, no. 8, pp. 1395–1412, 2021.
- H. Lin, Z. Gao, Y. Xu, L. Wu, L. Li, and S. Z. Li, “Conditional local convolution for spatio-temporal meteorological forecasting,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 36, no. 7, 2022, pp. 7470–7478.
- H. Lira, L. Martí, and N. Sanchez-Pi, “Frost forecasting model using graph neural networks with spatio-temporal attention,” in AI: Modeling Oceans and Climate Change Workshop at ICLR 2021, 2021.
- T. Stańczyk and S. Mehrkanoon, “Deep graph convolutional networks for wind speed prediction,” arXiv preprint arXiv:2101.10041, 2021.
- G. Jin, C. Zhu, X. Chen, H. Sha, X. Hu, and J. Huang, “Ufsp-net: a neural network with spatio-temporal information fusion for urban fire situation prediction,” in IOP Conference Series: Materials Science and Engineering, vol. 853, no. 1. IOP Publishing, 2020, p. 012050.
- L. Xia, C. Huang, Y. Xu, P. Dai, L. Bo, X. Zhang, and T. Chen, “Spatial-temporal sequential hypergraph network for crime prediction with dynamic multiplex relation learning,” arXiv preprint arXiv:2201.02435, 2022.
- M. Sun, P. Zhou, H. Tian, Y. Liao, and H. Xie, “Spatial-temporal attention network for crime prediction with adaptive graph learning,” in International Conference on Artificial Neural Networks. Springer, 2022, pp. 656–669.
- A. Kapoor, X. Ben, L. Liu, B. Perozzi, M. Barnes, M. Blais, and S. O’Banion, “Examining covid-19 forecasting using spatio-temporal graph neural networks,” arXiv preprint arXiv:2007.03113, 2020.
- M. Keicher, H. Burwinkel, D. Bani-Harouni, M. Paschali, T. Czempiel, E. Burian, M. R. Makowski, R. Braren, N. Navab, and T. Wendler, “Multimodal graph attention network for covid-19 outcome prediction,” Scientific Reports, vol. 13, no. 1, p. 19539, 2023.
- P. Huang, L. Zeng, X. Chen, K. Luo, Z. Zhou, and S. Yu, “Edge robotics: Edge-computing-accelerated multi-robot simultaneous localization and mapping,” IEEE Internet of Things Journal, 2022.
- J. D. Almeida, P. Schydlo, A. Dehban, and J. Santos-Victor, “Sensorimotor graph: Action-conditioned graph neural network for learning robotic soft hand dynamics,” in 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2021, pp. 9569–9576.
- Y. Li, J. Wu, R. Tedrake, J. B. Tenenbaum, and A. Torralba, “Learning particle dynamics for manipulating rigid bodies, deformable objects, and fluids,” arXiv preprint arXiv:1810.01566, 2018.
- F. Xie, A. Chowdhury, M. De Paolis Kaluza, L. Zhao, L. Wong, and R. Yu, “Deep imitation learning for bimanual robotic manipulation,” Advances in neural information processing systems, vol. 33, pp. 2327–2337, 2020.
- H. Liang, X. Lou, Y. Yang, and C. Choi, “Learning visual affordances with target-orientated deep q-network to grasp objects by harnessing environmental fixtures,” in 2021 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2021, pp. 2562–2568.
- H. Chen, L. Zeng, X. Zhang, and X. Chen, “Adadrone: Quality of navigation based neural adaptive scheduling for edge-assisted drones,” in 2022 IEEE 42nd International Conference on Distributed Computing Systems (ICDCS). IEEE, 2022, pp. 548–558.
- Q. Li, F. Gama, A. Ribeiro, and A. Prorok, “Graph neural networks for decentralized multi-robot path planning,” in 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2020, pp. 11 785–11 792.
- Q. Li, W. Lin, Z. Liu, and A. Prorok, “Message-aware graph attention networks for large-scale multi-robot path planning,” IEEE Robotics and Automation Letters, vol. 6, no. 3, pp. 5533–5540, 2021.
- J. Li, Z. Su, and Y. Qiu, “Dynamic motion planning model for multirobot using graph neural network and historical information,” Advanced Intelligent Systems, p. 2300036, 2023.
- L. Zeng, H. Chen, D. Feng, X. Zhang, and X. Chen, “A3d: Adaptive, accurate and autonomous navigation for edge-assisted drones,” in IEEE/ACM Transactions on Networking. IEEE, 2023, pp. 1–16.
- R. Möller, A. Furnari, S. Battiato, A. Härmä, and G. M. Farinella, “A survey on human-aware robot navigation,” Robotics and Autonomous Systems, vol. 145, p. 103837, 2021.
- T. Luo, B. Subagdja, D. Wang, and A.-H. Tan, “Multi-agent collaborative exploration through graph-based deep reinforcement learning,” in 2019 IEEE International Conference on Agents (ICA). IEEE, 2019, pp. 2–7.
- W. Gosrich, S. Mayya, R. Li, J. Paulos, M. Yim, A. Ribeiro, and V. Kumar, “Coverage control in multi-robot systems via graph neural networks,” in 2022 International Conference on Robotics and Automation (ICRA). IEEE, 2022, pp. 8787–8793.
- H. Zhang, J. Cheng, L. Zhang, Y. Li, and W. Zhang, “H2gnn: hierarchical-hops graph neural networks for multi-robot exploration in unknown environments,” IEEE Robotics and Automation Letters, vol. 7, no. 2, pp. 3435–3442, 2022.
- H.-X. Xie, L. Lo, H.-H. Shuai, and W.-H. Cheng, “Au-assisted graph attention convolutional network for micro-expression recognition,” in Proceedings of the 28th ACM International Conference on Multimedia, 2020, pp. 2871–2880.
- Y. Liu, X. Zhang, J. Zhou, and L. Fu, “Sg-dsn: A semantic graph-based dual-stream network for facial expression recognition,” Neurocomputing, vol. 462, pp. 320–330, 2021.
- R. Zhao, T. Liu, Z. Huang, D. P.-K. Lun, and K. K. Lam, “Geometry-aware facial expression recognition via attentive graph convolutional networks,” IEEE Transactions on Affective Computing, 2021.
- J. Wang, X. Long, Y. Gao, E. Ding, and S. Wen, “Graph-pcnn: Two stage human pose estimation with graph pose refinement,” in Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XI 16. Springer, 2020, pp. 492–508.
- W. Peng, X. Hong, H. Chen, and G. Zhao, “Learning graph convolutional network for skeleton-based human action recognition by neural searching,” in Proceedings of the AAAI conference on artificial intelligence, vol. 34, no. 03, 2020, pp. 2669–2676.
- S. Jin, W. Liu, E. Xie, W. Wang, C. Qian, W. Ouyang, and P. Luo, “Differentiable hierarchical graph grouping for multi-person pose estimation,” in Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part VII 16. Springer, 2020, pp. 718–734.
- G. Dong, L. Cai, D. Datta, S. Kumar, L. E. Barnes, and M. Boukhechba, “Influenza-like symptom recognition using mobile sensing and graph neural networks,” in Proceedings of the conference on health, inference, and learning, 2021, pp. 291–300.
- G. Dong, M. Tang, L. Cai, L. E. Barnes, and M. Boukhechba, “Semi-supervised graph instance transformer for mental health inference,” in 2021 20th IEEE International Conference on Machine Learning and Applications (ICMLA). IEEE, 2021, pp. 1221–1228.
- Z. Jia, Y. Lin, J. Wang, R. Zhou, X. Ning, Y. He, and Y. Zhao, “Graphsleepnet: Adaptive spatial-temporal graph convolutional networks for sleep stage classification.” in IJCAI, vol. 2021, 2020, pp. 1324–1330.
- P. Kefalas, P. Symeonidis, and Y. Manolopoulos, “Recommendations based on a heterogeneous spatio-temporal social network,” World Wide Web, vol. 21, pp. 345–371, 2018.
- A. Salamat, X. Luo, and A. Jafari, “Heterographrec: A heterogeneous graph-based neural networks for social recommendations,” Knowledge-Based Systems, vol. 217, p. 106817, 2021.
- H. Wang, Y. Zeng, J. Chen, Z. Zhao, and H. Chen, “A spatiotemporal graph neural network for session-based recommendation,” Expert Systems with Applications, vol. 202, p. 117114, 2022.
- Y. Luo, Q. Liu, and Z. Liu, “Stan: Spatio-temporal attention network for next location recommendation,” in Proceedings of the web conference 2021, 2021, pp. 2177–2185.
- Z. Yang, M. Ding, B. Xu, H. Yang, and J. Tang, “Stam: A spatiotemporal aggregation method for graph neural network-based recommendation,” in Proceedings of the ACM Web Conference 2022, 2022, pp. 3217–3228.
- W. Shi and R. Rajkumar, “Point-gnn: Graph neural network for 3d object detection in a point cloud,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 1711–1719.
- Y. Liu, R. Wang, S. Shan, and X. Chen, “Structure inference net: Object detection using scene-level context and instance-level relationships,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 6985–6994.
- Z.-M. Chen, X.-S. Wei, P. Wang, and Y. Guo, “Multi-label image recognition with graph convolutional networks,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019, pp. 5177–5186.
- Y. Lu, Y. Chen, D. Zhao, and J. Chen, “Graph-fcn for image semantic segmentation,” in International symposium on neural networks. Springer, 2019, pp. 97–105.
- G. Brasó and L. Leal-Taixé, “Learning a neural solver for multiple object tracking,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 6247–6257.
- Q. Liu, Q. Chu, B. Liu, and N. Yu, “Gsm: Graph similarity model for multi-object tracking.” in IJCAI, 2020, pp. 530–536.
- Y. Zhang, Y. Liang, J. Leng, and Z. Wang, “Scgtracker: Spatio-temporal correlation and graph neural networks for multiple object tracking,” Pattern Recognition, p. 110249, 2024.
- Y. Wang, Y. Sun, Z. Liu, S. E. Sarma, M. M. Bronstein, and J. M. Solomon, “Dynamic graph cnn for learning on point clouds,” ACM Transactions on Graphics (tog), vol. 38, no. 5, pp. 1–12, 2019.
- Z.-H. Lin, S.-Y. Huang, and Y.-C. F. Wang, “Convolution in the cloud: Learning deformable kernels in 3d graph convolution networks for point cloud analysis,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 1800–1809.
- K. Zhang, M. Hao, J. Wang, X. Chen, Y. Leng, C. W. de Silva, and C. Fu, “Linked dynamic graph cnn: Learning through point cloud by linking hierarchical features,” in 2021 27th international conference on mechatronics and machine vision in practice (M2VIP). IEEE, 2021, pp. 7–12.
- S. Ye, L. Zeng, Q. Wu, K. Luo, Q. Fang, and X. Chen, “Eco-fl: Adaptive federated learning with efficient edge collaborative pipeline training,” in Proceedings of the 51st International Conference on Parallel Processing, 2022, pp. 1–11.
- X. Fu, B. Zhang, Y. Dong, C. Chen, and J. Li, “Federated graph machine learning: A survey of concepts, techniques, and applications,” ACM SIGKDD Explorations Newsletter, vol. 24, no. 2, pp. 32–47, 2022.
- R. Liu, P. Xing, Z. Deng, A. Li, C. Guan, and H. Yu, “Federated graph neural networks: Overview, techniques, and challenges,” IEEE Transactions on Neural Networks and Learning Systems, 2024.
- L. Zheng, J. Zhou, C. Chen, B. Wu, L. Wang, and B. Zhang, “Asfgnn: Automated separated-federated graph neural network,” Peer-to-Peer Networking and Applications, vol. 14, no. 3, pp. 1692–1704, 2021.
- T. Zhang, C. Mai, Y. Chang, C. Chen, L. Shu, and Z. Zheng, “Fedego: Privacy-preserving personalized federated graph learning with ego-graphs,” ACM Transactions on Knowledge Discovery from Data, vol. 18, no. 2, pp. 1–27, 2023.
- Y. Lin, C. Chen, C. Chen, and L. Wang, “Improving federated relational data modeling via basis alignment and weight penalty,” arXiv preprint arXiv:2011.11369, 2020.
- B. Wang, A. Li, M. Pang, H. Li, and Y. Chen, “Graphfl: A federated learning framework for semi-supervised node classification on graphs,” in 2022 IEEE International Conference on Data Mining (ICDM). IEEE, 2022, pp. 498–507.
- W. Zhu, A. White, and J. Luo, “Federated learning of molecular properties in a heterogeneous setting,” arXiv preprint arXiv:2109.07258, 2021.
- Y. Liu, D. Han, J. Zhang, H. Zhu, M. Xu, and W. Chen, “Federated multi-task graph learning,” ACM Transactions on Intelligent Systems and Technology (TIST), vol. 13, no. 5, pp. 1–27, 2022.
- C. Zhang, S. Zhang, J. James, and S. Yu, “Fastgnn: A topological information protected federated learning approach for traffic speed forecasting,” IEEE Transactions on Industrial Informatics, vol. 17, no. 12, pp. 8464–8474, 2021.
- K. Zhang, C. Yang, X. Li, L. Sun, and S. M. Yiu, “Subgraph federated learning with missing neighbor generation,” Advances in Neural Information Processing Systems, vol. 34, pp. 6671–6682, 2021.
- L. Peng, N. Wang, N. Dvornek, X. Zhu, and X. Li, “Fedni: Federated graph learning with network inpainting for population-based disease prediction,” IEEE Transactions on Medical Imaging, 2022.
- Y. Qiu, C. Huang, J. Wang, Z. Huang, and J. Xiao, “A privacy-preserving subgraph-level federated graph neural network via differential privacy,” in International Conference on Knowledge Science, Engineering and Management. Springer, 2022, pp. 165–177.
- C. Wu, F. Wu, L. Lyu, T. Qi, Y. Huang, and X. Xie, “A federated graph neural network framework for privacy-preserving personalization,” Nature Communications, vol. 13, no. 1, p. 3091, 2022.
- C. Wu, F. Wu, Y. Cao, Y. Huang, and X. Xie, “Fedgnn: Federated graph neural network for privacy-preserving recommendation,” arXiv preprint arXiv:2102.04925, 2021.
- B. Du and C. Wu, “Federated graph learning with periodic neighbour sampling,” in 2022 IEEE/ACM 30th International Symposium on Quality of Service (IWQoS). IEEE, 2022, pp. 1–10.
- Y. Yao, W. Jin, S. Ravi, and C. Joe-Wong, “Fedgcn: Convergence and communication tradeoffs in federated training of graph convolutional networks,” arXiv preprint arXiv:2201.12433, 2022.
- H. Peng, H. Li, Y. Song, V. Zheng, and J. Li, “Differentially private federated knowledge graphs embedding,” in Proceedings of the 30th ACM International Conference on Information & Knowledge Management, 2021, pp. 1416–1425.
- J. Jordon, J. Yoon, and M. Van Der Schaar, “Pate-gan: Generating synthetic data with differential privacy guarantees,” in International conference on learning representations, 2018.
- M. Chen, W. Zhang, Z. Yuan, Y. Jia, and H. Chen, “Fede: Embedding knowledge graphs in federated setting,” in Proceedings of the 10th International Joint Conference on Knowledge Graphs, 2021, pp. 80–88.
- K. Zhang, Y. Wang, H. Wang, L. Huang, C. Yang, X. Chen, and L. Sun, “Efficient federated learning on knowledge graphs via privacy-preserving relation embedding aggregation,” arXiv preprint arXiv:2203.09553, 2022.
- M. Chen, W. Zhang, Z. Yuan, Y. Jia, and H. Chen, “Federated knowledge graph completion via embedding-contrastive learning,” Knowledge-Based Systems, vol. 252, p. 109459, 2022.
- G. Mei, Z. Guo, S. Liu, and L. Pan, “Sgnn: A graph neural network based federated learning approach by hiding structure,” in 2019 IEEE International Conference on Big Data (Big Data). IEEE, 2019, pp. 2560–2568.
- T.-H. Cheung, W. Dai, and S. Li, “Fedsgc: Federated simple graph convolution for node classification,” in IJCAI Workshops, 2021.
- W. Li and S. Wang, “Federated meta-learning for spatial-temporal prediction,” Neural Computing and Applications, vol. 34, no. 13, pp. 10 355–10 374, 2022.
- J. Chen, G. Huang, H. Zheng, S. Yu, W. Jiang, and C. Cui, “Graph-fraudster: Adversarial attacks on graph neural network-based vertical federated learning,” IEEE Transactions on Computational Social Systems, vol. 10, no. 2, pp. 492–506, 2022.
- A. Zhou, J. Yang, Y. Gao, T. Qiao, Y. Qi, X. Wang, Y. Chen, P. Dai, W. Zhao, and C. Hu, “Brief industry paper: Optimizing memory efficiency of graph neural networks on edge computing platforms,” in 2021 IEEE 27th Real-Time and Embedded Technology and Applications Symposium (RTAS). IEEE, 2021, pp. 445–448.
- Z. Xue, Y. Yang, and R. Marculescu, “Sugar: Efficient subgraph-level training via resource-aware graph partitioning,” IEEE Transactions on Computers, 2023.
- T. Liu, P. Li, Z. Su, and M. Dong, “Efficient inference of graph neural networks using local sensitive hash,” IEEE Transactions on Sustainable Computing, 2024.
- H. Zhou, A. Srivastava, H. Zeng, R. Kannan, and V. Prasanna, “Accelerating large scale real-time gnn inference using channel pruning,” arXiv preprint arXiv:2105.04528, 2021.
- J. Yik, S. R. Kuppannagari, H. Zeng, and V. K. Prasanna, “Input feature pruning for accelerating gnn inference on heterogeneous platforms,” in 2022 IEEE 29th International Conference on High Performance Computing, Data, and Analytics (HiPC). IEEE, 2022, pp. 282–291.
- J. Li, S. Tian, R. Wu, L. Zhu, W. Zhao, C. Meng, L. Chen, Z. Zheng, and H. Yin, “Less can be more: Unsupervised graph pruning for large-scale dynamic graphs,” arXiv preprint arXiv:2305.10673, 2023.
- F. Wu, A. Souza, T. Zhang, C. Fifty, T. Yu, and K. Weinberger, “Simplifying graph convolutional networks,” in International conference on machine learning. PMLR, 2019, pp. 6861–6871.
- X. He, K. Deng, X. Wang, Y. Li, Y. Zhang, and M. Wang, “Lightgcn: Simplifying and powering graph convolution network for recommendation,” in Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, 2020, pp. 639–648.
- K. Mao, J. Zhu, X. Xiao, B. Lu, Z. Wang, and X. He, “Ultragcn: ultra simplification of graph convolutional networks for recommendation,” in Proceedings of the 30th ACM International Conference on Information & Knowledge Management, 2021, pp. 1253–1262.
- A. Zhou, J. Yang, Y. Qi, Y. Shi, T. Qiao, W. Zhao, and C. Hu, “Hardware-aware graph neural network automated design for edge computing platforms,” arXiv preprint arXiv:2303.10875, 2023.
- W. Zhang, Y. Shen, Z. Lin, Y. Li, X. Li, W. Ouyang, Y. Tao, Z. Yang, and B. Cui, “Pasca: A graph neural architecture search system under the scalable paradigm,” in Proceedings of the ACM Web Conference 2022, 2022, pp. 1817–1828.
- M. Odema, H. Bouzidi, H. Ouarnoughi, S. Niar, and M. A. Al Faruque, “Magnas: A mapping-aware graph neural architecture search framework for heterogeneous mpsoc deployment,” ACM Transactions on Embedded Computing Systems, vol. 22, no. 5s, pp. 1–26, 2023.
- B. Feng, Y. Wang, X. Li, S. Yang, X. Peng, and Y. Ding, “Sgquant: Squeezing the last bit on graph neural networks with specialized quantization,” in 2020 IEEE 32nd International Conference on Tools with Artificial Intelligence (ICTAI). IEEE, 2020, pp. 1044–1052.
- S. A. Tailor, J. Fernández-Marqués, and N. D. Lane, “Degree-quant: Quantization-aware training for graph neural networks,” in 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021. OpenReview.net, 2021.
- M. Ding, K. Kong, J. Li, C. Zhu, J. Dickerson, F. Huang, and T. Goldstein, “Vq-gnn: A universal framework to scale up graph neural networks using vector quantization,” Advances in Neural Information Processing Systems, vol. 34, pp. 6733–6746, 2021.
- J. Wang, Y. Wang, Z. Yang, L. Yang, and Y. Guo, “Bi-gcn: Binary graph convolutional network,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 1561–1570.
- G. Hinton, O. Vinyals, and J. Dean, “Distilling the knowledge in a neural network,” arXiv preprint arXiv:1503.02531, 2015.
- J. H. Cho and B. Hariharan, “On the efficacy of knowledge distillation,” in Proceedings of the IEEE/CVF international conference on computer vision, 2019, pp. 4794–4802.
- H. Chen, L. Zeng, S. Yu, and X. Chen, “Knowledge distillation for mobile edge computation offloading,” ZTE Communications, vol. 18, no. 2, pp. 40–48, 2020.
- J. Gou, B. Yu, S. J. Maybank, and D. Tao, “Knowledge distillation: A survey,” International Journal of Computer Vision, vol. 129, pp. 1789–1819, 2021.
- Y. Yang, J. Qiu, M. Song, D. Tao, and X. Wang, “Distilling knowledge from graph convolutional networks,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020, pp. 7074–7083.
- C. Yang, J. Liu, and C. Shi, “Extract the knowledge of graph neural networks and go beyond it: An effective knowledge distillation framework,” in Proceedings of the web conference 2021, 2021, pp. 1227–1237.
- B. Yan, C. Wang, G. Guo, and Y. Lou, “Tinygnn: Learning efficient graph neural networks,” in Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 2020, pp. 1848–1856.
- W.-Q. Ren, Y.-B. Qu, C. Dong, Y.-Q. Jing, H. Sun, Q.-H. Wu, and S. Guo, “A survey on collaborative dnn inference for edge intelligence,” Machine Intelligence Research, vol. 20, no. 3, pp. 370–395, 2023.
- C. Zhou, J. Gao, M. Li, N. Cheng, X. Shen, and W. Zhuang, “Digital twin-based 3d map management for edge-assisted device pose tracking in mobile ar,” IEEE Internet of Things Journal, 2024.
- S. Hu, M. Li, J. Gao, C. Zhou, and X. S. Shen, “Adaptive device-edge collaboration on dnn inference in aiot: A digital twin-assisted approach,” IEEE Internet of Things Journal, 2023.
- K. Qu, W. Zhuang, W. Wu, M. Li, X. Shen, X. Li, and W. Shi, “Stochastic cumulative dnn inference with rl-aided adaptive iot device-edge collaboration,” IEEE Internet of Things Journal, 2023.
- L. Zeng, E. Li, Z. Zhou, and X. Chen, “Boomerang: On-demand cooperative deep neural network inference for edge intelligence on the industrial internet of things,” IEEE Network, vol. 33, no. 5, pp. 96–103, 2019.
- J. Shao, H. Zhang, Y. Mao, and J. Zhang, “Branchy-gnn: A device-edge co-inference framework for efficient point cloud processing,” in ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2021, pp. 8488–8492.
- S. Laskaridis, S. I. Venieris, M. Almeida, I. Leontiadis, and N. D. Lane, “Spinn: synergistic progressive inference of neural networks over device and cloud,” in Proceedings of the 26th Annual International Conference on Mobile Computing and Networking, 2020, pp. 1–15.
- Q. He, Z. Dong, F. Chen, S. Deng, W. Liang, and Y. Yang, “Pyramid: Enabling hierarchical neural networks with edge computing,” in Proceedings of the ACM Web Conference 2022, 2022, pp. 1860–1870.
- L. Zeng, S. Ye, X. Chen, and Y. Yang, “Implementation of big ai models for wireless networks with collaborative edge computing,” IEEE Wireless Communications, vol. 31, no. 3, 2024.
- S. Yang, L. Jiao, R. Yahyapour, and J. Cao, “Online orchestration of collaborative caching for multi-bitrate videos in edge computing,” IEEE Transactions on Parallel and Distributed Systems, vol. 33, no. 12, pp. 4207–4220, 2022.
- M. Zhang, J. Cao, L. Yang, L. Zhang, Y. Sahni, and S. Jiang, “Ents: An edge-native task scheduling system for collaborative edge computing,” in 2022 IEEE/ACM 7th Symposium on Edge Computing (SEC). IEEE, 2022, pp. 149–161.
- W. Xu, H. Wang, Z. Lu, C. Hua, N. Cheng, and S. Guo, “Mobile collaborative learning over opportunistic internet of vehicles,” IEEE Transactions on Mobile Computing, vol. 23, no. 4, pp. 3187–3199, 2023.
- L. Zeng, X. Chen, Z. Zhou, L. Yang, and J. Zhang, “Coedge: Cooperative dnn inference with adaptive workload partitioning over heterogeneous edge devices,” IEEE/ACM Transactions on Networking, vol. 29, no. 2, pp. 595–608, 2020.
- P. Dong, J. Ge, X. Wang, and S. Guo, “Collaborative edge computing for social internet of things: Applications, solutions, and challenges,” IEEE Transactions on Computational Social Systems, vol. 9, no. 1, pp. 291–301, 2021.
- L. Zeng, P. Huang, K. Luo, X. Zhang, Z. Zhou, and X. Chen, “Fograph: Enabling real-time deep graph inference with fog computing,” in Proceedings of the ACM Web Conference 2022, 2022, pp. 1774–1784.
- L. Zeng, X. Chen, P. Huang, K. Luo, X. Zhang, and Z. Zhou, “Serving graph neural networks with distributed fog servers for smart iot services,” in IEEE/ACM Transactions on Networking. IEEE, 2023, pp. 1–16.
- L. Zeng, C. Yang, P. Huang, Z. Zhou, S. Yu, and X. Chen, “Gnn at the edge: Cost-efficient graph neural network processing over distributed edge servers,” JSAC, vol. 41, no. 3, pp. 720–739, 2022.
- Y. Shen, Y. Shi, J. Zhang, and K. B. Letaief, “Graph neural networks for scalable radio resource management: Architecture design and theoretical analysis,” IEEE Journal on Selected Areas in Communications, vol. 39, no. 1, pp. 101–115, 2020.
- M. Chiang, P. Hande, T. Lan, C. W. Tan et al., “Power control in wireless cellular networks,” Foundations and Trends® in Networking, vol. 2, no. 4, pp. 381–533, 2008.
- R. L. Cruz and A. V. Santhanam, “Optimal routing, link scheduling and power control in multihop wireless networks,” in IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No. 03CH37428), vol. 1. IEEE, 2003, pp. 702–711.
- Y. Shen, Y. Shi, J. Zhang, and K. B. Letaief, “A graph neural network approach for scalable wireless power control,” in 2019 IEEE Globecom Workshops (GC Wkshps). IEEE, 2019, pp. 1–6.
- M. Eisen and A. Ribeiro, “Optimal wireless resource allocation with random edge graph neural networks,” ieee transactions on signal processing, vol. 68, pp. 2977–2991, 2020.
- Eisen, Mark and Ribeiro, Alejandro, “Transferable policies for large scale wireless networks with graph neural networks,” in ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2020, pp. 5040–5044.
- I. Nikoloska and O. Simeone, “Fast power control adaptation via meta-learning for random edge graph neural networks,” in 2021 IEEE 22nd International Workshop on Signal Processing Advances in Wireless Communications (SPAWC). IEEE, 2021, pp. 146–150.
- H. Yang, N. Cheng, R. Sun, W. Quan, R. Chai, K. Aldubaikhy, A. Alqasir, and X. Shen, “Knowledge-driven resource allocation for wireless networks: A wmmse unrolled graph neural network approach,” IEEE Internet of Things Journal, 2024.
- M. Lee, G. Yu, and G. Y. Li, “Graph embedding-based wireless link scheduling with few training samples,” IEEE Transactions on Wireless Communications, vol. 20, no. 4, pp. 2282–2294, 2020.
- K. Lei, M. Qin, B. Bai, G. Zhang, and M. Yang, “Gcn-gan: A non-linear temporal link prediction model for weighted dynamic networks,” in IEEE INFOCOM 2019-IEEE conference on computer communications. IEEE, 2019, pp. 388–396.
- E. Björnson, M. Bengtsson, and B. Ottersten, “Optimal multiuser transmit beamforming: A difficult problem with a simple solution structure [lecture notes],” IEEE Signal Processing Magazine, vol. 31, no. 4, pp. 142–148, 2014.
- T. Chen, M. You, G. Zheng, and S. Lambotharan, “Graph neural network based beamforming in d2d wireless networks,” in WSA 2021; 25th International ITG Workshop on Smart Antennas. VDE, 2021, pp. 1–5.
- J. Kim, H. Lee, S.-E. Hong, and S.-H. Park, “A bipartite graph neural network approach for scalable beamforming optimization,” IEEE Transactions on Wireless Communications, vol. 22, no. 1, pp. 333–347, 2022.
- X. Shen, J. Gao, W. Wu, M. Li, C. Zhou, and W. Zhuang, “Holistic network virtualization and pervasive network intelligence for 6g,” IEEE Communications Surveys & Tutorials, vol. 24, no. 1, pp. 1–30, 2021.
- D. Heo, S. Lange, H.-G. Kim, and H. Choi, “Graph neural network based service function chaining for automatic network control,” in 2020 21st Asia-Pacific Network Operations and Management Symposium (APNOMS). IEEE, 2020, pp. 7–12.
- D. Heo, D. Lee, H.-G. Kim, S. Park, and H. Choi, “Reinforcement learning of graph neural networks for service function chaining,” arXiv preprint arXiv:2011.08406, 2020.
- I. Afolabi, T. Taleb, K. Samdanis, A. Ksentini, and H. Flinck, “Network slicing and softwarization: A survey on principles, enabling technologies, and solutions,” IEEE Communications Surveys & Tutorials, vol. 20, no. 3, pp. 2429–2453, 2018.
- H. Wang, Y. Wu, G. Min, and W. Miao, “A graph neural network-based digital twin for network slicing management,” IEEE Transactions on Industrial Informatics, vol. 18, no. 2, pp. 1367–1376, 2020.
- F. Naeem, G. Kaddoum, and M. Tariq, “Digital twin-empowered network slicing in b5g networks: Experience-driven approach,” in 2021 IEEE Globecom Workshops (GC Wkshps). IEEE, 2021, pp. 1–5.
- J. Chen, Y. Yang, C. Wang, H. Zhang, C. Qiu, and X. Wang, “Multitask offloading strategy optimization based on directed acyclic graphs for edge computing,” IEEE Internet of Things Journal, vol. 9, no. 12, pp. 9367–9378, 2021.
- A. Swaminathan, M. Chaba, D. K. Sharma, and U. Ghosh, “Graphnet: Graph neural networks for routing optimization in software defined networks,” Computer Communications, vol. 178, pp. 169–182, 2021.
- M. Ma, C. Gong, L. Zeng, and Y. Yang, “Mogr: Multi-task offloading via graph representation in heterogeneous computing network,” in IEEE International Conference on Communications. IEEE, 2024, pp. 1–6.
- V. Lima, M. Eisen, K. Gatsis, and A. Ribeiro, “Resource allocation in large-scale wireless control systems with graph neural networks,” IFAC-PapersOnLine, vol. 53, no. 2, pp. 2634–2641, 2020.
- V. Lima, M. Eisen, K. Gatsis, and A. Ribeiro, “Large-scale graph reinforcement learning in wireless control systems,” arXiv preprint arXiv:2201.09859, 2022.
- H. Kim, B. S. Lee, W.-Y. Shin, and S. Lim, “Graph anomaly detection with graph neural networks: Current status and challenges,” IEEE Access, 2022.
- L.-H. Chen, H. Li, W. Zhang, J. Huang, X. Ma, J. Cui, N. Li, and J. Yoo, “Anomman: Detect anomalies on multi-view attributed networks,” Information Sciences, vol. 628, pp. 1–21, 2023.
- G. Zhang, Z. Li, J. Huang, J. Wu, C. Zhou, J. Yang, and J. Gao, “efraudcom: An e-commerce fraud detection system via competitive graph neural networks,” ACM Transactions on Information Systems (TOIS), vol. 40, no. 3, pp. 1–29, 2022.
- R. Ma, G. Pang, L. Chen, and A. van den Hengel, “Deep graph-level anomaly detection by glocal knowledge distillation,” in Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining, 2022, pp. 704–714.
- C. Qiu, M. Kloft, S. Mandt, and M. Rudolph, “Raising the bar in graph-level anomaly detection,” arXiv preprint arXiv:2205.13845, 2022.
- L. Ruff, R. Vandermeulen, N. Goernitz, L. Deecke, S. A. Siddiqui, A. Binder, E. Müller, and M. Kloft, “Deep one-class classification,” in International conference on machine learning. PMLR, 2018, pp. 4393–4402.
- H. Chen and H. Eldardiry, “Graph time-series modeling in deep learning: A survey,” ACM Transactions on Knowledge Discovery from Data, 2023.
- A. Deng and B. Hooi, “Graph neural network-based anomaly detection in multivariate time series,” in Proceedings of the AAAI conference on artificial intelligence, vol. 35, no. 5, 2021, pp. 4027–4035.
- W. Zhang, C. Zhang, and F. Tsung, “Grelen: Multivariate time series anomaly detection from the perspective of graph relational learning,” in Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJCAI-22, vol. 7, 2022, pp. 2390–2397.
- S. Han and S. S. Woo, “Learning sparse latent graph representations for anomaly detection in multivariate time series,” in Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2022, pp. 2977–2986.
- Z. Wu, X. Wu, and Y. Long, “Multi-level federated graph learning and self-attention based personalized wi-fi indoor fingerprint localization,” IEEE Communications Letters, vol. 26, no. 8, pp. 1794–1798, 2022.
- P. Xing, S. Lu, L. Wu, and H. Yu, “Big-fed: Bilevel optimization enhanced graph-aided federated learning,” IEEE Transactions on Big Data, 2022.
- F. Chen, G. Long, Z. Wu, T. Zhou, and J. Jiang, “Personalized federated learning with graph,” arXiv preprint arXiv:2203.00829, 2022.
- B. Li, A. Swami, and S. Segarra, “Power allocation for wireless federated learning using graph neural networks,” in ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2022, pp. 5243–5247.
- H. Lee, A. L. Bertozzi, J. Kovačević, and Y. Chi, “Privacy-preserving federated multi-task linear regression: A one-shot linear mixing approach inspired by graph regularization,” in ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2022, pp. 5947–5951.
- C. Meng, S. Rambhatla, and Y. Liu, “Cross-node federated graph neural network for spatio-temporal data modeling,” in Proceedings of the 27th ACM SIGKDD conference on knowledge discovery & data mining, 2021, pp. 1202–1211.
- D. Caldarola, M. Mancini, F. Galasso, M. Ciccone, E. Rodolà, and B. Caputo, “Cluster-driven graph federated learning over multiple domains,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 2749–2758.
- O. Litany, H. Maron, D. Acuna, J. Kautz, G. Chechik, and S. Fidler, “Federated learning with heterogeneous architectures using graph hypernetworks,” arXiv preprint arXiv:2201.08459, 2022.
- S. Lu, Y. Zhang, and Y. Wang, “Decentralized federated learning for electronic health records,” in 2020 54th Annual Conference on Information Sciences and Systems (CISS). IEEE, 2020, pp. 1–5.
- V. C. Gogineni, S. Werner, Y.-F. Huang, and A. Kuh, “Decentralized graph federated multitask learning for streaming data,” in 2022 56th Annual Conference on Information Sciences and Systems (CISS). IEEE, 2022, pp. 101–106.
- Y. Tao, Y. Li, and Z. Wu, “Semigraphfl: Semi-supervised graph federated learning for graph classification,” in International Conference on Parallel Problem Solving from Nature. Springer, 2022, pp. 474–487.
- X. Yuan, J. Chen, J. Yang, N. Zhang, T. Yang, T. Han, and A. Taherkordi, “Fedstn: Graph representation driven federated learning for edge computing enabled urban traffic flow prediction,” IEEE Transactions on Intelligent Transportation Systems, 2022.
- A. Ortega, P. Frossard, J. Kovačević, J. M. Moura, and P. Vandergheynst, “Graph signal processing: Overview, challenges, and applications,” Proceedings of the IEEE, vol. 106, no. 5, pp. 808–828, 2018.
- C. T. Dinh, T. T. Vu, N. H. Tran, M. N. Dao, and H. Zhang, “A new look and convergence rate of federated multitask learning with laplacian regularization,” IEEE Transactions on Neural Networks and Learning Systems, 2022.
- C. He, E. Ceyani, K. Balasubramanian, M. Annavaram, and S. Avestimehr, “Spreadgnn: Serverless multi-task federated learning for graph neural networks,” arXiv preprint arXiv:2106.02743, 2021.
- H. Wang, X. Zhao, and W. Lin, “Heterogeneous federated learning on a graph,” arXiv preprint arXiv:2209.08737, 2022.
- K. Huang, J. Zhai, Z. Zheng, Y. Yi, and X. Shen, “Understanding and bridging the gaps in current gnn performance optimizations,” in Proceedings of the 26th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, 2021, pp. 119–132.
- H. Zhang, Z. Yu, G. Dai, G. Huang, Y. Ding, Y. Xie, and Y. Wang, “Understanding gnn computational graph: A coordinated computation, io, and memory perspective,” Proceedings of Machine Learning and Systems, vol. 4, pp. 467–484, 2022.
- M. K. Rahman, M. H. Sujon, and A. Azad, “Fusedmm: A unified sddmm-spmm kernel for graph embedding and graph neural networks,” in 2021 IEEE International Parallel and Distributed Processing Symposium (IPDPS). IEEE, 2021, pp. 256–266.
- Z. Gong, H. Ji, Y. Yao, C. W. Fletcher, C. J. Hughes, and J. Torrellas, “Graphite: optimizing graph neural networks on cpus through cooperative software-hardware techniques,” in Proceedings of the 49th Annual International Symposium on Computer Architecture, 2022, pp. 916–931.
- V. Md, S. Misra, G. Ma, R. Mohanty, E. Georganas, A. Heinecke, D. Kalamkar, N. K. Ahmed, and S. Avancha, “Distgnn: Scalable distributed training for large-scale graph neural networks,” in Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, 2021, pp. 1–14.
- J. Thorpe, Y. Qiao, J. Eyolfson, S. Teng, G. Hu, Z. Jia, J. Wei, K. Vora, R. Netravali, M. Kim et al., “Dorylus: Affordable, scalable, and accurate {{\{{GNN}}\}} training with distributed {{\{{CPU}}\}} servers and serverless threads,” in 15th USENIX Symposium on Operating Systems Design and Implementation (OSDI 21), 2021, pp. 495–514.
- L. Wang, Q. Yin, C. Tian, J. Yang, R. Chen, W. Yu, Z. Yao, and J. Zhou, “Flexgraph: a flexible and efficient distributed framework for gnn training,” in Proceedings of the Sixteenth European Conference on Computer Systems, 2021, pp. 67–82.
- M. J. Adiletta, J. J. Tithi, E.-I. Farsarakis, G. Gerogiannis, R. Adolf, R. Benke, S. Kashyap, S. Hsia, K. Lakhotia, F. Petrini et al., “Characterizing the scalability of graph convolutional networks on intel® piuma,” in 2023 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS). IEEE, 2023, pp. 168–177.
- Y. Hu, Z. Ye, M. Wang, J. Yu, D. Zheng, M. Li, Z. Zhang, Z. Zhang, and Y. Wang, “Featgraph: A flexible and efficient backend for graph neural network systems,” in SC20: International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE, 2020, pp. 1–13.
- Y. Shao, H. Li, X. Gu, H. Yin, Y. Li, X. Miao, W. Zhang, B. Cui, and L. Chen, “Distributed graph neural network training: A survey,” ACM Computing Surveys, 2022.
- H. Lin, M. Yan, X. Ye, D. Fan, S. Pan, W. Chen, and Y. Xie, “A comprehensive survey on distributed training of graph neural networks,” Proceedings of the IEEE, 2023.
- Y.-C. Lin, B. Zhang, and V. Prasanna, “Hp-gnn: Generating high throughput gnn training implementation on cpu-fpga heterogeneous platform,” in Proceedings of the 2022 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays, 2022, pp. 123–133.
- S. Abi-Karam, Y. He, R. Sarkar, L. Sathidevi, Z. Qiao, and C. Hao, “Gengnn: A generic fpga framework for graph neural network acceleration,” arXiv preprint arXiv:2201.08475, 2022.
- B. Zhang, H. Zeng, and V. Prasanna, “Graphagile: An fpga-based overlay accelerator for low-latency gnn inference,” IEEE Transactions on Parallel and Distributed Systems, 2023.
- R. Chen, H. Zhang, S. Li, E. Tang, J. Yu, and K. Wang, “Graph-opu: A highly integrated fpga-based overlay processor for graph neural networks,” in 2023 33rd International Conference on Field-Programmable Logic and Applications (FPL). IEEE, 2023, pp. 228–234.
- A. Heintz, V. Razavimaleki, J. Duarte, G. DeZoort, I. Ojalvo, S. Thais, M. Atkinson, M. Neubauer, L. Gray, S. Jindariani et al., “Accelerated charged particle tracking with graph neural networks on fpgas,” arXiv preprint arXiv:2012.01563, 2020.
- B. Zhang, R. Kannan, V. Prasanna, and C. Busart, “Accelerating gnn-based sar automatic target recognition on hbm-enabled fpga,” in 2023 IEEE High Performance Extreme Computing Conference (HPEC). IEEE, 2023, pp. 1–7.
- S.-Y. Huang, Y.-C. Yang, Y.-R. Su, B.-C. Lai, J. Duarte, S. Hauck, S.-C. Hsu, J.-X. Hu, and M. S. Neubauer, “Low latency edge classification gnn for particle trajectory tracking on fpgas,” in 2023 33rd International Conference on Field-Programmable Logic and Applications (FPL). IEEE, 2023, pp. 294–298.
- B. Sun, L. Yang, P. Dong, W. Zhang, J. Dong, and C. Young, “Ultra power-efficient cnn domain specific accelerator with 9.3 tops/watt for mobile and embedded applications,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2018, pp. 1677–1685.
- Google, “Tensor processing unit,” Official Product Page, accessed: 2024-01-25. [Online]. Available: https://cloud.google.com/tpu/
- Qualcomm, “Mobile ai solutions,” Official Product Page, accessed: 2024-01-25. [Online]. Available: https://www.qualcomm.com/products/mobile/snapdragon/smartphones/mobile-ai
- Apple, “Deploying transformers on the apple neural engine,” Apple Machine Learning Research Website, accessed: 2024-01-25. [Online]. Available: https://machinelearning.apple.com/research/neural-engine-transformers
- S. Liang, Y. Wang, C. Liu, L. He, L. Huawei, D. Xu, and X. Li, “Engn: A high-throughput and energy-efficient accelerator for large graph neural networks,” IEEE Transactions on Computers, vol. 70, no. 9, pp. 1511–1525, 2020.
- A. Auten, M. Tomei, and R. Kumar, “Hardware acceleration of graph neural networks,” in 2020 57th ACM/IEEE Design Automation Conference (DAC). IEEE, 2020, pp. 1–6.
- M. Yan, Z. Chen, L. Deng, X. Ye, Z. Zhang, D. Fan, and Y. Xie, “Characterizing and understanding gcns on gpu,” IEEE Computer Architecture Letters, vol. 19, no. 1, pp. 22–25, 2020.
- H. Lin, M. Yan, X. Yang, M. Zou, W. Li, X. Ye, and D. Fan, “Characterizing and understanding distributed gnn training on gpus,” IEEE Computer Architecture Letters, vol. 21, no. 1, pp. 21–24, 2022.
- M. Yan, L. Deng, X. Hu, L. Liang, Y. Feng, X. Ye, Z. Zhang, D. Fan, and Y. Xie, “Hygcn: A gcn accelerator with hybrid architecture,” in 2020 IEEE International Symposium on High Performance Computer Architecture (HPCA). IEEE, 2020, pp. 15–29.
- K. Kiningham, P. Levis, and C. Ré, “Grip: A graph neural network accelerator architecture,” IEEE Transactions on Computers, vol. 72, no. 4, pp. 914–925, 2022.
- K. Kiningham, P. Levis, and C. Re, “Greta: Hardware optimized graph processing for gnns,” in Proceedings of the Workshop on Resource-Constrained Machine Learning (ReCoML 2020), 2020.
- T. Geng, A. Li, R. Shi, C. Wu, T. Wang, Y. Li, P. Haghi, A. Tumeo, S. Che, S. Reinhardt et al., “Awb-gcn: A graph convolutional network accelerator with runtime workload rebalancing,” in 2020 53rd Annual IEEE/ACM International Symposium on Microarchitecture (MICRO). IEEE, 2020, pp. 922–936.
- M. Fey and J. E. Lenssen, “Fast graph representation learning with PyTorch Geometric,” in ICLR Workshop on Representation Learning on Graphs and Manifolds, 2019.
- M. Wang, D. Zheng, Z. Ye, Q. Gan, M. Li, X. Song, J. Zhou, C. Ma, L. Yu, Y. Gai et al., “Deep graph library: A graph-centric, highly-performant package for graph neural networks,” arXiv preprint arXiv:1909.01315, 2019.
- D. Zhang, X. Huang, Z. Liu, J. Zhou, Z. Hu, X. Song, Z. Ge, L. Wang, Z. Zhang, and Y. Qi, “Agl: A scalable system for industrial-purpose graph machine learning,” Proceedings of the VLDB Endowment, vol. 13, no. 12, 2020.
- T. Liu, Y. Chen, D. Li, C. Wu, Y. Zhu, J. He, Y. Peng, H. Chen, H. Chen, and C. Guo, “{{\{{BGL}}\}}:{{\{{GPU-Efficient}}\}}{{\{{GNN}}\}} training by optimizing graph data {{\{{I/O}}\}} and preprocessing,” in 20th USENIX Symposium on Networked Systems Design and Implementation (NSDI 23), 2023, pp. 103–118.
- O. Ferludin, A. Eigenwillig, M. Blais, D. Zelle, J. Pfeifer, A. Sanchez-Gonzalez, W. L. S. Li, S. Abu-El-Haija, P. Battaglia, N. Bulut et al., “Tf-gnn: Graph neural networks in tensorflow,” arXiv preprint arXiv:2207.03522, 2022.
- Caltrans Performance Measurement System, “Pems dataset,” PeMS Official Website, accessed: 2023-07-31. [Online]. Available: http://pems.dot.ca.gov/
- Metro, “Metr-la dataset,” Kaggle, accessed: 2023-07-31. [Online]. Available: https://www.kaggle.com/datasets/annnnguyen/metr-la-dataset
- NYC Taxi & Limousine Commission, “Nyc taxi dataset,” NYC Data and Reports, accessed: 2023-07-31. [Online]. Available: https://www.nyc.gov/site/tlc/about/tlc-trip-record-data.page
- Divvy, “Chicago bike trip dataset,” Divvy Data, accessed: 2023-07-31. [Online]. Available: https://divvybikes.com/system-data
- Beijing Municipal Environmental Monitoring Center, “Beijing multi-site air quality dataset,” UC Irving Machine Learning Repository, accessed: 2023-07-31. [Online]. Available: https://archive.ics.uci.edu/dataset/501/beijing+multi+site+air+quality+data
- Google, “Weatherbench2 dataset,” Github, accessed: 2023-07-31. [Online]. Available: https://github.com/google-research/weatherbench2
- A. Varbella, K. Amara, B. Gjorgiev1, and S. Giovanni, “Powergraph dataset,” Figshare, accessed: 2024-03-01. [Online]. Available: https://figshare.com/articles/dataset/PowerGraph/22820534
- JHU CSSE, “Covid-19 dataset,” Github, accessed: 2023-07-31. [Online]. Available: https://github.com/CSSEGISandData/COVID-19
- Federal Highway Administration Research and Technology, “Us-101 dataset,” Federal Highway Administration Research and Technology, accessed: 2023-07-31. [Online]. Available: https://www.fhwa.dot.gov/publications/research/operations/07030/
- A. Robicquet, A. Sadeghian, A. Alahi, and S. Savarese, “Stanford drone dataset,” Stanford Project Page, accessed: 2023-07-31. [Online]. Available: https://cvgl.stanford.edu/projects/uav_data/
- K. P. Team, “Kinetics dataset,” Github, accessed: 2023-07-31. [Online]. Available: https://github.com/cvdfoundation/kinetics-dataset
- J. Liu, A. Shahroudy, M. Perez, G. Wang, L.-Y. Duan, and A. C. Kot, “Ntu rgb+d dataset,” ROSE Lab Website, accessed: 2023-07-31. [Online]. Available: https://rose1.ntu.edu.sg/dataset/actionRecognition/
- B. Lab, “Mobiact dataset,” BMI Lab, accessed: 2023-07-31. [Online]. Available: https://bmi.hmu.gr/the-mobifall-and-mobiact-datasets-2/
- E. Cippitelli, E. Gambi, S. Gasparrini, and S. Spinsante, “Tst fall detection datasets v2 dataset,” IEEE DataPort, accessed: 2023-07-31. [Online]. Available: https://ieee-dataport.org/documents/tst-fall-detection-dataset-v2
- CARSM, “Montreal archive of sleep studies dataset,” CARSM Official Website, accessed: 2023-07-31. [Online]. Available: http://ceams-carsm.ca/mass/
- A. Mollahosseini, B. Hasani, and M. H. Mahoor, “Affectnet dataset,” AffectNet Official Website, accessed: 2023-07-31. [Online]. Available: http://mohammadmahoor.com/affectnet/
- E. Cho, S. A. Myers, and J. Leskovec, “Gowalla dataset,” SNAP Group, accessed: 2023-07-31. [Online]. Available: https://snap.stanford.edu/data/loc-gowalla.html
- F. D. Team, “Foursquare dataset,” Dingqi Yang’s Homepage, accessed: 2023-07-31. [Online]. Available: https://sites.google.com/site/yangdingqi/home/foursquare-dataset
- C. Marche, L. Atzori, V. Pilloni, and M. Nitti, “Social iot dataset,” Social Internet of Things Project Official Website, accessed: 2023-07-31. [Online]. Available: https://www.social-iot.org/
- Yelp, “Yelp open dataset,” Yelp Official Website, accessed: 2023-07-31. [Online]. Available: https://www.yelp.com/dataset
- Y. LeCun, C. Cortes, and C. Burges, “Mnist dataset,” Google TensorFlow Datasets, accessed: 2023-07-31. [Online]. Available: https://www.tensorflow.org/datasets/catalog/mnist
- D. D. Team, “Davis dataset,” DAVIS Challenge Official Website, accessed: 2023-07-31. [Online]. Available: https://davischallenge.org/
- Y.-V. Team, “Youtube video instance segmentation dataset,” YouTube-VOS Official Website, accessed: 2023-07-31. [Online]. Available: https://youtube-vos.org/dataset/vis/
- A. Geiger, P. Lenz, C. Stiller, and R. Urtasun, “The kitti vision benchmark suite,” CVLIBS, accessed: 2023-07-31. [Online]. Available: https://www.cvlibs.net/datasets/kitti/
- Z. Wu, S. Song, A. Khosla, F. Yu, L. Zhang, X. Tang, and J. Xiao, “Modelnet dataset,” Princeton ModelNet Official Website, accessed: 2023-07-31. [Online]. Available: https://modelnet.cs.princeton.edu/
- W. Jiang, “Graph-based deep learning for communication networks: A survey,” Computer Communications, vol. 185, pp. 40–54, 2022.
- Y. Yang, J. Wu, T. Chen, C. Peng, J. Wang, J. Deng, X. Tao, G. Liu, W. Li, L. Yang et al., “Task-oriented 6g native-ai network architecture,” IEEE Network, 2023.
- K. Xu, W. Hu, J. Leskovec, and S. Jegelka, “How powerful are graph neural networks?” in International Conference on Learning Representations, 2018.
- H. Maron, H. Ben-Hamu, H. Serviansky, and Y. Lipman, “Provably powerful graph networks,” Advances in neural information processing systems, vol. 32, 2019.
- H. Yuan, H. Yu, S. Gui, and S. Ji, “Explainability in graph neural networks: A taxonomic survey,” IEEE transactions on pattern analysis and machine intelligence, vol. 45, no. 5, pp. 5782–5799, 2022.
Collections
Sign up for free to add this paper to one or more collections.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.