A Survey on Context-Aware Multi-Agent Systems: Techniques, Challenges and Future Directions (2402.01968v1)
Abstract: Research interest in autonomous agents is on the rise as an emerging topic. The notable achievements of LLMs have demonstrated the considerable potential to attain human-like intelligence in autonomous agents. However, the challenge lies in enabling these agents to learn, reason, and navigate uncertainties in dynamic environments. Context awareness emerges as a pivotal element in fortifying multi-agent systems when dealing with dynamic situations. Despite existing research focusing on both context-aware systems and multi-agent systems, there is a lack of comprehensive surveys outlining techniques for integrating context-aware systems with multi-agent systems. To address this gap, this survey provides a comprehensive overview of state-of-the-art context-aware multi-agent systems. First, we outline the properties of both context-aware systems and multi-agent systems that facilitate integration between these systems. Subsequently, we propose a general process for context-aware systems, with each phase of the process encompassing diverse approaches drawn from various application domains such as collision avoidance in autonomous driving, disaster relief management, utility management, supply chain management, human-AI interaction, and others. Finally, we discuss the existing challenges of context-aware multi-agent systems and provide future research directions in this field.
- A survey on context-aware recommender systems based on computational intelligence techniques. Computing, 97:667–690, 2015.
- Towards a better understanding of context and context-awareness. In Handheld and Ubiquitous Computing: First International Symposium, HUC’99 Karlsruhe, Germany, September 27–29, 1999 Proceedings 1, pages 304–307. Springer, 1999.
- Engineering context-aware systems and applications: A survey. Journal of Systems and Software, 117:55–83, 2016.
- Consensus in multi-agent systems: a review. Artificial Intelligence Review, 55(5):3897–3935, 2022.
- A survey on context-aware systems. International Journal of ad Hoc and ubiquitous Computing, 2(4):263–277, 2007.
- A survey of context data distribution for mobile ubiquitous systems. ACM computing surveys (CSUR), 44(4):1–45, 2012.
- A security-aware metamodel for multi-agent systems (mas). Information and software technology, 51(5):832–845, 2009.
- Sparks of artificial general intelligence: Early experiments with gpt-4. arXiv preprint arXiv:2303.12712, 2023.
- Context-aware recommender systems and cultural heritage: a survey. Journal of Ambient Intelligence and Humanized Computing, 14(4):3109–3127, 2023.
- A multi-agent system for enabling collaborative situation awareness via position-based stigmergy and neuro-fuzzy learning. Neurocomputing, 135:86–97, 2014.
- Midas: Multi-agent interaction-aware decision-making with adaptive strategies for urban autonomous navigation. In 2021 IEEE International Conference on Robotics and Automation (ICRA), pages 7980–7986. IEEE, 2021.
- Delay-aware multi-agent reinforcement learning for cooperative and competitive environments. arXiv preprint arXiv:2005.05441, 2020.
- Agentverse: Facilitating multi-agent collaboration and exploring emergent behaviors in agents. arXiv preprint arXiv:2308.10848, 2023.
- Survey of agent-based cloud computing applications. Future generation computer systems, 100:223–236, 2019.
- Multi-agent systems: A survey. Ieee Access, 6:28573–28593, 2018.
- The impact of diversity on performance of holonic multi-agent systems. Engineering Applications of Artificial Intelligence, 55:186–201, 2016.
- Motion planning among dynamic, decision-making agents with deep reinforcement learning. In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 3052–3059. IEEE, 2018.
- Switching-aware multi-agent deep reinforcement learning for target interception. Applied Intelligence, 53(7):7876–7891, 2023.
- Promptbreeder: Self-referential self-improvement via prompt evolution. arXiv preprint arXiv:2309.16797, 2023.
- Context-aware multi-agent planning in intelligent environments. Information Sciences, 227:22–42, 2013.
- Farid Feyzi. Model-driven development of self-adaptive multi-agent systems with context-awareness. International Journal of Computer Aided Engineering and Technology, 12(2):131–156, 2020.
- An adaptive multi-agent system for cost collaborative management in supply chains. Engineering applications of artificial intelligence, 44:91–100, 2015.
- Reputation in user profiling for a context-aware multiagent system. In EUMAS, 2006.
- Multi-agent deep reinforcement learning: a survey. Artificial Intelligence Review, pages 1–49, 2022.
- Context-aware multi-agent planning in intelligent environments. Multiagent and Grid Systems, 15(3):219–236, 2019.
- Adapt and overcome: Perceptions of adaptive autonomous agents for human-ai teaming. Computers in Human Behavior, 138:107451, 2023.
- Modeling and processing information for context-aware computing: A survey. New Generation Computing, 27:177–196, 2009.
- Metagpt: Meta programming for multi-agent collaborative framework. arXiv preprint arXiv:2308.00352, 2023.
- A survey of multi-agent organizational paradigms. The Knowledge engineering review, 19(4):281–316, 2004.
- Intent-aware interactive internet of things for enhanced collaborative ambient intelligence. IEEE Internet Computing, 26(5):68–75, 2022.
- Context-aware scheduling in fog computing: A survey, taxonomy, challenges and future directions. Journal of Network and Computer Applications, 180:103008, 2021.
- A survey and analysis of cooperative multi-agent robot systems: challenges and directions. Applications of Mobile Robots, pages 8–14, 2018.
- Situation-aware multi-agent system for disaster relief operations management. Proc. ISCRAM, pages 313–324, 2006.
- A multi-agent system for context-aware electric vehicle fleet routing: A step towards more sustainable urban operations. Journal of Cleaner Production, 374:134047, 2022.
- Supporting context-aware interaction in dynamic multi-agent systems. In International Workshop on Environments for Multi-Agent Systems, pages 168–189. Springer, 2004.
- Survey of multi-agent systems for microgrid control. Engineering applications of artificial intelligence, 45:192–203, 2015.
- Intent-aware pedestrian prediction for adaptive crowd navigation. In 2020 IEEE International Conference on Robotics and Automation (ICRA), pages 3277–3283. IEEE, 2020.
- Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907, 2016.
- Variational graph auto-encoders. arXiv preprint arXiv:1611.07308, 2016.
- Context aware recommendation systems: A review of the state of the art techniques. Computer Science Review, 37:100255, 2020.
- Applying case-based reasoning and multi-agent intelligent system to context-aware comparative shopping. Decision Support Systems, 37(2):199–213, 2004.
- Context-aware multi-agent approach to pervasive negotiation support systems. Expert Systems with Applications, 31(2):275–285, 2006.
- Yann LeCun. A path towards autonomous machine intelligence version 0.9. 2, 2022-06-27. Open Review, 62(1), 2022.
- Density-aware decentralised multi-agent exploration with energy constraint based on optimal transport theory. International Journal of Systems Science, 53(4):851–869, 2022.
- Survey and trend analysis of context-aware systems. Information-An International Interdisciplinary Journal, 14(2):527–548, 2011.
- A survey of the consensus for multi-agent systems. Systems Science & Control Engineering, 7(1):468–482, 2019.
- Celebrating diversity in shared multi-agent reinforcement learning. Advances in Neural Information Processing Systems, 34:3991–4002, 2021.
- A survey on techniques in the circular formation of multi-agent systems. Electronics, 10(23):2959, 2021.
- A survey of formation control and motion planning of multiple unmanned vehicles. Robotica, 36(7):1019–1047, 2018.
- An overview of opponent modeling for multi-agent competition. In International Conference on Machine Learning for Cyber Security, pages 634–648. Springer, 2022.
- A survey of multi-agent systems on distributed formation control. Unmanned Systems, pages 1–14, 2023.
- Self-refine: Iterative refinement with self-feedback. arXiv preprint arXiv:2303.17651, 2023.
- Nishtha Mahajan and Qi Zhang. Intent-aware autonomous driving: A case study on highway merging scenarios. arXiv preprint arXiv:2309.13206, 2023.
- Quantifying the effects of environment and population diversity in multi-agent reinforcement learning. Autonomous Agents and Multi-Agent Systems, 36(1):21, 2022.
- Formulating situation awareness for multi-agent systems. In 2013 International Conference on Advanced Computer Science Applications and Technologies, pages 48–53. IEEE, 2013.
- Tadao Murata. Petri nets: Properties, analysis and applications. Proceedings of the IEEE, 77(4):541–580, 1989.
- Adaptive multi-agent relief assessment and emergency response. International journal of disaster risk reduction, 24:12–23, 2017.
- A survey of adaptive multi-agent networks and their applications in smart cities. Smart Cities, 5(1):318–347, 2022.
- Deep reinforcement learning for multiagent systems: A review of challenges, solutions, and applications. IEEE transactions on cybernetics, 50(9):3826–3839, 2020.
- A context-aware multi-agent system as a middleware for ambient intelligence. Mobile Networks and Applications, 18:429–443, 2013.
- Context aware computing for the internet of things: A survey. IEEE communications surveys & tutorials, 16(1):414–454, 2013.
- The mom of context-aware systems: A survey. Computer Communications, 137:44–69, 2019.
- Intent-aware multi-agent reinforcement learning. In 2018 IEEE international conference on robotics and automation (ICRA), pages 7533–7540. IEEE, 2018.
- Communicative agents for software development. arXiv preprint arXiv:2307.07924, 2023.
- Recent advances in consensus of multi-agent systems: A brief survey. IEEE Transactions on Industrial Electronics, 64(6):4972–4983, 2016.
- A survey of consensus problems in multi-agent coordination. In Proceedings of the 2005, American Control Conference, 2005., pages 1859–1864. IEEE, 2005.
- Utility-based context-aware multi-agent recommendation system for energy efficiency in residential buildings. arXiv preprint arXiv:2205.02704, 2022.
- A context modeling survey. In Workshop Proceedings, 2004.
- Reinforcement learning: An introduction. MIT press, 2018.
- Dynamic and static context-aware lstm for multi-agent motion prediction. In European Conference on Computer Vision, pages 547–563. Springer, 2020.
- Cooperative multi-agent planning: A survey. ACM Computing Surveys (CSUR), 50(6):1–32, 2017.
- Iot and context-aware mobile recommendations using multi-agent systems. In 2015 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT), volume 1, pages 33–40. IEEE, 2015.
- Survey on context-aware healthcare systems. In 2021 IEEE 11th annual computing and communication workshop and conference (CCWC), pages 1190–1196. IEEE, 2021.
- Learning with a context-aware multiagent system. In 9th RoEduNet IEEE International Conference, pages 368–373. IEEE, 2010.
- A context-aware trust model for service-oriented multi-agent systems. In International Conference on Service-Oriented Computing, pages 221–236. Springer, 2008.
- A survey on large language model based autonomous agents. arXiv preprint arXiv:2308.11432, 2023.
- Q-learning. Machine learning, 8:279–292, 1992.
- Case-based reasoning: A review. The knowledge engineering review, 9(4):327–354, 1994.
- A comprehensive survey on graph neural networks. IEEE transactions on neural networks and learning systems, 32(1):4–24, 2020.
- iplan: Intent-aware planning in heterogeneous traffic via distributed multi-agent reinforcement learning. arXiv preprint arXiv:2306.06236, 2023.
- Congestion-aware multi-agent trajectory prediction for collision avoidance. In 2021 IEEE International Conference on Robotics and Automation (ICRA), pages 13693–13700. IEEE, 2021.
- Energy-aware leader-follower tracking control for electric-powered multi-agent systems. Control Engineering Practice, 79:209–218, 2018.
- A context-aware multi-agent reasoning based intelligent assistive formalism. Internet of Things, 23:100857, 2023.
- Formalizing distributed situation awareness in multi-agent networks. IEEE Transactions on Human-Machine Systems, 52(6):1166–1175, 2022.
- Multi-agent reinforcement learning: Methods, applications, visionary prospects, and challenges. arXiv preprint arXiv:2305.10091, 2023.
- A survey of multi-agent reinforcement learning with communication. arXiv preprint arXiv:2203.08975, 2022.