Wireless Multi-Agent Generative AI: From Connected Intelligence to Collective Intelligence (2307.02757v1)
Abstract: The convergence of generative LLMs, edge networks, and multi-agent systems represents a groundbreaking synergy that holds immense promise for future wireless generations, harnessing the power of collective intelligence and paving the way for self-governed networks where intelligent decision-making happens right at the edge. This article puts the stepping-stone for incorporating multi-agent generative AI in wireless networks, and sets the scene for realizing on-device LLMs, where multi-agent LLMs are collaboratively planning and solving tasks to achieve a number of network goals. We further investigate the profound limitations of cloud-based LLMs, and explore multi-agent LLMs from a game theoretic perspective, where agents collaboratively solve tasks in competitive environments. Moreover, we establish the underpinnings for the architecture design of wireless multi-agent generative AI systems at the network level and the agent level, and we identify the wireless technologies that are envisioned to play a key role in enabling on-device LLM. To demonstrate the promising potentials of wireless multi-agent generative AI networks, we highlight the benefits that can be achieved when implementing wireless generative agents in intent-based networking, and we provide a case study to showcase how on-device LLMs can contribute to solving network intents in a collaborative fashion. We finally shed lights on potential challenges and sketch a research roadmap towards realizing the vision of wireless collective intelligence.
- G. Yenduri et al., “Generative pre-trained transformer: A comprehensive review on enabling technologies, potential applications, emerging challenges, and future directions,” 2023.
- Falcon LLM. https://falconllm.tii.ae.
- H. Touvron et al., “LLaMA: Open and efficient foundation language models,” 2023.
- R. Anil et al., “PaLM 2 technical report,” 2023.
- S. Bubeck et al., “Sparks of artificial general intelligence: Early experiments with GPT-4,” 2023.
- A. Vaswani et al., “Attention is all you need,” 2017.
- C. Chaccour et al., “Less data, more knowledge: Building next generation semantic communication networks,” 2022.
- E. Akata et al., “Playing repeated games with large language models,” 2023.
- Y. Nakajima, “Task-driven autonomous agent utilizing GPT-4, Pinecone, and LangChain for diverse applications,” 2023.
- Auto-GPT: An autonomous GPT-4 experiment. https://github.com/Significant-Gravitas/Auto-GPT.
- Y. Shen et al., “Hugginggpt: Solving AI tasks with ChatGPT and its friends in HuggingFace,” 2023.
- G. Li et al., “CAMEL: Communicative agents for ”mind” exploration of large scale language model society,” 2023.
- J. S. Park et al., “Generative agents: Interactive simulacra of human behavior,” 2023.
- A. Ramesh et al., “Zero-shot text-to-image generation,” 2021.
- A. Ramesh, P. Dhariwal et al., “Hierarchical text-conditional image generation with clip latents,” 2022.
- Hang Zou (23 papers)
- Qiyang Zhao (15 papers)
- Lina Bariah (26 papers)
- Mehdi Bennis (333 papers)
- Merouane Debbah (269 papers)