Large Language Models as Urban Residents: An LLM Agent Framework for Personal Mobility Generation (2402.14744v3)
Abstract: This paper introduces a novel approach using LLMs integrated into an agent framework for flexible and effective personal mobility generation. LLMs overcome the limitations of previous models by effectively processing semantic data and offering versatility in modeling various tasks. Our approach addresses three research questions: aligning LLMs with real-world urban mobility data, developing reliable activity generation strategies, and exploring LLM applications in urban mobility. The key technical contribution is a novel LLM agent framework that accounts for individual activity patterns and motivations, including a self-consistency approach to align LLMs with real-world activity data and a retrieval-augmented strategy for interpretable activity generation. We evaluate our LLM agent framework and compare it with state-of-the-art personal mobility generation approaches, demonstrating the effectiveness of our approach and its potential applications in urban mobility. Overall, this study marks the pioneering work of designing an LLM agent framework for activity generation based on real-world human activity data, offering a promising tool for urban mobility analysis.
- Using large language models to simulate multiple humans. arXiv preprint arXiv:2208.10264, 2022.
- Using machine learning for agent specifications in agent-based models and simulations: A critical review and guidelines. Journal of Artificial Societies and Social Simulation, 26(1), 2023.
- Out of one, many: Using language models to simulate human samples. Political Analysis, 31(3):337–351, 2023.
- Smart cities of the future. The European Physical Journal Special Topics, 214:481–518, 2012.
- Michael Batty. The new science of cities. MIT press, 2013.
- A simple framework for contrastive learning of visual representations. In International conference on machine learning, pages 1597–1607. PMLR, 2020.
- Trajgail: Generating urban vehicle trajectories using generative adversarial imitation learning. Transportation Research Part C: Emerging Technologies, 128:103091, 2021.
- Deepmove: Predicting human mobility with attentional recurrent networks. In Proceedings of the 2018 world wide web conference, pages 1459–1468, 2018.
- Learning to simulate human mobility. In Proceedings of the 26th ACM SIGKDD international conference on knowledge discovery & data mining, pages 3426–3433, 2020.
- Large language models empowered agent-based modeling and simulation: A survey and perspectives. arXiv preprint arXiv:2312.11970, 2023.
- Pattern-oriented modeling of agent-based complex systems: lessons from ecology. science, 310(5750):987–991, 2005.
- The weirdest people in the world? Behavioral and brain sciences, 33(2-3):61–83, 2010.
- A variational autoencoder based generative model of urban human mobility. In 2019 IEEE conference on multimedia information processing and retrieval (MIPR), pages 425–430. IEEE, 2019.
- The timegeo modeling framework for urban mobility without travel surveys. Proceedings of the National Academy of Sciences, 113(37):E5370–E5378, 2016.
- Large language model-empowered agents for simulating macroeconomic activities. arXiv preprint arXiv:2310.10436, 2023.
- trajgans: Using generative adversarial networks for geo-privacy protection of trajectory data (vision paper). In Location privacy and security workshop, pages 1–7, 2018.
- Practical synthetic human trajectories generation based on variational point processes. In Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pages 4561–4571, 2023.
- A survey on deep learning for human mobility. ACM Computing Surveys (CSUR), 55(1):1–44, 2021.
- Gpt-driver: Learning to drive with gpt. arXiv preprint arXiv:2310.01415, 2023.
- Exploiting semantic annotations for clustering geographic areas and users in location-based social networks. In Proceedings of the International AAAI Conference on Web and Social Media, volume 5, pages 32–35, 2011.
- Representation learning with contrastive predictive coding. arXiv preprint arXiv:1807.03748, 2018.
- OpenAI. Introducing chatgpt. https://openai.com/blog/chatgpt, 2022.
- Data-driven generation of spatio-temporal routines in human mobility. Data Mining and Knowledge Discovery, 32(3):787–829, 2018.
- Generative agents: Interactive simulacra of human behavior. arXiv preprint arXiv:2304.03442, 2023.
- In-context impersonation reveals large language models’ strengths and biases. arXiv preprint arXiv:2305.14930, 2023.
- Modelling the scaling properties of human mobility. Nature physics, 6(10):818–823, 2010.
- Self-consistency improves chain of thought reasoning in language models. arXiv preprint arXiv:2203.11171, 2022.
- A survey on large language model based autonomous agents. arXiv preprint arXiv:2308.11432, 2023.
- Chain-of-thought prompting elicits reasoning in large language models. Advances in Neural Information Processing Systems, 35:24824–24837, 2022.
- Lilian Weng. Llm powered autonomous agents. https://lilianweng.github.io/posts/2023-06-23-agent/, 2023.
- Epidemic modeling with generative agents. arXiv preprint arXiv:2307.04986, 2023.
- Smart agent-based modeling: On the use of large language models in computer simulations. arXiv preprint arXiv:2311.06330, 2023.
- The rise and potential of large language model based agents: A survey. arXiv preprint arXiv:2309.07864, 2023.
- Retrieval meets long context large language models. arXiv preprint arXiv:2310.03025, 2023.
- Activity trajectory generation via modeling spatiotemporal dynamics. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pages 4752–4762, 2022.
- Learning to simulate daily activities via modeling dynamic human needs. In Proceedings of the ACM Web Conference 2023, pages 906–916, 2023.
- Trajgail: Trajectory generative adversarial imitation learning for long-term decision analysis. In 2020 IEEE International Conference on Data Mining (ICDM), pages 801–810. IEEE, 2020.
- Yu Zheng. Trajectory data mining: an overview. ACM Transactions on Intelligent Systems and Technology (TIST), 6(3):1–41, 2015.