Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
38 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
41 tokens/sec
o3 Pro
7 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Emergence of Social Norms in Generative Agent Societies: Principles and Architecture (2403.08251v4)

Published 13 Mar 2024 in cs.MA, cs.AI, and cs.CY

Abstract: Social norms play a crucial role in guiding agents towards understanding and adhering to standards of behavior, thus reducing social conflicts within multi-agent systems (MASs). However, current LLM-based (or generative) MASs lack the capability to be normative. In this paper, we propose a novel architecture, named CRSEC, to empower the emergence of social norms within generative MASs. Our architecture consists of four modules: Creation & Representation, Spreading, Evaluation, and Compliance. This addresses several important aspects of the emergent processes all in one: (i) where social norms come from, (ii) how they are formally represented, (iii) how they spread through agents' communications and observations, (iv) how they are examined with a sanity check and synthesized in the long term, and (v) how they are incorporated into agents' planning and actions. Our experiments deployed in the Smallville sandbox game environment demonstrate the capability of our architecture to establish social norms and reduce social conflicts within generative MASs. The positive outcomes of our human evaluation, conducted with 30 evaluators, further affirm the effectiveness of our approach. Our project can be accessed via the following link: https://github.com/sxswz213/CRSEC.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (62)
  1. Peer punishment promotes enforcement of bad social norms. Nature communications, 2017.
  2. Persistent anti-muslim bias in large language models. In AIES, pages 298–306, 2021.
  3. A temporal logic of normative systems. In Towards Mathematical Philosophy: Papers from the Studia Logica conference Trends in Logic IV. Springer, 2009.
  4. Elessar: Ethics in norm-aware agents. In AAMAS, pages 16–24, 2020.
  5. Normative emotional agents: a viewpoint paper. IEEE Trans. Affective Comput., 2020.
  6. The moral machine experiment. Nature, 2018.
  7. Andrea Baronchelli. The emergence of consensus: a primer. Royal Society open science, 5(2):172189, 2018.
  8. Andrea Baronchelli. Shaping new norms for ai. Philosophical Transactions of the Royal Society B, 379(1897):20230028, 2024.
  9. Cognitive social learners: An architecture for modeling normative behavior. In AAAI, 2015.
  10. A normative agent-based model for predicting smoking cessation trends. In AAMAS, 2014.
  11. Introduction to the special issue on normative multiagent systems. AAMAS, 17:1–10, 2008.
  12. Social Psychology 15th ed., 8.1. Pearson, 2022.
  13. Michael Bratman. Intention, Plans, and Practical Reason. Cambridge, MA: Harvard University Press, Cambridge, 1987.
  14. Experimental evidence for tipping points in social convention. Science, 360(6393):1116–1119, 2018.
  15. Agentverse: Facilitating multi-agent collaboration and exploring emergent behaviors. In ICLR, 2024.
  16. We and it: An interdisciplinary review of the experimental evidence on how humans interact with machines. Journal of Behavioral and Experimental Economics, 99:101897, 2022.
  17. A focus theory of normative conduct: A theoretical refinement and reevaluation of the role of norms in human behavior. In Advances in experimental social psychology, volume 24, pages 201–234. Elsevier, 1991.
  18. All that’s’ human’is not gold: Evaluating human evaluation of generated text. arXiv:2107.00061, 2021.
  19. Autonomous norm acceptance. In ATAL Workshop, 1998.
  20. Open issues for normative multi-agent systems. AI communications, 2011.
  21. Frank Dignum. Autonomous agents with norms. Artificial intelligence and law, 7:69–79, 1999.
  22. Learning influence in complex social networks. In AAMAS, 2013.
  23. A data fusion framework for multi-domain morality learning. In AAAI, 2023.
  24. Do multilingual language models capture differing moral norms? arXiv preprint arXiv:2203.09904, 2022.
  25. The emergence of social norms and conventions. Trends in cognitive sciences, 2019.
  26. Engineering the emergence of norms: a review. The Knowledge Engineering Review, 2017.
  27. Metagpt: Meta programming for multi-agent collaborative framework. arXiv:2308.00352, 2023.
  28. To be big picture thinker or detail-oriented? utilizing perceived gist information to achieve efficient convention emergence with bilateralism and multilateralism. In AAMAS, 2019.
  29. Achieving coordination in multi-agent systems by stable local conventions under community networks. In IJCAI, 2017.
  30. David Kellogg Lewis. Convention: A Philosophical Study. Wiley-Blackwell, Cambridge, MA, USA, 1969.
  31. Camel: Communicative agents for” mind” exploration of large language model society. In NeurIPS, 2023.
  32. Agent alignment in evolving social norms. arXiv preprint arXiv:2401.04620, 2024.
  33. Swiftsage: A generative agent with fast and slow thinking for complex interactive tasks. In NeurIPS, 2023.
  34. Training socially aligned language models on simulated social interactions. In ICLR, 2024.
  35. Establishing norms with metanorms in distributed computational systems. Artificial Intelligence and Law, 2015.
  36. Establishing norms with metanorms over interaction topologies. AAMAS, 31:1344–1376, 2017.
  37. A framework for monitoring agent-based normative systems. In AAMAS, 2009.
  38. Automated synthesis of normative systems. In AAMAS, 2013.
  39. Synthesising liberal normative systems. In AAMAS, 2015.
  40. Norm emergence in multiagent systems: a viewpoint paper. AAMAS, 2019.
  41. Spread of two linked social norms on complex interaction networks. Journal of theoretical biology, 2004.
  42. Engineering pro-sociality with autonomous agents. In AAAI, 2018.
  43. Generative agents: Interactive simulacra of human behavior. In UIST ’23. Association for Computing Machinery, 2023.
  44. Knowledge of cultural moral norms in large language models. ACL, 1:428–446, 2023.
  45. Social norms of cooperation with costly reputation building. In AAAI, 2018.
  46. Detection and resolution of normative conflicts in multi-agent systems: a literature survey. AAMAS, 2017.
  47. Bastin Tony Roy Savarimuthu and Stephen C. Norm creation, spreading and emergence: A survey of simulation models of norms in multi-agent systems. Multiagent and Grid Systems, 2011.
  48. Social norm emergence in virtual agent societies. In DALT 2008: Revised Selected and Invited Papers, 2009.
  49. Large pre-trained language models contain human-like biases of what is right and wrong to do. Nature Mach. Intell., 2022.
  50. Shalom H Schwartz. Normative explanations of helping behavior: A critique, proposal, and empirical test. Journal of experimental social psychology, 9(4):349–364, 1973.
  51. Emergence of norms through social learning. In IJCAI, 2007.
  52. Role play with large language models. Nature, 2023.
  53. Muzafer Sherif. The psychology of social norms. Harper, 1936.
  54. Sara J Shettleworth. Cognition, evolution, and behavior. Oxford university press, 2009.
  55. Cass R Sunstein. Social norms and social roles. Colum. L. Rev., 96:903, 1996.
  56. Dynamic sanctioning for robust and cost-efficient norm compliance. In IJCAI, 2011.
  57. Describe, explain, plan and select: interactive planning with llms enables open-world multi-task agents. In NeurIPS, 2023.
  58. Why bad coffee? explaining bdi agent behaviour with valuings. Artificial Intelligence, 2021.
  59. Evaluating a mechanism for explaining bdi agent behaviour. In AAMAS, 2023.
  60. Action-level intention selection for bdi agents. In Proceedings of the 2016 International Conference on Autonomous Agents & Multiagent Systems, pages 1227–1236, 2016.
  61. H Peyton Young. The evolution of social norms. economics, 7(1):359–387, 2015.
  62. Building cooperative embodied agents modularly with large language models. In ICLR, 2024.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (5)
  1. Siyue Ren (2 papers)
  2. Zhiyao Cui (2 papers)
  3. Ruiqi Song (10 papers)
  4. Zhen Wang (571 papers)
  5. Shuyue Hu (27 papers)
Citations (2)
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets