Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
38 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
41 tokens/sec
o3 Pro
7 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Variational Inference of Parameters in Opinion Dynamics Models (2403.05358v1)

Published 8 Mar 2024 in cs.CY, cs.LG, cs.SI, and stat.ML

Abstract: Despite the frequent use of agent-based models (ABMs) for studying social phenomena, parameter estimation remains a challenge, often relying on costly simulation-based heuristics. This work uses variational inference to estimate the parameters of an opinion dynamics ABM, by transforming the estimation problem into an optimization task that can be solved directly. Our proposal relies on probabilistic generative ABMs (PGABMs): we start by synthesizing a probabilistic generative model from the ABM rules. Then, we transform the inference process into an optimization problem suitable for automatic differentiation. In particular, we use the Gumbel-Softmax reparameterization for categorical agent attributes and stochastic variational inference for parameter estimation. Furthermore, we explore the trade-offs of using variational distributions with different complexity: normal distributions and normalizing flows. We validate our method on a bounded confidence model with agent roles (leaders and followers). Our approach estimates both macroscopic (bounded confidence intervals and backfire thresholds) and microscopic ($200$ categorical, agent-level roles) more accurately than simulation-based and MCMC methods. Consequently, our technique enables experts to tune and validate their ABMs against real-world observations, thus providing insights into human behavior in social systems via data-driven analysis.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (36)
  1. Philipp Andelfinger. Differentiable agent-based simulation for gradient-guided simulation-based optimization. In Proceedings of the 2021 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation, pages 27–38, 2021.
  2. Social media networks, fake news, and polarization. European Journal of Political Economy, 76:102256, January 2023. ISSN 0176-2680. doi: 10.1016/j.ejpoleco.2022.102256. URL https://www.sciencedirect.com/science/article/pii/S0176268022000623.
  3. Emergence of polarized ideological opinions in multidimensional topic spaces. Physical Review X, 11(1):011012, 2021.
  4. Achieving consensus in multilateral international negotiations: The case study of the 2015 paris agreement on climate change. Science Advances, 7(51):eabg8068, 2021.
  5. Variational inference: A review for statisticians. Journal of the American statistical Association, 112(518):859–877, 2017.
  6. Approximate bayesian computation (abc) in practice. Trends in ecology & evolution, 25(7):410–418, 2010.
  7. Block neural autoregressive flow. In Uncertainty in artificial intelligence, pages 1263–1273. PMLR, 2020.
  8. The spreading of misinformation online. Proceedings of the National Academy of Sciences, 113(3):554–559, January 2016. ISSN 0027-8424, 1091-6490. doi: 10.1073/pnas.1517441113. URL https://pnas.org/doi/full/10.1073/pnas.1517441113. tex.ids= del2016spreading tex.date-added: 2019-10-28 15:35:56 +0000 tex.date-modified: 2019-10-28 15:35:56 +0000 publisher: National Acad Sciences.
  9. Black-box bayesian inference for economic agent-based models. arXiv preprint arXiv:2202.00625, 2022.
  10. Validation of agent-based models in economics and finance. In Computer simulation validation, pages 763–787. Springer, 2019.
  11. Models of Social Influence: Towards the Next Frontiers. Journal of Artificial Societies and Social Simulation, 20(4):2, 2017.
  12. Scaling and universality in proportional elections. Physical Review Letters, 99(13):138701, 2007.
  13. Lack of practical identifiability may hamper reliable predictions in covid-19 epidemic models. Science advances, 8(3):eabg5234, 2022.
  14. Estimation of ergodic agent-based models by simulated minimum distance. Journal of Economic Dynamics and Control, 51:148–165, 2015.
  15. Bayesian estimation of agent-based models. Journal of Economic Dynamics and Control, 77:26–47, 2017.
  16. Stochastic variational inference. Journal of Machine Learning Research, 2013.
  17. The no-u-turn sampler: adaptively setting path lengths in hamiltonian monte carlo. J. Mach. Learn. Res., 15(1):1593–1623, 2014.
  18. Uniformity, bipolarization and pluriformity captured as generic stylized behavior with an agent-based simulation model of attitude change. Computational & Mathematical Organization Theory, 10(4):295–303, 2005.
  19. Categorical reparameterization with gumbel-softmax. In International Conference on Learning Representations, 2016.
  20. Agent-based model calibration using machine learning surrogates. Journal of Economic Dynamics and Control, 90:366–389, 2018.
  21. Likelihood-based methods improve parameter estimation in opinion dynamics models. Proceedings of the 17th ACM International Conference on Web Search and Data Mining, 2024.
  22. Empirical validation of agent-based models. In Handbook of computational economics, volume 4, pages 437–488. Elsevier, 2018.
  23. The concrete distribution: A continuous relaxation of discrete random variables. In International Conference on Learning Representations, 2016.
  24. Learning opinion dynamics from social traces. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pages 764–773, 2020.
  25. On learning agent-based models from data. arXiv preprint arXiv:2205.05052, 2022.
  26. Right and left, partisanship predicts (asymmetric) vulnerability to misinformation. Harvard Kennedy School Misinformation Review, 2021. doi: 10.37016/mr-2020-55. URL https://misinforeview.hks.harvard.edu/?p=5702.
  27. Normalizing flows for probabilistic modeling and inference. The Journal of Machine Learning Research, 22(1):2617–2680, 2021.
  28. Donovan Platt. A comparison of economic agent-based model calibration methods. Journal of Economic Dynamics and Control, 113:103859, 2020.
  29. Opinion dynamics in social networks with hostile camps: Consensus vs. polarization. IEEE Transactions on Automatic Control, 61(6):1524–1536, 2015.
  30. Bayesian calibration of differentiable agent-based models. arXiv preprint arXiv:2305.15340, 2023.
  31. Variational inference with normalizing flows. In International conference on machine learning, pages 1530–1538. PMLR, 2015.
  32. Data assimilation and agent-based modelling: towards the incorporation of categorical agent parameters. Open Research Europe, 1:131, 2022.
  33. Petter Törnberg. Echo chambers and viral misinformation: Modeling fake news as complex contagion. PLOS ONE, 13(9):e0203958, September 2018. ISSN 1932-6203. doi: 10.1371/journal.pone.0203958. URL https://dx.plos.org/10.1371/journal.pone.0203958.
  34. Sander van der Hoog. Surrogate modelling in (and of) agent-based models: A prospectus. Computational Economics, 53(3):1245–1263, 2019.
  35. Meet, discuss, and segregate! Complexity, 7(3):55–63, 2002.
  36. Synergistic integration between machine learning and agent-based modeling: A multidisciplinary review. IEEE Transactions on Neural Networks and Learning Systems, 2021.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (3)
Citations (2)