Papers
Topics
Authors
Recent
Search
2000 character limit reached

Designing Shared Information Displays for Agents of Varying Strategic Sophistication

Published 16 Oct 2023 in cs.HC and cs.GT | (2310.10858v3)

Abstract: Data-driven predictions are often perceived as inaccurate in hindsight due to behavioral responses. In this study, we explore the role of interface design choices in shaping individuals' decision-making processes in response to predictions presented on a shared information display in a strategic setting. We introduce a novel staged experimental design to investigate the effects of design features, such as visualizations of prediction uncertainty and error, within a repeated congestion game. In this game, participants assume the role of taxi drivers and use a shared information display to decide where to search for their next ride. Our experimental design endows agents with varying level-$k$ depths of thinking, allowing some agents to possess greater sophistication in anticipating the decisions of others using the same information display. Through several extensive experiments, we identify trade-offs between displays that optimize individual decisions and those that best serve the collective social welfare of the system. We find that the influence of display characteristics varies based on an agent's strategic sophistication. We observe that design choices promoting individual-level decision-making can lead to suboptimal system outcomes, as manifested by a lower realization of potential social welfare. However, this decline in social welfare is offset by a reduction in the distribution shift, narrowing the gap between predicted and realized system outcomes, which potentially enhances the perceived reliability and trustworthiness of the information display post hoc. Our findings pave the way for new research questions concerning the design of effective prediction interfaces in strategic environments.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (66)
  1. Empirica: a virtual lab for high-throughput macro-level experiments. Behavior Research Methods 53, 5 (2021), 2158–2171.
  2. Luc Anselin. 1988a. Lagrange multiplier test diagnostics for spatial dependence and spatial heterogeneity. Geographical analysis 20, 1 (1988), 1–17.
  3. Luc Anselin. 1988b. Spatial econometrics: methods and models. Vol. 4. Springer Science & Business Media.
  4. Random effects structure for confirmatory hypothesis testing: Keep it maximal. Journal of memory and language 68, 3 (2013), 255–278.
  5. Dirk Bergemann and Stephen Morris. 2019. Information design: A unified perspective. Journal of Economic Literature 57, 1 (2019), 44–95.
  6. Behavioural science is unlikely to change the world without a heterogeneity revolution. Nature human behaviour 5, 8 (2021), 980–989.
  7. A cognitive hierarchy model of games. The Quarterly Journal of Economics 119, 3 (2004), 861–898.
  8. Kathryn Chaloner and George T Duncan. 1987. Some properties of the Dirichlet-multinomial distribution and its use in prior elicitation. Communications in Statistics-Theory and Methods 16, 2 (1987), 511–523.
  9. Context-aware taxi demand hotspots prediction. International Journal of Business Intelligence and Data Mining 5, 1 (2010), 3–18.
  10. Giorgio Coricelli and Rosemarie Nagel. 2009. Neural correlates of depth of strategic reasoning in medial prefrontal cortex. Proceedings of the National Academy of Sciences 106, 23 (2009), 9163–9168.
  11. Exploring the taxi and Uber demand in New York City: An empirical analysis and spatial modeling. In 96th Annual Meeting of the Transportation Research Board, Washington, DC.
  12. Michael Correll and Michael Gleicher. 2014. Error bars considered harmful: Exploring alternate encodings for mean and error. IEEE transactions on visualization and computer graphics 20, 12 (2014), 2142–2151.
  13. Reducing congestion through information design. In 2017 55th annual allerton conference on communication, control, and computing (allerton). IEEE, 1279–1284.
  14. A multi-level clustering approach for forecasting taxi travel demand. In 2016 IEEE 19th international conference on intelligent transportation systems (ITSC). IEEE, 223–228.
  15. Non-cooperative game of multi-agent countermeasure systems based on cognitive hierarchy theory. In Journal of Physics: Conference Series, Vol. 1069. IOP Publishing, 012015.
  16. Peter Eades. 1984. A heuristic for graph drawing. Congressus numerantium 42 (1984), 149–160.
  17. Uncertainty displays using quantile dotplots or cdfs improve transit decision-making. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–12.
  18. Filippos Fotiadis and Kyriakos G Vamvoudakis. 2021. Recursive reasoning for bounded rationality in multi-agent non-equilibrium play learning systems. In 2021 IEEE Conference on Control Technology and Applications (CCTA). IEEE, 741–746.
  19. Seth Frey and Robert L Goldstone. 2013. Cyclic game dynamics driven by iterated reasoning. PloS one 8, 2 (2013), e56416.
  20. William W Gaver. 1991. Technology affordances. In Proceedings of the SIGCHI conference on Human factors in computing systems. 79–84.
  21. Causal quartets: Different ways to attain the same average treatment effect. arXiv preprint arXiv:2302.12878 (2023).
  22. Bayesian workflow. arXiv preprint arXiv:2011.01808 (2020).
  23. Michael F Goodchild. 1992. Geographical information science. International journal of geographical information systems 6, 1 (1992), 31–45.
  24. Strategic classification. In Proceedings of the 2016 ACM conference on innovations in theoretical computer science. 111–122.
  25. How visualizing inferential uncertainty can mislead readers about treatment effects in scientific results. In Proceedings of the 2020 chi conference on human factors in computing systems. 1–12.
  26. Random restarts in global optimization. (2009).
  27. Jessica Hullman. 2019. Why authors don’t visualize uncertainty. IEEE transactions on visualization and computer graphics 26, 1 (2019), 130–139.
  28. In pursuit of error: A survey of uncertainty visualization evaluation. IEEE transactions on visualization and computer graphics 25, 1 (2018), 903–913.
  29. Hypothetical outcome plots outperform error bars and violin plots for inferences about reliability of variable ordering. PloS one 10, 11 (2015), e0142444.
  30. On ridesharing competition and accessibility: Evidence from uber, lyft, and taxi. In Proceedings of the 2018 World Wide Web Conference. 863–872.
  31. Bryan D Jones. 1999. Bounded rationality. Annual review of political science 2, 1 (1999), 297–321.
  32. Daniel Kahneman and Amos Tversky. 2013. Prospect theory: An analysis of decision under risk. In Handbook of the fundamentals of financial decision making: Part I. World Scientific, 99–127.
  33. Hypothetical outcome plots help untrained observers judge trends in ambiguous data. IEEE transactions on visualization and computer graphics 25, 1 (2018), 892–902.
  34. When (ish) is my bus? user-centered visualizations of uncertainty in everyday, mobile predictive systems. In Proceedings of the 2016 chi conference on human factors in computing systems. 5092–5103.
  35. Visualization equilibrium. IEEE Transactions on Visualization and Computer Graphics 28, 1 (2021), 465–474.
  36. Pierre Legendre and Louis Legendre. 2012. Numerical ecology. Elsevier.
  37. Enterprise social media: Definition, history, and prospects for the study of social technologies in organizations. Journal of computer-mediated communication 19, 1 (2013), 1–19.
  38. Large-scale short-term urban taxi demand forecasting using deep learning. In 2018 23rd Asia and South Pacific Design Automation Conference (ASP-DAC). IEEE, 428–433.
  39. Zhuoran Lu and Ming Yin. 2021. Human reliance on machine learning models when performance feedback is limited: Heuristics and risks. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–16.
  40. Exponential random graph models for social networks: Theory, methods, and applications. Cambridge University Press.
  41. Richard McElreath. 2020. Statistical rethinking: A Bayesian course with examples in R and Stan. Chapman and Hall/CRC.
  42. Richard D McKelvey and Thomas R Palfrey. 1995. Quantal response equilibria for normal form games. Games and economic behavior 10, 1 (1995), 6–38.
  43. Stochastic optimization for performative prediction. Advances in Neural Information Processing Systems 33 (2020), 4929–4939.
  44. Outside the echo chamber: Optimizing the performative risk. In International Conference on Machine Learning. PMLR, 7710–7720.
  45. A predictive model for the passenger demand on a taxi network. In 2012 15th International IEEE Conference on Intelligent Transportation Systems. IEEE, 1014–1019.
  46. Trisalyn A Nelson and Barry Boots. 2008. Detecting spatial hot spots in landscape ecology. Ecography 31, 5 (2008), 556–566.
  47. Uncertain judgements: eliciting experts’ probabilities. (2006).
  48. Performative prediction. In International Conference on Machine Learning. PMLR, 7599–7609.
  49. Package ‘nlme’. Linear and nonlinear mixed effects models, version 3, 1 (2017).
  50. Heterogeneous quantal response equilibrium and cognitive hierarchies. Journal of Economic Theory 144, 4 (2009), 1440–1467.
  51. Robert W Rosenthal. 1973. A class of games possessing pure-strategy Nash equilibria. International Journal of Game Theory 2, 1 (1973), 65–67.
  52. Tim Roughgarden. 2005. Selfish routing and the price of anarchy. MIT press.
  53. The earth mover’s distance, multi-dimensional scaling, and color-based image retrieval. In Proceedings of the ARPA image understanding workshop, Vol. 661. 668.
  54. A metric for distributions with applications to image databases. In Sixth international conference on computer vision (IEEE Cat. No. 98CH36271). IEEE, 59–66.
  55. Reinhard Selten. 1990. Bounded rationality. Journal of Institutional and Theoretical Economics (JITE)/Zeitschrift für die gesamte Staatswissenschaft 146, 4 (1990), 649–658.
  56. Herbert A Simon. 1956. Rational choice and the structure of the environment. Psychological review 63, 2 (1956), 129.
  57. Herbert A Simon. 1990. Bounded rationality. Utility and probability (1990), 15–18.
  58. An introduction to hierarchical linear modelling. Statistics in medicine 18, 7 (1999), 855–888.
  59. Modelling bounded rationality in multi-agent interactions by generalized recursive reasoning. arXiv preprint arXiv:1901.09216 (2019).
  60. Modelling bounded rationality in multi-agent interactions by generalized recursive reasoning. In Proceedings of the Twenty-Ninth International Conference on International Joint Conferences on Artificial Intelligence. 414–421.
  61. GN Wilkinson and CE Rogers. 1973. Symbolic description of factorial models for analysis of variance. Journal of the Royal Statistical Society: Series C (Applied Statistics) 22, 3 (1973), 392–399.
  62. James R Wright and Kevin Leyton-Brown. 2012. Behavioral game theoretic models: a Bayesian framework for parameter analysis.. In AAMAS, Vol. 12. 921–930.
  63. James R Wright and Kevin Leyton-Brown. 2017. Predicting human behavior in unrepeated, simultaneous-move games. Games and Economic Behavior 106 (2017), 16–37.
  64. Yinyu Ye. 1988. Interior algorithms for linear, quadratic, and linearly constrained convex programming. Stanford University.
  65. Visualizing Uncertainty in Probabilistic Graphs with Network Hypothetical Outcome Plots (NetHOPs). IEEE Transactions on Visualization and Computer Graphics 28, 1 (2021), 443–453.
  66. A framework for passengers demand prediction and recommendation. In 2016 IEEE International Conference on Services Computing (SCC). IEEE, 340–347.
Citations (1)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Summarize

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up

Tweets

Sign up for free to view the 3 tweets with 1 like about this paper.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up for Free