Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
131 tokens/sec
GPT-4o
10 tokens/sec
Gemini 2.5 Pro Pro
47 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Persuasion, Delegation, and Private Information in Algorithm-Assisted Decisions (2402.09384v2)

Published 14 Feb 2024 in econ.TH, cs.AI, cs.CY, cs.GT, and cs.HC

Abstract: A principal designs an algorithm that generates a publicly observable prediction of a binary state. She must decide whether to act directly based on the prediction or to delegate the decision to an agent with private information but potential misalignment. We study the optimal design of the prediction algorithm and the delegation rule in such environments. Three key findings emerge: (1) Delegation is optimal if and only if the principal would make the same binary decision as the agent had she observed the agent's information. (2) Providing the most informative algorithm may be suboptimal even if the principal can act on the algorithm's prediction. Instead, the optimal algorithm may provide more information about one state and restrict information about the other. (3) Well-intentioned policies aiming to provide more information, such as keeping a "human-in-the-loop" or requiring maximal prediction accuracy, could strictly worsen decision quality compared to systems with no human or no algorithmic assistance. These findings predict the underperformance of human-machine collaborations if no measures are taken to mitigate common preference misalignment between algorithms and human decision-makers.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (25)
  1. Prediction, judgment, and complexity: a theory of decision-making and artificial intelligence. In The economics of artificial intelligence: An agenda, pages 89–110. University of Chicago Press, 2018.
  2. Optimal Delegation. The Review of Economic Studies, 75(1):259–293, 2008. ISSN 0034-6527. URL https://www.jstor.org/stable/4626195. Publisher: [Oxford University Press, Review of Economic Studies, Ltd.].
  3. The theory of optimal delegation with an application to tariff caps. Econometrica, 81(4):1541–1599, 2013.
  4. David Blackwell. Comparison of experiments. In Proceedings of the second Berkeley symposium on mathematical statistics and probability, volume 2, pages 93–103. University of California Press, 1951.
  5. David Blackwell. Equivalent comparisons of experiments. The annals of mathematical statistics, pages 265–272, 1953.
  6. How Child Welfare Workers Reduce Racial Disparities in Algorithmic Decisions. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, CHI ’22, pages 1–22, New York, NY, USA, April 2022. Association for Computing Machinery. ISBN 978-1-4503-9157-3. doi: 10.1145/3491102.3501831. URL https://doi.org/10.1145/3491102.3501831.
  7. Human-Algorithm Collaboration: Achieving Complementarity and Avoiding Unfairness, June 2022. URL http://arxiv.org/abs/2202.08821. arXiv:2202.08821 [cs].
  8. Emotional Judges and Unlucky Juveniles. American Economic Journal: Applied Economics, 10(3):171–205, July 2018. ISSN 1945-7782. doi: 10.1257/app.20160390. URL https://www.aeaweb.org/articles?id=10.1257/app.20160390.
  9. European Commission. Eu artificial intelligence act, Apr 2021. URL https://artificialintelligenceact.eu/.
  10. Bengt Holmström. On the theory of delegation. Technical report, Discussion Paper, 1980.
  11. Bengt Robert Holmström. On Incentives and Control in Organizations. Stanford University, 1978.
  12. Experimental Evaluation of Algorithm-Assisted Human Decision-Making: Application to Pretrial Public Safety Assessment, December 2021. URL http://arxiv.org/abs/2012.02845. arXiv:2012.02845 [cs, stat] version: 4.
  13. How machine-learning recommendations influence clinician treatment selections: the example of antidepressant selection. Translational Psychiatry, 11(1):1–9, February 2021. ISSN 2158-3188. doi: 10.1038/s41398-021-01224-x. URL https://www.nature.com/articles/s41398-021-01224-x. Number: 1 Publisher: Nature Publishing Group.
  14. Bayesian Persuasion. American Economic Review, 101(6):2590–2615, October 2011. ISSN 0002-8282. doi: 10.1257/aer.101.6.2590. URL https://www.aeaweb.org/articles?id=10.1257/aer.101.6.2590.
  15. Human Decisions and Machine Predictions*. The Quarterly Journal of Economics, August 2017. ISSN 0033-5533, 1531-4650. doi: 10.1093/qje/qjx032. URL http://academic.oup.com/qje/article/doi/10.1093/qje/qjx032/4095198/Human-Decisions-and-Machine-Predictions.
  16. Towards a science of human-ai decision making: a survey of empirical studies. arXiv preprint arXiv:2112.11471, 2021.
  17. Yichuan Lou. Optimal Delegation with Information Manipulation, October 2022. URL https://papers.ssrn.com/abstract=4298900.
  18. Algorithmic Assistance with Recommendation-Dependent Preferences. In Proceedings of the 24th ACM Conference on Economics and Computation, EC ’23, page 991, New York, NY, USA, July 2023. Association for Computing Machinery. ISBN 9798400701047. doi: 10.1145/3580507.3597775. URL https://doi.org/10.1145/3580507.3597775.
  19. Diagnosing Physician Error: A Machine Learning Approach to Low-Value Health Care. The Quarterly Journal of Economics, 137(2):679–727, April 2022. ISSN 0033-5533, 1531-4650. doi: 10.1093/qje/qjab046. URL https://academic.oup.com/qje/article/137/2/679/6449024.
  20. Ashesh Rambachan et al. Identifying prediction mistakes in observational data. Harvard University, 2021.
  21. A Unifying Framework for Combining Complementary Strengths of Humans and ML toward Better Predictive Decision-Making, August 2022. URL http://arxiv.org/abs/2204.10806. arXiv:2204.10806 [cs].
  22. Algorithmic Risk Assessment in the Hands of Humans, September 2022. URL https://papers.ssrn.com/abstract=3489440.
  23. Improving expert predictions with prediction sets. arXiv preprint arXiv:2201.12006, 2022.
  24. Maren Vairo. The value of information in delegation. 2023.
  25. Decision-aid or Controller? Steering Human Decision Makers with Algorithms, March 2023. URL http://arxiv.org/abs/2303.13712. arXiv:2303.13712 [cs].
Citations (1)

Summary

We haven't generated a summary for this paper yet.