Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
119 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Decoding AI's Nudge: A Unified Framework to Predict Human Behavior in AI-assisted Decision Making (2401.05840v1)

Published 11 Jan 2024 in cs.HC and cs.AI

Abstract: With the rapid development of AI-based decision aids, different forms of AI assistance have been increasingly integrated into the human decision making processes. To best support humans in decision making, it is essential to quantitatively understand how diverse forms of AI assistance influence humans' decision making behavior. To this end, much of the current research focuses on the end-to-end prediction of human behavior using black-box'' models, often lacking interpretations of the nuanced ways in which AI assistance impacts the human decision making process. Meanwhile, methods that prioritize the interpretability of human behavior predictions are often tailored for one specific form of AI assistance, making adaptations to other forms of assistance difficult. In this paper, we propose a computational framework that can provide an interpretable characterization of the influence of different forms of AI assistance on decision makers in AI-assisted decision making. By conceptualizing AI assistance as the{\em nudge}'' in human decision making processes, our approach centers around modelling how different forms of AI assistance modify humans' strategy in weighing different information in making their decisions. Evaluations on behavior data collected from real human decision makers show that the proposed framework outperforms various baselines in accurately predicting human behavior in AI-assisted decision making. Based on the proposed framework, we further provide insights into how individuals with different cognitive styles are nudged by AI assistance differently.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (71)
  1. COGAM: Measuring and Moderating Cognitive Load in Machine Learning Model Explanations. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems.
  2. Predictive model to assess user trust: a psycho-physiological approach. In Proceedings of the 10th Indian conference on human-computer interaction, 1–10.
  3. Evaluating saliency map explanations for convolutional neural networks: a user study. Proceedings of the 25th International Conference on Intelligent User Interfaces.
  4. Data-Centric Explanations: Explaining Training Data of Machine Learning Systems to Promote Transparency. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems.
  5. Is the Most Accurate AI the Best Teammate? Optimizing AI for Teamwork. In AAAI Conference on Artificial Intelligence.
  6. Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems.
  7. Toward Algorithmic Accountability in Public Services: A Qualitative Study of Affected Community Perspectives on Algorithmic Decision-making in Child Welfare Services. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems.
  8. Proxy tasks and subjective measures can be misleading in evaluating explainable AI systems. Proceedings of the 25th International Conference on Intelligent User Interfaces.
  9. To trust or to think: cognitive forcing functions can reduce overreliance on AI in AI-assisted decision-making. Proceedings of the ACM on Human-Computer Interaction, 5(CSCW1): 1–21.
  10. The effects of example-based explanations in a machine learning interface. Proceedings of the 24th International Conference on Intelligent User Interfaces.
  11. Human-Centered Tools for Coping with Imperfect Algorithms During Medical Decision-Making. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI ’19, 1–14. New York, NY, USA: Association for Computing Machinery. ISBN 9781450359702.
  12. Human-Centered Tools for Coping with Imperfect Algorithms During Medical Decision-Making. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems.
  13. Optimal nudging for cognitively bounded agents: A framework for modeling, predicting, and controlling the effects of choice architectures.
  14. Explaining Decision-Making Algorithms through UI: Strategies to Help Non-Expert Stakeholders. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems.
  15. I Think I Get Your Point, AI! The Illusion of Explanatory Depth in Explainable AI. 26th International Conference on Intelligent User Interfaces.
  16. Leveraging rationales to improve human task performance. Proceedings of the 25th International Conference on Intelligent User Interfaces.
  17. A Case for Humans-in-the-Loop: Decisions in the Presence of Erroneous Algorithmic Scores. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems.
  18. Increasing the Speed and Accuracy of Data Labeling Through an AI Assisted Interface. 26th International Conference on Intelligent User Interfaces.
  19. Explaining models: an empirical study of how explanations impact fairness judgment. Proceedings of the 24th International Conference on Intelligent User Interfaces.
  20. What can AI do for me?: evaluating machine learning interpretations in cooperative play. Proceedings of the 24th International Conference on Intelligent User Interfaces.
  21. Who Goes First? Influences of Human-AI Workflow on Decision Making in Clinical Imaging. Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency.
  22. Frederick, S. 2005. Cognitive Reflection and Decision Making. Journal of Economic Perspectives, 19: 25–42.
  23. Do People Engage Cognitively with AI? Impact of AI Assistance on Incidental Learning. 27th International Conference on Intelligent User Interfaces.
  24. ViCE: visual counterfactual explanations for machine learning models. Proceedings of the 25th International Conference on Intelligent User Interfaces.
  25. Disparate Interactions: An Algorithm-in-the-Loop Analysis of Fairness in Risk Assessments. Proceedings of the Conference on Fairness, Accountability, and Transparency.
  26. The Principles and Limits of Algorithm-in-the-Loop Decision Making. Proceedings of the ACM on Human-Computer Interaction, 3: 1 – 24.
  27. Human Decision Making with Machine Assistance: An Experiment on Bailing and Jailing. DecisionSciRN: Decision-Making in the Legal Field (Topic).
  28. Human Decision Making with Machine Assistance: An Experiment on Bailing and Jailing. Proc. ACM Hum.-Comput. Interact., 3(CSCW).
  29. Visualizing Uncertainty and Alternatives in Event Sequence Predictions. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems.
  30. An empirical study on the perceived fairness of realistic, imperfect machine learning models. Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency.
  31. Designing AI for Trust and Collaboration in Time-Constrained Medical Decisions: A Sociotechnical Lens. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems.
  32. Will You Accept an Imperfect AI?: Exploring Designs for Adjusting End-user Expectations of AI Systems. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems.
  33. Explaining algorithm aversion with metacognitive bandits. In Proceedings of the annual meeting of the cognitive science society, volume 43.
  34. Let Me Explain: Impact of Personal and Impersonal Explanations on Trust in Recommender Systems. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems.
  35. Towards a Science of Human-AI Decision Making: An Overview of Design Space in Empirical Human-Subject Studies. Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency.
  36. ”Why is ’Chicago’ deceptive?” Towards Building Model-Driven Tutorials for Humans. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems.
  37. On Human Predictions with Explanations and Predictions of Machine Learning Models: A Case Study on Deception Detection. Proceedings of the Conference on Fairness, Accountability, and Transparency.
  38. Co-Design and Evaluation of an Intelligent Decision Support System for Stroke Rehabilitation Assessment. Proceedings of the ACM on Human-Computer Interaction, 4: 1 – 27.
  39. A Human-AI Collaborative Approach for Clinical Decision Making on Rehabilitation Assessment. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems.
  40. Procedural Justice in Algorithmic Fairness: Leveraging Transparency and Outcome Control for Fair Algorithmic Mediation. Proc. ACM Hum.-Comput. Interact., 3(CSCW).
  41. Assessing the Impact of Automated Suggestions on Decision Making: Domain Experts Mediate Model Errors but Take Less Initiative. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, CHI ’21. New York, NY, USA: Association for Computing Machinery. ISBN 9781450380966.
  42. Assessing the Impact of Automated Suggestions on Decision Making: Domain Experts Mediate Model Errors but Take Less Initiative. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems.
  43. Modeling Human Trust and Reliance in AI-Assisted Decision Making: A Markovian Approach. Proceedings of the AAAI Conference on Artificial Intelligence, 37(5): 6056–6064.
  44. Understanding the Effect of Out-of-distribution Examples and Interactive Explanations on Human-AI Decision Making. Proceedings of the ACM on Human-Computer Interaction, 5: 1 – 45.
  45. Strategic adversarial attacks in AI-assisted decision making to reduce human trust and reliance. In Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, 3020–3028.
  46. Human Reliance on Machine Learning Models When Performance Feedback is Limited: Heuristics and Risks. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems.
  47. Why does my model fail?: contrastive local explanations for retail forecasting. Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency.
  48. A unified approach to interpreting model predictions. Advances in neural information processing systems, 30.
  49. Who Should I Trust: AI or Myself? Leveraging Human and AI Correctness Likelihood to Promote Appropriate Trust in AI-Assisted Decision-Making. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems.
  50. Mustafatz. 2023. Diabetes Prediction Dataset. https://www.kaggle.com/datasets/iammustafatz/diabetes-prediction-dataset.
  51. Anchoring Bias Affects Mental Model Formation and User Reliance in Explainable AI Systems. 26th International Conference on Intelligent User Interfaces.
  52. A Slow Algorithm Improves Users’ Assessments of the Algorithm’s Accuracy. Proceedings of the ACM on Human-Computer Interaction, 3: 1 – 15.
  53. Overreliance on AI Literature Review. Microsoft Research.
  54. Manipulating and Measuring Model Interpretability. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems.
  55. A Markovian Method for Predicting Trust Behavior in Human-Agent Interaction. Proceedings of the 7th International Conference on Human-Agent Interaction.
  56. Explanations as Mechanisms for Supporting Algorithmic Transparency. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems.
  57. ” Why should i trust you?” Explaining the predictions of any classifier. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, 1135–1144.
  58. Human Interpretation of Saliency-based Explanation Over Text. Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency.
  59. No Explainability without Accountability: An Empirical Study of Explanations and Feedback in Interactive ML. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems.
  60. Predicting human behavior: The next frontiers. Science, 355(6324): 489–489.
  61. Visual, textual or hybrid: the effect of user expertise on different explanations. 26th International Conference on Intelligent User Interfaces.
  62. AI-Assisted Decision-making: a Cognitive Modeling Approach to Infer Latent Reliance Strategies. Computational Brain & Behavior, 5: 491 – 508.
  63. Exploring and Promoting Diagnostic Transparency and Explainability in Online Symptom Checkers. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems.
  64. Effect of Information Presentation on Fairness Perceptions of Machine Learning Predictors. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems.
  65. The effects of AI biases and explanations on human decision fairness: a case study of bidding in rental housing markets. In Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, IJCAI-23, Edith Elkind (Ed.). International Joint Conferences on Artificial Intelligence Organization, 3076–3084.
  66. Will you accept the ai recommendation? predicting human behavior in ai-assisted decision making. In Proceedings of the ACM Web Conference 2022, 1697–1708.
  67. Are Explanations Helpful? A Comparative Study of the Effects of Explanations in AI-Assisted Decision-Making. 26th International Conference on Intelligent User Interfaces.
  68. How do visual explanations foster end users’ appropriate trust in machine learning? Proceedings of the 25th International Conference on Intelligent User Interfaces.
  69. Understanding the Effect of Accuracy on Trust in Machine Learning Models. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems.
  70. Do I trust my machine teammate?: an investigation from perception to decision. Proceedings of the 24th International Conference on Intelligent User Interfaces.
  71. Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making. Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (3)
  1. Zhuoyan Li (7 papers)
  2. Zhuoran Lu (7 papers)
  3. Ming Yin (70 papers)
Citations (8)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets