Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
129 tokens/sec
GPT-4o
28 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Improving Expert Predictions with Conformal Prediction (2201.12006v5)

Published 28 Jan 2022 in cs.LG, cs.CY, cs.HC, and stat.ML

Abstract: Automated decision support systems promise to help human experts solve multiclass classification tasks more efficiently and accurately. However, existing systems typically require experts to understand when to cede agency to the system or when to exercise their own agency. Otherwise, the experts may be better off solving the classification tasks on their own. In this work, we develop an automated decision support system that, by design, does not require experts to understand when to trust the system to improve performance. Rather than providing (single) label predictions and letting experts decide when to trust these predictions, our system provides sets of label predictions constructed using conformal prediction$\unicode{x2014}$prediction sets$\unicode{x2014}$and forcefully asks experts to predict labels from these sets. By using conformal prediction, our system can precisely trade-off the probability that the true label is not in the prediction set, which determines how frequently our system will mislead the experts, and the size of the prediction set, which determines the difficulty of the classification task the experts need to solve using our system. In addition, we develop an efficient and near-optimal search method to find the conformal predictor under which the experts benefit the most from using our system. Simulation experiments using synthetic and real expert predictions demonstrate that our system may help experts make more accurate predictions and is robust to the accuracy of the classifier the conformal predictor relies on.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (55)
  1. Uncertainty sets for image classifiers using conformal prediction. In International Conference on Learning Representations.
  2. A gentle introduction to conformal prediction and distribution-free uncertainty quantification. arXiv preprint arXiv:2107.07511.
  3. On the utility of prediction sets in human-ai teams. arXiv preprint arXiv:2205.01411.
  4. Conformal prediction for reliable machine learning: theory, adaptations and applications. Newnes.
  5. Beyond accuracy: The role of mental models in human-ai team performance. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, 7(1):2–11.
  6. Distribution-free, risk-controlling prediction sets. J. ACM, 68(6).
  7. Beach, L. R. (1993). Broadening the definition of decision making: The role of prechoice screening of options. Psychological Science, 4(4):215–220.
  8. Discrete choice models with latent choice sets. International Journal of Research in Marketing, 12(1):9–24.
  9. When humans and machines make joint decisions: A non-symmetric bandit model. arXiv preprint arXiv:2007.04800.
  10. Set-valued classification–overview via a unified framework. arXiv preprint arXiv:2102.12318.
  11. Regression under human assistance. In Proceedings of the AAAI Conference on Artificial Intelligence.
  12. Classification under human assistance. In Proceedings of the AAAI Conference on Artificial Intelligence.
  13. Learning nondeterministic classifiers. Journal of Machine Learning Research, 10(10).
  14. Human decision making with machine assistance: An experiment on bailing and jailing. Proceedings of the ACM on Human-Computer Interaction, 3(CSCW):1–25.
  15. Distribution-free binary classification: prediction sets, confidence intervals and calibration. In Advances in Neural Information Processing Systems.
  16. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 770–778.
  17. Identity mappings in deep residual networks. In European conference on computer vision, pages 630–645. Springer.
  18. Heiss, F. (2016). Discrete choice methods with simulation. Taylor & Francis.
  19. Densely connected convolutional networks. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 2261–2269.
  20. Adding asymmetrically dominated alternatives: Violations of regularity and the similarity hypothesis. Journal of consumer research, 9(1):90–98.
  21. Hulsman, R. (2022). Distribution-free finite-sample guarantees and split conformal prediction. arXiv preprint arXiv:2210.14735.
  22. A deep learning system accurately classifies primary and metastatic cancers using passenger mutation patterns. Nature communications, 11(1):1–12.
  23. Combining human predictions with model probabilities via confusion matrices and calibration. arXiv preprint arXiv:2109.14591.
  24. Learning multiple layers of features from tiny images. Citeseer.
  25. Assessing the impact of automated suggestions on decision making: Domain experts mediate model errors but take less initiative. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems.
  26. Evaluating eligibility criteria of oncology trials using real-world data and ai. Nature, 592(7855):629–633.
  27. Credal classification rule for uncertain data based on belief functions. Pattern Recognition, 47(7):2532–2541.
  28. Ask not what ai can do, but what ai should do: Towards a framework of task delegability. Advances in Neural Information Processing Systems, 32:57–67.
  29. Luce, R. D. (1959). On the possible psychophysical laws. Psychological review, 66(2):81.
  30. Partial classification in the belief function framework. Knowledge-Based Systems, 214:106742.
  31. Learning to switch among agents in a team. Transactions on Machine Learning Research.
  32. Efficient set-valued prediction in multi-class classification. Data Mining and Knowledge Discovery, 35(4):1435–1469.
  33. Consistent estimators for learning to defer to an expert. In International Conference on Machine Learning, pages 7076–7087.
  34. Multilabel classification with partial abstention: Bayes-optimal prediction under label independence. Journal of Artificial Intelligence Research, 72:613–665.
  35. The role of domain expertise in user trust and the impact of first impressions with intelligent systems. ArXiv, abs/2008.09100.
  36. Differentiable learning under triage. In Advances in Neural Information Processing Systems.
  37. How model accuracy and explanation fidelity influence user trust. arXiv preprint arXiv:1907.12652.
  38. Human uncertainty makes classification more robust. arXiv preprint arXiv:1908.07086.
  39. Distribution-free uncertainty quantification for classification under label shift. In Proceedings of the 37th Conference on Uncertainty in Artificial Intelligence.
  40. The algorithmic automation problem: Prediction, triage, and human effort. arXiv preprint arXiv:1903.12220.
  41. Conformalized quantile regression. Advances in Neural Information Processing Systems, 32:3543–3553.
  42. Classification with valid and adaptive coverage. Advances in Neural Information Processing Systems, 33:3581–3591.
  43. Simonson, I. (1989). Choice based on reasons: The case of attraction and compromise effects. Journal of consumer research, 16(2):158–174.
  44. Reinforcement learning under algorithmic triage. arXiv preprint arXiv:2109.11328.
  45. Misplaced trust: Measuring the interference of machine learning in human decision-making. In 12th ACM Conference on Web Science, pages 315–324.
  46. Tversky, A. (1972). Elimination by aspects: A theory of choice. Psychological review, 79(4):281.
  47. Context-dependent preferences. Management Science, 39(10):1179–1189.
  48. Uncalibrated models can improve human-ai collaboration. In Advances in Neural Information Processing Systems.
  49. Algorithmic Learning in a Random World. Springer-Verlag, Berlin, Heidelberg.
  50. Improving screening processes via calibrated subset selection. In Proceedings of the 39th International Conference on Machine Learning.
  51. Are explanations helpful? a comparative study of the effects of explanations in ai-assisted decision-making. In 26th International Conference on Intelligent User Interfaces, pages 318–328.
  52. Phased decision strategies: Sequels to an initial screening. Graduate School of Business, Stanford University.
  53. Cautious classification with nested dichotomies and imprecise probabilities. Soft Computing, 21(24):7447–7462.
  54. Understanding the effect of accuracy on trust in machine learning models. In Proceedings of the 2019 chi conference on human factors in computing systems, pages 1–12.
  55. Effect of confidence and explanation on accuracy and trust calibration in ai-assisted decision making. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, pages 295–305.
Citations (24)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now