Peer Neighborhood Mechanisms: A Framework for Mechanism Generalization
Abstract: Peer prediction incentive mechanisms for crowdsourcing are generally limited to eliciting samples from categorical distributions. Prior work on extending peer prediction to arbitrary distributions has largely relied on assumptions on the structures of the distributions or known properties of the data providers. We introduce a novel class of incentive mechanisms that extend peer prediction mechanisms to arbitrary distributions by replacing the notion of an exact match with a concept of neighborhood matching. We present conditions on the belief updates of the data providers that guarantee incentive-compatibility for rational data providers, and admit a broad class of possible reasonable updates.
- Cantelli, F. P. 1933. Sulla determinazione empirica delle leggi di probabilita. Giorn. Ist. Ital. Attuari, 4(421-424).
- Truthful data acquisition via peer prediction. Advances in Neural Information Processing Systems, 33: 18194–18204.
- Crowdsourced judgement elicitation with endogenous proficiency. In Proceedings of the 22nd international conference on World Wide Web, 319–330.
- Incentives and incomplete information. Journal of Public economics, 11(1): 25–45.
- Glivenko, V. 1933. Sulla determinazione empirica delle leggi di probabilita. Gion. Ist. Ital. Attauri., 4: 92–99.
- Personalized peer truth serum for eliciting multi-attribute personal data. In Uncertainty in Artificial Intelligence, 18–27. PMLR.
- An information theoretic framework for designing information elicitation mechanisms that reward truth-telling. ACM Transactions on Economics and Computation (TEAC), 7(1): 1–33.
- Correlated information and mecanism design. Econometrica: Journal of the Econometric Society, 395–421.
- Eliciting informative feedback: The peer-prediction method. Management Science, 51(9): 1359–1373.
- Miranda, C. 1940. Un’osservazione su un teorema di Brouwer. Consiglio Nazionale delle Ricerche.
- Prelec, D. 2004. A Bayesian truth serum for subjective data. science, 306(5695): 462–466.
- Incentives for truthful information elicitation of continuous signals. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 28.
- Incentivizing truthful responses with the logarithmic peer truth serum. In Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers, 1349–1354.
- Incentives for effort in crowdsourcing using the peer truth serum. ACM Transactions on Intelligent Systems and Technology (TIST), 7(4): 1–28.
- Informed truthfulness in multi-task peer prediction. In Proceedings of the 2016 ACM Conference on Economics and Computation, 179–196.
- Labeling images with a computer game. In Proceedings of the SIGCHI conference on Human factors in computing systems, 319–326.
- Output agreement mechanisms and common knowledge. In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, volume 2, 220–226.
- Scoring rules and the evaluation of probabilities. Test, 5(1): 1–60.
- A robust bayesian truth serum for small populations. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 26, 1492–1498.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.