Reliability quality measures for recommender systems (2402.04457v1)
Abstract: Users want to know the reliability of the recommendations; they do not accept high predictions if there is no reliability evidence. Recommender systems should provide reliability values associated with the predictions. Research into reliability measures requires the existence of simple, plausible and universal reliability quality measures. Research into recommender system quality measures has focused on accuracy. Moreover, novelty, serendipity and diversity have been studied; nevertheless there is an important lack of research into reliability/confidence quality measures. This paper proposes a reliability quality prediction measure (RPI) and a reliability quality recommendation measure (RRI). Both quality measures are based on the hypothesis that the more suitable a reliability measure is, the better accuracy results it will provide when applied. These reliability quality measures show accuracy improvements when appropriated reliability values are associated with their predictions (i.e. high reliability values associated with correct predictions or low reliability values associated with incorrect predictions). The proposed reliability quality metrics will lead to the design of brand new recommender system reliability measures. These measures could be applied to different matrix factorization techniques and to content-based, context-aware and social recommendation approaches. The recommender system reliability measures designed could be tested, compared and improved using the proposed reliability quality metrics.
- Do recommender systems manipulate consumer preferences? a study of anchoring effects. Information Systems Research, 24(4):956–975, 2013.
- Neighbor selection and weighting in user-based collaborative filtering: a performance prediction approach. ACM Transactions on the Web (TWEB), 8(2):1–30, 2014.
- Recommender systems survey. Knowledge-based systems, 46:109–132, 2013.
- A new collaborative filtering metric that improves the behavior of recommender systems. Knowledge-Based Systems, 23(6):520–528, 2010.
- Recommender systems handbook. Recommender Systems Handbook. https://doi. org/10.1007/978-0-387-85820-3, 2011.
- Explaining collaborative filtering recommendations. In Proceedings of the 2000 ACM conference on Computer supported cooperative work, pages 241–250, 2000.
- Evaluating collaborative filtering recommender systems. ACM Transactions on Information Systems (TOIS), 22(1):5–53, 2004.
- Trees for explaining recommendations made through collaborative filtering. Information Sciences, 239:1–17, 2013.
- Incorporating reliability measurements into the predictions of a recommender system. Information Sciences, 218:1–16, 2013.
- Hierarchical graph maps for visualization of collaborative recommender systems. Journal of Information Science, 40(1):97–106, 2014.
- Ordrec: an ordinal model for predicting personalized item rating distributions. In Proceedings of the fifth ACM conference on Recommender systems, pages 117–124, 2011.
- A model to represent users trust in recommender systems using ontologies and fuzzy linguistic modeling. Information Sciences, 311:102–118, 2015.
- Maciej A Mazurowski. Estimating confidence of individual rating predictions in collaborative filtering recommender systems. Expert Systems with Applications, 40(10):3847–3857, 2013.
- A collaborative filtering algorithm and evaluation metric that accurately model the user experience. In Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, pages 329–336, 2004.
- A reliability-based recommendation method to improve trust-aware recommender systems. Expert Systems with Applications, 42(21):7386–7398, 2015.
- Improving top-k recommendation with truster and trustee relationship in user trust network. Information Sciences, 374:100–114, 2016.
- Evaluating recommendation systems. Recommender systems handbook, pages 257–297, 2011.
- Beyond algorithms: An hci perspective on recommender systems. In ACM SIGIR 2001 workshop on recommender systems, volume 13, pages 1–11, 2001.
- Evaluating recommender systems. In Seventh International Conference on Digital Information Management (ICDIM 2012), pages 56–61. IEEE, 2012.
Sponsor
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.