Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
133 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Understanding and Counteracting Feature-Level Bias in Click-Through Rate Prediction (2402.03600v1)

Published 6 Feb 2024 in cs.IR

Abstract: Common click-through rate (CTR) prediction recommender models tend to exhibit feature-level bias, which leads to unfair recommendations among item groups and inaccurate recommendations for users. While existing methods address this issue by adjusting the learning of CTR models, such as through additional optimization objectives, they fail to consider how the bias is caused within these models. To address this research gap, our study performs a top-down analysis on representative CTR models. Through blocking different components of a trained CTR model one by one, we identify the key contribution of the linear component to feature-level bias. We conduct a theoretical analysis of the learning process for the weights in the linear component, revealing how group-wise properties of training data influence them. Our experimental and statistical analyses demonstrate a strong correlation between imbalanced positive sample ratios across item groups and feature-level bias. Based on this understanding, we propose a minimally invasive yet effective strategy to counteract feature-level bias in CTR models by removing the biased linear weights from trained models. Additionally, we present a linear weight adjusting strategy that requires fewer random exposure records than relevant debiasing methods. The superiority of our proposed strategies are validated through extensive experiments on three real-world datasets.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (73)
  1. Controlling Popularity Bias in Learning-to-Rank Recommendation. In Proceedings of the 11th ACM Conference on Recommender Systems. ACM, 42–46.
  2. Pearson Correlation Coefficient. In Noise reduction in speech processing. Springer, 1–4.
  3. Fairness in Recommendation Ranking through Pairwise Comparisons. In Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining. ACM, 2212–2220.
  4. Higher-Order Factorization Machines. Advances in Neural Information Processing Systems 29 (2016).
  5. Simon Caton and Christian Haas. 2020. Fairness in Machine Learning: A Survey. arXiv preprint arXiv:2010.04053 (2020).
  6. AutoDebias: Learning to Debias for Recommendation. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 21–30.
  7. Bias and Debias in Recommender System: A Survey and Future Directions. ACM Transactions on Information Systems 41, 3 (2023), 1–39.
  8. Improving Recommendation Fairness via Data Augmentation. In Proceedings of the ACM Web Conference 2023. ACM, 1012–1020.
  9. Fairly adaptive negative sampling for recommendations. In Proceedings of the ACM Web Conference 2023. ACM, 3723–3733.
  10. Wide & Deep Learning for Recommender Systems. In Proceedings of the 1st Workshop on Deep Learning for Recommender Systems. 7–10.
  11. Interpolative Distillation for Unifying Biased and Debiased Recommendation. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 40–49.
  12. External Evaluation of Ranking Models under Extreme Position-Bias. In Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining. ACM, 252–261.
  13. A Comprehensive Survey on Trustworthy Recommender Systems. (2022).
  14. KuaiRand: An Unbiased Sequential Recommendation Dataset with Randomly Exposed Videos. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management. ACM, 3953–3957.
  15. Towards Long-Term Fairness in Recommendation. In Proceedings of the 14th ACM International Conference on Web Search and Data Mining. ACM, 445–453.
  16. Fairness-Aware Ranking in Search & Recommendation Systems with Application to LinkedIn Talent Search. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. ACM, 2221–2231.
  17. DeepFM: A Factorization-Machine Based Neural Network for CTR Prediction. In Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence. 1725–1731.
  18. Equality of Opportunity in Supervised Learning. Advances in Neural Information Processing Systems 29 (2016).
  19. F Maxwell Harper and Joseph A Konstan. 2015. The Movielens Datasets: History and Context. Acm Transactions on Interactive Intelligent Systems (TIIS) 5, 4 (2015), 1–19.
  20. Xiangnan He and Tat-Seng Chua. 2017. Neural Factorization Machines for Sparse Predictive Analytics. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 355–364.
  21. Neural Collaborative Filtering. In Proceedings of the 26th International Conference on World Wide Web. ACM, 173–182.
  22. Debiasing Career Recommendations with Neural Fair Collaborative Filtering. In Proceedings of the Web Conference 2021. ACM / IW3C2, 3779–3790.
  23. Kalervo Järvelin and Jaana Kekäläinen. 2002. Cumulated Gain-Based Evaluation of IR Techniques. ACM Transactions on Information Systems (TOIS) 20, 4 (2002), 422–446.
  24. Field-Aware Factorization Machines for CTR Prediction. In Proceedings of the 10th ACM Conference on Recommender Systems. ACM, 43–50.
  25. Diederik P Kingma and Jimmy Ba. 2014. Adam: A Method for Stochastic Optimization. (2014).
  26. Yehuda Koren. 2008. Factorization Meets the Neighborhood: A Multifaceted Collaborative Filtering Model. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 426–434.
  27. An Adversarial Approach to Improve Long-Tail Performance in Neural Collaborative Filtering. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management. ACM, 1491–1494.
  28. FairGAN: GANs-based Fairness-aware Learning for Recommendations with Implicit Feedback. In Proceedings of the ACM Web Conference 2022. ACM, 297–307.
  29. User-Oriented Fairness in Recommendation. In Proceedings of the Web Conference 2021. ACM / IW3C2, 624–632.
  30. Fairness in Recommendation: A Survey. (2022).
  31. Towards Personalized Fairness Based on Causal Notion. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 1054–1063.
  32. Interpretable Click-Through Rate Prediction through Hierarchical Attention. In Proceedings of the 13th International Conference on Web Search and Data Mining. ACM, 313–321.
  33. xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. ACM, 1754–1763.
  34. A General Knowledge Distillation Framework for Counterfactual Recommendation via Uniform Data. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 831–840.
  35. Rating Distribution Calibration for Selection Bias Mitigation in Recommendations. In Proceedings of the ACM Web Conference 2022. ACM, 2048–2057.
  36. Mitigating Popularity Bias for Users and Items with Fairness-Centric Adaptive Recommendation. ACM Transactions on Information Systems 41, 3 (2023), 1–27.
  37. Feedback Loop and Bias Amplification in Recommender Systems. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management. ACM, 2145–2148.
  38. Regulating Group Exposure for Item Providers in Recommendation. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 1839–1843.
  39. Alistair Moffat and Justin Zobel. 2008. Rank-Biased Precision for Measurement of Retrieval Effectiveness. ACM Transactions on Information Systems (TOIS) 27, 1 (2008), 1–27.
  40. CPFair: Personalized Consumer and Producer Fairness Re-ranking for Recommender Systems. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 770–779.
  41. Vilfredo Pareto et al. 1971. Manual of Political Economy. (1971).
  42. Fairrec: Two-sided fairness for personalized recommendations in two-sided platforms. In Proceedings of the web conference 2020. ACM, 1194–1204.
  43. Judea Pearl. 2009. Causality. Cambridge university press.
  44. Experiments on Generalizability of User-Oriented Fairness in Recommender Systems. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 2755–2764.
  45. Steffen Rendle. 2010. Factorization Machines. In 2010 IEEE International Conference on Data Mining. IEEE Computer Society, 995–1000.
  46. Countering Popularity Bias by Regularizing Score Differences. In Proceedings of the 16th ACM Conference on Recommender Systems. ACM, 145–155.
  47. Predicting Clicks: Estimating the Click-Through Rate for New Ads. In Proceedings of the 16th International Conference on World Wide Web. ACM, 521–530.
  48. Donald B Rubin. 2005. Causal Inference Using Potential Outcomes: Design, Modeling, Decisions. J. Amer. Statist. Assoc. 100, 469 (2005), 322–331.
  49. Unbiased Recommender Learning from Missing-Not-at-Random Implicit Feedback. In Proceedings of the 13th International Conference on Web Search and Data Mining. ACM, 501–509.
  50. Recommendations as Treatments: Debiasing Learning and Evaluation. In Proceedings of the 33nd International Conference on Machine Learning. PMLR, 1670–1679.
  51. Scoping Fairness Objectives and Identifying Fairness Metrics for Recommender Systems: The Practitioners’ Perspective. In Proceedings of the ACM Web Conference 2023. ACM, 3648–3659.
  52. Autoint: Automatic Feature Interaction Learning via Self-Attentive Neural Networks. In Proceedings of the 28th ACM International Conference on Information & Knowledge Management. ACM, 1161–1170.
  53. Lequn Wang and Thorsten Joachims. 2023. Uncertainty Quantification for Fairness in Two-Stage Recommender Systems. In Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining. ACM, 940–948.
  54. Deconfounded Recommendation for Alleviating Bias Amplification. In The 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. ACM, 1717–1725.
  55. Doubly Robust Joint Learning for Recommendation on Data Missing Not at Random. In International Conference on Machine Learning. PMLR, 6638–6647.
  56. Model-Agnostic Counterfactual Reasoning for Eliminating Popularity Bias in Recommender System. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. ACM, 1791–1800.
  57. A Multi-Objective Optimization Framework for Multi-Stakeholder Fairness-Aware Recommendation. ACM Transactions on Information Systems 41, 2 (2022), 1–29.
  58. Joint Multisided Exposure Fairness for Recommendation. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 703–714.
  59. Learning Fair Representations for Recommendation: A Graph-Based Perspective. In Proceedings of the Web Conference 2021. ACM / IW3C2, 2198–2208.
  60. FASTER: A Dynamic Fairness-assurance Strategy for Session-based Recommender Systems. ACM Transactions on Information Systems (2023).
  61. TFROM: A Two-Sided Fairness-Aware Recommendation Model for Both Customers and Providers. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 1013–1022.
  62. Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attention Networks. In Proceedings of the 26th International Joint Conference on Artificial Intelligence. AAAI Press, 3119–3125.
  63. P-MMF: Provider Max-min Fairness Re-ranking in Recommender System. In Proceedings of the ACM Web Conference 2023. ACM, 3701–3711.
  64. Neutralizing Popularity Bias in Recommendation Models. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 2623–2628.
  65. Jerrold H Zar. 1972. Significance Testing of the Spearman Rank Correlation Coefficient. J. Amer. Statist. Assoc. 67, 339 (1972), 578–580.
  66. Causal Intervention for Leveraging Popularity Bias in Recommendation. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 11–20.
  67. Towards Fair Classifiers Without Sensitive Attributes: Exploring Biases in Related Features. In Proceedings of the 15th International Conference on Web Search and Data Mining. ACM, 1433–1442.
  68. Disentangling User Interest and Conformity for Recommendation with Causal Embedding. In Proceedings of the Web Conference 2021. ACM / IW3C2, 2980–2991.
  69. Deep Interest Network for Click-Through Rate Prediction. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 1059–1068.
  70. BARS: Towards Open Benchmarking for Recommender Systems. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 2912–2923.
  71. Open Benchmarking for Click-Through Rate Prediction. In Proceedings of the 30th ACM International Conference on Information & Knowledge Management. ACM, 2759–2769.
  72. Popularity-Opportunity Bias in Collaborative Filtering. In Proceedings of the 14th ACM International Conference on Web Search and Data Mining. ACM, 85–93.
  73. Measuring and Mitigating Item Under-Recommendation Bias in Personalized Ranking Systems. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 449–458.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now