Papers
Topics
Authors
Recent
Search
2000 character limit reached

On-Device Recommender Systems: A Tutorial on The New-Generation Recommendation Paradigm

Published 18 Dec 2023 in cs.IR | (2312.10864v1)

Abstract: Given the sheer volume of contemporary e-commerce applications, recommender systems (RSs) have gained significant attention in both academia and industry. However, traditional cloud-based RSs face inevitable challenges, such as resource-intensive computation, reliance on network access, and privacy breaches. In response, a new paradigm called on-device recommender systems (ODRSs) has emerged recently in various industries like Taobao, Google, and Kuaishou. ODRSs unleash the computational capacity of user devices with lightweight recommendation models tailored for resource-constrained environments, enabling real-time inference with users' local data. This tutorial aims to systematically introduce methodologies of ODRSs, including (1) an overview of existing research on ODRSs; (2) a comprehensive taxonomy of ODRSs, where the core technical content to be covered span across three major ODRS research directions, including on-device deployment and inference, on-device training, and privacy/security of ODRSs; (3) limitations and future directions of ODRSs. This tutorial expects to lay the foundation and spark new insights for follow-up research and applications concerning this new recommendation paradigm.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (36)
  1. Efficient Federated Matrix Factorization Against Inference Attacks. TIST 13, 4 (2022), 1–20.
  2. Learning elastic embeddings for customizing on-device recommenders. In SIGKDD. 138–147.
  3. Real-time Short Video Recommendation on Mobile Devices. In CIKM. 3103–3112.
  4. EdgeRec: recommender system on edge in Mobile Taobao. In CIKM. 2477–2484.
  5. ReFRS: Resource-efficient federated recommender system for dynamic and diversified user preferences. TOIS 41, 3 (2023), 1–30.
  6. Learning to embed categorical features without embedding tables for recommendation. In SIGKDD. 840–850.
  7. Advances in collaborative filtering. Recommender systems handbook (2021), 91–142.
  8. LightRec: A Memory and Search-Efficient Recommender System. In The Web Conference. 695–705.
  9. Learning Compact Compositional Embeddings via Regularized Pruning for Recommendation. arXiv preprint arXiv:2309.03518 (2023).
  10. Automated Embedding Size Search in Deep Recommender Systems. In SIGIR. 2307–2316.
  11. Learnable Embedding sizes for Recommender Systems. In ICLR.
  12. Model-Agnostic Decentralized Collaborative Learning for On-Device POI Recommendation. SIGIR (2023).
  13. Decentralized collaborative learning framework for next POI recommendation. TOIS 41, 3 (2023), 1–25.
  14. Zheqi Lv et al. 2023. DUET: A Tuning-Free Device-Cloud Collaborative Parameters Generation Framework for Efficient Device Model Generalization. In Proceedings of the ACM Web Conference 2023. 3077–3085.
  15. Fedfast: Going beyond average for faster training of federated recommender systems. In SIGKDD. 1234–1242.
  16. Semi-decentralized Federated Ego Graph Learning for Recommendation. In WWW. 339–348.
  17. Budgeted Embedding Table For Recommender Systems. arXiv preprint arXiv:2310.14884 (2023).
  18. Continuous Input Embedding Size Search For Recommender Systems. SIGIR (2023).
  19. Compositional embeddings using complementary partitions for memory-efficient recommendation systems. In SIGKDD. 165–175.
  20. Next Point-of-Interest Recommendation on Resource-Constrained Mobile Devices. In The Web Conference. 906–916.
  21. Fast-adapting and privacy-preserving federated recommender system. VLDBJ (2021), 1–20.
  22. FedAttack: Effective and covert poisoning attack on federated recommendation via hard sampling. In SIGKDD. 4164–4172.
  23. On-Device Next-Item Recommendation with Self-Supervised Knowledge Distillation. In SIGIR. 546–555.
  24. Efficient on-device session-based recommendation. ACM Transactions on Information Systems 41, 4 (2023), 1–24.
  25. Towards Communication-Efficient Model Updating for On-Device Session-Based Recommendation. In Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. 2795–2804.
  26. On-Device Learning for Model Personalization with Large-Scale Cloud-Coordinated Domain Adaption. In SIGKDD. 2180–2190.
  27. VQGraph: Graph Vector-Quantization for Bridging GNNs and MLPs. arXiv preprint arXiv:2308.02117 (2023).
  28. Device-cloud collaborative learning for recommendation. In SIGKDD. 3865–3874.
  29. Manipulating Federated Recommender Systems: Poisoning with Synthetic Users and Its Countermeasures. SIGIR (2023).
  30. Interaction-level Membership Inference Attack Against Federated Recommender Systems. In WWW. 1053–1062.
  31. Federated unlearning for on-device recommendation. In WSDM. 393–401.
  32. LightFR: Lightweight federated recommendation with privacy-preserving matrix factorization. TOIS 41, 4 (2023), 1–28.
  33. Discrete collaborative filtering. In SIGIR. 325–334.
  34. Pipattack: Poisoning federated recommender systems for manipulating item promotion. In WSDM. 1415–1423.
  35. Comprehensive privacy analysis on federated recommender system against attribute inference attacks. IEEE Transactions on Knowledge and Data Engineering (2023).
  36. Discrete personalized ranking for fast collaborative filtering from implicit feedback. In AAAI, Vol. 31.
Citations (2)

Summary

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Authors (4)

Collections

Sign up for free to add this paper to one or more collections.