Review-Based Cross-Domain Recommendation via Hyperbolic Embedding and Hierarchy-Aware Domain Disentanglement (2403.20298v1)
Abstract: The issue of data sparsity poses a significant challenge to recommender systems. In response to this, algorithms that leverage side information such as review texts have been proposed. Furthermore, Cross-Domain Recommendation (CDR), which captures domain-shareable knowledge and transfers it from a richer domain (source) to a sparser one (target), has received notable attention. Nevertheless, the majority of existing methodologies assume a Euclidean embedding space, encountering difficulties in accurately representing richer text information and managing complex interactions between users and items. This paper advocates a hyperbolic CDR approach based on review texts for modeling user-item relationships. We first emphasize that conventional distance-based domain alignment techniques may cause problems because small modifications in hyperbolic geometry result in magnified perturbations, ultimately leading to the collapse of hierarchical structures. To address this challenge, we propose hierarchy-aware embedding and domain alignment schemes that adjust the scale to extract domain-shareable information without disrupting structural forms. The process involves the initial embedding of review texts in hyperbolic space, followed by feature extraction incorporating degree-based normalization and structure alignment. We conducted extensive experiments to substantiate the efficiency, robustness, and scalability of our proposed model in comparison to state-of-the-art baselines.
- Gpt-4 technical report. arXiv preprint arXiv:2303.08774 (2023).
- Ssvr Kumar Addagarla and Anthoniraj Amalanathan. 2020. Probabilistic unsupervised machine learning approach for a similar image recommender system for E-commerce. Symmetry 12, 11 (2020), 1783.
- Sumaia Mohammed Al-Ghuribi and Shahrul Azman Mohd Noah. 2019. Multi-criteria review-based recommender system–the state of the art. IEEE Access 7 (2019), 169446–169468.
- A theory of learning from different domains. Machine learning 79, 1 (2010), 151–175.
- Cross-Market Product Recommendation. In Proceedings of the 30th ACM International Conference on Information & Knowledge Management. 110–119.
- Domain separation networks. Advances in neural information processing systems 29 (2016), 343–351.
- Learning disentangled semantic representation for domain adaptation. In IJCAI: proceedings of the conference, Vol. 2019. NIH Public Access, 2060.
- Disencdr: Learning disentangled representations for cross-domain recommendation. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 267–277.
- Neural attentional rating regression with review-level explanations. In Proceedings of the 2018 World Wide Web Conference. 1583–1592.
- Knowledge-inspired Subdomain Adaptation for Cross-Domain Knowledge Transfer. In Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. 234–244.
- Dynamic Explainable Recommendation based on Neural Attentive Models. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 53–60.
- On feature learning in neural networks with global convergence guarantees. arXiv preprint arXiv:2204.10782 (2022).
- Co-attentive multi-task learning for explainable recommendation. In Proceedings of the 28th International Joint Conference on Artificial Intelligence. AAAI Press, 2137–2143.
- Based Domain Disentanglement without Duplicate Users or Contexts for Cross-Domain Recommendation. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 293–303.
- Power-law distributions in empirical data. SIAM review 51, 4 (2009), 661–703.
- Asymmetrical hierarchical networks with attentive interactions for interpretable review-based recommendation. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34. 7667–7674.
- A multi-view deep learning approach for cross domain user modeling in recommendation systems. In Proceedings of the 24th International Conference on World Wide Web. 278–288.
- Hme: A hyperbolic metric embedding approach for next-poi recommendation. In Proceedings of the 43rd International ACM SIGIR Conference on research and development in information retrieval. 1429–1438.
- Deeply fusing reviews and contents for cold start users in cross-domain recommendation systems. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 94–101.
- Yasutaka Furusho and Kazushi Ikeda. 2019. Resnet and batch-normalization improve data separability. In Asian Conference on Machine Learning. PMLR, 94–108.
- Euclidean embedding of co-occurrence data. Advances in neural information processing systems 17 (2004).
- Measuring statistical dependence with Hilbert-Schmidt norms. In International conference on algorithmic learning theory. Springer, 63–77.
- Hyperbolic attention networks. arXiv preprint arXiv:1805.09786 (2018).
- DA-GCN: A Domain-aware Attentive Graph Convolution Network for Shared-account Cross-domain Sequential Recommendation. arXiv preprint arXiv:2105.03300 (2021).
- Hyperbolic Contrastive Graph Representation Learning for Session-based Recommendation. IEEE Transactions on Knowledge and Data Engineering (2023).
- Domain identification of scientific articles using transfer learning and ensembles. In Pacific-Asia Conference on Knowledge Discovery and Data Mining. Springer, 88–97.
- Neural collaborative filtering. In Proceedings of the 26th international conference on world wide web. 173–182.
- Conet: Collaborative cross networks for cross-domain recommendation. In Proceedings of the 27th ACM international conference on information and knowledge management. 667–676.
- Semi-supervised learning for cross-domain recommendation to cold-start users. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 1563–1572.
- Multidimensional social network in the social recommender system. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans 41, 4 (2011), 746–759.
- Mohammad Khoshneshin and W Nick Street. 2010. Collaborative filtering via euclidean embedding. In Proceedings of the fourth ACM conference on Recommender systems. 87–94.
- Hyperbolic image embeddings. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 6418–6428.
- Transfer Learning via Contextual Invariants for One-to-Many Cross-Domain Recommendation. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 1081–1090.
- Lorentzian distance learning for hyperbolic representations. In International Conference on Machine Learning. PMLR, 3672–3681.
- Hyperbolic neural collaborative recommender. IEEE Transactions on Knowledge and Data Engineering (2022).
- Pan Li and Alexander Tuzhilin. 2020. Ddtcdr: Deep dual transfer cross domain recommendation. In Proceedings of the 13th International Conference on Web Search and Data Mining. 331–339.
- Learning disentangled representation with pairwise independence. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 4245–4252.
- Tong Lin and Hongbin Zha. 2008. Riemannian manifold learning. IEEE transactions on pattern analysis and machine intelligence 30, 5 (2008), 796–809.
- Collaborative filtering with a deep adversarial and attention network for cross-domain recommendation. Information Sciences 565 (2021), 370–389.
- Recommender systems with heterogeneous side information. In The world wide web conference. 3027–3033.
- Exploiting variational domain-invariant user embedding for partially overlapped cross domain recommendation. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 312–321.
- Recommender system application developments: a survey. Decision support systems 74 (2015), 12–32.
- Cross-Domain Recommendation: An Embedding and Mapping Approach.. In IJCAI, Vol. 17. 2464–2470.
- Domain adaptation: Learning bounds and algorithms. arXiv preprint arXiv:0902.3430 (2009).
- Distributed representations of words and phrases and their compositionality. Advances in neural information processing systems 26 (2013).
- Disentangling Preference Representations for Recommendation Critiquing with ß-VAE. In Proceedings of the 30th ACM International Conference on Information & Knowledge Management. 1356–1365.
- Maximillian Nickel and Douwe Kiela. 2017. Poincaré embeddings for learning hierarchical representations. Advances in neural information processing systems 30 (2017).
- Maximillian Nickel and Douwe Kiela. 2018. Learning continuous hierarchies in the lorentz model of hyperbolic geometry. In International conference on machine learning. PMLR, 3779–3788.
- Domain agnostic learning with disentangled representations. In International Conference on Machine Learning. PMLR, 5102–5112.
- Glove: Global vectors for word representation. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). 1532–1543.
- Overcoming language priors in visual question answering with adversarial regularization. arXiv preprint arXiv:1810.03649 (2018).
- Noveen Sachdeva and Julian McAuley. 2020. How Useful are Reviews for Recommendation? A Critical Review and Potential Improvements. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 1845–1848.
- Interpretable convolutional neural networks with dual local and global attention for review rating prediction. In Proceedings of the eleventh ACM conference on recommender systems. 297–305.
- Recommender systems based on collaborative filtering using review texts—a survey. Information 11, 6 (2020), 317.
- Enhancing Hierarchy-Aware Graph Networks with Deep Dual Clustering for Session-based Recommendation. In Proceedings of the ACM Web Conference 2023. 165–176.
- Hgcf: Hyperbolic graph convolution networks for collaborative filtering. In Proceedings of the Web Conference 2021. 593–601.
- Multi-pointer co-attention networks for recommendation. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2309–2318.
- Poincar\\\backslash\’e glove: Hyperbolic word embeddings. arXiv preprint arXiv:1810.06546 (2018).
- Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971 (2023).
- Xing Wan. 2019. Influence of feature scaling on convergence of gradient iterative algorithm. In Journal of physics: Conference series, Vol. 1213. IOP Publishing, 032021.
- Hypersorec: Exploiting hyperbolic user and item representations with multiple aspects for social-aware recommendation. ACM Transactions on Information Systems (TOIS) 40, 2 (2021), 1–28.
- HDNR: A Hyperbolic-Based Debiased Approach for Personalized News Recommendation. In Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. 259–268.
- Cross-domain recommendation for cold-start users via neighborhood based feature mapping. In International conference on database systems for advanced applications. Springer, 158–165.
- Contrastive cross-domain recommendation in matching. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 4226–4236.
- Jingyun Xu and Yi Cai. 2023. Decoupled Hyperbolic Graph Attention Network for Cross-domain Named Entity Recognition. In Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. 591–600.
- Two sides of the same coin: Heterophily and oversmoothing in graph convolutional neural networks. In 2022 IEEE International Conference on Data Mining (ICDM). IEEE, 1287–1292.
- Hicf: Hyperbolic informative collaborative filtering. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2212–2221.
- HRCF: Enhancing collaborative filtering via hyperbolic geometric regularization. In Proceedings of the ACM Web Conference 2022. 2462–2471.
- AutoFT: Automatic Fine-Tune for Parameters Transfer Learning in Click-Through Rate Prediction. arXiv preprint arXiv:2106.04873 (2021).
- Parameter-efficient transfer from sequential behaviors for user modeling and recommendation. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 1469–1478.
- DARec: deep domain adaptation for cross-domain recommendation via transferring rating patterns. arXiv preprint arXiv:1905.10760 (2019).
- A Zero Attentive Relevance Matching Networkfor Review Modeling in Recommendation System. arXiv preprint arXiv:2101.06387 (2021).
- Deep learning based recommender system: A survey and new perspectives. ACM computing surveys (CSUR) 52, 1 (2019), 1–38.
- CATN: Cross-Domain Recommendation for Cold-Start Users via Aspect Transfer Network. arXiv preprint arXiv:2005.10549 (2020).
- Cross-domain recommendation via user interest alignment. In Proceedings of the ACM Web Conference 2023. 887–896.
- Joint deep modeling of users and items using reviews for recommendation. In Proceedings of the Tenth ACM International Conference on Web Search and Data Mining. 425–434.
- Cross-domain recommendation: challenges, progress, and prospects. arXiv preprint arXiv:2103.01696 (2021).
- Personalized transfer of user preferences for cross-domain recommendation. In Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining. 1507–1515.