Papers
Topics
Authors
Recent
Assistant
AI Research Assistant
Well-researched responses based on relevant abstracts and paper content.
Custom Instructions Pro
Preferences or requirements that you'd like Emergent Mind to consider when generating responses.
Gemini 2.5 Flash
Gemini 2.5 Flash 87 tok/s
Gemini 2.5 Pro 51 tok/s Pro
GPT-5 Medium 17 tok/s Pro
GPT-5 High 23 tok/s Pro
GPT-4o 102 tok/s Pro
Kimi K2 166 tok/s Pro
GPT OSS 120B 436 tok/s Pro
Claude Sonnet 4 37 tok/s Pro
2000 character limit reached

Temporally and Distributionally Robust Optimization for Cold-Start Recommendation (2312.09901v3)

Published 15 Dec 2023 in cs.IR

Abstract: Collaborative Filtering (CF) recommender models highly depend on user-item interactions to learn CF representations, thus falling short of recommending cold-start items. To address this issue, prior studies mainly introduce item features (e.g., thumbnails) for cold-start item recommendation. They learn a feature extractor on warm-start items to align feature representations with interactions, and then leverage the feature extractor to extract the feature representations of cold-start items for interaction prediction. Unfortunately, the features of cold-start items, especially the popular ones, tend to diverge from those of warm-start ones due to temporal feature shifts, preventing the feature extractor from accurately learning feature representations of cold-start items. To alleviate the impact of temporal feature shifts, we consider using Distributionally Robust Optimization (DRO) to enhance the generation ability of the feature extractor. Nonetheless, existing DRO methods face an inconsistency issue: the worse-case warm-start items emphasized during DRO training might not align well with the cold-start item distribution. To capture the temporal feature shifts and combat this inconsistency issue, we propose a novel temporal DRO with new optimization objectives, namely, 1) to integrate a worst-case factor to improve the worst-case performance, and 2) to devise a shifting factor to capture the shifting trend of item features and enhance the optimization of the potentially popular groups in cold-start items. Substantial experiments on three real-world datasets validate the superiority of our temporal DRO in enhancing the generalization ability of cold-start recommender models. The code is available at https://github.com/Linxyhaha/TDRO/.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (62)
  1. Invariant risk minimization. arXiv:1907.02893.
  2. CB2CF: a neural multiview content-to-collaborative filtering model for completely cold item recommendations. In RecSys, 228–236. ACM.
  3. Generative adversarial framework for cold-start item recommendation. In SIGIR, 2565–2571. ACM.
  4. Meta policy learning for cold-start conversational recommendation. In WSDM, 222–230. ACM.
  5. Socially-aware dual contrastive learning for cold-start recommendation. In SIGIR, 1927–1932. ACM.
  6. How to learn item representation for cold-start multimedia recommendation? In MM, 3469–3477. ACM.
  7. Invariant representation learning for multimedia recommendation. In MM, 619–628. ACM.
  8. Distributionally robust losses for latent covariate mixtures. Operations Research, 71(2): 649–664.
  9. Learning models with uniform performance via distributionally robust optimization. arXiv:1810.08750.
  10. Learning image and user features for recommendation in social networks. In ICCV, 4274–4282. IEEE.
  11. Model patching: closing the subgroup performance gap with data augmentation. In ICLR.
  12. How integration helps on cold-start recommendations. In RecSys Challenge, 1–6. ACM.
  13. Pre-training graph neural networks for cold-start users and items representation. In WSDM, 265–273. ACM.
  14. Ups and downs: modeling the visual evolution of fashion trends with one-class collaborative filtering. In WWW, 507–517. ACM.
  15. Neural collaborative filtering. In WWW, 173–182. ACM.
  16. CausPref: Causal Preference Learning for Out-of-Distribution Recommendation. In WWW, 410–421. ACM.
  17. Cold-start active learning with robust ordinal matrix factorization. In ICML, 766–774. PMLR.
  18. Does distributionally robust supervised learning give robust classifiers? In ICML, 2029–2037. PMLR.
  19. An industrial framework for cold-start recommendation in zero-shot scenarios. In SIGIR, 3403–3407. ACM.
  20. Premere: meta-reweighting via self-ensembling for point-of-interest recommendation. In AAAI, 4164–4171. AAAI press.
  21. Matrix factorization techniques for recommender systems. Computer, 42(8): 30–37.
  22. When is invariance useful in an out-of-distribution generalization problem? arXiv:2008.01883.
  23. Routing micro-videos via a temporal graph-guided recommendation system. In MM, 1464–1472.
  24. Heterogeneous risk minimization. In ICML, 6804–6814. PMLR.
  25. Distributionally robust optimization with data geometry. In NeurIPS, 33689–33701. Curran Associates, Inc.
  26. Wasserstein collaborative filtering for item cold-start recommendation. In UMAP, 318–322. ACM.
  27. Modeling the second player in distributionally robust optimization. In ICLR.
  28. Distributionally robust models with parametric likelihood ratios. In ICLR.
  29. A dynamic meta-learning model for time-sensitive cold-start recommendations. In AAAI, 7868–7876. AAAI press.
  30. Distributionally robust language modeling. arXiv:1909.02060.
  31. Warm up cold-start advertisements: Improving ctr predictions via learning to learn id embeddings. In SIGIR, 695–704. ACM.
  32. Focus on the common good: group distributional robustness follows. In ICLR.
  33. Siamese neural networks for content-based cold-start music recommendation. In RecSys, 719–723. ACM.
  34. Distributionally robust optimization: A review. arXiv:1908.05659.
  35. Fast and accurate user cold-start learning using monte carlo tree search. In RecSys, 350–359. ACM.
  36. Shared neural item representations for completely cold start problem. In RecSys, 422–431. ACM.
  37. Distributionally robust neural networks for group shifts: on the importance of regularization for worst-case generalization. In ICLR.
  38. M2TRec: metadata-aware multi-task transformer for large-scale and cold-start free session-based recommendations. In RecSys, 573–578. ACM.
  39. Attention-based adaptive model to unify warm and cold starts recommendation. In CIKM, 127–136. ACM.
  40. Distributionally robust optimization and generalization in kernel methods. In NeurIPS, 9131–9141. Curran Associates, Inc.
  41. Counterfactual reasoning for out-of-distribution multimodal sentiment analysis. In MM, 15–23.
  42. FORM: follow the online regularized meta-leader for cold-start recommendation. In SIGIR, 1177–1186. ACM.
  43. Alleviating cold-start problems in recommendation through pseudo-labelling over knowledge graph. In WSDM, 931–939. ACM.
  44. Vapnik, V. 1991. Principles of risk minimization for learning theory. In NeurIPS, 831–838. Curran Associates, Inc.
  45. A meta-learning perspective on cold-start recommendations for items. In NeurIPS, 6904–6914. Curran Associates, Inc.
  46. Dropoutnet: addressing cold start in recommender systems. In NeurIPS, 4957–4966. Curran Associates, Inc.
  47. Privileged graph distillation for cold start recommendation. In SIGIR, 1187–1196. ACM.
  48. Denoising implicit feedback for recommendation. In WSDM, 373–381. ACM.
  49. Causal Representation Learning for Out-of-Distribution Recommendation. In WWW, 3562–3571. ACM.
  50. Fast adaptation for cold-start collaborative filtering with meta-learning. In ICDM, 661–670. IEEE.
  51. Contrastive learning for cold-start recommendation. In MM, 5382–5390. ACM.
  52. Distributionally-robust recommendations for improving worst-case user experience. In WWW, 3606–3610. ACM.
  53. DGRec: graph neural network for recommendation with diversified embedding generation. In WSDM, 661–669. ACM.
  54. DORO: distributional and outlier robust optimization. In ICML, 12345–12355. PMLR.
  55. Causal intervention for leveraging popularity bias in recommendation. In SIGIR, 11–20. ACM.
  56. Popularity-aware Distributionally Robust Optimization for Recommendation System. In CIKM, 4967–4973.
  57. Improving Item Cold-start Recommendation via Model-agnostic Conditional Variational Autoencoder. In SIGIR, 2595–2600. ACM.
  58. Examining and combating spurious features under distribution shift. In ICML, 12857–12867. PMLR.
  59. Distributionally Robust Sequential Recommnedation. In SIGIR, 279–288.
  60. Contrastive collaborative filtering for cold-start item recommendation. In WWW, 928–937. ACM.
  61. Fairness among new items in cold start recommender systems. In SIGIR, 767–776. ACM.
  62. Recommendation for new users and new items via randomized training and mixture-of-experts transformation. In SIGIR, 1121–1130. ACM.
Citations (4)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
Lightbulb Streamline Icon: https://streamlinehq.com

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now
List To Do Tasks Checklist Streamline Icon: https://streamlinehq.com

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets

This paper has been mentioned in 1 post and received 0 likes.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up to View

Don't miss out on important new AI/ML research

See which papers are being discussed right now on X, Reddit, and more:

Explore Trending Papers

“Emergent Mind helps me see which AI papers have caught fire online.”

Philip

Philip

Creator, AI Explained on YouTube