Papers
Topics
Authors
Recent
Search
2000 character limit reached

To Search or to Recommend: Predicting Open-App Motivation with Neural Hawkes Process

Published 4 Apr 2024 in cs.IR | (2404.03267v1)

Abstract: Incorporating Search and Recommendation (S&R) services within a singular application is prevalent in online platforms, leading to a new task termed open-app motivation prediction, which aims to predict whether users initiate the application with the specific intent of information searching, or to explore recommended content for entertainment. Studies have shown that predicting users' motivation to open an app can help to improve user engagement and enhance performance in various downstream tasks. However, accurately predicting open-app motivation is not trivial, as it is influenced by user-specific factors, search queries, clicked items, as well as their temporal occurrences. Furthermore, these activities occur sequentially and exhibit intricate temporal dependencies. Inspired by the success of the Neural Hawkes Process (NHP) in modeling temporal dependencies in sequences, this paper proposes a novel neural Hawkes process model to capture the temporal dependencies between historical user browsing and querying actions. The model, referred to as Neural Hawkes Process-based Open-App Motivation prediction model (NHP-OAM), employs a hierarchical transformer and a novel intensity function to encode multiple factors, and open-app motivation prediction layer to integrate time and user-specific information for predicting users' open-app motivations. To demonstrate the superiority of our NHP-OAM model and construct a benchmark for the Open-App Motivation Prediction task, we not only extend the public S&R dataset ZhihuRec but also construct a new real-world Open-App Motivation Dataset (OAMD). Experiments on these two datasets validate NHP-OAM's superiority over baseline models. Further downstream application experiments demonstrate NHP-OAM's effectiveness in predicting users' Open-App Motivation, highlighting the immense application value of NHP-OAM.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (42)
  1. Reinforcing User Retention in a Billion Scale Short Video Recommender System. In Companion Proceedings of the ACM Web Conference 2023. 421–426.
  2. Latent User Intent Modeling for Sequential Recommenders. In Companion Proceedings of the ACM Web Conference 2023. 427–431.
  3. Time lag aware sequential recommendation. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 212–221.
  4. Autoformer: Searching transformers for visual recognition. In Proceedings of the IEEE/CVF international conference on computer vision. 12270–12280.
  5. Transformer-XL: Attentive Language Models beyond a Fixed-Length Context. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. 2978–2988.
  6. Automatic detection of clear-sky periods from irradiance data. IEEE Journal of Photovoltaics 9, 4 (2019), 998–1005.
  7. Metapath-guided heterogeneous graph neural network for intent recommendation. In Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining. 2478–2486.
  8. Personalizing search results using hierarchical RNN with query-aware attention. In Proceedings of the 27th ACM international conference on information and knowledge management. 347–356.
  9. A Large-Scale Rich Context Query and Recommendation Dataset in Online Knowledge-Sharing. arXiv preprint arXiv:2106.06467 (2021).
  10. Alan G Hawkes. 1971. Spectra of some self-exciting and mutually exciting point processes. Biometrika 58, 1 (1971), 83–90.
  11. A Concept Knowledge Graph for User Next Intent Prediction at Alipay. In Companion Proceedings of the ACM Web Conference 2023. 45–48.
  12. Query-Aware Sequential Recommendation. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 4019–4023.
  13. Dan Hendrycks and Kevin Gimpel. 2016. Gaussian error linear units (gelus). arXiv preprint arXiv:1606.08415 (2016).
  14. Session-based Recommendations with Recurrent Neural Networks. In Proc. of ICLR, Yoshua Bengio and Yann LeCun (Eds.).
  15. Wang-Cheng Kang and Julian McAuley. 2018. Self-attentive sequential recommendation. In 2018 IEEE international conference on data mining (ICDM). IEEE, 197–206.
  16. Bekir Karlik and A Vehbi Olgac. 2011. Performance analysis of various activation functions in generalized MLP architectures of neural networks. International Journal of Artificial Intelligence and Expert Systems 1, 4 (2011), 111–122.
  17. Sundong Kim and Jae-Gil Lee. 2018. Utilizing in-store sensors for revisit prediction. In 2018 IEEE International Conference on Data Mining (ICDM). IEEE, 217–226.
  18. Revisit Prediction by Deep Survival Analysis. In Advances in Knowledge Discovery and Data Mining: 24th Pacific-Asia Conference, PAKDD 2020, Singapore, May 11–14, 2020, Proceedings, Part II 24. Springer, 514–526.
  19. Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings, Yoshua Bengio and Yann LeCun (Eds.).
  20. Modeling long-and short-term temporal patterns with deep neural networks. In The 41st international ACM SIGIR conference on research & development in information retrieval. 95–104.
  21. NEON: Living Needs Prediction System in Meituan. In Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 5292–5302.
  22. Time interval aware self-attention for sequential recommendation. In Proceedings of the 13th international conference on web search and data mining. 322–330.
  23. Automatically Discovering User Consumption Intents in Meituan. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 3259–3269.
  24. An Effective Ensemble Framework with Multichannel Time Series for User Retention Prediction. ([n. d.]).
  25. Bryan Lim and Stefan Zohren. 2021. Time-series forecasting with deep learning: a survey. Philosophical Transactions of the Royal Society A 379, 2194 (2021), 20200209.
  26. An Empirical Study: Extensive Deep Temporal Point Process. arXiv preprint arXiv:2110.09823 (2021).
  27. Hongyuan Mei and Jason M Eisner. 2017. The neural hawkes process: A neurally self-modulating multivariate point process. Advances in neural information processing systems 30 (2017).
  28. Monte Carlo statistical methods. Vol. 2. Springer.
  29. Roformer: Enhanced transformer with rotary position embedding. arXiv preprint arXiv:2104.09864 (2021).
  30. BERT4Rec: Sequential recommendation with bidirectional encoder representations from transformer. In Proceedings of the 28th ACM international conference on information and knowledge management. 1441–1450.
  31. Attention is all you need. Advances in neural information processing systems 30 (2017).
  32. Neural news recommendation with heterogeneous user behavior. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 4874–4883.
  33. A Hybrid approach for Users Retention Rate Prediction. ([n. d.]).
  34. USER: A unified information search and recommendation model based on integrated behavior sequence. In Proceedings of the 30th ACM International Conference on Information & Knowledge Management. 2373–2382.
  35. Are transformers effective for time series forecasting?. In Proceedings of the AAAI conference on artificial intelligence, Vol. 37. 11121–11128.
  36. Efficiently leveraging multi-level user intent for session-based recommendation via atten-mixer network. In Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining. 168–176.
  37. Self-attentive Hawkes process. In International conference on machine learning. PMLR, 11183–11193.
  38. Qihang Zhao. 2022. RESETBERT4Rec: A pre-training model integrating time and user historical behavior for sequential recommendation. In Proceedings of the 45th international ACM SIGIR conference on research and development in information retrieval. 1812–1816.
  39. A revisiting study of appropriate offline evaluation for top-N recommendation algorithms. ACM Transactions on Information Systems 41, 2 (2022), 1–41.
  40. Deep interest evolution network for click-through rate prediction. In Proceedings of the AAAI conference on artificial intelligence, Vol. 33. 5941–5948.
  41. Deep interest network for click-through rate prediction. In Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining. 1059–1068.
  42. Transformer hawkes process. In International conference on machine learning. PMLR, 11692–11702.
Citations (1)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now