2000 character limit reached
A Trio Neural Model for Dynamic Entity Relatedness Ranking (1808.08316v4)
Published 24 Aug 2018 in cs.IR, cs.CL, cs.LG, and stat.ML
Abstract: Measuring entity relatedness is a fundamental task for many natural language processing and information retrieval applications. Prior work often studies entity relatedness in static settings and an unsupervised manner. However, entities in real-world are often involved in many different relationships, consequently entity-relations are very dynamic over time. In this work, we propose a neural networkbased approach for dynamic entity relatedness, leveraging the collective attention as supervision. Our model is capable of learning rich and different entity representations in a joint framework. Through extensive experiments on large-scale datasets, we demonstrate that our method achieves better results than competitive baselines.
- Nitish Aggarwal and Paul Buitelaar. 2014. Wikipedia-based distributional semantics for entity relatedness. In 2014 AAAI Fall Symposium Series.
- Entity recommendations in web search. In ISWC, pages 33–48. Springer.
- Learning relatedness measures for entity linking. In Proceedings of the 22nd ACM international conference on Information & Knowledge Management, pages 139–148. ACM.
- Label ranking with partial abstention based on thresholded probabilistic models. In F. Pereira, C. J. C. Burges, L. Bottou, and K. Q. Weinberger, editors, Advances in Neural Information Processing Systems 25, pages 2501–2509. Curran Associates, Inc.
- Learning a similarity metric discriminatively, with application to face verification. In Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, volume 1, pages 539–546. IEEE.
- Document embedding with paragraph vectors. arXiv preprint arXiv:1507.07998.
- Extracting semantics from random walks on wikipedia: Comparing learning and counting methods.
- Evgeniy Gabrilovich and Shaul Markovitch. 2007. Computing semantic relatedness using wikipedia-based explicit semantic analysis. In Proceedings of the 20th International Joint Conference on Artifical Intelligence, IJCAI’07, pages 1606–1611, San Francisco, CA, USA. Morgan Kaufmann Publishers Inc.
- Evgeniy Gabrilovich and Shaul Markovitch. 2009. Wikipedia-based semantic interpretation for natural language processing. Journal of Artificial Intelligence Research, 34:443–498.
- Xavier Glorot and Yoshua Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In Proceedings of the thirteenth international conference on artificial intelligence and statistics, pages 249–256.
- A deep relevance matching model for ad-hoc retrieval. In Proceedings of the 25th ACM International on Conference on Information and Knowledge Management, pages 55–64. ACM.
- Zhaochen Guo and Denilson Barbosa. 2014. Robust entity linking via random walks. In Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management, pages 499–508. ACM.
- Kore: keyphrase overlap relatedness for entity disambiguation. In Proceedings of the 21st ACM international conference on Information and knowledge management, pages 545–554. ACM.
- Entity hierarchy embedding. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), volume 1, pages 1292–1300.
- Learning deep structured semantic models for web search using clickthrough data. In Proceedings of the 22nd ACM international conference on Conference on information & knowledge management, pages 2333–2338. ACM.
- Sergey Ioffe and Christian Szegedy. 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In International Conference on Machine Learning, pages 448–456.
- Towards time-aware knowledge graph completion. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pages 1715–1724.
- Learning to rank related entities in web search. Neurocomputing, 166:309–318.
- What triggers human remembering of events? a large-scale analysis of catalysts for collective memory in wikipedia. In Digital Libraries (JCDL), 2014 IEEE/ACM Joint Conference on, pages 341–350. IEEE.
- Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980.
- Quoc Le and Tomas Mikolov. 2014. Distributed representations of sentences and documents. In International Conference on Machine Learning, pages 1188–1196.
- Hybrid neural networks for learning the trend in time series.
- Zhengdong Lu and Hang Li. 2013. A deep architecture for matching short texts. In Advances in Neural Information Processing Systems, pages 1367–1375.
- Effective approaches to attention-based neural machine translation. arXiv preprint arXiv:1508.04025.
- Distributed representations of words and phrases and their compositionality. In Advances in neural information processing systems, pages 3111–3119.
- From selena gomez to marlon brando: Understanding explorative entity search. In Proceedings of the 24th International Conference on World Wide Web, pages 765–775. International World Wide Web Conferences Steering Committee.
- Entity linking meets word sense disambiguation: a unified approach. Transactions of the Association for Computational Linguistics, 2:231–244.
- Multiple models for recommending temporal aspects of entities. In The Semantic Web - 15th International Conference, ESWC 2018, Heraklion, Crete, Greece, June 3-7, 2018, Proceedings, pages 462–480.
- Semantic documents relatedness using concept graph representation. In Proceedings of the Ninth ACM International Conference on Web Search and Data Mining, WSDM ’16, pages 635–644, New York, NY, USA. ACM.
- Francisco Javier Ordóñez and Daniel Roggen. 2016. Deep convolutional and lstm recurrent neural networks for multimodal wearable activity recognition. Sensors, 16(1):115.
- Deepwalk: Online learning of social representations. In Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 701–710. ACM.
- A two-stage framework for computing entity relatedness in wikipedia. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, CIKM ’17, pages 1867–1876, New York, NY, USA. ACM.
- Beyond time: Dynamic context-aware entity recommendation. In European Semantic Web Conference, pages 353–368. Springer.
- Attention is all you need. In Advances in Neural Information Processing Systems, pages 5998–6008.
- Ian H Witten and David N Milne. 2008. An effective, low-cost measure of semantic relatedness obtained from wikipedia links.
- Abcnn: Attention-based convolutional neural network for modeling sentence pairs. Transactions of the Association of Computational Linguistics, 4(1):259–272.
- On building entity recommender systems using user click log and freebase knowledge. In Proceedings of WSDM, pages 263–272. ACM.
- Collaborative knowledge base embedding for recommender systems. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pages 353–362. ACM.
- A probabilistic model for time-aware entity recommendation. In International Semantic Web Conference, pages 598–614. Springer.
- Representation learning for measuring entity relatedness with rich information. In Twenty-Fourth International Joint Conference on Artificial Intelligence.
- Time series classification using multi-channels deep convolutional neural networks. In International Conference on Web-Age Information Management, pages 298–310. Springer.