2000 character limit reached
Antonym vs Synonym Distinction using InterlaCed Encoder NETworks (ICE-NET) (2401.10045v1)
Published 18 Jan 2024 in cs.CL
Abstract: Antonyms vs synonyms distinction is a core challenge in lexico-semantic analysis and automated lexical resource construction. These pairs share a similar distributional context which makes it harder to distinguish them. Leading research in this regard attempts to capture the properties of the relation pairs, i.e., symmetry, transitivity, and trans-transitivity. However, the inability of existing research to appropriately model the relation-specific properties limits their end performance. In this paper, we propose InterlaCed Encoder NETworks (i.e., ICE-NET) for antonym vs synonym distinction, that aim to capture and model the relation-specific properties of the antonyms and synonyms pairs in order to perform the classification task in a performance-enhanced manner. Experimental evaluation using the benchmark datasets shows that ICE-NET outperforms the existing research by a relative score of upto 1.8% in F1-measure. We release the codes for ICE-NET at https://github.com/asif6827/ICENET.
- Heike Adel and Hinrich Schütze. 2014. Using mined coreference chains as a resource for a semantic task. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pages 1447–1452.
- Gari: Graph attention for relative isomorphism of arabic word embeddings. In Proceedings of ArabicNLP 2023, pages 181–190.
- Gri: Graph-based relative isomorphism of word embedding spaces. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 11304–11313.
- Fine-grained named entity typing over distantly supervised data based on refined representations. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 34, pages 7391–7398.
- Fine-grained named entity typing over distantly supervised data via refinement in hyperbolic space. arXiv preprint arXiv:2101.11212.
- Antonym-synonym classification based on new sub-space embeddings. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 33, pages 6204–6211.
- Marco Baroni and Sabrina Bisi. 2004. Using cooccurrence statistics and the web to discover synonyms in a technical language. In LREC.
- Translating embeddings for modeling multi-relational data. Advances in neural information processing systems, 26.
- Mathias Etcheverry and Dina Wonsever. 2019. Unraveling antonym’s word vectors through a siamese-like network. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 3297–3307.
- Yoav Goldberg and Omer Levy. 2014. word2vec explained: deriving mikolov et al.’s negative-sampling word-embedding method. arXiv preprint arXiv:1402.3722.
- Learning word vectors for 157 languages. In Proceedings of the International Conference on Language Resources and Evaluation (LREC 2018).
- Zellig S Harris. 1954. Distributional structure. Word, 10(2-3):146–162.
- Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980.
- Thomas N Kipf and Max Welling. 2016. Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907.
- Identifying synonyms among distributionally similar words. In IJCAI, volume 3, pages 1492–1493.
- Defining antonymy: A corpus-based study of opposites by lexico-syntactic patterns. International Journal of Lexicography, 23(1):19–53.
- Integrating distributional lexical contrast into word embeddings for antonym-synonym distinction. arXiv preprint arXiv:1605.07766.
- Distinguishing antonyms and synonyms in a pattern-based neural network. arXiv preprint arXiv:1701.02962.
- Word embedding-based antonym detection using thesauri and distributional information. In Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 984–989.
- Glove: Global vectors for word representation. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pages 1532–1543.
- Michael Roth and Sabine Schulte Im Walde. 2014. Combining word patterns and discourse markers for paradigmatic relation classification. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 524–530.
- Modeling relational data with graph convolutional networks. In The Semantic Web: 15th International Conference, ESWC 2018, Heraklion, Crete, Greece, June 3–7, 2018, Proceedings 15, pages 593–607. Springer.
- Symmetric pattern based word embeddings for improved word similarity prediction. In CoNLL, volume 2015, pages 258–267.
- Improving hypernymy detection with an integrated path-based and distributional method. arXiv preprint arXiv:1603.06076.
- Lonneke Van der Plas and Jörg Tiedemann. 2006. Finding synonyms using automatic word alignment and measures of distributional similarity. In Proceedings of the COLING/ACL 2006 Main Conference Poster Sessions, pages 866–873.
- Zhipeng Xie and Nan Zeng. 2021. A mixture-of-experts model for antonym-synonym discrimination. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers), pages 558–564.
- Embedding entities and relations for learning and inference in knowledge bases. arXiv preprint arXiv:1412.6575.