A semantically enhanced dual encoder for aspect sentiment triplet extraction (2306.08373v1)
Abstract: Aspect sentiment triplet extraction (ASTE) is a crucial subtask of aspect-based sentiment analysis (ABSA) that aims to comprehensively identify sentiment triplets. Previous research has focused on enhancing ASTE through innovative table-filling strategies. However, these approaches often overlook the multi-perspective nature of language expressions, resulting in a loss of valuable interaction information between aspects and opinions. To address this limitation, we propose a framework that leverages both a basic encoder, primarily based on BERT, and a particular encoder comprising a Bi-LSTM network and graph convolutional network (GCN ). The basic encoder captures the surface-level semantics of linguistic expressions, while the particular encoder extracts deeper semantics, including syntactic and lexical information. By modeling the dependency tree of comments and considering the part-of-speech and positional information of words, we aim to capture semantics that are more relevant to the underlying intentions of the sentences. An interaction strategy combines the semantics learned by the two encoders, enabling the fusion of multiple perspectives and facilitating a more comprehensive understanding of aspect--opinion relationships. Experiments conducted on benchmark datasets demonstrate the state-of-the-art performance of our proposed framework.
- Knowing what, how and why: A near complete solution for aspect-based sentiment analysis, in: The Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI), AAAI Press, New York, NY, USA, 2020, pp. 8600–8607. doi:10.1609/aaai.v34i05.6383.
- Semeval-2014 task 4: Aspect based sentiment analysis, in: Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval@COLING), ACL, Dublin, Ireland, 2014, pp. 27–35. doi:10.3115/v1/s14-2004.
- An interactive multi-task learning network for end-to-end aspect-based sentiment analysis, in: Proceedings of the 57th Conference of the Association for Computational Linguistics (ACL), ACL, Florence, Italy, 2019, pp. 504–515. doi:10.18653/v1/p19-1048.
- Latent opinions transfer network for target-oriented opinion words extraction, in: The Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI), The Thirty-Second Innovative Applications of Artificial Intelligence Conference (IAAI), The Tenth AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI), AAAI Press, New York, NY, USA, 2020, pp. 9298–9305. doi:10.1609/aaai.v34i05.6469.
- Exploring sequence-to-sequence learning in aspect term extraction, in: Proceedings of the 57th Conference of the Association for Computational Linguistics (ACL), ACL, Florence, Italy, 2019, pp. 3538–3547. doi:10.18653/v1/p19-1344.
- Graph convolutional networks for target-oriented opinion words extraction with adversarial training, in: 2020 International Joint Conference on Neural Networks (IJCNN), IEEE, Glasgow, United Kingdom, 2020, pp. 1–7. doi:10.1109/IJCNN48605.2020.9207463.
- Spanmtl: a span-based multi-table labeling for aspect-oriented fine-grained opinion extraction, Soft Computing 27 (2023) 4627–4637. doi:10.1007/s00500-022-07721-5.
- Gated relational encoder-decoder model for target-oriented opinion word extraction, IEEE Access 10 (2022) 130507–130517. doi:10.1109/ACCESS.2022.3228835.
- Pair-wise aspect and opinion terms extraction as graph parsing via a novel mutually-aware interaction mechanism, Neurocomputing 493 (2022) 268–280. doi:10.1016/j.neucom.2022.04.064.
- Synchronously tracking entities and relations in a syntax-aware parallel architecture for aspect-opinion pair extraction, Applied Intelligence 52 (2022) 15210–15225. doi:10.1007/s10489-022-03286-w.
- Aspect-level sentiment classification via location enhanced aspect-merged graph convolutional networks, J. Supercomput. 79 (2023) 9666–9691. doi:10.1007/s11227-022-05002-4.
- Attention-enabled gated spiking neural p model for aspect-level sentiment classification, Neural Networks 157 (2023) 437–443. doi:10.1016/j.neunet.2022.11.006.
- Detecting dependency-related sentiment features for aspect-level sentiment classification, IEEE Transactions on Affective Computing 14 (2023) 196–210. doi:10.1109/TAFFC.2021.3063259.
- Position-aware tagging for aspect sentiment triplet extraction, in: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), ACL, Onlien, 2020, pp. 2339–2349. doi:10.18653/v1/2020.emnlp-main.183.
- Learning span-level interactions for aspect sentiment triplet extraction, in: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics (ACL), The 11th International Joint Conference on Natural Language Processing (IJCNLP), ACL, Online, 2021, pp. 4755–4766. doi:10.18653/v1/2021.acl-long.367.
- Grid tagging scheme for aspect-oriented fine-grained opinion extraction, in: Findings of the Association for Computational Linguistics (EMNLP), ACL, Online, 2020, pp. 2576–2585. doi:10.18653/v1/2020.findings-emnlp.234.
- Enhanced multi-channel graph convolutional network for aspect sentiment triplet extraction, in: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (ACL), ACL, Dublin, Ireland, 2022, pp. 2974–2985. doi:10.18653/v1/2022.acl-long.212.
- A joint training dual-mrc framework for aspect based sentiment analysis, in: Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI), AAAI Press, Online, 2021, pp. 13543–13551. doi:10.1609/aaai.v35i15.17597.
- Seeking common but distinguishing difference, A joint aspect-based sentiment analysis model, in: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP), ACL, Punta Cana, Dominican Republic, 2021, pp. 3910–3922. doi:10.18653/v1/2021.emnlp-main.318.
- Boundary-driven table-filling for aspect sentiment triplet extraction, in: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP), ACL, Abu Dhabi, United Arab Emirates, 2022, pp. 6485–6498. URL: https://aclanthology.org/2022.emnlp-main.435.
- Dependency graph enhanced interactive attention network for aspect sentiment triplet extraction, Neurocomputing 507 (2022) 315–324. doi:10.1016/j.neucom.2022.07.067.
- Interactive pos-aware network for aspect-level sentiment classification, Neurocomputing 420 (2021) 181–196. doi:10.1016/j.neucom.2020.08.013.
- S. Hochreiter, J. Schmidhuber, Long short-term memory, Neural Computation 9 (1997) 1735–1780. doi:10.1162/neco.1997.9.8.1735.
- BERT: pre-training of deep bidirectional transformers for language understanding, in: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), ACL, Minneapolis, MN, USA, 2019, pp. 4171–4186. doi:10.18653/v1/n19-1423.
- T. N. Kipf, M. Welling, Semi-supervised classification with graph convolutional networks, in: 5th International Conference on Learning Representations (ICLR), OpenReview.net, Toulon, France, 2017, pp. 1–14. doi:10.48550/arXiv.1609.02907.
- Double embedding and bidirectional sentiment dependence detector for aspect sentiment triplet extraction, Knowledge-Based Systems 253 (2022) 109506. doi:10.1016/j.knosys.2022.109506.
- D. Hendrycks, K. Gimpel, Gaussian error linear units (gelus), arXiv e-prints (2016) arXiv–1606. doi:10.48550/arXiv.1606.08415.
- Deep residual learning for image recognition, in: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE Computer Society, Las Vegas, NV, USA, 2016, pp. 770–778. doi:10.1109/CVPR.2016.90.
- Semeval-2015 task 12: Aspect based sentiment analysis, in: Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval@NAACL-HLT), ACL, Denver, Colorado, USA, 2015, pp. 486–495. doi:10.18653/v1/s15-2082.
- Semeval-2016 task 5: Aspect based sentiment analysis, in: Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval@NAACL-HLT), ACL, San Diego, CA, USA, 2016, pp. 19–30. doi:10.18653/v1/s16-1002.
- Target-oriented opinion words extraction with target-fused neural sequence labeling, in: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), ACL, Minneapolis, MN, USA, 2019, pp. 2509–2518. doi:10.18653/v1/n19-1259.
- Glove: Global vectors for word representation, in: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), ACL, Doha, Qatar, 2014, pp. 1532–1543. doi:10.3115/v1/d14-1162.
- Towards bootstrapping a polarity shifter lexicon using linguistic features, in: Proceedings of the Eighth International Joint Conference on Natural Language Processing (IJCNLP), Asian Federation of Natural Language Processing, Taipei, Taiwan, 2017, pp. 624–633. URL: https://aclanthology.org/I17-1063/.
- H. Dai, Y. Song, Neural aspect and opinion term extraction with mined rules as weak supervision, in: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (ACL), ACL, Florence, Italy, 2019, pp. 5268–5277. doi:10.18653/v1/p19-1520.
- Bidirectional machine reading comprehension for aspect sentiment triplet extraction, in: Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI), Thirty-Third Conference on Innovative Applications of Artificial Intelligence (IAAI), The Eleventh Symposium on Educational Advances in Artificial Intelligence (EAAI), AAAI Press, Online, 2021, pp. 12666–12674. doi:10.1609/aaai.v35i14.17500.
- Span-based dual-decoder framework for aspect sentiment triplet extraction, Neurocomputing 492 (2022) 211–221. doi:10.1016/j.neucom.2022.04.022.