FaiMA: Feature-aware In-context Learning for Multi-domain Aspect-based Sentiment Analysis (2403.01063v1)
Abstract: Multi-domain aspect-based sentiment analysis (ABSA) seeks to capture fine-grained sentiment across diverse domains. While existing research narrowly focuses on single-domain applications constrained by methodological limitations and data scarcity, the reality is that sentiment naturally traverses multiple domains. Although LLMs offer a promising solution for ABSA, it is difficult to integrate effectively with established techniques, including graph-based models and linguistics, because modifying their internal architecture is not easy. To alleviate this problem, we propose a novel framework, Feature-aware In-context Learning for Multi-domain ABSA (FaiMA). The core insight of FaiMA is to utilize in-context learning (ICL) as a feature-aware mechanism that facilitates adaptive learning in multi-domain ABSA tasks. Specifically, we employ a multi-head graph attention network as a text encoder optimized by heuristic rules for linguistic, domain, and sentiment features. Through contrastive learning, we optimize sentence representations by focusing on these diverse features. Additionally, we construct an efficient indexing mechanism, allowing FaiMA to stably retrieve highly relevant examples across multiple dimensions for any given input. To evaluate the efficacy of FaiMA, we build the first multi-domain ABSA benchmark dataset. Extensive experimental results demonstrate that FaiMA achieves significant performance improvements in multiple domains compared to baselines, increasing F1 by 2.07% on average. Source code and data sets are anonymously available at https://github.com/SupritYoung/FaiMA.
- Enhanced multi-channel graph convolutional network for aspect sentiment triplet extraction. In Annual Meeting of the Association for Computational Linguistics.
- Semantic and syntactic enhanced aspect sentiment triplet extraction. In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pages 1474–1483.
- Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805.
- Can ai language models replace human participants? Trends in Cognitive Sciences.
- Reasoning implicit sentiment with chain-of-thought prompting. In Annual Meeting of the Association for Computational Linguistics.
- Unified feature and instance based domain adaptation for end-to-end aspect-based sentiment analysis. In Conference on Empirical Methods in Natural Language Processing.
- Lora: Low-rank adaptation of large language models.
- Open-domain targeted sentiment analysis via span-based extraction and classification. arXiv preprint arXiv:1906.03820.
- A unified labeling model for open-domain aspect-based sentiment analysis. 2020 IEEE Fifth International Conference on Data Science in Cyberspace (DSC), pages 186–189.
- Think and retrieval: A hypothesis knowledge graph enhanced medical large language models. arXiv preprint arXiv:2312.15883.
- Cross-domain end-to-end aspect-based sentiment analysis with domain-dependent embeddings. Complex, 2021:5529312:1–5529312:11.
- Billion-scale similarity search with gpus. IEEE Transactions on Big Data, 7(3):535–547.
- Mining spatio-temporal relations via self-paced graph contrastive learning. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pages 936–944.
- Bisyn-gat+: Bi-syntax aware graph attention network for aspect-based sentiment analysis. In Findings of the Association for Computational Linguistics: ACL 2022, pages 799–810.
- What makes good in-context examples for GPT-3? In Proceedings of Deep Learning Inside Out (DeeLIO 2022): The 3rd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures, pages 100–114, Dublin, Ireland and Online. Association for Computational Linguistics.
- Ilya Loshchilov and Frank Hutter. 2017. Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101.
- Kuaiji: the first chinese accounting large language model. arXiv preprint arXiv:2402.13866.
- Timeseries suppliers allocation risk optimization via deep black litterman model. arXiv preprint arXiv:2401.17350.
- Challenges for open-domain targeted sentiment analysis. arXiv preprint arXiv:2204.06893.
- Augmented large language models with parametric knowledge guiding. arXiv preprint arXiv:2305.04757.
- Rethinking the role of demonstrations: What makes in-context learning work? arXiv preprint arXiv:2202.12837.
- Issues and challenges of aspect-based sentiment analysis: A comprehensive survey. IEEE Transactions on Affective Computing, 13(2):845–863.
- Opinion mining and sentiment analysis. Foundations and Trends® in information retrieval, 2(1–2):1–135.
- Exploring the limits of transfer learning with a unified text-to-text transformer. The Journal of Machine Learning Research, 21(1):5485–5551.
- Multi-source multi-domain sentiment analysis with bert-based models. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 581–589.
- Learning to retrieve prompts for in-context learning. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 2655–2671.
- Instructabsa: Instruction learning for aspect based sentiment analysis. arXiv preprint arXiv:2302.08624.
- Kim Schouten and Flavius Frasincar. 2016. Survey on aspect-level sentiment analysis. IEEE Transactions on Knowledge and Data Engineering, page 813–830.
- Syntax-enhanced aspect-based sentiment analysis with multi-layer attention. Neurocomputing, 557:126730.
- Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971.
- Llama 2: Open foundation and fine-tuned chat models. arXiv preprint arXiv:2307.09288.
- Instruction tuning for few-shot aspect-based sentiment analysis. In Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis.
- Relational graph attention network for aspect-based sentiment analysis. In Annual Meeting of the Association for Computational Linguistics.
- Aspect-based sentiment analysis with dependency relation graph convolutional network. 2022 International Conference on Asian Language Processing (IALP), pages 63–68.
- Is chatgpt a good sentiment analyzer? a preliminary study. arXiv preprint arXiv:2304.04339.
- Chain-of-thought prompting elicits reasoning in large language models. Advances in Neural Information Processing Systems, 35:24824–24837.
- Learn from syntax: Improving pair-wise aspect and opinion terms extractionwith rich syntactic knowledge. In International Joint Conference on Artificial Intelligence.
- Grid tagging scheme for aspect-oriented fine-grained opinion extraction. arXiv preprint arXiv:2010.04640.
- Improving aspect sentiment triplet extraction with perturbed masking and edge-enhanced sentiment graph attention network. In 2023 International Joint Conference on Neural Networks (IJCNN), pages 1–8. IEEE.
- Zhongjing: Enhancing the chinese medical capabilities of large language model through expert feedback and real-world multi-turn dialogue. arXiv preprint arXiv:2308.03549.
- In-context instruction learning. arXiv preprint arXiv:2302.14691.
- Syntax-aware aspect-level sentiment classification with proximity-weighted convolution network. Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval.
- Lei Zhang and Bing Liu. 2012. Sentiment analysis and opinion mining. In Encyclopedia of Machine Learning and Data Mining.
- Infinite-horizon graph filters: Leveraging power series to enhance sparse information aggregation. arXiv preprint arXiv:2401.09943.
- Aspect sentiment quad prediction as paraphrase generation. arXiv preprint arXiv:2110.00796.
- Sentiment analysis in the era of large language models: A reality check. arXiv preprint arXiv:2305.15005.
- A survey on aspect-based sentiment analysis: Tasks, methods, and challenges. IEEE Transactions on Knowledge and Data Engineering.
- Active example selection for in-context learning. arXiv preprint arXiv:2211.04486.
- Ssegcn: Syntactic and semantic enhanced graph convolutional network for aspect-based sentiment analysis. In North American Chapter of the Association for Computational Linguistics.
- A survey of large language models. arXiv preprint arXiv:2303.18223.
- Knowledge graph augmented network towards multiview representation learning for aspect-based sentiment analysis. IEEE Transactions on Knowledge and Data Engineering, page 1–14.
- Adaptive recursive neural network for target-dependent twitter sentiment classification. In Proceedings of the 52nd annual meeting of the association for computational linguistics (volume 2: Short papers), pages 49–54.
- Minqing Hu and Bing Liu. 2004. Mining and summarizing customer reviews. In Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, pages 168–177.
- SemEval-2014 task 4: Aspect based sentiment analysis. In Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), pages 27–35, Dublin, Ireland. Association for Computational Linguistics.
- Sentfin 1.0: Entity-aware sentiment analysis for financial news. Journal of the Association for Information Science and Technology, 73(9):1314–1335.
- Sentence and expression level annotation of opinions in user-generated discourse. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pages 575–584.
- Songhua Yang (6 papers)
- Xinke Jiang (16 papers)
- Hanjie Zhao (8 papers)
- Wenxuan Zeng (11 papers)
- Hongde Liu (9 papers)
- Yuxiang Jia (11 papers)