2000 character limit reached
Adverb Is the Key: Simple Text Data Augmentation with Adverb Deletion
Published 29 Mar 2024 in cs.CL and cs.AI | (2403.20015v1)
Abstract: In the field of text data augmentation, rule-based methods are widely adopted for real-world applications owing to their cost-efficiency. However, conventional rule-based approaches suffer from the possibility of losing the original semantics of the given text. We propose a novel text data augmentation strategy that avoids such phenomena through a straightforward deletion of adverbs, which play a subsidiary role in the sentence. Our comprehensive experiments demonstrate the efficiency and effectiveness of our proposed approach for not just single text classification, but also natural language inference that requires semantic preservation. We publicly released our source code for reproducibility.
- Do not have enough data? deep learning to the rescue! In Proceedings of the AAAI Conference on Artificial Intelligence, volume 34, pp. 7383–7390, 2020.
- Synthetic and natural noise both break neural machine translation. In International Conference on Learning Representations, 2018.
- Softeda: Rethinking rule-based data augmentation with soft labels. In ICLR 2023 Tiny Papers, 2023.
- The pascal recognising textual entailment challenge. In Machine learning challenges workshop, pp. 177–190, 2005.
- Denis Delfitto. Adverb classes and adverb placement. The Blackwell companion to syntax, pp. 83–120, 2006.
- Bert: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pp. 4171–4186, 2019.
- A survey of data augmentation approaches for nlp. In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pp. 968–988, 2021.
- spaCy: Industrial-strength Natural Language Processing in Python, 2020.
- AEDA: An easier data augmentation technique for text classification. In Findings of the Association for Computational Linguistics: EMNLP 2021, pp. 2748–2754, 2021.
- Adam: A method for stochastic optimization. In International Conference on Learning Representations, 2015.
- Datasets: A community library for natural language processing. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pp. 175–184, 2021.
- Learning question classifiers. In COLING 2002: The 19th International Conference on Computational Linguistics, pp. 1–7, 2002.
- Pcc: Paraphrasing with bottom-k sampling and cyclic learning for curriculum data augmentation. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, pp. 68–82, 2023.
- Adverbs, surprisingly. In Proceedings of the 12th Joint Conference on Lexical and Computational Semantics (*SEM 2023), pp. 512–526, 2023.
- Squad: 100,000+ questions for machine comprehension of text. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp. 2383–2392, 2016.
- Ordering adverbs by their scaling effect on adjective intensity. In Proceedings of the International Conference Recent Advances in Natural Language Processing, pp. 545–554, 2015.
- Improving neural machine translation models with monolingual data. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 86–96, 2016.
- Recursive deep models for semantic compositionality over a sentiment treebank. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, pp. 1631–1642, 2013.
- Glue: A multi-task benchmark and analysis platform for natural language understanding. In International Conference on Learning Representations, 2019.
- Neural network acceptability judgments. Transactions of the Association for Computational Linguistics, 7:625–641, 2019.
- EDA: Easy data augmentation techniques for boosting performance on text classification tasks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 6382–6388, 2019.
- Few-shot text classification with triplet networks, data augmentation, and curriculum learning. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 5493–5500, 2021.
- A broad-coverage challenge corpus for sentence understanding through inference. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), pp. 1112–1122, 2018.
- Transformers: State-of-the-art natural language processing. In Proceedings of the 2020 conference on empirical methods in natural language processing: system demonstrations, pp. 38–45, 2020.
- Conditional bert contextual augmentation. In ICCS 2019: 19th International Conference, pp. 84–95, 2019.
- Efficient contrastive learning via novel data augmentation and curriculum learning. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pp. 1832–1838, 2021.
- A good data augmentation policy is not all you need: A multi-task learning perspective. IEEE Transactions on Circuits and Systems for Video Technology, 2022.
- Character-level convolutional networks for text classification. In Advances in neural information processing systems, volume 28, 2015.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.
