2000 character limit reached
Argumentative Segmentation Enhancement for Legal Summarization (2307.05081v1)
Published 11 Jul 2023 in cs.CL
Abstract: We use the combination of argumentative zoning [1] and a legal argumentative scheme to create legal argumentative segments. Based on the argumentative segmentation, we propose a novel task of classifying argumentative segments of legal case decisions. GPT-3.5 is used to generate summaries based on argumentative segments. In terms of automatic evaluation metrics, our method generates higher quality argumentative summaries while leaving out less relevant context as compared to GPT-4 and non-GPT models.
- Towards domain-independent argumentative zoning: Evidence from chemistry and computational linguistics, in: Proceedings of the 2009 conference on empirical methods in natural language processing, 2009, pp. 1493–1502.
- Introduction to the special issue on summarization, Computational linguistics 28 (2002) 399–408.
- Automatic text summarization: A comprehensive survey, Expert systems with applications 165 (2021) 113679.
- Review of automatic text summarization techniques & methods, Journal of King Saud University-Computer and Information Sciences (2020).
- S. Gupta, S. K. Gupta, Abstractive summarization: An overview of the state of the art, Expert Systems with Applications 121 (2019) 49–65.
- Y. Zhong, D. Litman, Computing and exploiting document structure to improve unsupervised extractive summarization of legal case decisions, in: Proceedings of the Natural Legal Language Processing Workshop 2022, Association for Computational Linguistics, Abu Dhabi, United Arab Emirates (Hybrid), 2022, pp. 322–337. URL: https://aclanthology.org/2022.nllp-1.30.
- Discourse-aware unsupervised summarization for long scientific documents, in: Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, 2021, pp. 1089–1102.
- Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension, in: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020, pp. 7871–7880.
- Exploring the limits of transfer learning with a unified text-to-text transformer, Journal of Machine Learning Research 21 (2020) 1–67.
- Longformer: The long-document transformer, arXiv preprint arXiv:2004.05150 (2020).
- M. Elaraby, D. Litman, Arglegalsumm: Improving abstractive summarization of legal documents with argument mining, in: Proceedings of the 29th International Conference on Computational Linguistics, 2022, pp. 6187–6194.
- Training language models to follow instructions with human feedback, arXiv preprint arXiv:2203.02155 (2022).
- Corpora for the conceptualisation and zoning of scientific papers, in: Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC’10), 2010.
- Rhetorical move detection in english abstracts: Multi-label sentence classifiers and their annotated corpora, in: Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC’12), 2012, pp. 1604–1609.
- B. Hachey, C. Grover, Automatic legal text summarisation: experiments with summary structuring, in: Proceedings of the 10th International Conference on Artificial intelligence and Law, 2005, pp. 75–84.
- M.-F. Moens, C. Uyttendaele, Automatic text structuring and categorization as a first step in summarizing legal cases, Information Processing & Management 33 (1997) 727–737.
- A platform for argumentative zoning annotation and scientific summarization, in: Proceedings of the 31st ACM International Conference on Information & Knowledge Management, 2022, pp. 4843–4847.
- R. Mochales, M.-F. Moens, Study on the structure of argumentation in case law, in: Proceedings of the 2008 conference on legal knowledge and information systems, 2008, pp. 11–20.
- M. Saravanan, B. Ravindran, Identification of rhetorical roles for segmentation and summarization of a legal judgment, Artificial Intelligence and Law 18 (2010) 45–76.
- V. W. Feng, G. Hirst, Classifying arguments by scheme, in: Proceedings of the 49th annual meeting of the association for computational linguistics: Human language technologies, 2011, pp. 987–996.
- R. Mochales, M.-F. Moens, Argumentation mining, Artificial Intelligence and Law 19 (2011) 1–22.
- R. M. Palau, M.-F. Moens, Argumentation mining: the detection, classification and structure of arguments in text, in: Proceedings of the 12th international conference on artificial intelligence and law, 2009, pp. 98–107.
- Toward summarizing case decisions via extracting argument issues, reasons, and conclusions, in: Proceedings of the eighteenth international conference on artificial intelligence and law, 2021a, pp. 250–254.
- Accounting for sentence position and legal domain sentence embedding in learning to classify case sentences, in: Legal Knowledge and Information Systems, IOS Press, 2021b, pp. 33–42.
- N. Reimers, I. Gurevych, Sentence-bert: Sentence embeddings using siamese bert-networks, in: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), 2019, pp. 3982–3992.
- When does pretraining help? assessing self-supervised learning for law and the casehold dataset of 53,000+ legal holdings, in: Proceedings of the eighteenth international conference on artificial intelligence and law, 2021, pp. 159–168.
- W. Yin, Y. Pei, Optimizing sentence modeling and selection for document summarization, in: Twenty-fourth international joint conference on artificial intelligence, 2015.
- Single-document summarization as a tree knapsack problem, in: Proceedings of the 2013 conference on empirical methods in natural language processing, 2013, pp. 1515–1520.
- D. Miller, Leveraging bert for extractive text summarization on lectures, arXiv e-prints (2019) arXiv–1906.
- Get to the point: Summarization with pointer-generator networks, in: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2017, pp. 1073–1083.
- News summarization and evaluation in the era of gpt-3, arXiv preprint arXiv:2209.12356 (2022).
- Using argument mining for legal text summarization, in: Legal Knowledge and Information Systems, IOS Press, 2020, pp. 184–193.
- F. Y. Choi, Advances in domain independent linear text segmentation, in: 1st Meeting of the North American Chapter of the Association for Computational Linguistics, 2000.
- BERT: Pre-training of deep bidirectional transformers for language understanding, in: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Association for Computational Linguistics, Minneapolis, Minnesota, 2019, pp. 4171–4186. URL: https://aclanthology.org/N19-1423. doi:10.18653/v1/N19-1423.
- C.-Y. Lin, Rouge: A package for automatic evaluation of summaries, in: Text summarization branches out, 2004, pp. 74–81.
- Bleu: a method for automatic evaluation of machine translation, in: Proceedings of the 40th annual meeting of the Association for Computational Linguistics, 2002, pp. 311–318.
- S. Banerjee, A. Lavie, Meteor: An automatic metric for mt evaluation with improved correlation with human judgments, in: Proceedings of the acl workshop on intrinsic and extrinsic evaluation measures for machine translation and/or summarization, 2005, pp. 65–72.
- Bertscore: Evaluating text generation with bert, in: International Conference on Learning Representations, 2020. URL: https://openreview.net/forum?id=SkeHuCVFDr.
- Language models are few-shot learners, Advances in neural information processing systems 33 (2020) 1877–1901.