2000 character limit reached
Event Grounded Criminal Court View Generation with Cooperative (Large) Language Models (2404.07001v3)
Published 10 Apr 2024 in cs.CL and cs.AI
Abstract: With the development of legal intelligence, Criminal Court View Generation has attracted much attention as a crucial task of legal intelligence, which aims to generate concise and coherent texts that summarize case facts and provide explanations for verdicts. Existing researches explore the key information in case facts to yield the court views. Most of them employ a coarse-grained approach that partitions the facts into broad segments (e.g., verdict-related sentences) to make predictions. However, this approach fails to capture the complex details present in the case facts, such as various criminal elements and legal events. To this end, in this paper, we propose an Event Grounded Generation (EGG) method for criminal court view generation with cooperative (Large) LLMs, which introduces the fine-grained event information into the generation. Specifically, we first design a LLMs-based extraction method that can extract events in case facts without massive annotated events. Then, we incorporate the extracted events into court view generation by merging case facts and events. Besides, considering the computational burden posed by the use of LLMs in the extraction phase of EGG, we propose a LLMs-free EGG method that can eliminate the requirement for event extraction using LLMs in the inference phase. Extensive experimental results on a real-world dataset clearly validate the effectiveness of our proposed method.
- Neural machine translation by jointly learning to align and translate. Proceedings of International Conference on Learning Representations (ICLR) (2014).
- BaiChuan-Inc. 2023. A large-scale 7B pretraining language model developed by BaiChuan-Inc. https://github.com/baichuan-inc/Baichuan-7B.
- A Unified Generative Retriever for Knowledge-Intensive Language Tasks via Prompt Learning. In Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. 1448–1457.
- Learning phrase representations using RNN encoder-decoder for statistical machine translation. In Proceedings of the 2014 Conference on EMNLP.
- ChatLaw: Open-Source Legal Large Language Model with Integrated External Knowledge Bases. ArXiv (2023).
- Cjrc: A reliable human-annotated benchmark dataset for chinese judicial reading comprehension. In China National Conference on Chinese Computational Linguistics. Springer, 439–451.
- Legal Judgment Prediction via Event Extraction with Constraints. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Association for Computational Linguistics.
- HanFei-1.0. https://github.com/siat-nlp/HanFei.
- LoRA: Low-Rank Adaptation of Large Language Models. In International Conference on Learning Representations.
- Lawyer LLaMA Technical Report. ArXiv (2023).
- Generating Reasonable Legal Text through the Combination of Language Modeling and Question Answering. In Proceedings of the 29th International Joint Conference on Artificial Intelligence (IJCAI).
- Jacob Devlin Ming-Wei Chang Kenton and Lee Kristina Toutanova. 2019. Bert: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of naacL-HLT, Vol. 1. 2.
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.
- Apply Event Extraction Techniques to the Judicial Field. In Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers.
- Constructing Tree-based Index for Efficient and Effective Dense Retrieval. In Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. 131–140.
- Event Extraction for Criminal Legal Text. In 2020 IEEE International Conference on Knowledge Graph (ICKG).
- Chin-Yew Lin. 2004. ROUGE: A Package for Automatic Evaluation of Summaries. In Text Summarization Branches Out. Association for Computational Linguistics.
- ML-LJP: Multi-Law Aware Legal Judgment Prediction. In Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. 1023–1034.
- Ilya Loshchilov and Frank Hutter. 2019. Decoupled Weight Decay Regularization. In 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019. OpenReview.net.
- Learning to Predict Charges for Criminal Cases with Legal Basis. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP). 2727–2736.
- LeCaRD: a legal case retrieval dataset for Chinese law system. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval.
- Representation learning with contrastive predictive coding. arXiv preprint arXiv:1807.03748 (2018).
- OpenAI. 2023. Introducing ChatGPT. OpenAI Blogs (2023). https://openai.com/blog/chatgpt
- Bleu: a method for automatic evaluation of machine translation. In Proceedings of the 40th annual meeting of the Association for Computational Linguistics. 311–318.
- Know What You Don’t Know: Unanswerable Questions for SQuAD. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers).
- Get To The Point: Summarization with Pointer-Generator Networks. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics. (ACL).
- Investigating user behavior in legal case retrieval. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval.
- Hierarchical Chinese Legal event extraction via Pedal Attention Mechanism. In Proceedings of the 28th International Conference on Computational Linguistics.
- Stanford Alpaca: An Instruction-following LLaMA model. https://github.com/tatsu-lab/stanford_alpaca.
- LLaMA: Open and Efficient Foundation Language Models. arXiv preprint arXiv:2302.13971 (2023).
- Attention is all you need. Advances in neural information processing systems (2017).
- PanGu: Enhancing Language Model Architectures via Nonlinearity Compensation. arXiv preprint arXiv:2312.17276 (2023).
- De-Biased Court’s View Generation with Causality. In Proceedings of the 2020 Conference on EMNLP.
- Towards Interactivity and Interpretability: A Rationale-based Legal Judgment Prediction Framework. (2022), 4787–4799.
- LEVEN: A Large-Scale Chinese Legal Event Detection Dataset. In Findings of the Association for Computational Linguistics: ACL 2022.
- Interpretable charge predictions for criminal cases: Learning to generate court views from fact descriptions. Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics(NAACL) (2018).
- Fedjudge: Federated legal large language model. arXiv preprint arXiv:2309.08173 (2023).
- NeurJudge: A Circumstance-aware Neural Framework for Legal Judgment Prediction. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval.
- Circumstances enhanced criminal court view generation. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 1855–1859.
- Disc-lawllm: Fine-tuning large language models for intelligent legal services. arXiv preprint arXiv:2309.11325 (2023).
- Contrastive Learning for Legal Judgment Prediction. ACM Transactions on Information Systems 41, 4 (2023), 1–25.
- Legal Judgment Prediction via Topological Learning. In Proceedings of the 2018 Conference on EMNLP.
- Iteratively questioning and answering for interpretable legal judgment prediction. In Proceedings of the 34th AAAI Conference on Artificial Intelligence, Vol. 34. 1250–1257.