Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
97 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
44 tokens/sec
o3 Pro
5 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Automatic Debate Evaluation with Argumentation Semantics and Natural Language Argument Graph Networks (2203.14647v2)

Published 28 Mar 2022 in cs.CL

Abstract: The lack of annotated data on professional argumentation and complete argumentative debates has led to the oversimplification and the inability of approaching more complex natural language processing tasks. Such is the case of the automatic debate evaluation. In this paper, we propose an original hybrid method to automatically evaluate argumentative debates. For that purpose, we combine concepts from argumentation theory such as argumentation frameworks and semantics, with Transformer-based architectures and neural graph networks. Furthermore, we obtain promising results that lay the basis on an unexplored new instance of the automatic analysis of natural language arguments.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (40)
  1. Exploiting personal characteristics of debaters for predicting persuasiveness. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 7067–7072, Online. Association for Computational Linguistics.
  2. Argumentation frameworks with strong and weak constraints: Semantics and complexity. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, pages 6175–6184.
  3. Towards artificial argumentation. AI magazine, 38(3):25–36.
  4. A neural transition-based model for argumentation mining. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 6354–6364, Online. Association for Computational Linguistics.
  5. From arguments to key points: Towards automatic argument summarization. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 4029–4039, Online. Association for Computational Linguistics.
  6. Relational inductive biases, deep learning, and graph networks. arXiv preprint arXiv:1806.01261.
  7. Longformer: The long-document transformer. arXiv preprint arXiv:2004.05150.
  8. Martin Caminada. 2006. On the issue of reinstatement in argumentation. In European Workshop on Logics in Artificial Intelligence, pages 111–123. Springer.
  9. Towards an argument interchange format. The knowledge engineering review, 21(4):293–316.
  10. Dennis Craandijk and Floris Bex. 2021. Deep learning for abstract argumentation semantics. In Proceedings of the Twenty-Ninth International Conference on International Joint Conferences on Artificial Intelligence, pages 1667–1673.
  11. Phan Minh Dung. 1995. On the acceptability of arguments and its fundamental role in nonmonotonic reasoning, logic programming and n-person games. Artificial Intelligence, 77(2):321–357.
  12. Esin Durmus and Claire Cardie. 2019. A corpus for modeling user and language effects in argumentation on online debating. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 602–607, Florence, Italy. Association for Computational Linguistics.
  13. Analyzing the Persuasive Effect of Style in News Editorial Argumentation. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 3154–3160, Online. Association for Computational Linguistics.
  14. Are you convinced? choosing the more convincing evidence with a Siamese network. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 967–976, Florence, Italy. Association for Computational Linguistics.
  15. Disputool 2.0: A modular architecture for multi-layer argumentative analysis of political debates. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 37, pages 16431–16433.
  16. Exploring network structure, dynamics, and function using networkx. Technical report, Los Alamos National Lab.(LANL), Los Alamos, NM (United States).
  17. Qt30: A corpus of argument and conflict in broadcast debate. In Proceedings of the 13th Language Resources and Evaluation Conference, pages 3291–3300. European Language Resources Association (ELRA).
  18. Modeling inter round attack of online debaters for winner prediction. In Proceedings of the ACM Web Conference 2022, pages 2860–2869.
  19. A cascade model for proposition extraction in argumentation. In Proceedings of the 6th Workshop on Argument Mining, pages 11–24, Florence, Italy. Association for Computational Linguistics.
  20. Isabelle Kuhlmann and Matthias Thimm. 2019. Using graph convolutional networks for approximate reasoning with abstract argumentation frameworks: A feasibility study. In International Conference on Scalable Uncertainty Management, pages 24–37. Springer.
  21. John Lawrence and Chris Reed. 2019. Argument mining: A survey. Computational Linguistics, 45(4):765–818.
  22. Towards an argument mining pipeline transforming texts to argument graphs. Computational Models of Argument: Proceedings of COMMA 2020, 326:263.
  23. Semantic textual similarity measures for case-based retrieval of argument graphs. In Case-Based Reasoning Research and Development: 27th International Conference, ICCBR 2019, Otzenhausen, Germany, September 8–12, 2019, Proceedings 27, pages 219–234. Springer.
  24. Determining the acceptability of abstract arguments with graph convolutional networks. In SAFA@ COMMA, pages 47–56.
  25. Graph embeddings for argumentation quality assessment. In Findings of the Association for Computational Linguistics: EMNLP 2022, pages 4154–4164, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
  26. Wes McKinney et al. 2010. Data structures for statistical computing in python. In Proceedings of the 9th Python in Science Conference, volume 445, pages 51–56. Austin, TX.
  27. Combining argumentation structure and language model for generating natural argumentative dialogue. In Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing, pages 65–71.
  28. A dataset of general-purpose rebuttal. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 5591–5601, Hong Kong, China. Association for Computational Linguistics.
  29. Andreas Peldszus and Manfred Stede. 2013. From argument diagrams to argumentation mining in texts: A survey. International Journal of Cognitive Informatics and Natural Intelligence (IJCINI), 7(1):1–31.
  30. Peter Potash and Anna Rumshisky. 2017. Towards debate automation: a recurrent model for predicting debate winners. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 2465–2475, Copenhagen, Denmark. Association for Computational Linguistics.
  31. Nils Reimers and Iryna Gurevych. 2019. Sentence-BERT: Sentence embeddings using Siamese BERT-networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 3982–3992, Hong Kong, China. Association for Computational Linguistics.
  32. Nils Reimers and Iryna Gurevych. 2020. Making monolingual sentence embeddings multilingual using knowledge distillation. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics.
  33. Allen Roush and Arvind Balaji. 2020. DebateSum: A large-scale argument mining and summarization dataset. In Proceedings of the 7th Workshop on Argument Mining, pages 1–7, Online. Association for Computational Linguistics.
  34. Transformer-based models for automatic identification of argument relations: A cross-domain evaluation. IEEE Intelligent Systems, 36(6):62–70.
  35. Vivesdebate: A new annotated multilingual corpus of argumentation in a debate tournament. Applied Sciences, 11(15):7160.
  36. Graph-based argument quality assessment. In Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2021), pages 1268–1280, Held Online. INCOMA Ltd.
  37. Debate outcome prediction using automatic persuasiveness evaluation and counterargument relations. In LaCATODA/BtG@ IJCAI, pages 24–29.
  38. Bart Verheij. 2005. Evaluating arguments based on toulmin’s scheme. Argumentation, 19(3):347–371.
  39. Argumentation in the 2016 us presidential elections: annotated corpora of television debates and social media reaction. Language Resources and Evaluation, 54(1):123–154.
  40. Computational argumentation quality assessment in natural language. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers, pages 176–187, Valencia, Spain. Association for Computational Linguistics.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (3)
  1. Ramon Ruiz-Dolz (7 papers)
  2. Stella Heras (3 papers)
  3. Ana García-Fornes (7 papers)
Citations (7)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets