Interpretation modeling: Social grounding of sentences by reasoning over their implicit moral judgments (2312.03726v1)
Abstract: The social and implicit nature of human communication ramifies readers' understandings of written sentences. Single gold-standard interpretations rarely exist, challenging conventional assumptions in natural language processing. This work introduces the interpretation modeling (IM) task which involves modeling several interpretations of a sentence's underlying semantics to unearth layers of implicit meaning. To obtain these, IM is guided by multiple annotations of social relation and common ground - in this work approximated by reader attitudes towards the author and their understanding of moral judgments subtly embedded in the sentence. We propose a number of modeling strategies that rely on one-to-one and one-to-many generation methods that take inspiration from the philosophical study of interpretation. A first-of-its-kind IM dataset is curated to support experiments and analyses. The modeling results, coupled with scrutiny of the dataset, underline the challenges of IM as conflicting and complex interpretations are socially plausible. This interplay of diverse readings is affirmed by automated and human evaluations on the generated interpretations. Finally, toxicity analyses in the generated interpretations demonstrate the importance of IM for refining filters of content and assisting content moderators in safeguarding the safety in online discourse.
- \APACrefYearMonthDay2021. \BBOQ\APACrefatitleTime-aware evidence ranking for fact-checking Time-aware evidence ranking for fact-checking.\BBCQ \APACjournalVolNumPagesJournal of Web Semantics71100663. \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2023. \BBOQ\APACrefatitlePreventing profiling for ethical fake news detection Preventing profiling for ethical fake news detection.\BBCQ \APACjournalVolNumPagesInformation Processing & Management602103206. \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2023\APACmonth05. \BBOQ\APACrefatitleImplicit Temporal Reasoning for Evidence-Based Fact-Checking Implicit temporal reasoning for evidence-based fact-checking.\BBCQ \BIn \APACrefbtitleFindings of the Association for Computational Linguistics: EACL 2023 Findings of the association for computational linguistics: Eacl 2023 (\BPGS 176–189). \APACaddressPublisherDubrovnik, CroatiaAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2023.findings-eacl.13 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2022\APACmonth05. \BBOQ\APACrefatitleThe Moral Debater: A Study on the Computational Generation of Morally Framed Arguments The moral debater: A study on the computational generation of morally framed arguments.\BBCQ \BIn \APACrefbtitleProceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) Proceedings of the 60th annual meeting of the association for computational linguistics (volume 1: Long papers) (\BPGS 8782–8797). \APACaddressPublisherDublin, IrelandAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2022.acl-long.601 {APACrefDOI} 10.18653/v1/2022.acl-long.601 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2022. \BBOQ\APACrefatitleAiSocrates: Towards answering ethical quandary questions Aisocrates: Towards answering ethical quandary questions.\BBCQ \APACjournalVolNumPagesarXiv preprint arXiv:2205.05989. \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2022. \BBOQ\APACrefatitleAnalysis of moral judgment on Reddit Analysis of moral judgment on Reddit.\BBCQ \APACjournalVolNumPagesIEEE Transactions on Computational Social Systems1-11. {APACrefDOI} 10.1109/TCSS.2022.3160677 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2023. \BBOQ\APACrefatitleToward a Perspectivist Turn in Ground Truthing for Predictive Computing Toward a perspectivist turn in ground truthing for predictive computing.\BBCQ \BIn \APACrefbtitleProceedings of the AAAI Conference on Artificial Intelligence Proceedings of the aaai conference on artificial intelligence (\BPGS 6860–6868). {APACrefDOI} 10.1609/aaai.v37i6.25840 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2019\APACmonth06. \BBOQ\APACrefatitleSeeing Things from a Different Angle:Discovering Diverse Perspectives about Claims Seeing things from a different angle:discovering diverse perspectives about claims.\BBCQ \BIn \APACrefbtitleProceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) Proceedings of the 2019 conference of the north American chapter of the association for computational linguistics: Human language technologies, volume 1 (long and short papers) (\BPGS 542–557). \APACaddressPublisherMinneapolis, MinnesotaAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/N19-1053 {APACrefDOI} 10.18653/v1/N19-1053 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2018. \BBOQ\APACrefatitleAcquiring common sense spatial knowledge through implicit spatial templates Acquiring common sense spatial knowledge through implicit spatial templates.\BBCQ \BIn \APACrefbtitleProceedings of the AAAI Conference on Artificial Intelligence Proceedings of the aaai conference on artificial intelligence (\BVOL 32). \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2023. \BBOQ\APACrefatitleSocratis: Are large multimodal models emotionally aware? Socratis: Are large multimodal models emotionally aware?\BBCQ \APACjournalVolNumPagesarXiv preprint arXiv:2308.16741. \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2022\APACmonth12. \BBOQ\APACrefatitleOn the Limitations of Reference-Free Evaluations of Generated Text On the limitations of reference-free evaluations of generated text.\BBCQ \BIn \APACrefbtitleProceedings of the 2022 Conference on Empirical Methods in Natural Language Processing Proceedings of the 2022 conference on empirical methods in natural language processing (\BPGS 10960–10977). \APACaddressPublisherAbu Dhabi, United Arab EmiratesAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2022.emnlp-main.753 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2022. \BBOQ\APACrefatitleComprehensive viewpoint representations for a deeper understanding of user interactions with debated topics Comprehensive viewpoint representations for a deeper understanding of user interactions with debated topics.\BBCQ \BIn \APACrefbtitleACM SIGIR Conference on Human Information Interaction and Retrieval Acm sigir conference on human information interaction and retrieval (\BPGS 135–145). {APACrefDOI} 10.1145/3498366.3505812 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2023. \BBOQ\APACrefatitleViewpoint Diversity in Search Results Viewpoint diversity in search results.\BBCQ \BIn \APACrefbtitleAdvances in Information Retrieval: 45th European Conference on Information Retrieval, ECIR 2023, Dublin, Ireland, April 2–6, 2023, Proceedings, Part I Advances in information retrieval: 45th european conference on information retrieval, ecir 2023, dublin, ireland, april 2–6, 2023, proceedings, part i (\BPGS 279–297). {APACrefDOI} 10.1007/978-3-031-28244-7_18 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2022. \BBOQ\APACrefatitleExplainable patterns for distinction and prediction of moral judgement on Reddit Explainable patterns for distinction and prediction of moral judgement on Reddit.\BBCQ \APACjournalVolNumPagesarXiv preprint arXiv:2201.11155. \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2021\APACmonth11. \BBOQ\APACrefatitleLatent Hatred: A Benchmark for Understanding Implicit Hate Speech Latent hatred: A benchmark for understanding implicit hate speech.\BBCQ \BIn \APACrefbtitleProceedings of the 2021 Conference on Empirical Methods in Natural Language Processing Proceedings of the 2021 conference on empirical methods in natural language processing (\BPGS 345–363). \APACaddressPublisherOnline and Punta Cana, Dominican RepublicAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2021.emnlp-main.29 {APACrefDOI} 10.18653/v1/2021.emnlp-main.29 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2021\APACmonth11. \BBOQ\APACrefatitleMoral stories: Situated reasoning about norms, intents, actions, and their consequences Moral stories: Situated reasoning about norms, intents, actions, and their consequences.\BBCQ \BIn \APACrefbtitleProceedings of the 2021 Conference on Empirical Methods in Natural Language Processing Proceedings of the 2021 conference on empirical methods in natural language processing (\BPGS 698–718). \APACaddressPublisherOnline and Punta Cana, Dominican RepublicAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2021.emnlp-main.54 {APACrefDOI} 10.18653/v1/2021.emnlp-main.54 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2020\APACmonth11. \BBOQ\APACrefatitleSocial Chemistry 101: Learning to reason about social and moral norms Social chemistry 101: Learning to reason about social and moral norms.\BBCQ \BIn \APACrefbtitleProceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) Proceedings of the 2020 conference on empirical methods in natural language processing (emnlp) (\BPGS 653–670). \APACaddressPublisherOnlineAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2020.emnlp-main.48 {APACrefDOI} 10.18653/v1/2020.emnlp-main.48 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2022\APACmonth12. \BBOQ\APACrefatitleDirections for NLP Practices Applied to Online Hate Speech Detection Directions for NLP practices applied to online hate speech detection.\BBCQ \BIn \APACrefbtitleProceedings of the 2022 Conference on Empirical Methods in Natural Language Processing Proceedings of the 2022 conference on empirical methods in natural language processing (\BPGS 11794–11805). \APACaddressPublisherAbu Dhabi, United Arab EmiratesAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2022.emnlp-main.809 {APACrefDOI} 10.18653/v1/2022.emnlp-main.809 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2022\APACmonth05. \BBOQ\APACrefatitleMisinfo Reaction Frames: Reasoning about Readers’ Reactions to News Headlines Misinfo reaction frames: Reasoning about readers’ reactions to news headlines.\BBCQ \BIn \APACrefbtitleProceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) Proceedings of the 60th annual meeting of the association for computational linguistics (volume 1: Long papers) (\BPGS 3108–3127). \APACaddressPublisherDublin, IrelandAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2022.acl-long.222 {APACrefDOI} 10.18653/v1/2022.acl-long.222 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2022\APACmonth11. \BBOQ\APACrefatitlePrediction of People’s Emotional Response towards Multi-modal News Prediction of people’s emotional response towards multi-modal news.\BBCQ \BIn \APACrefbtitleProceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) Proceedings of the 2nd conference of the asia-pacific chapter of the association for computational linguistics and the 12th international joint conference on natural language processing (volume 1: Long papers) (\BPGS 364–374). \APACaddressPublisherOnline onlyAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2022.aacl-main.29 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2021\APACmonth11. \BBOQ\APACrefatitleSimCSE: Simple Contrastive Learning of Sentence Embeddings SimCSE: Simple contrastive learning of sentence embeddings.\BBCQ \BIn \APACrefbtitleProceedings of the 2021 Conference on Empirical Methods in Natural Language Processing Proceedings of the 2021 conference on empirical methods in natural language processing (\BPGS 6894–6910). \APACaddressPublisherOnline and Punta Cana, Dominican RepublicAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2021.emnlp-main.552 {APACrefDOI} 10.18653/v1/2021.emnlp-main.552 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2021. \BBOQ\APACrefatitleDid aristotle use a laptop? a question answering benchmark with implicit reasoning strategies Did aristotle use a laptop? a question answering benchmark with implicit reasoning strategies.\BBCQ \APACjournalVolNumPagesTransactions of the Association for Computational Linguistics9346–361. {APACrefDOI} 10.1162/tacl_a_00370 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2018. \BBOQ\APACrefatitleA deep generative framework for paraphrase generation A deep generative framework for paraphrase generation.\BBCQ \BIn \APACrefbtitleProceedings of the Thirty-Second AAAI Conference on Artificial Intelligence and Thirtieth Innovative Applications of Artificial Intelligence Conference and Eighth AAAI Symposium on Educational Advances in Artificial Intelligence Proceedings of the thirty-second aaai conference on artificial intelligence and thirtieth innovative applications of artificial intelligence conference and eighth aaai symposium on educational advances in artificial intelligence (\BPGS 5149–5156). \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2004. \BBOQ\APACrefatitleIntuitive ethics: How innately prepared intuitions generate culturally variable virtues Intuitive ethics: How innately prepared intuitions generate culturally variable virtues.\BBCQ \APACjournalVolNumPagesDaedalus133455–66. {APACrefDOI} 10.1162/0011526042365555 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2021\APACmonth11. \BBOQ\APACrefatitleA Fine-Grained Analysis of BERTScore A fine-grained analysis of BERTScore.\BBCQ \BIn \APACrefbtitleProceedings of the Sixth Conference on Machine Translation Proceedings of the sixth conference on machine translation (\BPGS 507–517). \APACaddressPublisherOnlineAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2021.wmt-1.59 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2017. \BBOQ\APACrefatitleHow Dogwhistles Work How dogwhistles work.\BBCQ \BIn \APACrefbtitleNew Frontiers in Artificial Intelligence: JSAI-isAI 2017 New frontiers in artificial intelligence: Jsai-isai 2017 (\BVOL 10838, \BPGS 231–240). {APACrefDOI} 10.1007/978-3-319-93794-6_16 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2020. \BBOQ\APACrefatitleAligning AI With Shared Human Values Aligning ai with shared human values.\BBCQ \BIn \APACrefbtitleInternational Conference on Learning Representations. International conference on learning representations. \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2021. \APACrefbtitleWhat Would Jiminy Cricket Do? Towards Agents That Behave Morally. What would jiminy cricket do? towards agents that behave morally. {APACrefURL} https://openreview.net/forum?id=G1muTb5zuO7 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2020. \BBOQ\APACrefatitleMoral foundations twitter corpus: A collection of 35k tweets annotated for moral sentiment Moral foundations twitter corpus: A collection of 35k tweets annotated for moral sentiment.\BBCQ \APACjournalVolNumPagesSocial Psychological and Personality Science1181057–1071. {APACrefDOI} 10.1177/1948550619876629 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2021\APACmonth06. \BBOQ\APACrefatitleThe Importance of Modeling Social Factors of Language: Theory and Practice The importance of modeling social factors of language: Theory and practice.\BBCQ \BIn \APACrefbtitleProceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies Proceedings of the 2021 conference of the north american chapter of the association for computational linguistics: Human language technologies (\BPGS 588–602). \APACaddressPublisherOnlineAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2021.naacl-main.49 {APACrefDOI} 10.18653/v1/2021.naacl-main.49 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2023. \BBOQ\APACrefatitleMaking the Implicit Explicit: Implicit Content as a First Class Citizen in NLP Making the implicit explicit: Implicit content as a first class citizen in nlp.\BBCQ \APACjournalVolNumPagesarXiv preprint arXiv:2305.14583. \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2023. \BBOQ\APACrefatitleIs ChatGPT Better than Human Annotators? Potential and Limitations of ChatGPT in Explaining Implicit Hate Speech Is chatgpt better than human annotators? potential and limitations of chatgpt in explaining implicit hate speech.\BBCQ \BIn \APACrefbtitleCompanion Proceedings of the ACM Web Conference 2023 Companion proceedings of the acm web conference 2023 (\BPG 294–297). \APACaddressPublisherNew York, NY, USAAssociation for Computing Machinery. {APACrefURL} https://doi.org/10.1145/3543873.3587368 {APACrefDOI} 10.1145/3543873.3587368 \PrintBackRefs\CurrentBib
- \APACinsertmetastarhursthouse1999virtue{APACrefauthors}Hursthouse, R. \APACrefYear1999. \APACrefbtitleOn Virtue Ethics On virtue ethics. \APACaddressPublisherOUP Oxford. \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2019\APACmonth07. \BBOQ\APACrefatitleComparison of Diverse Decoding Methods from Conditional Language Models Comparison of diverse decoding methods from conditional language models.\BBCQ \BIn \APACrefbtitleProceedings of the 57th Annual Meeting of the Association for Computational Linguistics Proceedings of the 57th annual meeting of the association for computational linguistics (\BPGS 3752–3762). \APACaddressPublisherFlorence, ItalyAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/P19-1365 {APACrefDOI} 10.18653/v1/P19-1365 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2022. \BBOQ\APACrefatitleWhen to Make Exceptions: Exploring Language Models as Accounts of Human Moral Judgment When to make exceptions: Exploring language models as accounts of human moral judgment.\BBCQ \BIn \APACrefbtitleAdvances in Neural Information Processing Systems 35 (NeurIPS 2022) Advances in neural information processing systems 35 (neurips 2022) (\BVOL 35, \BPGS 28458–28473). \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2022. \BBOQ\APACrefatitleSODA: Million-scale Dialogue Distillation with Social Commonsense Contextualization Soda: Million-scale dialogue distillation with social commonsense contextualization.\BBCQ \APACjournalVolNumPagesarXiv preprint arXiv:2212.10465. \PrintBackRefs\CurrentBib
- \APACinsertmetastarkuhn1955hungarian{APACrefauthors}Kuhn, H\BPBIW. \APACrefYearMonthDay1955. \BBOQ\APACrefatitleThe Hungarian method for the assignment problem The Hungarian method for the assignment problem.\BBCQ \APACjournalVolNumPagesNaval research logistics quarterly21-283–97. {APACrefDOI} 10.1002/nav.3800020109 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2023\APACmonth07. \BBOQ\APACrefatitleZero-Shot Prompting for Implicit Intent Prediction and Recommendation with Commonsense Reasoning Zero-shot prompting for implicit intent prediction and recommendation with commonsense reasoning.\BBCQ \BIn \APACrefbtitleFindings of the Association for Computational Linguistics: ACL 2023 Findings of the association for computational linguistics: Acl 2023 (\BPGS 249–258). \APACaddressPublisherToronto, CanadaAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2023.findings-acl.17 {APACrefDOI} 10.18653/v1/2023.findings-acl.17 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2021\APACmonth11. \BBOQ\APACrefatitleLearning Implicit Sentiment in Aspect-based Sentiment Analysis with Supervised Contrastive Pre-Training Learning implicit sentiment in aspect-based sentiment analysis with supervised contrastive pre-training.\BBCQ \BIn \APACrefbtitleProceedings of the 2021 Conference on Empirical Methods in Natural Language Processing Proceedings of the 2021 conference on empirical methods in natural language processing (\BPGS 246–256). \APACaddressPublisherOnline and Punta Cana, Dominican RepublicAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2021.emnlp-main.22 {APACrefDOI} 10.18653/v1/2021.emnlp-main.22 \PrintBackRefs\CurrentBib
- \APACinsertmetastarlin2004rouge{APACrefauthors}Lin, C\BHBIY. \APACrefYearMonthDay2004. \BBOQ\APACrefatitleROUGE: A package for automatic evaluation of summaries ROUGE: A package for automatic evaluation of summaries.\BBCQ \BIn \APACrefbtitleText summarization branches out Text summarization branches out (\BPGS 74–81). \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2022. \BBOQ\APACrefatitleCUP: Curriculum Learning based Prompt Tuning for Implicit Event Argument Extraction Cup: Curriculum learning based prompt tuning for implicit event argument extraction.\BBCQ \APACjournalVolNumPagesProceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJCAI-224245 – 4251. {APACrefURL} https://doi.org/10.24963/ijcai.2022/589 {APACrefDOI} 10.24963/ijcai.2022/589 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2018. \BBOQ\APACrefatitleAcquiring Background Knowledge to Improve Moral Value Prediction Acquiring background knowledge to improve moral value prediction.\BBCQ \BIn \APACrefbtitle2018 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) 2018 ieee/acm international conference on advances in social networks analysis and mining (asonam) (\BPG 552-559). {APACrefDOI} 10.1109/ASONAM.2018.8508244 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2023. \BBOQ\APACrefatitleWe’re Afraid Language Models Aren’t Modeling Ambiguity We’re afraid language models aren’t modeling ambiguity.\BBCQ \APACjournalVolNumPagesarXiv preprint arXiv:2304.14399. \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2021\APACmonth11. \BBOQ\APACrefatitleMachine Reading Comprehension as Data Augmentation: A Case Study on Implicit Event Argument Extraction Machine reading comprehension as data augmentation: A case study on implicit event argument extraction.\BBCQ \BIn \APACrefbtitleProceedings of the 2021 Conference on Empirical Methods in Natural Language Processing Proceedings of the 2021 conference on empirical methods in natural language processing (\BPGS 2716–2725). \APACaddressPublisherOnline and Punta Cana, Dominican RepublicAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2021.emnlp-main.214 {APACrefDOI} 10.18653/v1/2021.emnlp-main.214 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2023jan. \BBOQ\APACrefatitlePre-Train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing.\BBCQ \APACjournalVolNumPagesACM Comput. Surv.559. {APACrefURL} https://doi.org/10.1145/3560815 {APACrefDOI} 10.1145/3560815 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2022\APACmonth05. \BBOQ\APACrefatitleBRIO: Bringing Order to Abstractive Summarization BRIO: Bringing order to abstractive summarization.\BBCQ \BIn \APACrefbtitleProceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) Proceedings of the 60th annual meeting of the association for computational linguistics (volume 1: Long papers) (\BPGS 2890–2903). \APACaddressPublisherDublin, IrelandAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2022.acl-long.207 {APACrefDOI} 10.18653/v1/2022.acl-long.207 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2023. \BBOQ\APACrefatitleFrom Dogwhistles to Bullhorns: Unveiling Coded Rhetoric with Language Models From dogwhistles to bullhorns: Unveiling coded rhetoric with language models.\BBCQ \APACjournalVolNumPagesarXiv preprint arXiv:2305.17174. \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2020\APACmonth07. \BBOQ\APACrefatitleAdversarial NLI: A New Benchmark for Natural Language Understanding Adversarial NLI: A new benchmark for natural language understanding.\BBCQ \BIn \APACrefbtitleProceedings of the 58th Annual Meeting of the Association for Computational Linguistics Proceedings of the 58th annual meeting of the association for computational linguistics (\BPGS 4885–4901). \APACaddressPublisherOnlineAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2020.acl-main.441 {APACrefDOI} 10.18653/v1/2020.acl-main.441 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2020\APACmonth11. \BBOQ\APACrefatitleWhat Can We Learn from Collective Human Opinions on Natural Language Inference Data? What can we learn from collective human opinions on natural language inference data?\BBCQ \BIn \APACrefbtitleProceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) Proceedings of the 2020 conference on empirical methods in natural language processing (emnlp) (\BPGS 9131–9143). \APACaddressPublisherOnlineAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2020.emnlp-main.734 {APACrefDOI} 10.18653/v1/2020.emnlp-main.734 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2023\APACmonth05. \BBOQ\APACrefatitleAn In-depth Analysis of Implicit and Subtle Hate Speech Messages An in-depth analysis of implicit and subtle hate speech messages.\BBCQ \BIn \APACrefbtitleProceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics Proceedings of the 17th conference of the european chapter of the association for computational linguistics (\BPGS 1997–2013). \APACaddressPublisherDubrovnik, CroatiaAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2023.eacl-main.147 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2002. \BBOQ\APACrefatitleBLEU: a method for automatic evaluation of machine translation BLEU: a method for automatic evaluation of machine translation.\BBCQ \BIn \APACrefbtitleProceedings of the 40th annual meeting of the Association for Computational Linguistics Proceedings of the 40th annual meeting of the association for computational linguistics (\BPGS 311–318). {APACrefDOI} 10.3115/1073083.1073135 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2021. \BBOQ\APACrefatitleStandardizing reporting of participant compensation in HCI: A systematic literature review and recommendations for the field Standardizing reporting of participant compensation in HCI: A systematic literature review and recommendations for the field.\BBCQ \BIn \APACrefbtitleProceedings of the 2021 CHI Conference on Human Factors in Computing Systems Proceedings of the 2021 chi conference on human factors in computing systems (\BPGS 1–16). {APACrefDOI} 10.1145/3411764.3445734 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2019. \BBOQ\APACrefatitleInherent Disagreements in Human Textual Inferences Inherent disagreements in human textual inferences.\BBCQ \APACjournalVolNumPagesTransactions of the Association for Computational Linguistics7677–694. {APACrefURL} https://aclanthology.org/Q19-1043 {APACrefDOI} 10.1162/tacl_a_00293 \PrintBackRefs\CurrentBib
- \APACinsertmetastarplank-2022-problem{APACrefauthors}Plank, B. \APACrefYearMonthDay2022\APACmonth12. \BBOQ\APACrefatitleThe “Problem” of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation The “problem” of human label variation: On ground truth in data, modeling and evaluation.\BBCQ \BIn \APACrefbtitleProceedings of the 2022 Conference on Empirical Methods in Natural Language Processing Proceedings of the 2022 conference on empirical methods in natural language processing (\BPGS 10671–10682). \APACaddressPublisherAbu Dhabi, United Arab EmiratesAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2022.emnlp-main.731 {APACrefDOI} 10.18653/v1/2022.emnlp-main.731 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2023\APACmonth07. \BBOQ\APACrefatitleClarifyDelphi: Reinforced Clarification Questions with Defeasibility Rewards for Social and Moral Situations ClarifyDelphi: Reinforced clarification questions with defeasibility rewards for social and moral situations.\BBCQ \BIn \APACrefbtitleProceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) Proceedings of the 61st annual meeting of the association for computational linguistics (volume 1: Long papers) (\BPGS 11253–11271). \APACaddressPublisherToronto, CanadaAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2023.acl-long.630 {APACrefDOI} 10.18653/v1/2023.acl-long.630 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2019\APACmonth11. \BBOQ\APACrefatitleExploring Diverse Expressions for Paraphrase Generation Exploring diverse expressions for paraphrase generation.\BBCQ \BIn \APACrefbtitleProceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (emnlp-ijcnlp) (\BPGS 3173–3182). \APACaddressPublisherHong Kong, ChinaAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/D19-1313 {APACrefDOI} 10.18653/v1/D19-1313 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2019. \BBOQ\APACrefatitleLanguage models are unsupervised multitask learners Language models are unsupervised multitask learners.\BBCQ \APACjournalVolNumPagesOpenAI blog189. \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2020. \BBOQ\APACrefatitleExploring the limits of transfer learning with a unified text-to-text transformer Exploring the limits of transfer learning with a unified text-to-text transformer.\BBCQ \APACjournalVolNumPagesThe Journal of Machine Learning Research2115485–5551. {APACrefDOI} 10.5555/3455716.3455856 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2018\APACmonth07. \BBOQ\APACrefatitleEvent2Mind: Commonsense Inference on Events, Intents, and Reactions Event2Mind: Commonsense inference on events, intents, and reactions.\BBCQ \BIn \APACrefbtitleProceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) Proceedings of the 56th annual meeting of the association for computational linguistics (volume 1: Long papers) (\BPGS 463–473). \APACaddressPublisherMelbourne, AustraliaAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/P18-1043 {APACrefDOI} 10.18653/v1/P18-1043 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2022. \BBOQ\APACrefatitleControlling hallucinations at word level in data-to-text generation Controlling hallucinations at word level in data-to-text generation.\BBCQ \APACjournalVolNumPagesData Mining and Knowledge Discovery361318–354. {APACrefURL} https://doi.org/10.1007/s10618-021-00801-4 {APACrefDOI} 10.1007/s10618-021-00801-4 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2022\APACmonth12. \BBOQ\APACrefatitleCOMET-22: Unbabel-IST 2022 Submission for the Metrics Shared Task COMET-22: Unbabel-IST 2022 submission for the metrics shared task.\BBCQ \BIn \APACrefbtitleProceedings of the Seventh Conference on Machine Translation (WMT) Proceedings of the seventh conference on machine translation (wmt) (\BPGS 578–585). \APACaddressPublisherAbu Dhabi, United Arab Emirates (Hybrid)Association for Computational Linguistics. {APACrefURL} https://aclanthology.org/2022.wmt-1.52 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2020\APACmonth11. \BBOQ\APACrefatitleCOMET: A Neural Framework for MT Evaluation COMET: A neural framework for MT evaluation.\BBCQ \BIn \APACrefbtitleProceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) Proceedings of the 2020 conference on empirical methods in natural language processing (emnlp) (\BPGS 2685–2702). \APACaddressPublisherOnlineAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2020.emnlp-main.213 {APACrefDOI} 10.18653/v1/2020.emnlp-main.213 \PrintBackRefs\CurrentBib
- \APACinsertmetastarricoeur1974{APACrefauthors}Ricoeur, P. \APACrefYear1974. \APACrefbtitleThe Conflict of Interpretations: Essays in Hermeneutics The conflict of interpretations: Essays in hermeneutics. \APACaddressPublisherEvanston, IllinoisNorthwestern University Press. \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2020\APACmonth07. \BBOQ\APACrefatitleSocial Bias Frames: Reasoning about Social and Power Implications of Language Social bias frames: Reasoning about social and power implications of language.\BBCQ \BIn \APACrefbtitleProceedings of the 58th Annual Meeting of the Association for Computational Linguistics Proceedings of the 58th annual meeting of the association for computational linguistics (\BPGS 5477–5490). \APACaddressPublisherOnlineAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2020.acl-main.486 {APACrefDOI} 10.18653/v1/2020.acl-main.486 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2019\APACmonth11. \BBOQ\APACrefatitleSocial IQa: Commonsense Reasoning about Social Interactions Social IQa: Commonsense reasoning about social interactions.\BBCQ \BIn \APACrefbtitleProceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (emnlp-ijcnlp) (\BPGS 4463–4473). \APACaddressPublisherHong Kong, ChinaAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/D19-1454 {APACrefDOI} 10.18653/v1/D19-1454 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2022\APACmonth07. \BBOQ\APACrefatitleSemantic Diversity in Dialogue with Natural Language Inference Semantic diversity in dialogue with natural language inference.\BBCQ \BIn \APACrefbtitleProceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies Proceedings of the 2022 conference of the north american chapter of the association for computational linguistics: Human language technologies (\BPGS 85–98). \APACaddressPublisherSeattle, United StatesAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2022.naacl-main.6 {APACrefDOI} 10.18653/v1/2022.naacl-main.6 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2022\APACmonth07. \BBOQ\APACrefatitleOn the Machine Learning of Ethical Judgments from Natural Language On the machine learning of ethical judgments from natural language.\BBCQ \BIn \APACrefbtitleProceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies Proceedings of the 2022 conference of the north american chapter of the association for computational linguistics: Human language technologies (\BPGS 769–779). \APACaddressPublisherSeattle, United StatesAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2022.naacl-main.56 {APACrefDOI} 10.18653/v1/2022.naacl-main.56 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2021\APACmonth04. \BBOQ\APACrefatitleEvaluating the Evaluation of Diversity in Natural Language Generation Evaluating the evaluation of diversity in natural language generation.\BBCQ \BIn \APACrefbtitleProceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume Proceedings of the 16th conference of the european chapter of the association for computational linguistics: Main volume (\BPGS 326–346). \APACaddressPublisherOnlineAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2021.eacl-main.25 {APACrefDOI} 10.18653/v1/2021.eacl-main.25 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2021. \BBOQ\APACrefatitleLearning from disagreement: A survey Learning from disagreement: A survey.\BBCQ \APACjournalVolNumPagesJournal of Artificial Intelligence Research721385–1470. {APACrefDOI} 10.1613/jair.1.12752 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2023. \BBOQ\APACrefatitleArtificial Artificial Artificial Intelligence: Crowd Workers Widely Use Large Language Models for Text Production Tasks Artificial artificial artificial intelligence: Crowd workers widely use large language models for text production tasks.\BBCQ \APACjournalVolNumPagesarXiv preprint arXiv:2306.07899. \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2018. \BBOQ\APACrefatitleDiverse beam search for improved description of complex scenes Diverse beam search for improved description of complex scenes.\BBCQ \BIn \APACrefbtitleProceedings of the AAAI Conference on Artificial Intelligence Proceedings of the aaai conference on artificial intelligence (\BVOL 32). {APACrefDOI} 10.1609/aaai.v32i1.12340 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2021. \BBOQ\APACrefatitleModeling human motives and emotions from personal narratives using external knowledge and entity tracking Modeling human motives and emotions from personal narratives using external knowledge and entity tracking.\BBCQ \BIn \APACrefbtitleProceedings of the Web Conference 2021 Proceedings of the web conference 2021 (\BPGS 529–540). {APACrefDOI} 10.1145/3442381.3449997 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2022\APACmonth05. \BBOQ\APACrefatitleJust Rank: Rethinking Evaluation with Word and Sentence Similarities Just rank: Rethinking evaluation with word and sentence similarities.\BBCQ \BIn \APACrefbtitleProceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) Proceedings of the 60th annual meeting of the association for computational linguistics (volume 1: Long papers) (\BPGS 6060–6077). \APACaddressPublisherDublin, IrelandAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2022.acl-long.419 {APACrefDOI} 10.18653/v1/2022.acl-long.419 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2020\APACmonth12. \BBOQ\APACrefatitleA Taxonomy of Empathetic Response Intents in Human Social Conversations A taxonomy of empathetic response intents in human social conversations.\BBCQ \BIn \APACrefbtitleProceedings of the 28th International Conference on Computational Linguistics Proceedings of the 28th international conference on computational linguistics (\BPGS 4886–4899). \APACaddressPublisherBarcelona, Spain (Online)International Committee on Computational Linguistics. {APACrefURL} https://aclanthology.org/2020.coling-main.429 {APACrefDOI} 10.18653/v1/2020.coling-main.429 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2021\APACmonth04. \BBOQ\APACrefatitleImplicitly Abusive Comparisons – A New Dataset and Linguistic Analysis Implicitly abusive comparisons – a new dataset and linguistic analysis.\BBCQ \BIn \APACrefbtitleProceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume Proceedings of the 16th conference of the european chapter of the association for computational linguistics: Main volume (\BPGS 358–368). \APACaddressPublisherOnlineAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2021.eacl-main.27 {APACrefDOI} 10.18653/v1/2021.eacl-main.27 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2023\APACmonth07. \BBOQ\APACrefatitleConnective Prediction for Implicit Discourse Relation Recognition via Knowledge Distillation Connective prediction for implicit discourse relation recognition via knowledge distillation.\BBCQ \BIn \APACrefbtitleProceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) Proceedings of the 61st annual meeting of the association for computational linguistics (volume 1: Long papers) (\BPGS 5908–5923). \APACaddressPublisherToronto, CanadaAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2023.acl-long.325 {APACrefDOI} 10.18653/v1/2023.acl-long.325 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2021\APACmonth06. \BBOQ\APACrefatitlePersonalized Response Generation via Generative Split Memory Network Personalized response generation via generative split memory network.\BBCQ \BIn \APACrefbtitleProceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies Proceedings of the 2021 conference of the north american chapter of the association for computational linguistics: Human language technologies (\BPGS 1956–1970). \APACaddressPublisherOnlineAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2021.naacl-main.157 {APACrefDOI} 10.18653/v1/2021.naacl-main.157 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2023mar. \BBOQ\APACrefatitleA Survey of Implicit Discourse Relation Recognition A survey of implicit discourse relation recognition.\BBCQ \APACjournalVolNumPagesACM Comput. Surv.5512. {APACrefURL} https://doi.org/10.1145/3574134 {APACrefDOI} 10.1145/3574134 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2021\APACmonth11. \BBOQ\APACrefatitleCHoRaL: Collecting Humor Reaction Labels from Millions of Social Media Users CHoRaL: Collecting humor reaction labels from millions of social media users.\BBCQ \BIn \APACrefbtitleProceedings of the 2021 Conference on Empirical Methods in Natural Language Processing Proceedings of the 2021 conference on empirical methods in natural language processing (\BPGS 4429–4435). \APACaddressPublisherOnline and Punta Cana, Dominican RepublicAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2021.emnlp-main.364 {APACrefDOI} 10.18653/v1/2021.emnlp-main.364 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2021\APACmonth11. \BBOQ\APACrefatitleSentence-Permuted Paragraph Generation Sentence-permuted paragraph generation.\BBCQ \BIn \APACrefbtitleProceedings of the 2021 Conference on Empirical Methods in Natural Language Processing Proceedings of the 2021 conference on empirical methods in natural language processing (\BPGS 5051–5062). \APACaddressPublisherOnline and Punta Cana, Dominican RepublicAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2021.emnlp-main.412 {APACrefDOI} 10.18653/v1/2021.emnlp-main.412 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2020. \BBOQ\APACrefatitleBERTScore: Evaluating Text Generation with BERT BERTScore: Evaluating text generation with BERT.\BBCQ \BIn \APACrefbtitleInternational Conference on Learning Representations. International conference on learning representations. {APACrefURL} https://openreview.net/forum?id=SkeHuCVFDr \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2019\APACmonth11. \BBOQ\APACrefatitleMoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance MoverScore: Text generation evaluating with contextualized embeddings and earth mover distance.\BBCQ \BIn \APACrefbtitleProceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (emnlp-ijcnlp) (\BPGS 563–578). \APACaddressPublisherHong Kong, ChinaAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/D19-1053 {APACrefDOI} 10.18653/v1/D19-1053 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2021\APACmonth11. \BBOQ\APACrefatitleImplicit Sentiment Analysis with Event-centered Text Representation Implicit sentiment analysis with event-centered text representation.\BBCQ \BIn \APACrefbtitleProceedings of the 2021 Conference on Empirical Methods in Natural Language Processing Proceedings of the 2021 conference on empirical methods in natural language processing (\BPGS 6884–6893). \APACaddressPublisherOnline and Punta Cana, Dominican RepublicAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2021.emnlp-main.551 {APACrefDOI} 10.18653/v1/2021.emnlp-main.551 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2021\APACmonth11. \BBOQ\APACrefatitleParaphrase Generation: A Survey of the State of the Art Paraphrase generation: A survey of the state of the art.\BBCQ \BIn \APACrefbtitleProceedings of the 2021 Conference on Empirical Methods in Natural Language Processing Proceedings of the 2021 conference on empirical methods in natural language processing (\BPGS 5075–5086). \APACaddressPublisherOnline and Punta Cana, Dominican RepublicAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2021.emnlp-main.414 {APACrefDOI} 10.18653/v1/2021.emnlp-main.414 \PrintBackRefs\CurrentBib
- \APACrefYearMonthDay2022\APACmonth05. \BBOQ\APACrefatitleThe Moral Integrity Corpus: A benchmark for ethical dialogue systems The moral integrity corpus: A benchmark for ethical dialogue systems.\BBCQ \BIn \APACrefbtitleProceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) Proceedings of the 60th annual meeting of the association for computational linguistics (volume 1: Long papers) (\BPGS 3755–3773). \APACaddressPublisherDublin, IrelandAssociation for Computational Linguistics. {APACrefURL} https://aclanthology.org/2022.acl-long.261 {APACrefDOI} 10.18653/v1/2022.acl-long.261 \PrintBackRefs\CurrentBib
Sponsored by Paperpile, the PDF & BibTeX manager trusted by top AI labs.
Get 30 days freePaper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.