CausalSent: Causal Analysis in Text

• CausalSent is a term for techniques that identify causal language in text, including sentence-level detection, span extraction, and causal effect estimation in sentiment analysis.
• Various models—from linear SVMs and hierarchical RNNs to BERT-based systems—are deployed to classify, extract, and benchmark causal relations using datasets like UniCausal and CausalTalk.
• The RieszNet-based framework applies causal inference for sentiment by evaluating token-level interventions, achieving significant reductions in treatment effect estimation errors.

“CausalSent” is used in the literature in two closely related but non-identical senses. In one line of work, it denotes sentence-level or message-level detection of causal language: deciding whether a sentence, discourse segment, or short message contains a causal relation or a causal explanation, and in some settings extending that decision to span extraction and pair classification (Tan et al., 2022, Kyriakakis et al., 2019, Son et al., 2018). In another, it is the name of a 2025 framework for interpretable sentiment classification that uses a two-headed RieszNet architecture to estimate causal effects of token-level interventions such as inserting or masking a word in text (Frees et al., 25 Aug 2025). The common thread is causal analysis over text, but the target estimands, supervision, and evaluation protocols differ substantially across these usages.

1. Terminological scope and historical usage

A recurring source of confusion is that “CausalSent” is not a single canonical benchmark. UniCausal explicitly states that it “does not include a dataset explicitly called ‘CausalSent’,” and instead defines Task I, “Causal Sequence (sentence) Classification,” as a direct substitute: given an input sequence $w = (w_1, \ldots, w_N)$, predict $s \in \{0,1\}$ for Non-causal versus Causal (Tan et al., 2022). In parallel, “Transfer Learning for Causal Sentence Detection” formalizes causal sentence detection as binary sentence classification, where a causal sentence is any sentence that conveys at least one causal relation (Kyriakakis et al., 2019). A third usage appears in “CausalSent: Interpretable Sentiment Classification with RieszNet,” where the object is not sentence-level causality detection at all, but estimation of treatment effects of text features on sentiment labels (Frees et al., 25 Aug 2025).

Usage of “CausalSent”	Core task	Representative source
Sentence-level causality detection	Causal vs Non-causal classification	(Tan et al., 2022, Kyriakakis et al., 2019)
Message-level causal explanation detection	Detect whether a message contains a causal explanation	(Son et al., 2018, Zuo et al., 2020)
Interpretable sentiment classification	Estimate causal effects of token-level interventions on sentiment	(Frees et al., 25 Aug 2025)

This suggests that “CausalSent” functions less as a single standardized object than as an umbrella label for causal analysis at sentence scale. A plausible implication is that any precise use of the term should specify whether the target is causal-language detection, cause–effect extraction, or causal effect estimation for sentiment.

2. Sentence-level causality and causal explanation detection

The sentence-detection lineage begins with binary decisions about whether causal semantics are present. “Causal Explanation Analysis on Social Media” introduces two subtasks on Facebook status updates: causality detection, which determines whether a post contains any causal explanation, and causal explanation identification, which identifies the specific phrase that is the explanation (Son et al., 2018). The dataset contains 3,268 messages, with 1,598 positives and 1,670 negatives, and the paper reports that a linear SVM is best for causality prediction with $F1 = 0.791$, while a hierarchy of Bidirectional LSTMs is best for causal explanation identification with $F1 = 0.853$; the complete pipeline reaches $F1 = 0.868$ (Son et al., 2018).

“Towards Causal Explanation Detection with Pyramid Salient-Aware Network” shifts the same message-level problem to a pyramid architecture. Its Causal Explanation Detection task decides whether a message $m$ contains at least one causal explanation, with output $y \in \{0,1\}$ (Zuo et al., 2020). PSAN combines an Input Processing Module, a bottom graph-based word-level salient network centered on syntactic dependency roots, and a top attention-based discourse-level salient network. On the Facebook CEA dataset, PSAN reaches $86.8$ F1, improving over the H-BiLSTM + BERT baseline at $85.0$ by $+1.8$ F1, and it also improves on PDTB-CED and BEcuasE-CED (Zuo et al., 2020). The model’s empirical claim is not only higher accuracy but also better generalization beyond the social-media domain.

A different formulation appears in “Causal BERT: LLMs for causality detection between events expressed in text.” There the unit is a single sentence with two marked event spans $s \in \{0,1\}$0 and $s \in \{0,1\}$1, and the label is binary: Cause-Effect or Other (Khetan et al., 2020). The paper evaluates on SemEval 2007 Task 4, SemEval 2010 Task 8, and ADE, and reports F1 values up to $s \in \{0,1\}$2 for SemEval 2007, $s \in \{0,1\}$3 for SemEval 2010, and $s \in \{0,1\}$4 for ADE under cross-domain masked pretraining plus event-aware finetuning (Khetan et al., 2020). This event-pair perspective is narrower than message-level explanation detection, but it is directly relevant whenever sentence-level causal labels are derived from underlying event-pair decisions.

3. Benchmarks, datasets, and annotation regimes

UniCausal is the most explicit attempt to standardize the sentence-level side of the literature. It consolidates six corpora—AltLex, BECAUSE 2.0, CausalTimeBank, EventStoryLine, Penn Discourse Treebank v3.0, and SemEval 2010 Task 8—into a unified benchmark across three tasks: Task I Causal Sequence Classification, Task II Cause–Effect Span Detection, and Task III Causal Pair Classification (Tan et al., 2022). The totals are 58,720 examples for Task I, 12,144 for Task II, and 69,165 for Task III, with Task I comprising 43,817 Non-causal and 14,903 Causal instances (Tan et al., 2022). For Task I, input is one to three sentences and output is a binary label, which aligns directly with a CausalSent classifier.

Later resources push beyond binary detection. The Fine-grained Causal Reasoning dataset introduces a seven-class event relation taxonomy—irrelevant, cause, cause_by, enable, enable_by, prevent, and prevent_by—over Yahoo Finance analyst reports (Yang et al., 2022). Its Task 1, causality detection, contains 51,025 total instances with 21,046 positives and 29,979 negatives; Task 2 includes 33,634 event triples used for experiments; Task 3 adds 24,486 span-based QA pairs (Yang et al., 2022). CausalTalk targets informal discourse, specifically Reddit public-health discussion around COVID-19, with 10,120 annotated posts across four tasks: binary causal classification, explicit versus implicit causality, cause–effect span extraction, and causal gist generation (Ding et al., 20 Sep 2025).

Resource	Scope	Key statistics
UniCausal	Unified benchmark across 3 tasks	58,720 / 12,144 / 69,165 examples for Tasks I/II/III
FCR	Fine-grained causal reasoning in analyst reports	51,025 detection instances; 33,634 event triples; 24,486 QA pairs
CausalTalk	Social-media causal language understanding	10,120 annotated Reddit posts

These benchmarks also differ in annotation ontology. UniCausal standardizes sequence labels, BIO cause/effect spans, and ARG0/ARG1 pair labels (Tan et al., 2022). FCR annotates event triples $s \in \{0,1\}$5 with temporal inverses and non-causal negatives (Yang et al., 2022). CausalTalk adds “gist” generation, defined as a concise abstraction of the core cause–effect relation (Ding et al., 20 Sep 2025). The result is that “CausalSent” can refer to substantially different supervision granularities even when all tasks are sentence-centered.

4. Model families and evaluation patterns

The model space spans classical feature-based classifiers, hierarchical RNNs, dependency-graph models, and PLM-based systems. In social media, the strongest result in the 2018 causal explanation work is a linear SVM for message-level causality detection, using word n-grams, character n-grams, Tweet POS tags, sentiment tags, and discourse-argument interaction features (Son et al., 2018). For causal explanation identification, the same paper reports that a hierarchical BiLSTM over discourse arguments is best (Son et al., 2018). This division is important: detection and extraction are empirically distinct problems even within a single annotation framework.

“Transfer Learning for Causal Sentence Detection” evaluates BIGRUATT, BIGRUATT+ELMO, BERT+LR, and BERT+BIGRUATT on SemEval, Causal-TimeBank, Event StoryLine, and BioCausal (Kyriakakis et al., 2019). BIGRUATT uses a bidirectional GRU with self-attention and a sigmoid classifier trained with binary cross-entropy. The paper’s central empirical claim is unusually specific: transfer learning helps only in very small datasets, whereas with larger datasets BIGRUATT reaches a performance plateau and larger datasets and transfer learning do not help (Kyriakakis et al., 2019). On CausalTB and EventSL, BERT+BIGRUATT yields the best AUCs, $s \in \{0,1\}$6 and $s \in \{0,1\}$7 respectively; on BioCausal-Large, BIGRUATT already achieves $s \in \{0,1\}$8 AUC and BERT+BIGRUATT reaches $s \in \{0,1\}$9 (Kyriakakis et al., 2019).

PSAN emphasizes syntactic keyword salience through a dependency-tree GCN rooted at the discourse root, followed by discourse-level attention constrained by a global message representation (Zuo et al., 2020). Causal-BERT instead emphasizes event-aware sentence representations and masked-event pretraining, with sentence context and event-local context combined through BERT-derived embeddings and MLP heads (Khetan et al., 2020). UniCausal’s baseline is simpler: fine-tuned BERT for all three tasks, with [CLS]-pooled sequence embeddings for Task I and Task III and a BERT token classifier for Task II (Tan et al., 2022).

The metric layer is similarly heterogeneous. UniCausal reports Binary F1 for Task I and Task III and Macro F1 for token-level BIO span evaluation in Task II, with Task I reaching 70.10% Binary F1 and Task III 84.68% Binary F1 in the baseline benchmark (Tan et al., 2022). CausalTalk reports weighted Precision, Recall, and F1 for Tasks 1–2, token-level and span-level F1 for Task 3, and ROUGE/BERTScore for Task 4; DeBERTa-v3 reaches F1 0.83 on gold and 0.87 on silver for binary causal classification (Ding et al., 20 Sep 2025). A common misconception is that high sentence-level F1 implies full causal extraction capability; UniCausal’s three-task design makes explicit that detection, span localization, and pair verification are separate stages (Tan et al., 2022).

5. “CausalSent” as interpretable sentiment classification with RieszNet

The 2025 paper “CausalSent: Interpretable Sentiment Classification with RieszNet” gives the term a distinct, explicitly causal-inference meaning (Frees et al., 25 Aug 2025). Here the treatment $F1 = 0.791$0 is the presence versus absence of a chosen word or phrase in a review, the outcome $F1 = 0.791$1 is sentiment, and the covariates $F1 = 0.791$2 are all other words or tokens in the text besides the treatment token (Frees et al., 25 Aug 2025). The paper defines the individual treatment effect

$F1 = 0.791$3

the CATE, and the ATE, and states the identification assumptions of ignorability and overlap (Frees et al., 25 Aug 2025).

The framework replaces unstable propensity weighting with a Riesz representation approach. It learns two functions, $F1 = 0.791$4 for outcome prediction and $F1 = 0.791$5 for the Riesz representer, under a two-headed architecture with a shared DistilBERT backbone, specifically sentence-transformers/msmarco-distilbert-base-v4 (Frees et al., 25 Aug 2025). The principal losses are the Riesz-head loss

$F1 = 0.791$6

the sentiment binary cross-entropy

$F1 = 0.791$7

optional effect regularization

$F1 = 0.791$8

and the overall objective

$F1 = 0.791$9

The paper also uses a doubly robust Riesz estimator,

$F1 = 0.853$0

All of these are part of a semi-synthetic and observational pipeline for causal effect estimation in sentiment analysis (Frees et al., 25 Aug 2025).

Empirically, the paper reports that on semi-synthetic IMDB reviews CausalSent reduces mean absolute error of treatment effect estimates by 2–3x compared to Bansal et al.’s reported MAE on synthetic Civil Comments data (Frees et al., 25 Aug 2025). Under simultaneous learning with a shared frozen backbone and a linear sentiment head, it estimates true ATE $F1 = 0.853$1 as $F1 = 0.853$2, true ATE $F1 = 0.853$3 as $F1 = 0.853$4, true ATE $F1 = 0.853$5 as $F1 = 0.853$6, and true ATE $F1 = 0.853$7 as $F1 = 0.853$8 (Frees et al., 25 Aug 2025). In an observational IMDB case study, an ensemble of validated models estimates that the presence of the word “love” causes a +2.9% increase in the probability of a positive sentiment, with a range from +2.3% to +3.4% (Frees et al., 25 Aug 2025). The same paper is careful about its limitations: overlap is strained in long-form text, backbone unfreezing caused effect estimates to blow up outside theoretical bounds, and no formal standard errors or confidence intervals are reported for the “love” estimate (Frees et al., 25 Aug 2025).

6. Limitations, misconceptions, and adjacent directions

Several recurring difficulties cut across the CausalSent literature. First, implicit causality remains hard. CausalTalk identifies implicit causality as the highest source of false negatives in binary classification, with models over-relying on explicit connectives (Ding et al., 20 Sep 2025). The 2018 social-media study similarly notes misses on implicit or distant causes and emoji-only causes (Son et al., 2018). UniCausal lists implicit causality without explicit markers, long-distance dependencies, and ambiguous spans as common errors (Tan et al., 2022).

Second, sentence-level classification is not equivalent to structured causal understanding. UniCausal therefore chains Task I, Task II, and Task III into an end-to-end pipeline: detect causal sentences, pinpoint candidate spans, and confirm which span pairs are truly causal (Tan et al., 2022). Fine-grained Causal Reasoning goes further by distinguishing cause, enable, prevent, and temporal inverses, and shows that joint extraction-plus-labeling exact match remains low even when span-only F1 is relatively high (Yang et al., 2022). A plausible implication is that binary “CausalSent” scores can be useful front ends but are insufficient for high-fidelity causal knowledge extraction.

Third, LLMs do not automatically solve the problem. “Causal Understanding by LLMs: The Role of Uncertainty” reports near-random four-way causal classification on PubMed conclusion sentences, almost identical accuracy on seen and unseen sentences, no memorization bias, output distributions that are almost flat with entropic values near the maximum, and severe miscalibration for instruction-tuned models such as Qwen-7B-base, which shows $F1 = 0.853$9 confidence with 32.8% accuracy and $F1 = 0.868$0 (Lithgow-Serrano et al., 24 Sep 2025). The paper’s interpretation is that failures arise from lack of structured causal representation rather than insufficient exposure to causal examples (Lithgow-Serrano et al., 24 Sep 2025).

Adjacent work extends the CausalSent agenda beyond detection. “Guided Generation of Cause and Effect” introduces CausalBank with 314 million cause–effect sentence pairs and a Cause Effect Graph with 89.1 million edges for conditional generation of plausible causes and effects (Li et al., 2021). “Causal Retrieval with Semantic Consideration” introduces CAWAI, a tri-encoder retrieval model trained with dual semantic and causal objectives, and reports stronger large-scale cause→effect and effect→cause retrieval than standard dense retrievers (Shin et al., 7 Apr 2025). These developments reinforce a broader view: CausalSent can denote a detection module, a benchmark interface, or a causal-inference layer over sentiment, but its research frontier increasingly connects classification to extraction, retrieval, generation, and calibrated causal reasoning.