---
title: PersuasionTrace Analysis
url: https://www.emergentmind.com/topics/persuasiontrace
type: topic
---

# PersuasionTrace Analysis

PERSUASIONTRACE is a process-level formulation of persuasion analysis in which the primary object is a trajectory rather than a single endpoint label. In its explicit human–LLM instantiation, it instruments multi-turn persuasion conversations, records turn-by-turn numeric belief reports, annotates persuader messages with logos, pathos, and ethos, and evaluates simulated targets by fidelity to human belief dynamics [2606.05330]. Closely related work uses adjacent trace formalisms—utterance-level persuasive-strategy sequences, Belief–Desire–Intention state logs, debate-state representations, resistance labels, and downstream action traces—suggesting a broader family of persuasion-tracing methods across dialogue understanding, online discourse, debate, agentic execution, and persuasion-effect estimation [2011.09954] [2605.22602] [2602.00851] [2509.26517].

## 1. Core definition and analytical scope

In the human–LLM framework, targets answer the same question before the dialogue, after each persuader message, and after the dialogue: “How much do you agree with the proposition shown?” on a 0–100 scale. This yields a belief trajectory $(b_{pre}, b_1, b_2, \ldots, b_t, b_{post})$, where $b_t$ is the belief after persuader turn $t$. The persuader’s stance $s$ is assigned from the target’s pre belief $b_{pre}$, and the round-level endpoint metric is
$$
\Delta = (b_{post} - b_{pre}) \cdot s,
$$
with positive values indicating movement in the persuader’s assigned direction [2606.05330].

This process-level view differs from endpoint-only formulations in which persuasion is observed only through final success. In Change My View, successful persuasion is defined by the presence of a $\Delta$ award on a reply, yielding a binary classification problem over replies; in the Truth Wins setting, belief update is directly rated on a continuous scale from $-100$ to $100$ as $\Delta belief = belief_{post} - belief_{pre}$ [2511.22109]. In regression discontinuity designs, persuasion is localized at a threshold through the RD persuasion rate
$$
\pi(c) = \Pr\{A(1)=1 \mid A(0)=0, X=c\},
$$
which measures the probability that threshold units would act under exposure given that they would not act without exposure [2509.26517]. These formulations use different observational interfaces, but all treat persuasion as state change under an intervention.

A further expansion appears in agentic systems, where persuasion is defined behaviorally rather than only propositionally. There, persuasion propagation denotes the phenomenon whereby a task-irrelevant persuasive intervention changes an agent’s belief state and this belief persists to influence downstream execution behavior in later, unrelated, long-horizon tasks [2602.00851]. This suggests that PERSUASIONTRACE is not restricted to belief reports; it can also denote the tracing of exploration breadth, revision dynamics, and stopping behavior.

## 2. Representational forms of the trace

Across the literature, a persuasion trace is encoded through several recurrent state representations.

| Trace representation | State variables | Setting |
|---|---|---|
| Belief trajectory | $(b_{pre}, b_1, \ldots, b_t, b_{post})$ | Human–LLM persuasion [2606.05330] |
| Utterance strategy sequence | ER/EE strategy labels plus tactic history | Persuasive dialogue understanding [2011.09954] |
| ToM trace | $\tau_t = (I_t, D_t, B_t, S_t)$ | ToM-based persuasive dialogue [2605.22602] |
| Resistance trace | Target-side resisting strategies per utterance | Persuasion and negotiation [2101.10545] |
| Debate State Representation | $S_t = \{C_t, A_t\}$ and taxonomic vector $V$ | Multi-step debate [2606.24976] |
| Agentic action trace | $(a_{1:T}, o_{1:T}, b_t)$ | Persuasion propagation in agents [2602.00851] |

In persuasive dialogue understanding, the trace is a sequence-labeling object over utterances in a dyadic dialogue. Given a dialogue $D=(u_1,\ldots,u_T)$, the task is to predict, for each utterance, the persuasive strategy employed. Strategies are speaker-specific: the persuader has 10 categories, the persuadee has 12 categories, and both share a non-strategy dialogue-acts class. The representation explicitly distinguishes inter-speaker contextual relations, intra-speaker contextual relations, and tactic history, where tactic history denotes the sequence of previously used strategy labels in the dialogue [2011.09954].

In ToM-based persuasive dialogue, the trace is richer and includes latent mental states. The per-turn object is $\tau_t=(I_t,D_t,B_t,S_t)$, where $I_t$ is intention, $D_t \in \{-1,0,1\}$ is desire, $B_t$ is a set of belief statements, and $S_t$ is the persuader’s selected strategy. The associated backward inference chain is
$$
I_t = f_{intention}(h_t),\quad
D_t = f_{desire}(I_t,h_t),\quad
B_t = f_{belief}(I_t,D_t,h_t),\quad
S_t = f_{strategy}(B_t,D_t,I_t,h_t),
$$
and the annotation protocol enforces carry-over of unresolved negative beliefs into the next turn [2605.22602].

In debate-oriented tracing, the Debate State Representation compresses the live state into $S_t=\{C_t,A_t\}$, where $C_t$ is the Committed Claims Trajectory and $A_t$ is the Active Trigger Flaw Extraction. This state is mapped to a $K$-dimensional probability vector $V \in \Delta^{K-1}$, creating a discrete categorical bottleneck over structural vulnerabilities rather than topical content [2606.24976]. By contrast, resistance-oriented tracing labels the target’s utterances with one of seven resisting strategies—Source Derogation, Counter Argument, Information Inquiry, Personal Choice, Self Pity, Hesitance, and Self-Assertion—yielding a parallel target-side dynamics that complements persuader strategy traces [2101.10545].

## 3. Data collection and annotation protocols

The explicit PERSUASIONTRACE framework is implemented as a web-based experimental platform for AI persuasion experiments with text and audio I/O, participant-chosen personalized propositions, and multi-turn belief elicitation. Participants were recruited on Prolific and interacted with an LLM persuader. Across all analyses, $N=255$ completed rounds were collected. Unless otherwise noted, human cohorts used a text-based interface, fixed four-turn dialogues, a 10-minute cap per round, multi-turn belief elicitation, and DebateGPT topic propositions; quality filters excluded rounds with average human message length below 10 characters or average human reply time below 5 seconds [2606.05330].

The rhetorical annotation pipeline in that framework assigns logos, pathos, and ethos scores to persuader messages on an ordinal scale with 0 = absent, 1 = somewhat present, and 2 = dominant. The guidelines emphasize conservatism and context-aware scoring. The same paper also introduces a related-belief survey arm enabling forced-initialization replay, stance-bias diagnostics, and naive-responsiveness diagnostics for simulated targets [2606.05330].

Several adjacent datasets instantiate alternative trace granularities. PersuasionForGood contains 1,017 dialogues in a charity-donation setting, of which 300 dialogues are annotated with persuasive strategies; the dialogues average 10.43 turns and 19.36 words per utterance, are split roughly 80/20 into train/test, and are evaluated with macro F1 under five-fold cross-validation because of label imbalance [2011.09954]. ToM-BPD contains 504 dialogues and 3,926 utterances, with average 7.79 turns per dialogue, average persuader utterance length 38.62 tokens, and average persuadee utterance length 19.67 tokens; its annotations include desire labels, belief statements with polarity and reason, and one of nine persuasive strategies, and its quality control includes an annotator qualification test with a 25-turn exam and a 90% threshold [2605.22602].

Resistance tracing is instantiated on 530 Persuasion4Good conversations and 800 CraigslistBargain conversations. Agreement before full annotation reached Fleiss’ $\kappa = 0.787$ for Persuasion4Good and Fleiss’ $\kappa = 0.790$ for CraigslistBargain, after iterative calibration rounds. Multi-label utterances are rare—1.2% in Persuasion4Good and 3.85% in CraigslistBargain—and are reduced to a single label for modeling by random selection [2101.10545].

In large-scale online persuasion detection, the primary target corpus is the Winning Arguments Change My View dataset, with 3,456 posts for training and 807 for testing. Each post provides the original post, one positive reply, and one negative reply, with pairs chosen using highest Jaccard similarity. A second dataset, Truth Wins, supplies theory-grounded feature annotations, including belief update on a $-100$ to $100$ scale and eight feature ratings on a 1–5 Likert scale averaged across 10 raters [2511.22109].

## 4. Modeling paradigms

One major line treats persuasion tracing as contextual sequence labeling. In persuasive dialogue understanding, RoBERTa Large is fine-tuned for utterance-level strategy classification, the final four layer [CLS] activations are averaged into a 1024-dimensional utterance vector, and context is modeled through inter-speaker and speaker-specific encoders. The proposed Transformer-ExtCRF uses a Transformer over the whole dialogue, then speaker-specific Transformers for ER and EE subsequences, followed by an extended linear-chain CRF with four transition matrices for ER$\rightarrow$ER, ER$\rightarrow$EE, EE$\rightarrow$ER, and EE$\rightarrow$EE transitions, plus auxiliary losses for speaker-specific CRFs and persuasion outcome prediction [2011.09954].

A second line models latent cognitive state explicitly. In ToM-PD, TTBYS decomposes reasoning into three stages: desire inference, belief inference, and strategy prediction. Desire is inferred by fusing an experience-driven distribution $P_{ex}(D)$ with an LLM distribution $P_{ag}(D)$ through coefficient $\alpha$; belief is generated with explicit exemplar injection; strategy is selected by combining retrieved experiential priors $P_{ex}(S\mid ToM_t)$ with LLM probabilities $P_{ag}(S\mid ToM_t)$ through coefficient $\beta$ [2605.22602]. In the human–LLM framework, the Bayesian-network target instead decomposes each persuader turn into atomization, Bayesian state update, and verbalization. It maintains a small Bayesian network over proposition and related beliefs, updates node probabilities through rhetoric-weighted evidence, and generates a response conditioned on the updated BN state and persona [2606.05330].

A third line uses lightweight discriminative models over structured features or internal representations. In online discourse, three LLMs—LLaMA3-70B, Gemma2-9B, and Mixtral-8x7B—rate replies along eight theory-driven features, including Influential, Interesting, Interesting-If-True, Positive emotion, Negative emotion, Shareable, Truthfulness, and Attention. These ratings, plus a predicted belief-update score from an OLS model trained on Truth Wins, feed a Random Forest with 300 estimators; the paper distinguishes Hybrid-Independent and Hybrid-Interaction variants [2511.22109]. In multi-turn conversations, linear probes on frozen Llama-3.2-3B residual activations at middle-to-late layers are trained for binary persuasion success, three-way strategy classification over logos/pathos/ethos-style categories, and OCEAN personality inference. These probes operate at token or turn granularity and use logistic or softmax classifiers on cached hidden states [2508.05625].

A fourth line is retrieval-centered. TS-RAG routes debate states through a taxonomic strategy space $\mathcal{V}=\{v_1,\ldots,v_K\}$, maps a live state to $V_q \in \Delta^{K-1}$, and retrieves domain-agnostic blueprints by cosine similarity
$$
sim(V_q,V_d)=\frac{V_q \cdot V_d}{\|V_q\|\,\|V_d\|}.
$$
Its purpose is to decouple argumentative structure from topical content and to prevent semantic leakage in cross-domain persuasion [2606.24976]. In agentic execution, persuasion propagation is modeled causally by an action policy
$$
a_t \sim \pi_\theta(a_t \mid b_t, o_t),
$$
with belief updates $b_t = g_\theta(b_{t-1}, o_t; T, X)$ and behavior-level outcomes extracted from the action trace [2602.00851].

## 5. Empirical findings

The human–LLM PERSUASIONTRACE results show that belief trajectories are not homogeneous. KMeans on standardized normalized cumulative trajectories yielded two clusters: a low-shift cluster with $n=44$ and mean end-delta 0.039, and a higher-shift cluster with $n=40$ and mean end-delta 0.437. In a logistic model of cluster membership, pathos was positively associated with membership in the higher-shift cluster ($\beta = 0.76$, SE = 0.37, $p = 0.043$), and baseline belief was also positive ($\beta = 1.04$, SE = 0.35, $p = 0.0027$). Across standard text, personalized text, and audio cohorts, LLM persuaders were significantly more persuasive than control. For simulation fidelity, the BN target scored 81.3 in LLM-judge human-likeness versus a human reference at 80.0, while unstructured and structure-conditioned LLM targets scored 64.7 and 64.2; in forced-initialization replay, the BN target had the lowest conditional replay error at 0.1429 [2606.05330].

The strategy-recognition literature records two negative results that are central for persuasion tracing. First, CRF did not capture persuasive label dependencies: adding CRF layers yielded negligible or inconsistent improvements, and transition heatmaps showed that beyond a few frequent combinations, most label transitions were low-frequency. Second, Transformer encoders trained from scratch were less capable of capturing sequential information than LSTM-based contextual encoders, which the paper attributes to the limitations of vanilla self-attention with sinusoidal positional encodings under sparse annotated data. On PersuasionForGood, cLSTMs reached Macro F1 65.5 for ER and 52.5 for EE, whereas plain Transformers reached 64.6 and 51.4; the proposed Transformers-ExtCRF reached 65.2 and 51.6 [2011.09954].

In online persuasion detection, theory-grounded feature extraction with LLMs and Random Forests substantially exceeded lexical and zero-shot baselines. On the CMV test set, the transparent logistic-regression baseline on term frequencies achieved 56.50% accuracy, zero-shot LLM baselines ranged from 56.90% to 64.93%, and hybrid models ranged from 72.55% to 82.69%, with Gemma2 Hybrid-Interaction performing best at 82.69%. Permutation-based variable importance showed that epistemic-emotion signals—especially Interesting and Interesting-If-True—and social transmission via Shareable were consistently among the strongest predictors, with Influential and Attention also prominent [2511.22109].

Linear probes recover fine-grained temporal structure. In PersuasionForGood, AUROC for success detection peaks in middle turns; in DailyPersuasion, the signal concentrates in the final turns, with the context probe achieving turn classification accuracy of 91% and conversation classification accuracy of 95% on DP. The probe-based strategy distribution is closer to a GPT-4.1-Nano reference than prompting across most turns, and credibility appeals dominate much of PersuasionForGood [2508.05625].

Debate and agentic systems extend the empirical picture from belief trajectories to trace-level control and downstream behavior. In held-out-domain debate, TS-RAG improved a weak persuader against a strong opponent from 70.5 to 78.5 win rate and reduced average rounds from 15.19 to 15.0; removing OP resistance constraints caused evaluation collapse by sycophancy, such as a Flash 3.0 Self-Routed Heuristics win rate inflating to 93.0 [2606.24976]. In agentic web research, belief-prefilled agents conducted on average 26.9% fewer searches and visited 16.9% fewer unique sources than neutral-prefilled agents; by contrast, on-the-fly persuasion produced weak and inconsistent aggregate effects, with persona-level dispersion often larger than pooled means [2602.00851].

## 6. Extensions, limitations, and open problems

PERSUASIONTRACE has been extended beyond multi-turn dyadic dialogue. In persuasive requests on r/Borrow, strategy orderings are represented as sentence-level sequences over Concreteness, Reciprocity, Impact, Credibility, Politeness, and boundary markers SOS/EOS. The central finding is that specific triplets interact with content and outcome: for example, $(Po, Po, EOS)$ has success 0.82, whereas concreteness-heavy triplets such as $(Co, Co, Im)$ have success 0.27, and there is a strong negative correlation between triplet-level strategy attention and empirical success ($R=-0.90$, $p<.0001$) [2010.04625]. In text-only tactic detection, a domain-independent unsupervised framework classifies persuasive spans into 14 tactic types by normalized edit distance in parse-string space, yielding ParseTree+SP multi-class F1 of 0.489 on ChangeMyView and 0.501 on Supreme Court data, with better performance than a Doc2Vec baseline across all four evaluated domains [1912.06745]. In advertising, persuasion traces become multimodal: a 3,000-image corpus annotated with 20 strategies in 9 groups supports a multi-task attention fusion model that reaches 59.2% top-1 and 84.8% top-3 accuracy for strategy prediction, with OCR and DenseCap contributing strongly to performance [2208.09626].

Limitations recur across these formulations. Data scarcity, label imbalance, and sparse transitions remain a major constraint: the persuasive-strategy sequence-labeling study uses only 300 annotated dialogues and reports weak label grammar [2011.09954]. Online discourse detection is evaluated on CMV, which the paper explicitly cautions is a persuasion-focused environment; it reports accuracy but not precision, recall, F1, ROC-AUC, calibration, confidence intervals, significance tests, or ablations [2511.22109]. The human–LLM framework relies on self-reported numeric beliefs, proposition-specific Bayesian-network construction, and modest sample sizes; it does not model social or affective mechanisms such as trust dynamics or identity threat [2606.05330]. ToM-BPD is limited to 504 dialogues and does not directly annotate intention, which is summarized instead through $i_t$ [2605.22602]. In debate systems, evaluation collapse under default sycophancy necessitates stringent constraints such as Pre-Concession Analysis and the Concession Rule [2606.24976]. In agentic persuasion propagation, the on-the-fly comparison between persuaded and non-persuaded trials is explicitly post-treatment and can carry selection bias [2602.00851].

Taken together, these findings suggest several open directions. Relative-position modeling and pretrained conversational encoders are repeatedly proposed where vanilla Transformers fail under small data [2011.09954]. Richer ToM knowledge bases, causal models of how $S_t$ changes $D_{t+1}$ or $B_{t+1}$, and user-specific long-term traces are proposed for ToM-based persuasion [2605.22602]. Domain adaptation, rolling human validation, and broader metric suites are recommended for online persuasion detection [2511.22109]. In the human–LLM framework, a central safety direction is to optimize with fidelity metrics rather than raw endpoint movement, so that persuasion systems are constrained by human-likeness, stance symmetry, and resistance to naive persuasion rather than only by net movement [2606.05330].

Source: https://www.emergentmind.com/topics/persuasiontrace