CRISP Model for Cognitive Restructuring

• CRISP Model is a comprehensive cognitive restructuring framework combining CRDial (a psychotherapy-aligned dialogue workflow), Crisp (a bilingual dataset), and Crispers (fine-tuned LLMs).
• It employs an iterative, two-stage process with identification and restructuring phases using strategies like Defense, Prosecution, and Verdict to target multiple cognitive distortions.
• Empirical evaluations demonstrate that its sentence-level strategy control and multi-channel looping mechanism significantly enhance supportiveness, trustworthiness, and overall therapeutic impact.

The CRISP Model, in the context of mental-health dialogue systems, denotes an end-to-end methodology for cognitive restructuring that unifies a psychotherapy-grounded dialogue framework, a distilled bilingual dialogue dataset, and conversational LLMs trained to perform multi-turn supportive intervention. In the formulation introduced for cognitive restructuring, CRISP comprises CRDial, Crisp, and Crispers: CRDial structures the therapeutic workflow, Crisp encodes that workflow as a large-scale bilingual corpus, and Crispers are the 7B and 14B conversational LLMs fine-tuned to execute supportive cognitive restructuring with sentence-level strategy control and multi-channel distortion identification (Zhou et al., 24 Apr 2025).

1. Definition and architectural composition

A common misconception is to equate CRISP with the dataset alone. In the paper’s terminology, Crisp is only one component, whereas the “CRISP Model” denotes the overall methodology: a psychotherapy-aligned framework (CRDial), dataset (Crisp), and models (Crispers) that together implement multi-turn cognitive restructuring with emotional support (Zhou et al., 24 Apr 2025).

The architecture is explicitly tripartite. CRDial is the generative framework and prompt suite used to distill the dataset from LLMs. It structures multi-turn interactions into an identification stage and a restructuring stage, embeds sentence-level supportive strategies, and iterates through a multi-channel loop mechanism so that multiple distortions within a single mental-health issue can be addressed. Crisp is a large-scale, bilingual dialogue dataset distilled from GPT-4o with CRDial. It encodes the two-stage workflow, sentence-level strategy labels, cognitive distortion channels, Defense–Prosecution–Verdict phases, and loop decisions. Crispers are Qwen-2.5-7B and Qwen-2.5-14B instruction-tuned variants fine-tuned on Crisp by supervised fine-tuning rather than RLHF or DPO.

The design principles are explicitly clinical rather than merely stylistic. The system is intended to align with clinical CBT, using Cognitive Therapy, CT-guided identification and Defense Attorney Technique, DAT-driven restructuring, while maintaining emotional safety and engagement through sentence-level supportive strategies and adapting to individual differences through multi-channel identification and iterative looping. This makes CRISP distinct from text rewriting approaches, fixed-pattern dialogues, or one-shot cognitive-reframing pipelines.

2. Psychotherapeutic workflow and algorithmic structure

CRDial operationalizes cognitive restructuring as a staged, iterative dialogue process rather than as a single rewriting act. The identification stage begins from a help-seeking situation derived from posts from Yixinli and r/mentalhealth, summarized and de-identified, and paired with a personality profile inferred from the post to diversify interaction styles. The therapist then probes progressively from Automatic thoughts → Intermediate beliefs → Core beliefs. Once core beliefs are articulated, the system performs core belief dissection, yielding up to three candidate channels of cognitive distortion, each with a named distortion and a detailed description grounded in the individual’s context (Zhou et al., 24 Apr 2025).

The restructuring stage is organized by the Defense Attorney Technique. In Defense, the individual is guided to marshal only verifiable factual evidence supporting the negative thought. In Prosecution, the therapist challenges each defense point with factual counter-evidence, then moves toward alternative, more helpful perspectives. Verdict is a silent assessment step that determines whether the restructuring is “Resolved” or “Unresolved”, together with a confidence score and rationale, based on the individual’s ability to generate factual counters and show evidence of perspective shift.

A central innovation is the multi-channel loop mechanism. After one distortion channel is processed, CRDial runs a Loop Evaluation to determine whether residual distortions remain that were not previously addressed. If so, control returns to identification and opens subsequent channels. This makes the workflow iterative at the level of co-occurring distortions, rather than terminating after a single reframing pass. The framework also injects Atomic^10x knowledge triples with relations such as intention, desire, reaction, need to guide each sub-step and reduce generic responses.

The pseudocode-level structure reflects this decomposition: initialize situation $S$, personality $P$, and history $H$; generate dialogues for “Understanding Thoughts / Exploring Intermediate Beliefs” and “Analyzing Core Beliefs”; enumerate up to three channels; alternate between Defense and Prosecution until AssessVerdict returns Resolved; then run LoopCheck until no residual distortions remain. A condensed example in the paper begins with the situation “I got harsh feedback from my advisor; I think I’ll never have a successful career.” Identification yields candidate channels for All-or-Nothing Thinking, Catastrophizing, and Disqualifying the Positive; the patient selects Catastrophizing; DAT then proceeds through defense evidence, prosecution counter-evidence, a Resolved; confidence 8/10 verdict, and a subsequent loop that detects residual All-or-Nothing Thinking and re-enters identification.

3. Supportive strategy control and the Crisp dataset

Therapeutic support in CRISP is not left as an emergent property of long-form generation. Therapist responses are constrained at the sentence level, and each sentence carries a strategy label; the full response is therefore a sequence of $(\text{strategy}, \text{sentence})$ pairs. The strategy taxonomy comprises 5 categories, 8 sub-strategies: Description with Question and Restatement; Expression with Reflection of Feelings and Self-disclosure; Assertion with Providing Suggestions and Information; Reinforcement with Affirmation and Reassurance; and Negotiation with Negotiate. Prompt rules require concrete and actionable suggestions, avoidance of generic phrasing, limited questioning, alternation of strategies, prohibition of repetitive content, and coherence across stages with no time gap (Zhou et al., 24 Apr 2025).

The dataset itself is large and structurally dense. Crisp is built from 2,985 de-identified seed situations and contains 22,063 dialogues, with English 10,733 and Chinese 11,330. It has average turns per dialogue: 36.48, total utterances ≈ 796,859, average utterance length: 38.12 tokens, and lexical diversity (MTLD): 70.51. On a per-situation basis, the dataset reports average 7.39 dialogues, average loops per dialogue: 2.28, and average channels per situation: 2.94. Sentence-level strategy labels have mean strategies per response: 2.23, strategy label accuracy: 97.6%, and Cohen’s $\kappa \approx 0.712$. Distortion labels, verified by experts, reach accuracy 85.5% and $\kappa \approx 0.681$.

The distortion taxonomy contains 15 types: Catastrophizing (3014), All-or-Nothing (2906), Overgeneralization (2673), Personalization (2583), Mental Filtering (2557), Fortune Telling (2160), Mind Reading (1972), Disqualifying the Positive (1955), Jumping to Conclusions (1830), Emotional Reasoning (1600), Should Statements (1348), Comparing and Despairing (1155), Blaming (1047), Control Fallacy (931), External Validation (644). The paper states that the distribution is relatively uniform overall.

Quality control is multi-layered. Basic filtering by GPT-4o removes unnatural/inappropriate/erroneous content (6.34%), incoherent social dynamics (2.54%), and commonsense violations (2.15%). Safety filtering uses a Canary classifier and an LLM safety prompt, with final removal ≈ 0.02%. Expert filtering scores dialogues on Therapist Standard, Help-Seeker Standard, and Supervisor criteria; dialogues with average below 3.5 on the [1–5] scale are removed, yielding ≈ 11% removal. Human experts spot-check 100 retained dialogues with a 95% pass rate. In comparative dataset evaluation against ESConv, AugESC, ExTES, and HealMe, Crisp is reported as best on Sensibleness, Specificity, Supportiveness, Helpfulness, Trustworthiness, and Overall, with substantial agreement $\kappa \in [0.59,0.70]$.

4. Crispers models and training objectives

Crispers are trained conversational models built on Qwen-2.5-7B and Qwen-2.5-14B instruction-tuned variants. The training method is supervised fine-tuning (SFT) with joint objectives designed for strategy control and multi-channel distortion identification; no RLHF/DPO is reported. The multi-turn context is defined as

$$C_{n-1} = \{u_1, y_1, \ldots, u_{n-1}, y_{n-1}, u_n\},$$

where $u$ are help-seeker turns and $y$ are therapist turns (Zhou et al., 24 Apr 2025).

For strategy-controlled generation, the next therapist response is represented as

$P$0

with sentence-level strategy token $P$1. The objective is

$P$2

For multi-channel distortion identification, the model predicts up to $P$3 channels in the prior turn: $P$4

$P$5

The joint loss is

$P$6

with standard cross-entropy form

$P$7

Training uses AdamW for 3 epochs. Reported training time is ≈ 2.5 hours for the 7B model and ≈ 5.5 hours for the 14B model on 4×8 H20 GPUs. At inference, the model maintains multi-turn context, emits strategy tokens per sentence and distortion tokens with channel metadata, alternates DAT phases based on dialogue state, checks verdicts, and invokes a loop evaluator to decide whether to re-enter identification for additional channels.

5. Empirical performance, safety, and limitations

Evaluation is centered on human interaction rather than static automatic metrics. In human interactive pointwise evaluation, 10 English and 10 Chinese volunteers each build two ≥30-turn dialogues with each model. The criteria are Sensibleness, Specificity, Supportiveness, Helpfulness, Trustworthiness, Overall on 1–5 scales. Crispers-14B slightly surpasses GPT-4o and significantly outperforms open baselines on Supportiveness, Helpfulness, Trustworthiness ($P$8). Ablations show that removing sentence-level strategy control (SSCG) causes drops across all criteria; removing multi-channel distortion identification (MDI) causes drops in Helpfulness and Trustworthiness; removing both causes the largest declines, confirming that both components are crucial (Zhou et al., 24 Apr 2025).

In human interactive pairwise evaluation, volunteers engage in ≥30 turns with paired models, compare each turn holistically, and continue with preferred outputs. Crispers-14B significantly wins most pairs across both English/Chinese ($P$9) against baselines including GPT-4o, GLM-4, Qwen-2.5-14B, and Qwen-2.5-72B. The paper also reports a psychological intervention trial (PANAS) with 90 Chinese participants randomized across Crispers-14B, GPT-4o, and Emohaa. Pre-intervention ANOVA shows no group differences ($H$0). Within-group, Crispers-14B improves positive affect by ~48.77% and reduces negative affect by ~44.01% (Student’s t-test $H$1). Between-group, Tukey HSD shows Crispers-14B is significantly better than Emohaa ($H$2) and GPT-4o ($H$3) on both PA and NA changes.

Safety provisions are explicit but bounded. Seed situations are screened to remove sensitive content; a Canary safety classifier plus an LLM safety prompt remove unsafe dialogues; prompts prohibit research claims and require supportive, non-preachy language; high-risk scenarios (e.g., self-harm) are acknowledged as beyond claims of efficacy. Recommended deployment guardrails include input/output safety filters, crisis escalation to human professionals, and disclaimers that the system is not a licensed therapist. The ethics protocol includes informed consent, right to withdraw, encrypted storage, anonymized PANAS and dialogue data, IRB approvals, and adherence to the APA Ethics Code.

The limitations are substantial and explicitly stated. Dialogue construction depends on GPT-4o, so LLM choice may bias content/style. There is annotation bias despite training and substantial agreement. The intervention trial is moderate (n=90, Chinese-only), so broader clinical validation is needed. Cultural and linguistic biases depend on data sources, and future work is directed toward diversifying LLM sources and backbones, expanding trials, and stronger safety pipelines.

6. Relation to prior work and practical deployment

CRISP is positioned against three families of prior approaches. Text rewriting approaches present reframed statements directly and therefore lack progressive guidance and may elicit resistance. Fixed-pattern dialogues, including limited Socratic scripts, are described as rigid and weak at emotional management and personalization. One-shot CR workflows address only a single distortion per interaction and therefore miss co-occurring distortions. Against this background, the paper’s claimed contributions are a multi-stage, multi-turn, psychotherapy-aligned workflow, sentence-level supportive strategy control unified across stages, multi-channel identification with iterative looping, and a bilingual, large-scale dataset with fine-grained labels at sentence and channel levels (Zhou et al., 24 Apr 2025).

For application, the paper recommends using staged prompts in the order Understanding thoughts/intermediate beliefs → Core belief dissection with channel options → DAT Defense/Prosecution → Verdict → Loop Evaluation. Runtime control operates at three levels. First, strategy mix can throttle [Question] while diversifying [Reflection of Feelings], [Affirmation], [Information], [Providing Suggestions], and [Negotiate]. Second, channel count and order should present up to three candidate distortions, allow the individual to choose which to address first, and revisit via loop if residual distortions remain. Third, DAT phase switching should keep Defense restricted to factual support for the thought and Prosecution focused on factual counterpoints and actionable reframing.

The deployment guidance also emphasizes auditability. Systems are advised to provide a CR mode with staged flows and strategy labels, to log channels addressed, verdicts, and loop decisions as explicit metadata, and to support bilingual interaction. One recommendation is to present distortion descriptions without names to reduce labeling stigma while tracking distortion tokens internally. Commonsense augmentation can use Atomic^10x relations: xIntent/xNeed/xReact to seed richer, non-generic dialogues. A plausible implication is that CRISP’s main significance lies not in a single model architecture, but in formalizing cognitive restructuring as a controllable dialogue protocol whose therapeutic stages, supportive discourse acts, and distortion-level state transitions are all explicitly represented.