---
title: Visual-Text Dual Chain-of-Thought
url: https://www.emergentmind.com/topics/visual-text-dual-chain-of-thought
type: topic
---

# Visual-Text Dual Chain-of-Thought

Searching arXiv for the specified paper and closely related work on visual-text dual chain-of-thought reasoning.
Visual-Text Dual Chain-of-Thought denotes a class of multimodal reasoning frameworks in which intermediate inference is not confined to a purely textual rationale, but instead couples textual reasoning with visual evidence, visual states, or visual intermediate representations. In this literature, the duality can take several forms: interleaving textual steps with image regions or frames, maintaining parallel visual and linguistic reasoning streams, rendering reasoning into a visual canvas, or replacing explicit word sequences with latent visual-textual states. A recurring motivation is that text-only multimodal reasoning often becomes “vision-blind reasoning,” whereas dual CoT seeks to preserve visual grounding throughout the reasoning process rather than only at initial encoding [2606.08464]. A related unifying claim is that multimodal CoT improves large vision-language models by introducing “visual thoughts,” namely intermediate representations that convey image information into the reasoning process, regardless of whether the outward format is textual or interleaved image-text output [2505.15510].

## 1. Historical emergence and conceptual scope

Early work established the premise that CoT in vision-language settings should not be treated as a trivial transfer of language-only prompting. “Chain of Thought Prompt Tuning in Vision Language Models” introduced a chain of prompts and corresponding networks, with a dynamic chain controller, and stated that it was the first work to successfully adapt chain-of-thought prompting that combines visual and textual embeddings [2304.07919]. In parallel, “Visual Chain of Thought” proposed recursively generating multimodal infillings to bridge logical gaps in sequential data, making explicit the idea that intermediate steps could be both textual and visual rather than textual alone [2305.02317].

Subsequent work expanded this premise from prompt design to explicit multimodal reasoning substrates. “Chain of Images for Intuitively Reasoning” argued that current models merely align images into textual space and proposed using a series of generated images as intermediate representations; it also introduced the CoI evaluation dataset across 15 distinct domains where images can intuitively aid problem-solving [2311.09241]. “Cantor” reframed multimodal CoT as a perception-decision architecture in which visual context acquisition and logical reasoning are jointly organized through expert-role prompting inside a single MLLM, without fine-tuning or ground-truth rationales [2404.16033].

By 2025–2026, the field had diversified into several distinct but related families: hierarchical grounding for 3D vision-language learning [2503.06232], interleaved text-visual reasoning with explicit control tokens [2606.08464], dynamic visual-thought insertion [2603.21754], mutable visual state reasoning [2602.10494], latent-space or continuous-thought approaches [2602.00574][2508.12587], and parallel visual-linguistic reasoning for action-conditioned systems [2603.22280]. Across these lines, “dual CoT” no longer refers to a single architecture, but to the broader principle that visual information must remain available, revisable, and structurally coupled to reasoning.

## 2. Representational forms and architectural families

A useful conceptual synthesis is provided by “Visual Thoughts: A Unified Perspective of Understanding Multimodal Chain-of-Thought,” which distinguishes Textual-MCoT, taking multimodal input and producing textual output, from Interleaved-MCoT, which generates interleaved image-text outputs [2505.15510]. The same work defines four forms of visual thought expression: Natural Language, Structured Language, Edited Image, and Generative Image. Its central claim is that these forms differ in clarity and conciseness, and that MCoT gains depend on those properties rather than on modality labels alone [2505.15510]. This suggests that dual CoT is best understood as a design space of intermediate representations rather than a single prompting convention.

Several architectural families instantiate that design space:

| Paradigm | Representative work | Defining mechanism |
|---|---|---|
| Textual visual thoughts | “Visual Thoughts” [2505.15510] | Natural Language or Structured Language as intermediate visual thought expressions |
| Explicit interleaving | “TVI-CoT” [2606.08464] | Learnable control tokens `<THINK>`, `<LOOK>`, `<ANSWER>` |
| Dynamic visual insertion | “DaP-ICoT” [2603.21754] | Confidence-triggered visual thought integration plus precise visual guidance |
| Mutable external state | “Canvas-of-Thought” [2602.10494] | HTML Canvas with DOM-based CRUD operations |
| Latent modal mixing | “Learning Modal-Mixed Chain-of-Thought Reasoning with Latent Embeddings” [2602.00574] | Text tokens interleaved with compact visual sketches represented as latent embeddings |
| Continuous latent reasoning | “MCOUT” [2508.12587] | Iteratively refined continuous hidden vector in joint latent space |
| Parallel dual-branch reasoning | “DualCoT-VLA” [2603.22280] | Visual CoT and linguistic CoT via separate learnable query tokens |

The interleaving family makes the visual-text alternation explicit. TVI-CoT augments a base MLLM with control tokens and a visual grounding module, so that the model alternates between reasoning and visual access during generation. At each `<LOOK>` step, reasoning-conditioned attention over visual tokens is computed as
$$
\alpha_t = \text{softmax}\left(\frac{\mathbf{h}_t \mathbf{W}_q (\mathbf{v} \mathbf{W}_k)^\top}{\sqrt{d}}\right),
$$
and the top-\(k\) attended visual tokens with \(k=32\) are retrieved as the grounding set [2606.08464].

Other families treat dual Co

Source: https://www.emergentmind.com/topics/visual-text-dual-chain-of-thought