---
title: 'Chat-CBM: Conversational Concept Bottlenecks'
url: https://www.emergentmind.com/topics/chat-cbm
type: topic
---

# Chat-CBM: Conversational Concept Bottlenecks

Searching arXiv for the Chat-CBM paper and closely related concept bottleneck work.
Chat-CBM is a concept bottleneck model in which the conventional score-based label predictor is replaced by a language-based classifier implemented with a frozen large language model. In standard CBMs, an input \(x \in \mathcal{X}\) is mapped to a concept activation vector \(c \in [0,1]^{N_c}\), and then to a class label \(y \in \{1,\dots,M\}\) through a typically linear classifier. Chat-CBM preserves the bottleneck structure but shifts prediction into the semantic space of concepts: activated concepts are decoded into textual concept semantics, candidate labels are proposed by the original CBM head, and a frozen LLM reasons over those semantics, optionally augmented by in-context demonstrations and class-prior descriptions, to select a label [2509.17522].

## 1. Origins in concept bottlenecks and interactive prediction

Concept bottleneck models are interpretable neural networks that first predict labels for human-interpretable concepts relevant to the prediction task and then predict the final label from those concept predictions. In the standard formulation, the concept predictor \(g\) produces \(\hat c = g(x)\), with \(g_j(x) \in [0,1]\) for concept \(j\), and the label predictor \(h\) computes
\[
p(y=i \mid \hat c) = \mathrm{softmax}(W\hat c + b)_i,\qquad
\hat y = \arg\max_i p(y=i \mid \hat c).
\]
This architecture makes the internal decision interface legible and editable, but the usual fixed linear classifier restricts interventions to numerical manipulation of concept scores [2509.17522].

A precursor line extended CBMs to interactive prediction settings by allowing the model to query a human collaborator for the label to some concepts at test time. In that setting, the model maintains a set \(S\subset\{1,\dots,m\}\) of acquired ground-truth concepts and chooses which remaining concept to request next so as to maximally improve the final prediction. The policy combines concept prediction uncertainty and concept influence on the current top-scoring label, and the resulting interactive CBM was reported to achieve accuracy gains of \(5\)–\(10\%\) with only \(5\) interactions over competitive baselines on Caltech-UCSD Birds, CheXpert, and OAI [2212.07430].

This progression clarifies Chat-CBM’s research position. Interactive CBMs made the bottleneck queryable; Chat-CBM generalizes the intervention interface by replacing a fixed score-based classifier with a conversational, semantics-aware classifier. This suggests that the central innovation is not the bottleneck itself, but the relocation of decision making from a linear map over scores to an LLM that reasons over concept names, descriptions, and user-supplied language.

## 2. Semantic bottleneck architecture

Chat-CBM introduces what the paper describes as a language-based classifier on a semantic bottleneck. Rather than sending the numerical vector \(\hat c\) directly into a fixed linear layer, the model decodes \(\hat c\) into a semantic list
\[
\hat s = \mathrm{decode}(\hat c),
\]
consisting of the textual names or short descriptions of all concepts whose score exceeds \(0.5\), or the top-\(K\) concepts in unsupervised settings. The original label head \(h(\cdot)\) is still used, but only to generate a candidate set
\[
Y=\{y_1,\dots,y_N\}=\mathrm{top}\text{-}N(h(\hat c)).
\]

The final prompt is a knowledge-enhanced semantic bottleneck prompt comprising four components: a fixed task instruction \(I\), an in-context demonstration set \(D=\{(\hat s^{(k)}_{\mathrm{val}}, y_{\mathrm{val}})\}\), an optional class-prior \(\theta=\{\theta_i\}\) describing common attributes for each candidate class, and the test-time semantic list \(\hat s\). The LLM is then asked to choose one of the candidates, with the paper formalizing the decision rule as
\[
P(y_i \mid D,\theta,\hat s)\coloneqq f_{\mathcal M}(\text{prompt}, \text{candidate}=y_i),\qquad
\hat y=\arg\max_{y_i\in Y} P(y_i \mid D,\theta,\hat s).
\]
In this construction, the original CBM still supplies the bottleneck and a candidate shortlist, but semantic reasoning is delegated to the frozen LLM [2509.17522].

The architecture is motivated by a specific limitation of traditional CBMs: users can intervene in the concept space, but a fixed linear classifier over concept scores prevents the incorporation of new concepts or domain knowledge at test time. The 2025 paper further states that this limitation is particularly severe in unsupervised CBMs, where concept activations are often noisy and densely activated, making user interventions ineffective. Chat-CBM addresses this by grounding prediction in the semantic space of concepts rather than only in their numerical activations [2509.17522].

## 3. Intervention interface

Because the label predictor is conversational, Chat-CBM supports two classes of intervention. The first is numerical concept correction, which mirrors standard CBMs. A user edits the concept activation vector, \(\hat c \rightarrow \hat c_{\mathrm{new}}\), after which the model recomputes
\[
\hat s_{\mathrm{new}}=\mathrm{decode}(\hat c_{\mathrm{new}}),\qquad
Y_{\mathrm{new}}=\mathrm{top}\text{-}N(h(\hat c_{\mathrm{new}})),
\]
and reinvokes the LLM to obtain an updated prediction
\[
\hat y_{\mathrm{new}}=\arg\max_{y_i\in Y_{\mathrm{new}}} P(y_i \mid D,\theta,\hat s_{\mathrm{new}}).
\]

The second class is conversational intervention. The model maintains a chat history \(\mathcal H\) and accepts free-form textual feedback \(u_{\text{text}}\). The paper enumerates three types: concept correction, concept addition or removal, and high-level reasoning guidance. The LLM input becomes
\[
[I,\,D,\,\{\theta_i\},\,\hat s,\,\mathcal H,\,u_{\rm text}],
\]
and the updated prediction is
\[
\hat y_{\mathrm{new}}=\arg\max_{y_i\in Y} P\bigl(y_i \mid D,\theta,\hat s,\mathcal H,u_{\rm text}\bigr).
\]
Illustrative interventions given in the paper include “Actually the bird’s bill is *hooked*, not straight,” “Add concept: ‘yellow belly’,” “Ignore size-related concepts,” and “Focus on feather pattern when uncertain” [2509.17522].

This interface distinguishes Chat-CBM from the earlier interactive CBM policy framework. In the earlier setting, interaction consists of selectively acquiring ground-truth concept labels according to an acquisition score such as \(A(c_i)=U(c_i)\cdot I(c_i)\), where \(U\) is concept uncertainty and \(I\) is concept influence on the label predictor. In Chat-CBM, by contrast, interventions can be numerical or linguistic and can include external knowledge or reasoning advice, not just correction of existing concept coordinates [2212.07430].

## 4. Training and inference pipeline

Chat-CBM preserves the underlying CBM training regime and leaves the LLM frozen. For supervised CBMs with ground-truth concept labels, the concept predictor \(g\) is trained with
\[
L_c = \mathbb{E}_{(x,c)}\sum_{j=1}^{N_c}\mathrm{BCE}\bigl(g_j(x),c_j\bigr),
\]
and the linear label head \(h\) is trained independently with
\[
L_y = \mathbb{E}_{(c,y)} -\log h_y(c).
\]
The reported implementation uses AdamW and CosineAnnealingLR. For unsupervised CBMs, the bottleneck is constructed with
\[
g(x)=\mathrm{cosine}(e_v(x), e_t(t_j))
\]
for each concept \(t_j\) in a large CLIP-derived bank, and only \(h\) is trained on \((\hat c,y)\). In all cases, the LLM classifier is fully frozen, with prompts \(I\), \(D\), \(\theta\), and \(\hat s\) designed by hand rather than learned [2509.17522].

The inference-time workflow is explicitly specified in seven steps. The model first computes \(\hat c=g(x)\), extracts top-\(K\) concept semantics \(\hat s=\mathrm{decode}(\hat c)\), and generates candidate labels \(Y=\mathrm{top}\text{-}N(h(\hat c))\). It then selects \(K\) in-context examples per candidate to form \(D\), optionally computes a per-class prior \(\theta\) from training-set statistics given by average concept frequencies \(>0.5\), and forms a single long prompt containing the instruction, ICL examples, class-prior sentences, and test input semantics. The LLM is called with `do_sample=true`, `top_k=10`, and `max_length` up to \(8\)–\(10\)K tokens, after which the model parses structured output of the form `<analysis: …><answer: class>` [2509.17522].

Ablation results indicate that prompt construction is not incidental. The paper reports that adding class-prior \(\theta\) and clean ICL demonstrations \(D\) each yields substantial gains, exemplified on CUB by an accuracy change from \(0.645 \rightarrow 0.775 \rightarrow 0.801\) depending on combination. It also reports that increasing the number of ICL shots improves accuracy, with an example on CUB where \(N=2\) candidates and \(K=1 \rightarrow 3\) improves \(0.784 \rightarrow 0.798\). Larger models such as LLaMA3-70B relative to 8B and Qwen2.5-14B relative to 7B consistently outperform smaller ones, although gains saturate beyond approximately \(14\)B for some datasets [2509.17522].

## 5. Empirical performance

The experimental evaluation spans nine datasets divided into supervised and unsupervised CBM settings. The supervised datasets are CUB with \(112\) bird concepts and \(200\) classes, AwA2 with \(85\) animal attributes and \(50\) classes, and PBC with white blood cell attributes and \(5\) classes. The unsupervised datasets are DTD, Food-101, Flower-102, CIFAR10, CIFAR100, and ImageNet. The main metric is top-1 classification accuracy, with concept-prediction accuracy also reported where available. Supervised baselines are Hard CBM, ProbCBM, CEM, and ECBM; unsupervised baselines are LaBo and V2C-CBM. The LLMs evaluated are LLaMA3-8B/70B and Qwen2.5-7B/14B/32B/72B, all in instruct variants [2509.17522].

On supervised datasets without intervention, the paper reports the following changes from a standard CBM baseline to Chat-CBM: CUB \(75.2\% \rightarrow 81.5\%\) for a gain of \(+6.3\) percentage points, AwA2 \(92.3\% \rightarrow 96.4\%\) for \(+4.1\) percentage points, and PBC \(98.8\% \rightarrow 98.6\%\), described as a slight change but with substantially greater robustness under intervention. On unsupervised datasets in the \(2\)-shot setting, Chat-CBM averages \(1.8\) percentage points above LaBo and \(9.5\) percentage points above V2C-CBM [2509.17522].

The intervention results are central to the model’s identity. For supervised CBMs, Chat-CBM’s accuracy is reported to quickly approach \(100\%\) as users correct concepts, whereas standard CBMs plateau much lower. For unsupervised CBMs, the paper states that within \(5\) natural-language interventions, Chat-CBM surpasses the all-shot baseline accuracy. These observations are consistent with the paper’s claim that semantic reasoning makes interventions effective even when raw concept activations are noisy and densely activated [2509.17522].

| Setting | Reported result |
|---|---|
| CUB | CBM \(75.2\%\) \(\rightarrow\) Chat-CBM \(81.5\%\) |
| AwA2 | CBM \(92.3\%\) \(\rightarrow\) Chat-CBM \(96.4\%\) |
| PBC | CBM \(98.8\%\) \(\rightarrow\) Chat-CBM \(98.6\%\) |
| Unsupervised, 2-shot | \(+1.8\) pp over LaBo; \(+9.5\) pp over V2C-CBM |
| Supervised intervention | Accuracy quickly approaches \(100\%\) |
| Unsupervised intervention | Within \(5\) natural-language interventions, surpasses all-shot baseline |

These results should be interpreted with the model’s evaluation design in mind. Candidate labels are generated by the original head \(h(\hat c)\), and the LLM reasons over a restricted top-\(N\) class set rather than the full label space. A plausible implication is that Chat-CBM leverages semantic disambiguation within a shortlist rather than replacing the original CBM pipeline end-to-end.

## 6. Use cases, limitations, and interpretability claims

The paper identifies four use cases. In medical imaging, exemplified by PBC, experts can correct or add pathological attributes in real time. In fine-grained ecology, such as bird or flower identification, field biologists can inject domain knowledge such as “this species often has a crest.” In interactive education, students can query and refine model reasoning through natural-language feedback. In low-label domains, unsupervised CBMs combined with Chat-CBM support meaningful interventions even without concept supervision [2509.17522].

The same paper also states four limitations. First, computational cost remains materially higher than for standard CBMs because each image requires an LLM call, quantified as approximately \(3\) seconds per image with an \(8\)B model on an L40. Second, incomplete concept sets remain a bottleneck: if human-defined concepts omit key distinguishing features, Chat-CBM cannot learn new latent concepts without external text prompts. Third, frozen LLMs may inject harmful or biased prior knowledge, so deployment in high-stakes settings demands alignment, filtering, or unlearning of undesirable behaviors. Fourth, long chains of intervention increase context length, potentially requiring larger GPUs or dynamic retrieval of demonstrations [2509.17522].

These constraints qualify Chat-CBM’s interpretability claims. The model preserves the CBM property that users can see and edit concept-level explanations, but the final classifier is no longer a transparent linear map over concept scores. Instead, interpretability is mediated through concept semantics, candidate labels, prompt design, and the reasoning behavior of a frozen LLM. This suggests a shift from parametric transparency to interactive, language-mediated interpretability: the bottleneck remains human-readable, yet the mapping from bottleneck to label becomes more expressive, more adaptable to intervention, and correspondingly more dependent on prompt engineering and LLM behavior.

Source: https://www.emergentmind.com/topics/chat-cbm