---
title: Representational Decomposability
url: https://www.emergentmind.com/topics/representational-decomposability
type: topic
---

# Representational Decomposability

Representational decomposability is the property that a representation can be factored into interpretable, reusable components rather than treated as a single opaque vector or monolithic function. In the recent literature, this idea appears in several technically distinct forms: additive attribute embeddings for recognition, symbolic grammars for abstract visual reasoning, part–prototype factorizations for images, geodesically additive tangent-space models for vision–language embeddings, and semantic-preserving subnetworks defined relative to a model’s decision boundary [1812.09213] [2604.21346] [2204.08090] [2503.17142] [2604.07868]. Across these formulations, the common claim is not merely that a system can be partitioned, but that global behavior can be reconstructed or analyzed from structured local units.

## 1. Formal criteria and recurring dimensions

A first formalization treats decomposability as additive reconstruction from named primitives. In "Learning Compositional Representations for Few-Shot Recognition", each image \(x\) is associated with a derivation \(D(x)\) over an attribute vocabulary \(\mathcal{D}_0\), and a representation \(f_\theta(x)\) is compositional if
\[
f_{\theta}(x_i) = \sum_{d \in D(x_i)} \hat{f}_{\eta}(d).
\]
The paper then relaxes this hard equality to
\[
f_\theta(x_i)= \sum_{d \in D(x_i)} \hat{f}_\eta(d) + w(x_i),
\]
and adds an orthogonality penalty
\[
R_{\text{orth}}(\eta)= \mid \eta \eta^T - I \mid
\]
to encourage factorization of attribute directions [1812.09213].

A second formalization is geometric rather than linear. "Not Only Text" defines geodesically decomposable embeddings by requiring primitive-specific tangent vectors \(z_i^\# \in T_\mu M\) such that, for a composition \(z=(z_1,\dots,z_s)\),
\[
u_{z} = \Exp_\mu \big( z_{1}^\# + \dots + z_{s}^\# \big),
\]
with the centering constraint
\[
\sum_{z_i \in Z_i} z_i^\# = 0.
\]
Here decomposability is not additive in ambient Euclidean space, but additive in the tangent space of a manifold such as the unit sphere \(S^{d-1}\) [2503.17142].

A third formalization is semantic and structural. "On the Decompositionality of Neural Networks" defines a decomposition
\[
F_\theta^\downarrow(x) = A\big(m_1(x), \dots, m_K(x)\big)
\]
and requires boundary-aware semantic fidelity
\[
\mathrm{Dis}_\tau\left(F_\theta^\downarrow \,\middle|\, F_\theta\right) \le \varepsilon,
\]
together with structural divergence constraints
\[
\mathrm{Overlap}(S_i, S_j) \le \gamma,\qquad \frac{|S_k|}{|S|} \le 1-\eta.
\]
Decomposability is therefore defined as a semantic-preserving abstraction over a network’s internal supports, not as pruning alone [2604.07868].

A fourth formalization is explicitly hierarchical. In "Symbolic Grounding Reveals Representational Bottlenecks in Abstract Visual Reasoning", Bongard-LOGO is represented as
\[
\text{Problem} \to \text{Image} \to \text{Shape} \to \text{Action},
\]
with images decomposed into LOGO-style primitives whose attributes are explicitly separable across type, style, and geometry [2604.21346].

These definitions differ in ontology, but they recur along the same axes: a unit of decomposition, a composition rule, an explicit constraint against entanglement, and a criterion that the decomposition remain behaviorally meaningful. This suggests that representational decomposability is not a single formal object but a family of constraints on how structure is exposed.

## 2. Symbolic decomposability in abstract visual reasoning

In Bongard-LOGO, each problem contains six positive images \(\{x^+_1,\dots,x^+_6\}\), six negative images \(\{x^-_1,\dots,x^-_6\}\), and one query image \(x^?\). The task is to infer a rule \(R\) such that \(R(x^+_i)=\text{true}\), \(R(x^-_j)=\text{false}\), and then classify the query. The benchmark emphasizes geometric, relational, and topological concepts, and each image is generated by a ground-truth LOGO program. The paper’s Componential–Grammatical paradigm replaces pixels with symbolic inputs, either as Action Programs of the form `line_TYPE_LENGTH-TURNANGLE` and `arc_TYPE_ARCANGLE_ARCRADIUS-TURNANGLE`, or as Action Descriptions rendered as stepwise English clauses. Both formats preserve decomposition at the levels of problem, image, shape, and primitive action [2604.21346].

This change in representation produces large empirical differences. The visual baseline, Gemini-2.5-Flash on pixels, reaches \(50.2\%\) on Free-form, \(49.8\%\) on Basic, and \(50.1\%\) on Human-designed problems, essentially chance for a binary task. By contrast, pooled over 12 LLMs, C–G with Action Programs reaches \(78.1\%\) on Free-form, \(68.8\%\) on Basic, and \(61.0\%\) on Human-designed, while Action Descriptions reach \(79.3\%\), \(72.0\%\), and \(59.1\%\), respectively. The best model, Phi-4-Reasoning, attains \(96.2\%\) on Free-form problems in the AP setting. Minimal-context prompting remains close to the full AP condition, with \(77.3\%\) versus \(78.1\%\) on Free-form, and concept conditioning adds only small pooled gains of \(+1.3\), \(+1.2\), and \(+0.2\) points on Free-form, Basic, and Human-designed splits. In a VLM-capable subset, grounded C–G with symbolic input plus the query image gives \(62.4\%\), \(55.3\%\), and \(58.2\%\), compared with a visual-only baseline of \(62.6\%\), \(57.1\%\), and \(57.5\%\), so adding the query image does not systematically help [2604.21346].

The significance of these numbers is narrow but strong. The paper explicitly treats symbolic grounding as a diagnostic probe, not a practical multimodal architecture. Its main claim is that the dominant bottleneck on Bongard-LOGO lies in representation rather than reasoning: when the input is already hierarchical, compositional, and factorized, the same class of language models can perform strong abstract visual reasoning.

## 3. Attribute, part, and primitive factorization in vision

In supervised recognition, decomposability has been enforced by attribute-aligned feature spaces. "Learning Compositional Representations for Few-Shot Recognition" uses category-level attribute annotations and a soft compositionality loss that aligns image features with positive attributes and pushes them away from negative ones. On CUB-200-2011 with a ResNet-10 and cosine classifier, 1-shot top-5 accuracy on novel classes rises from \(46.1\) to \(52.5\), and with data augmentation to \(53.6\). On SUN, it rises from \(35.4\) to \(43.4\), and with augmentation to \(45.9\). On ImageNet 1-shot novel classes, the method reaches \(49.3\), compared with a best previous \(45.8\). Network Dissection analysis on SUN shows the number of interpretable units in the last layer increasing from 169 to 333, and unique concepts from 92 to 119 [1812.09213].

A different construction appears in Recognition as Part Composition. RPC first extracts \(M\) part-level features with a Multi-Attention CNN, then represents each part as a mixture over \(K\) prototypes. For part \(m\),
\[
\pi_m(x) = \phi(P_m z_m(x)), \qquad z_m(x) \approx D_m^\top \pi_m(x),
\]
and the full image code is \(\pi(x)=[\pi_1(x);\dots;\pi_M(x)]\). On miniImageNet, RPC reports \(63.9\%\) 1-shot and \(84.57\%\) 5-shot accuracy; on CUB few-shot, \(75.0\%\) and \(89.6\%\). In human evaluation, part-only class identification reaches \(94.2\%\), and prototype recognition accuracies are \(92.96\%\), \(95.73\%\), and \(96.98\%\) across the three parts. Under FGSM at \(\epsilon=0.2\), RPC retains about \(40\%\) accuracy on CUB and about \(30\%\) on Cars, whereas the baselines drop below \(20\%\) and about \(5\%\), respectively [2204.08090].

Physical Primitive Decomposition pushes factorization into geometry and physics. Each primitive is a rigid oriented box with size \(x_k^\text{S}\), translation \(x_k^\text{T}\), rotation \(x_k^\text{R}\), and density \(x_k^\text{D}\in\{1,\dots,100\}\). The object representation is the set \(x=\{x_k\}_{k=1}^n\), trained jointly from voxelized shape, RGB appearance, and physical trajectories. On block towers, geometric decomposition reaches F1 \(\approx 97.5\); on tools, F1 \(\approx 85.9\). For density estimation on tools, PPD full reports Top-1 \(35.7\%\) and RMSE \(2.6\), improving to \(38.3\%\) and \(2.5\) with sampling, compared with \(7.7\%\)/\(16.8\) for image-only and \(15.0\%\)/\(5.9\) for physics-only. In a real 2-block tower task, model-vs-truth correlation is \(0.90\), human-vs-truth \(0.71\), and human-vs-model \(0.69\) [1809.05070].

Taken together, these studies instantiate decomposability as explicit factorization into attributes, parts, prototypes, or physical primitives. They also show that the benefits are not identical: some gains appear as few-shot sample efficiency, some as interpretability, some as robustness, and some as better alignment with physically meaningful behavior.

## 4. Geometric and Jacobian-based decompositions

A post-hoc geometric account is given by Geodesically Decomposable Embeddings. For normalized VLM embeddings on the sphere, the paper maps image representations into a tangent space at the intrinsic mean \(\mu\), averages tangent vectors over slices that share a primitive, and reconstructs compositions through \(\Exp_\mu(v_a+v_o)\). On UT-Zappos closed-world compositional classification, CLIP zero-shot gives AUC \(4.4\), linear decomposition on image embeddings gives AUC \(0.9\), and GDE gives AUC \(13.9\) with HM \(29.3\). On MIT-States, the corresponding AUCs are \(11.1\), \(2.0\), and \(8.6\). In group robustness, GDE reaches worst-group accuracy \(86.4\) on Waterbirds and \(87.5\) on CelebA, with GAP \(5.0\) and \(0.4\), outperforming or matching task-specific debiasing baselines [2503.17142].

A complementary argument is that global embedding geometry is not an adequate proxy for compositional structure. "Global Geometry Is Not Enough for Vision Representations" tests 21 vision encoders and finds near-zero correlation between compositional binding and standard geometry statistics: G.PR versus binding \(r=-0.00, p=0.998\), G.Iso \(r=+0.18, p=0.423\), and L.Iso \(r=+0.05, p=0.817\). In contrast, Jacobian Effective Rank correlates with binding at \(r=0.65, p=0.001\), with cross-validated \(R^2=0.43\); combining JER with the Same/Different structural control yields \(R^2 \approx 0.74\) and leave-one-out \(R^2 \approx 0.65\). The paper’s analytic account attributes this disparity to objective design: existing losses constrain embedding geometry but leave the local input–output mapping underconstrained [2602.03282].

A third geometric perspective models representations as coordinates on a random lattice with percolation structure. "Representation Learning on a Random Lattice" classifies learned features into context, component, and surface features. In the high-dimensional analysis, the lattice is approximated by a Bethe lattice with percolation threshold
\[
p_c=\frac{1}{z-1},
\]
and the model assigns high-level context features to clusters, component features to coordinates within a cluster, and surface features to format-specific or shortcut structure. The paper argues that cluster geometry has fractal dimension \(D=4\), so many component features should be intrinsically multidimensional rather than one-dimensional linear directions [2504.20197].

These papers converge on a specific correction to a common simplification. A representation can be globally well-spread and still fail to expose the local factor structure needed for binding, robustness, or controlled composition. In that sense, decomposability is closer to geometry-aware factorization or functional sensitivity than to isotropy alone.

## 5. Distributional and linguistic decomposability

In idiom processing, decomposability has been recast as a model-internal property of contextualized sentence representations. "Rethinking the Idiomaticity Decomposability Hypothesis" defines decomposability as the degree of semantic alignment between an idiom sentence \(s\) and a glossed sentence \(s_g\), then measures token contribution by masking each idiom token \(j\) and computing
\[
\Delta_j = \big| S_{\mathrm{fig}} - S_{\mathrm{mask}}^{(j)} \big|.
\]
Expression-level decomposability is then aggregated over \(\{\Delta_j\}\) by mean, maximum, Gini dispersion, or entropy. The paper evaluates BERT-base, BERT-large, ModernBERT, and OLMo checkpoints, and the best human-aligned configuration is BERT-large uncased, final layer, Wasserstein similarity, and sum aggregation, with correlation \(r(90)=0.24, p=0.005\) against human decomposability ratings [2606.03817].

The relationship to syntax is notably weak and often reversed. Across 527 idioms, the maximum reported decomposability–flexibility correlation is
\[
r(527)=-0.16,\quad p=0.0002,
\]
and by idiom type the PP subset yields \(\rho=-0.24, p=0.01\), while the VP subset shows \(\rho=-0.02, p=0.68\). Human decomposability ratings do not significantly correlate with corpus-based syntactic flexibility. In pretraining analyses over 100 OLMo checkpoints, representational stabilization is not explained by frequency alone: surprisal, decomposability, and frequency all contribute, with interaction coefficients \(-0.0008\), \(-0.0007\), and \(-0.0010\) for steps \(\times\) frequency, steps \(\times\) surprisal, and steps \(\times\) decomposability, respectively, and decomposability shows the strongest training-dependent effect [2606.03817].

This literature narrows the meaning of decomposability in language. It is not simply a proxy for human semantic transparency, nor does it robustly predict syntactic flexibility. Instead, in these results it behaves as an emergent distributional property of how figurative meaning is distributed across constituents during learning.

## 6. Semantic-preserving and representation-independent decomposition

Neural decompositionality makes decomposability into an explicit semantic contract. SAVED constructs component subnetworks \(m_k\), mines low-margin inputs near the decision boundary, and learns structure-aware masks while tracking empirical disagreement
\[
\widehat{\mathrm{Dis}_\kappa\!\bigl(F^\downarrow_\theta \mid F_\theta;\, S\bigr)}.
\]
On BERT-small for DBPedia-14, LBMask reports \(\widehat{\mathrm{Dis}_\kappa}=0.0521\), Hoeffding-corrected \(0.0636 \le 0.1\), max overlap \(0.3629 \le 0.5\), min prune \(0.5 \ge 0.3\), and boundary confusion deviation \(0.0700 \le 2\varepsilon\), so the local contract is satisfied. On AG News, semantic fidelity fails despite acceptable structural statistics, and for ResNet-34 and DeiT-small on CIFAR-10, structured masking yields structural separation but boundary-local disagreement remains too high. The paper therefore reports a marked architectural difference: BERT on DBPedia-14 is decompositional under the proposed contract, whereas the tested vision models are not [2604.07868].

A more abstract formalization appears in "Representation Independent Decompositions of Computation". The paper generalizes from semigroups to semigroupoids and gives a decomposition procedure with three stages: collapse, copy, and compress. Starting from a surjective relational functor \(\varphi:S\twoheadrightarrow T\), it defines the tracing product \(T\times_\varphi S\), compresses equivalent preimages into a kernel \(K_\varphi\), and proves that the pinhole cascade product \(T \wr_\varphi K_\varphi\) emulates the original system:
\[
S \hookrightarrow T \wr_\varphi K_\varphi.
\]
The point of the construction is that the decomposition is stated in terms of arrows, objects, and relational functors rather than any particular state encoding, so decomposability is representation independent in a categorical sense [2504.04660].

These works move decomposability away from heuristic modularization. In one case the criterion is preservation of decision-boundary semantics under structural separation; in the other it is an iterative algebraic factorization of computation that is independent of concrete representation.

## 7. Scope, misconceptions, and open questions

Several recurring caveats limit how far current claims can be taken. In Bongard-LOGO, symbolic grounding is explicitly a diagnostic upper bound with oracle access to ground-truth programs rather than a learned perception system, and even with perfect symbolic input, Human-designed accuracy remains around \(60\%-66\%\), so residual reasoning difficulty remains [2604.21346]. In attribute-based compositional representation learning, hard equality \(f=\sum_d \hat f(d)\) is often too strong because attributes are not exhaustive; the practical method is the softer additive-plus-residual form, and the orthogonality constraint may conflict with correlated attributes [1812.09213]. In GDE, decomposability depends on a predefined factorization such as attribute \(\times\) object and on a tangent-space approximation that is justified only locally; the method does not discover factorization unsupervised [2503.17142]. In vision representation analysis, global isotropy and participation ratio are shown to be nearly blind to compositional binding, so geometry alone should not be treated as a proxy for decomposability [2602.03282]. In language, model-derived idiom decomposability correlates only weakly with human judgments and shows a small negative relationship with syntactic flexibility, which cautions against equating representational decomposability with traditional psycholinguistic decomposability [2606.03817]. In neural decompositionality, pruning is not sufficient: unstructured pruning can preserve semantics while collapsing structure, and structured pruning can preserve structure while violating boundary semantics [2604.07868].

A recurring misconception is that decomposability is synonymous with interpretability or sparsity. The cited work does not support that equivalence. In these papers, decomposability is variously tied to additive recoverability, grammar-like structure, manifold-aware composition, local functional sensitivity, or semantic-preserving modularity. A plausible implication is that decomposability is task-aligned rather than universal: representations appear decomposable when their factorization matches the causal, relational, or decision-boundary structure that the task actually requires.

Source: https://www.emergentmind.com/topics/representational-decomposability