---
title: Any-Subgroup Equivariant Network (ASEN)
url: https://www.emergentmind.com/topics/any-subgroup-equivariant-network-asen
type: topic
---

# Any-Subgroup Equivariant Network (ASEN)

Searching arXiv for the cited ASEN papers and closely related work to ground the article.
An Any-Subgroup Equivariant Network (ASEN) is a neural-network construction intended to realize equivariance with respect to a chosen subgroup rather than a single, fixed symmetry class selected a priori. Across the cited literature, the term is used for several related constructions: subgroup selection by group decomposition and neural architecture search in finite groups [2104.04848], finite-subgroup equivariance via graph automorphism groups and bilabelled-graph bases [2307.07810], subgroup restriction by symmetry breaking inside a fully permutation-equivariant model [2603.19486], encoder–decoder latent decompositions separating invariant and equivariant components [2202.07559], and subgroup restriction of general equivariant architectures on reductive Lie groups [2306.00091]. Taken together, these works define ASEN less as a single canonical architecture than as a family of mechanisms for making subgroup equivariance selectable, constructible, or learnable.

## 1. Terminological scope and core definition

The central object shared by these works is equivariance. Let \(G\) be a group acting on feature spaces \(\mathcal X\) and \(\mathcal Y\) through linear representations \(\Gamma_x:G\to GL(\mathcal X)\) and \(\Gamma_y:G\to GL(\mathcal Y)\). A map \(\phi:\mathcal X\to\mathcal Y\) is \(G\)-equivariant if
\[
\phi(\Gamma_x(g)x)=\Gamma_y(g)\phi(x)\qquad \forall g\in G,\;x\in\mathcal X.
\]
This formulation appears explicitly in the group-decomposition treatment of autoequivariant networks [2104.04848].

Within that common formalism, ASEN refers to architectures that can realize equivariance to arbitrary subgroups drawn from a larger ambient symmetry class. In the finite-group setting, this may mean composing subgroup-equivariant layers associated with factors \(H_1,\dots,H_m\) whose semidirect or direct products reconstruct a larger group [2104.04848]. In the permutation setting, it may mean taking a fully \(S_n\)-equivariant base model and restricting equivariance to \(G\le S_n\) by appending an auxiliary structure \(\mathcal H\) whose automorphism group is \(G\) or \(G^{(2)}\) [2603.19486]. In graph-based constructions, it may mean realizing any finite subgroup \(H\le S_n\) through a graph \(G\) with \(\mathrm{Aut}(G)\cong H\), then building all linear \(\mathrm{Aut}(G)\)-equivariant maps between tensor-power features [2307.07810]. In representation-theoretic settings for reductive Lie groups, it means restricting a \(G\)-equivariant layer construction to any closed subgroup \(H\subseteq G\) by representation restriction and intertwiner-based layer design [2306.00091].

A plausible implication is that ASEN is best understood as a design principle: start from a symmetry-rich model class and introduce mechanisms that permit exact or approximate restriction to a specified subgroup.

## 2. Group decomposition and architecture search

One formulation of ASEN originates in the result that equivariance to a large group can be reduced to equivariance to smaller groups from which it is constructed [2104.04848]. For a semidirect product \(G=H_1\rtimes_\alpha H_2\), with restricted actions \(\mu_x^{H_i}\) and \(\mu_y^{H_i}\), the paper states that a linear map \(\phi:\mathcal X\to\mathcal Y\) is \(G\)-equivariant under \((\Gamma_x,\Gamma_y)\) if and only if it is \(H_i\)-equivariant under \((\mu_x^{H_i},\mu_y^{H_i})\) for \(i=1,2\) [2104.04848]. By induction, if \(G\) decomposes as a chain of semidirect or direct products of subgroups \(H_1,\dots,H_m\), then \(G\)-equivariance is equivalent to equivariance to each factor.

This theorem leads directly to a constructive ASEN recipe for MLP-like layers. A fully connected layer with input index set \(N\), output index set \(M\), and weight matrix \(W\in\mathbb R^{|M|\times |N|}\) is made \(H\)-equivariant by tying together all entries \(W_{m,n}\) lying in a common orbit of the joint action of \(H\) on \(N\times M\) [2104.04848]. Instead of computing orbits under the full group \(G\), the proposed fast construction computes a combined orbit index using subgroup actions only, with complexity
\[
O((|H_1|+\cdots+|H_m|)\cdot |N|\cdot |M|)
\]
rather than
\[
O(|G|\cdot |N|\cdot |M|).
\]
The resulting weight matrix is defined through shared parameters \(\theta_{I[n,m]}\), and layerwise nonlinearity preserves equivariance [2104.04848].

The same work treats subgroup choice as a discrete architecture-search problem. The search state is a binary mask over candidate subgroups, possibly extended with augmentation choices and channel-size options in a GCNN setting. Actions toggle subgroup inclusion or modify augmentation/channel flags. A deep Q-network \(Q_\phi(s,a)\) is trained with Bellman updates,
\[
Q(s,a)=R(s,a)+\gamma\max_{a'}Q(s',a'),
\]
and the reward can combine validation accuracy with a parameter-count penalty [2104.04848]. In this usage, ASEN is not only a layer-construction method but also a search space over equivariance patterns.

## 3. Symmetry breaking from full permutation equivariance

A later formulation begins from a fully permutation-equivariant base model
\[
h_\theta:\mathbb R^{n\times d_x}\times \prod_{k=1}^K \mathbb R^{n^k\times d_k}\to \mathbb R^{n\times d_y}
\]
satisfying
\[
h_\theta\bigl(P\cdot X,\;P^{\otimes 1}A^{(1)},\dots,P^{\otimes K}A^{(K)}\bigr)=P\,[h_\theta(X,A^{(1)},\dots,A^{(K)})]
\]
for every \(P\in S_n\) [2603.19486]. In practice, that work takes \(K=2\) and implements each layer as a standard Message-Passing Neural Network with injective MLPs \(\psi_e,\psi_n,\phi\) and an injective multiset aggregator \(\tau\) [2603.19486].

Subgroup restriction is then induced by a fixed auxiliary symmetry-breaking input. The model appends a “hypergraph” \(\mathcal H=(A^{(1)},A^{(2)})\) whose automorphism group is exactly or approximately the desired subgroup \(G\le S_n\), and defines
\[
f_\theta(X)=h_\theta(X,\mathcal H).
\]
If \(\mathrm{Aut}(\mathcal H)=G\), then for all \(g\in G\),
\[
f_\theta(gX)=g\,f_\theta(X),
\]
while in general \(f_\theta\) is not equivariant outside \(G\) [2603.19486]. The mechanism is therefore explicit symmetry breaking inside an ambient \(S_n\)-equivariant architecture.

Because exact symmetry-breaking inputs are computationally hard to find, the paper relaxes the construction through 2-closure. Given \(G\le S_n\), its 2-closure \(G^{(2)}\) is the largest subgroup of \(S_n\) acting identically to \(G\) on unordered pairs \([n]^2\). If \([n]^2\) is partitioned into \(G\)-orbits \(\{\tau_1,\dots,\tau_q\}\), then the edge-orbit labelling tensor \(A^{(2)}\in [q]^{n\times n}\) satisfies
\[
G^{(2)}=\mathrm{Aut}(A^{(2)})=\{P\in S_n:\;P\cdot(i,j)\sim_G(i,j)\;\forall (i,j)\},
\]
and equivalently
\[
G^{(2)}=\mathrm{Aut}(A^{(2)})=\{P\in S_n:\;P^{\otimes 2}A^{(2)}=A^{(2)}\}
\]
[2603.19486]. The construction computes pair orbits of the diagonal subgroup \(\Delta(G)\subseteq S_{n^2}\) via Schreier–Sims; orbit decomposition is stated as \(O(rn^2)\) time for generators \(\{\sigma_1,\dots,\sigma_r\}\), with preprocessing polynomial in \(n\) and \(r\) [2603.19486].

This symmetry-breaking view differs conceptually from group decomposition. Rather than assembling subgroup-equivariant components, it starts with maximal permutation equivariance and uses an auxiliary input to lower the symmetry of the realized function.

## 4. Finite-subgroup realization through graph automorphisms

A distinct ASEN construction is based on the observation that finite groups can be realized as graph automorphism groups [2307.07810]. For a graph \(G=(V,E)\) with \(|V|=n\), the automorphism group is
\[
\mathrm{Aut}(G)=\{\sigma\in S_n:\;\sigma A_G=A_G\sigma\},
\]
where \(A_G\in\{0,1\}^{n\times n}\) is the adjacency matrix. This group acts on \(\mathbb R^n\) and on tensor powers \((\mathbb R^n)^{\otimes k}\) through
\[
\rho_k(\sigma)(e_{i_1}\otimes\cdots\otimes e_{i_k})
=
e_{\sigma(i_1)}\otimes\cdots\otimes e_{\sigma(i_k)}
\]
[2307.07810].

The paper gives a full characterization of linear \(\mathrm{Aut}(G)\)-equivariant maps
\[
\Phi:(\mathbb R^n)^{\otimes k}\to (\mathbb R^n)^{\otimes l}.
\]
If \(W\in \mathbb R^{n^l\times n^k}\) is the matrix of \(\Phi\), equivariance is equivalent to
\[
P_l(\sigma)W=WP_k(\sigma)\qquad \forall \sigma\in \mathrm{Aut}(G),
\]
with \(P_r(\sigma)=\rho_r(\sigma)\) flattened to \(n^r\times n^r\) form [2307.07810].

A classical result summarized there states that
\[
\mathrm{Hom}_{\mathrm{Aut}(G)}((\mathbb R^n)^{\otimes k},(\mathbb R^n)^{\otimes l})
=
\mathrm{Span}_{\mathbb R}\{X_{\mathbf H}^G\mid [\mathbf H]\text{ an isomorphism class of }(k,l)\text{-bilabelled graphs}\}.
\]
For a \((k,l)\)-bilabelled graph \(\mathbf H=(H,\mathbf i,\mathbf o)\), the associated basis matrix \(X_{\mathbf H}^G\) is indexed by \((I,J)\in [n]^l\times [n]^k\) and has entries
\[
(X_{\mathbf H}^G)_{I,J}
=
\bigl|\{\phi:V(H)\to V(G)\text{ graph homomorphism}\mid \phi\circ \mathbf i=J,\;\phi\circ \mathbf o=I\}\bigr|
\]
[2307.07810]. Consequently, each linear layer can be written as
\[
W=\sum_{[\mathbf H]\in \mathcal G(k,l)} \lambda_{\mathbf H} X_{\mathbf H}^G.
\]
In practice one truncates to generating bilabelled graphs using the “no free components” result or Frobenius duality, then stacks these linear maps with pointwise nonlinearities to obtain an \(\mathrm{Aut}(G)\)-equivariant network [2307.07810].

The extension to arbitrary finite \(H\le S_n\) uses Frucht’s theorem: every finite group \(H\) is isomorphic to the automorphism group of some finite graph \(G\). The procedure is therefore to choose or construct such a graph and then apply the same homomorphism-matrix construction, yielding an \(H\)-equivariant network under the chosen embedding \(H\hookrightarrow S_n\) [2307.07810]. This places ASEN in direct contact with algebraic graph theory and invariant-theoretic characterizations of equivariant linear maps.

## 5. Representation-theoretic and encoder–decoder generalizations

Two further strands broaden ASEN beyond finite permutation groups.

For reductive Lie groups, an ASEN can be defined for any closed subgroup \(H\) of a reductive Lie group \(G\) by restricting finite-dimensional \(G\)-representations to \(H\) [2306.00091]. If \(V\) and \(W\) are \(G\)-modules, their tensor product carries the representation \((\rho_V\otimes \rho_W)(g)=\rho_V(g)\otimes \rho_W(g)\), and reductivity yields a Clebsch–Gordan decomposition
\[
V\otimes W\cong \bigoplus_{\lambda\in \Lambda} m_\lambda U_\lambda.
\]
After restriction to \(H\), every layer must intertwine the \(H\)-actions on input and output features [2306.00091]. The proposed ASEN layer on point-cloud or graph data consists of one-body basis functions \(\phi_{c,k}\), aggregated one-body features \(A_{i;c,k}\), \(n\)-body correlations, reduction to irreps through Clebsch–Gordan intertwiners, equivariant linear mixing, and norm-based gating. Group convolution on \(H\),
\[
(f*g)(x)=\int_H f(h)\,g(h^{-1}x)\,dh,
\]
is presented as the convolutional analogue of this construction [2306.00091]. This formulation treats ASEN as a subgroup-restriction principle internal to a general equivariant representation-theoretic framework.

A different generalization appears in unsupervised learning, where the ASEN framework separates a latent representation into an invariant code and a group-action component [2202.07559]. Given a group action \(\rho_X:G\to \mathrm{GL}(X)\), one encodes
\[
z_{\rm inv}=\eta(x)\in Z,\qquad g_{\rm act}=\psi(x)\in G,
\]
with \(\eta\) required to be \(G\)-invariant and \(\psi\) predicting the group element used to reconstruct the input through
\[
x_{\rm rec}=\rho_X(\psi(x))\,\delta(\eta(x)).
\]
The basic training criterion is the reconstruction loss
\[
\mathcal L_{\rm rec}=\mathbb E_{x\sim \mathcal D}\; d\bigl(\rho_X(\psi(x))\delta(\eta(x)),x\bigr),
\]
optionally augmented by invariance and equivariance regularizers [2202.07559]. The paper further states that \(\eta\) must be strictly \(G\)-invariant, that \(\psi\) is equivariant up to the stabilizer \(G_x\), and that \(\psi\) induces an isomorphism of the orbit \(G\cdot x\) with the coset space \(G/G_x\) [2202.07559].

These two strands suggest a broader conceptual split. In one reading, ASEN is a layerwise subgroup-equivariant architecture built from intertwiners and symmetry-aware parameter tying. In another, it is a representation-learning framework that factors out invariant content and explicitly models the group action needed to reconstruct or realign the data.

## 6. Guarantees, empirical findings, and limitations

Theoretical guarantees differ across formulations. In the symmetry-breaking construction, an “ASEN Universality” theorem states that if \(\{h_\theta:\mathcal X\times \mathcal V\to \mathcal Y\}\) is universal over continuous \(\mathbf G\)-equivariant maps and \(\mathcal H\in \mathcal V\) has stabilizer \(G=\mathrm{Stab}_{\mathbf G}(\mathcal H)\), then the restricted family \(\{x\mapsto h_\theta(x,\mathcal H)\}\) is universal over continuous \(G\)-equivariant functions \(\mathcal X\to \mathcal Y\) [2603.19486]. The same paper states that any order-1 \(G\)-MLP composed of \(G\)-equivariant linear maps on \(\mathbb R^n\) plus entrywise nonlinearities can be approximated to arbitrary accuracy by ASEN with \(K=2\) and an MPNN base [2603.19486]. In the reductive Lie-group formulation, stacking the described equivariant blocks yields a universal approximator of any \(H\)-equivariant map, as cited there to Appendix E of the source paper [2306.00091].

Empirical results also vary by instantiation.

| Setting | Reported finding | Source |
|---|---|---|
| G-MNIST, G-Fashion-MNIST, CIFAR10, SVHN, RotMNIST, ASL, EMNIST, KMNIST | AENs find the right balance between equivariance and network size; in high-performing GCNNs, group equivariance is the most dominating factor | [2104.04848] |
| Human-3.6M, METR-LA, Pathfinder-64, synthetic sequence tasks | A single network equivariant to multiple permutation subgroups outperforms both separate equivariant models and a single non-equivariant model | [2603.19486] |
| Pathfinder-64 | 1D-PE baseline ≈ 0.66; local 2D-PE with patch group \((S_4)^{256}\) ≈ 0.82 | [2603.19486] |
| Synthetic multitask / transfer | multitask training yields up to 30 % faster convergence; transfer pretraining reduces fine-tune error by up to 40 % | [2603.19486] |
| TopTagger | AUC≈0.987 with ≈\(2\cdot 10^5\) parameters for a Lorentz-group ASEN | [2306.00091] |
| ModelNet10 | ~96% accuracy using only three ASEN layers in the \(SO(3)\) example | [2306.00091] |

The limitations are likewise construction-specific. In the symmetry-breaking approach, when the target subgroup is not totally 2-closed, the relaxation can introduce additional symmetries; the paper states that ASEN learns extra symmetries from data if \(G^{(2)}<G\) but fails if \(G^{(2)}>G\), with parity detection as the explicit example where the target invariance is to \(A_n\) but the 2-closure is \(S_n\), leaving ASEN “stuck at chance” [2603.19486]. The same source notes that too large a subgroup can over-constrain the model and degrade performance, while too small a subgroup slows convergence but may be recovered through learned ties in the edge embedder [2603.19486]. In the reductive Lie-group formulation, applicability is limited to reductive Lie groups with finite-dimensional irreps, and basis truncation in body order and irrep range is a central expressivity–cost trade-off [2306.00091].

A recurring misconception is that more symmetry is always preferable. The cited results do not support that simplification. One source explicitly reports that choosing a smaller subgroup \(S_{n_1}\times S_{n_2}\) can outperform full \(S_n\)-equivariance on traffic forecasting [2603.19486], and another frames the search itself as finding the right balance between equivariance and network size [2104.04848].

## 7. Conceptual synthesis and research directions

Across these works, ASEN occupies the intersection of equivariant deep learning, neural architecture search, algebraic graph theory, and representation theory. One line builds subgroup equivariance by decomposition of large groups into smaller factors and searches over subgroup sets [2104.04848]. Another realizes finite subgroups through automorphism groups of graphs and characterizes all admissible linear layers via bilabelled-graph homomorphism counts [2307.07810]. A third treats subgroup equivariance as controlled symmetry breaking inside a universal \(S_n\)-equivariant base model, using auxiliary orbit-labelled structures and 2-closure relaxations [2603.19486]. Further extensions connect the idea to invariant/equivariant latent decompositions in unsupervised learning [2202.07559] and to subgroup restriction for reductive Lie-group architectures built from Clebsch–Gordan reductions [2306.00091].

This suggests that the most stable meaning of ASEN is operational rather than architectural: a network family in which the symmetry class can be specialized to an arbitrary subgroup by parameter tying, auxiliary symmetry-breaking inputs, graph-based realization of automorphism groups, or restriction of a larger equivariant representation. A plausible implication is that ASEN provides a route toward models that are not locked to a single hand-chosen symmetry, especially in settings involving grids, sets, graphs, sequences, or geometric data with heterogeneous or task-dependent invariances.

Another plausible implication is that the main unresolved issue is not only universality but subgroup specification: exact realizability, computational cost of subgroup-dependent preprocessing, and the approximation gap induced by relaxations such as 2-closure. The cited literature therefore places ASEN at a technically rich point between strict equivariant design and adaptive symmetry selection, with different formulations emphasizing exact algebraic characterization, efficient construction, or flexible deployment under changing symmetry requirements.

Source: https://www.emergentmind.com/topics/any-subgroup-equivariant-network-asen