---
title: Directional Sheaf Hypergraph Networks
url: https://www.emergentmind.com/topics/directional-sheaf-hypergraph-networks-dshn
type: topic
---

# Directional Sheaf Hypergraph Networks

Directional Sheaf Hypergraph Networks (DSHN) are a sheaf-theoretic neural framework for learning on directed and undirected hypergraphs, introduced to model higher-order interactions with explicit orientation while avoiding the implicit homophily bias that often constrains earlier directed-hypergraph methods. The framework combines cellular sheaves with a principled encoding of asymmetry through complex phases, yielding a complex-valued Directed Sheaf Hypergraph Laplacian that unifies several Laplacian constructions previously used in graph and hypergraph learning. In the formulation reported in "Directional Sheaf Hypergraph Networks: Unifying Learning on Directed and Undirected Hypergraphs," DSHN is evaluated on 7 real-world datasets against 13 baselines and is reported to achieve relative accuracy gains from 2% up to 20% [2510.04727].

## 1. Problem setting and motivation

Hypergraphs represent interactions among more than two entities by allowing a hyperedge to connect a set of vertices rather than a single pair. The directed case assigns orientation to these higher-order relations, making it possible to model oriented group interactions. The motivating premise of DSHN is that directed hypergraphs remain substantially less explored than undirected hypergraphs, despite their relevance for applications in which head–tail structure is semantically meaningful [2510.04727].

The framework is positioned against a recurring limitation of recent approaches to directed hypergraph learning: an implicit bias toward homophily. In heterophilic regimes, this bias can degrade performance because message passing that primarily averages neighboring information tends to suppress discriminative local structure. DSHN inherits from Sheaf Neural Networks the idea that learnable restriction maps can transport features across incidence relations without forcing simple agreement. In this setting, directionality is not appended as an external correction, but is built directly into the sheaf structure through complex phase factors.

A central claim of the framework is unification. The same operator family is constructed to subsume undirected hypergraph learning, directed graph learning, and directed hypergraph learning within a single spectral object. This positioning matters because it treats directionality, higher-order incidence, and sheaf transport as parts of the same algebraic mechanism rather than as independent design choices.

## 2. Directed hypergraph cellular sheaf and Laplacian

Let $\mathcal H=(V,E)$ be a directed hypergraph, with stalk dimension $d$, working over $\mathbb C^d$. DSHN assigns a vector space $\mathcal F(u)\cong\mathbb C^d$ to each vertex $u\in V$ and a vector space $\mathcal F(e)\cong\mathbb C^d$ to each hyperedge $e\in E$ [2510.04727].

Orientation is encoded by a complex phase matrix $S^{(q)}\in\mathbb C^{m\times n}$ with entries
$$
S^{(q)}_{u\trianglelefteq e}=
\begin{cases}
1, & u\in H(e)\ (\text{head})\\[4pt]
e^{-2\pi i q}, & u\in T(e)\ (\text{tail})\\[4pt]
0, & \text{otherwise.}
\end{cases}
$$
The scalar $q\in[0,1)$ is the charge parameter. The reported interpretation is that $q=0$ collapses directions, whereas $q=\tfrac14$ yields pure imaginary factors for tail–head interactions.

The model then introduces real-valued, learnable, direction-agnostic restriction maps
$$
\mathcal F_{u\trianglelefteq e}\in\mathbb R^{d\times d},
$$
and defines the complex restriction map
$$
\vec{\mathcal F}_{u\trianglelefteq e}=S^{(q)}_{u\trianglelefteq e}\,\mathcal F_{u\trianglelefteq e}\in\mathbb C^{d\times d}.
$$
The tuple $\{\mathcal F(u),\mathcal F(e),\vec{\mathcal F}_{u\trianglelefteq e}\}$ is termed a Directed Hypergraph Cellular Sheaf.

From these components, the framework assembles a complex-valued incidence operator
$$
B^{(q)}\in\mathbb C^{(m d)\times(n d)},\qquad
\bigl[B^{(q)}\bigr]_{(e,u)}=
\begin{cases}
\vec{\mathcal F}_{u\trianglelefteq e}, & u\in e\\
0, & \text{otherwise.}
\end{cases}
$$
It also defines
$$
D_E=\operatorname{diag}(\delta_1 I_d,\ldots,\delta_m I_d),\qquad \delta_e=|e|,
$$
and
$$
D_V=\operatorname{diag}(D_1,\ldots,D_n),\qquad
D_u=\sum_{e:u\in e}\vec{\mathcal F}_{u\trianglelefteq e}^{\dagger}\vec{\mathcal F}_{u\trianglelefteq e}\in\mathbb R^{d\times d}.
$$

The reported unnormalized Directed Sheaf Laplacian is
$$
L^{\vec{\mathcal F}}=D_V-B^{(q)\dagger}D_E^{-1}B^{(q)}=D_V-Q^{\vec{\mathcal F}}},
$$
where
$$
Q^{\vec{\mathcal F}}=B^{(q)\dagger}D_E^{-1}B^{(q)}.
$$
The same presentation also writes, in boundary–co-boundary notation,
$$
\delta=B^{(q)},\qquad \delta^*=B^{(q)\dagger},\qquad W=D_E^{-1},\qquad
L^{\vec{\mathcal F}}=\delta^*W\delta.
$$
For numerical stability, the normalized form is used:
$$
L_N^{\vec{\mathcal F}}
=D_V^{-\tfrac12}L^{\vec{\mathcal F}}D_V^{-\tfrac12}
=I-D_V^{-\tfrac12}B^{(q)\dagger}D_E^{-1}B^{(q)}D_V^{-\tfrac12}.
$$

For $u\neq v$, the off-diagonal entries satisfy
$$
(L^{\vec{\mathcal F}})_{uv}
=
-\sum_{e:u,v\in e}
\frac{1}{\delta_e}\,
\vec{\mathcal F}_{u\trianglelefteq e}^{\dagger}\,
\vec{\mathcal F}_{v\trianglelefteq e}.
$$
The reported interpretation is that matching head–head or tail–tail incidences yield real negative weights, while tail–head incidences yield the complex phase $e^{+2\pi i q}$; at $q=\tfrac14$, this becomes purely imaginary. The paper further states that $L_N^{\vec{\mathcal F}}$ is Hermitian, positive semidefinite, diagonalizable with real spectrum in $[0,1]$, and that its Dirichlet energy is
$$
\mathcal E_N(x)=x^\dagger L_N^{\vec{\mathcal F}}x
=\tfrac12\sum_{e\in E}\frac1{\delta_e}\sum_{u\neq v\in e}
\left\|
\vec{\mathcal F}_{u\trianglelefteq e}D_u^{-\tfrac12}x_u-
\vec{\mathcal F}_{v\trianglelefteq e}D_v^{-\tfrac12}x_v
\right\|_2^2.
$$

## 3. Recovery of existing operators and spectral interpretation

A major feature of DSHN is that specific parameter choices recover several established Laplacian constructions [2510.04727]. For a 2-uniform undirected graph with trivial sheaf, meaning all restriction maps are $I$, $L^{\vec{\mathcal F}}$ reduces, up to scaling by $\tfrac12$, to the classical graph Laplacian $D-A$. For a 2-uniform directed graph with $q\neq 0$, it becomes the Magnetic Laplacian of Zhang et al., or the Sigmanet Laplacian when $q=\tfrac14$. For general undirected hypergraphs with trivial sheaf, it recovers the Zhou et al. normalized hypergraph Laplacian. For directed hypergraphs with unit weights and trivial sheaf, it yields the Generalized Directed Laplacian of Fiorini et al.

This recovery behavior is the formal basis for the framework’s claim to unify learning on directed and undirected hypergraphs. It means that classical diffusion on pairwise undirected structure, magnetic phase-based diffusion on directed graphs, and hypergraph spectral propagation can all be treated as special cases of a single complex sheaf operator. A plausible implication is that comparisons among these models can be reframed as comparisons among particular choices of charge, stalk dimension, and restriction-map parameterization rather than as fundamentally separate architectures.

The spectral viewpoint also clarifies why the model is positioned for heterophilic settings. In ordinary averaging-based hypergraph propagation, alignment is encouraged by scalar or sign-limited edge couplings. In DSHN, each incidence relation is mediated by a full $d\times d$ map together with a complex phase, so consistency is transported through learned linear correspondences rather than through direct feature averaging.

## 4. Network architecture and feature propagation

The neural architecture is derived from the sheaf-diffusion ODE
$$
\dot X_t=-L_N^{\vec{\mathcal F}}X_t.
$$
A forward Euler step yields
$$
X_{t+1}=(I-L_N^{\vec{\mathcal F}})X_t=Q^{\vec{\mathcal F}}X_t.
$$
The $\ell$-th DSHN layer then inserts learnable linear maps and a nonlinearity:
$$
X^{(\ell+1)}
=
\sigma\Bigl(
(I-L_N^{\vec{\mathcal F}})
\,(I_n\otimes W_1^{(\ell)})\,
X^{(\ell)}\,
W_2^{(\ell)}
\Bigr)
\in\mathbb C^{(n d)\times f},
$$
where $W_1\in\mathbb R^{d\times d}$ and $W_2\in\mathbb R^{f\times f}$ are trainable, $I_n\otimes W_1$ applies $W_1$ on each stalk, and $\sigma$ is a complex activation such as complex-ReLU [2510.04727]. At the final layer, complex features are unwound into real features by concatenating real and imaginary parts.

The input node features $X^0\in\mathbb R^{n\times f}$ are first projected to $\mathbb C^{n\times (d f)}$ and then reshaped to $\mathbb C^{(n d)\times f}$. Restriction maps $\mathcal F_{u\trianglelefteq e}$ are predicted by an MLP $\Phi$ applied to concatenated real-valued node and hyperedge features. When explicit hyperedge features are unavailable, they are aggregated from incident nodes by mean or sum. The reported implementation further applies layer normalization separately to $W_1$ and $W_2$ in the complex domain, jointly normalizing real–imaginary pairs, and allows residual connections together with multiple dropout options.

The framework attributes two main modeling effects to these design choices. First, because the restriction maps are full $d\times d$ matrices, DSHN is reported to resist oversmoothing even at large depths and to naturally handle heterophily. Second, the charge parameter $q$ controls how strongly orientation affects propagation: $q=0$ recovers the undirected case, whereas $q=\tfrac14$ or tuned values in $(0,\tfrac14]$ amplify oriented flows.

## 5. Optimization protocol and computational complexity

The reported task setting is node classification with $C$ classes, using standard cross-entropy loss on output logits after unwinding [2510.04727]. Optimization uses Adam with learning rate in $\{0.02,0.01,0.005,0.001\}$ and weight decay in $\{0,5\mathrm e{-5},5\mathrm e{-4}\}$. Training uses early stopping after 200 no-improvement epochs and a maximum of 500 epochs. Regularization includes dropout on restriction maps, residual toggles, and layer normalization on $W_1$ and $W_2$.

For per-layer inference complexity, let $n=|V|$, $m=|E|$, $\bar e$ be average hyperedge size, and $c=d f$ be total channel size. Linear transforms cost
$$
O\!\bigl(n(d^2f+d f^2)\bigr)=O(nc^2).
$$
Message passing through $Q\cdot X$ costs
$$
O(m\bar e^2 d f)
$$
in the diagonal-restriction case, or
$$
O(m\bar e^2 d^3 f)
$$
in general, since each hyperedge induces $\bar e^2$ block interactions of size $d\times d$. Predicting sheaf maps costs
$$
O\!\Bigl(\sum_u \deg(u)\cdot \Phi\text{-cost}\Bigr)\approx O(m\bar e d^2),
$$
or $O(m\bar e d)$ if the MLP is diagonal. Computing $D_V$, $D_E$, and assembling $L_N$ similarly costs $O(m\bar e^2 d^3)$. The dominant per-layer term is therefore reported as
$$
O(m\bar e^2 d^3).
$$

This complexity motivates the lightweight variant DSHNLight, which mitigates the cost by freezing the restriction-model MLP and detaching Laplacian assembly from backprop. The stated trade-off is therefore not between directionality and nondirectionality, but between full end-to-end sheaf adaptation and a more economical approximation of the same operator family.

## 6. Empirical behavior, ablations, and limitations

The experimental protocol converts seven standard directed graph benchmarks into directed hypergraphs by creating, for each node $v$, a hyperedge $e_v$ with $\mathrm{tail}=\{v\}$ and $\mathrm{head}=\text{all its out-neighbors}$, thereby preserving original orientation as forward hyperedges [2510.04727]. The datasets are Roman-empire, Squirrel, email-EU, Telegram, Chameleon, email-Enron, and Cora. Their reported statistics are as follows: Roman-empire has $22\,662$ nodes, $300$ features, $22\,662$ hyperedges, $18$ classes, average $|e|=2.73$, average degree $2.73$, and CE homophily $0.2363$; Squirrel has $2\,223$ nodes, $2\,089$ features, $2\,060$ hyperedges, $5$ classes, average $|e|=23.8$, average degree $22.1$, and CE homophily $0.2448$; email-EU has $986$ nodes, no explicit features, $787$ hyperedges, $10$ classes, average $|e|=43.4$, average degree $34.6$, and CE homophily $0.2608$; Telegram has $245$ nodes, $1$ feature, $183$ hyperedges, $4$ classes, average $|e|=49.7$, average degree $37.1$, and CE homophily $0.2854$; Chameleon has $890$ nodes, $2\,325$ features, $797$ hyperedges, $5$ classes, average $|e|=12.1$, average degree $10.8$, and CE homophily $0.3221$; email-Enron has $143$ nodes, no explicit features, $139$ hyperedges, $7$ classes, average $|e|=19.6$, average degree $19.0$, and CE homophily $0.3251$; Cora has $2\,708$ nodes, $1\,433$ features, $1\,565$ hyperedges, $7$ classes, average $|e|=4.47$, average degree $2.58$, and CE homophily $0.8035$. Hyperparameters are tuned over stalk dimension $d\in\{1,\ldots,6\}$, number of convolutional layers in $\{1,\ldots,5\}$, charge $q\in\{0,0.05,\ldots,0.25\}$, activation in $\{\text{sigmoid},\text{tanh}\}$, dropout in $[0.1,0.9]$, and residual on/off.

The baselines comprise undirected hypergraph GNNs including HGNN, HNHN, UniGCNII, LEGCN, HyperND, AllSet variants, ED-HNN, SheafHyperGNN, and PhenomNN, together with directed methods GeDi-HNN and DHGNN. The reported summary results are:

| Dataset | Best baseline | DSHN / DSHNLight |
|---|---|---|
| Roman-empire | 83.9 (GeDi) | 89.2 (DSHNLight) |
| Squirrel | 43.6 (PhenomNN) | 44.1 (DSHNLight) |
| email-EU | 68.9 (ED-HNN) | 82.7 (DSHNLight) |
| Telegram | 80.6 (DHGNN-emb) | 88.7 (DSHN) / 81.2 (DSHNLight) |
| Chameleon | 44.7 (ED-HNN) | 47.0 (DSHN) / 46.5 (DSHNLight) |
| email-Enron | 63.8 (AllSetTr) | 75.7 (DSHN) / 76.8 (DSHNLight) |
| Cora | 88.1 (PhenomNN) | 87.8 (DSHN) / 88.0 (DSHNLight) |

The accompanying gains are reported as $+6$ pt / $+7\%$ on Roman-empire, $+0.5$ pt / $+1\%$ on Squirrel, $+13.8$ pt / $+20\%$ on email-EU, $+8$ pt / $+10\%$ on Telegram, $+2.3$ pt / $+5\%$ on Chameleon, $+12$ pt / $+19\%$ on email-Enron, and approximately $0$ on Cora. The contrast between Telegram and Cora is especially informative. On Telegram, described as highly directional, tuning $q$ from $0$ to $0.25$ raises accuracy from $63.5\%$ to $88.5\%$. On Cora, described as homophilic, $q=0$ is best. This suggests that the charge parameter functions as an explicit bias control: it can amplify oriented flows when directionality is semantically useful, but may act as directional noise in strongly homophilic settings.

The ablation analysis reports that DSHN accuracy improves with up to 7 layers, while standard HGNN degrades, and that accuracy rises with larger stalk dimension $d$. It also reports that removing either the sheaf restriction maps or the complex phase causes performance to drop back to baseline levels. These observations are presented as evidence that the framework’s gains do not arise from directionality alone or from sheaf parameterization alone, but from their combination.

The reported limitations are equally specific. Scalability is constrained by the $O(m\bar e^2 d^3)$ cost when hyperedges are extremely large. Large-scale directed hypergraphs such as biochemical reaction networks and multi-agent flows remain to be tested. Further engineering of sparse GPU kernels for complex Laplacians is stated as needed. Future work is suggested in the form of a learnable charge $q$, either as a trainable scalar or a per-hyperedge parameter, to automatically balance homophilic and heterophilic bias.

Source: https://www.emergentmind.com/topics/directional-sheaf-hypergraph-networks-dshn