---
title: Higher-Order Homophily in Complex Networks
url: https://www.emergentmind.com/topics/higher-order-homophily
type: topic
---

# Higher-Order Homophily in Complex Networks

Searching arXiv for recent papers on higher-order homophily and closely related frameworks.
Higher-order homophily is the extension of homophily from dyadic links to group interactions, where association patterns are defined not only by whether two nodes are similar but by how attributes are arranged within hyperedges, cliques, simplices, motifs, or multi-hop interaction structures. In this setting, homophily is no longer a single scalar attached to a graph: it can vary with group size, group composition, message-passing depth, and the null model used for comparison. Recent work treats higher-order homophily as a property of hypergraphs and related higher-order representations, develops size- and type-resolved measures, shows that pairwise projections can erase essential structure, and demonstrates that higher-order homophily materially alters polarization, contagion, information access, structural balance, and representation learning [2103.11818] [2412.07901] [2606.02537].

## 1. Conceptual scope and relation to pairwise homophily

Traditional homophily metrics operate at the pairwise level and distinguish only within-group from between-group edges. Higher-order homophily begins where that binary distinction breaks down: a group interaction can contain any mixture of attributes, and the relevant question becomes whether particular group compositions are overrepresented or underrepresented relative to a baseline. Hypergraphs and simplicial complexes are therefore natural formalisms, because they encode multi-way interactions directly rather than as projections of dyads [2103.11818] [2509.18289].

A central consequence is that homophily becomes scale-dependent. In the maximum-entropy clique framework, homophily is parameterized for all clique sizes \(c\), not only dyads, allowing local homophily within tightly connected small groups and weaker or different mixing patterns at larger scales. The paper explicitly decomposes overall homophily as
\[
h_c = \sum_{i=0}^{c} h_{c,i} F_{c,i},
\qquad
h = \sum_{c \geq 2} \alpha_c h_c,
\]
so that dyadic mixing and larger-group mixing are analytically separable [2412.07901].

This scale dependence is empirically consequential. The same network may be heterophilic at the dyadic level but homophilic within larger social circles, or vice versa. The Pokec social network is described as heterophilic between males and females at the dyadic level, while Facebook university networks show that larger cliques tend to be more homophilic than dyadic connections. This suggests that “the homophily of a network” is often an underspecified object unless the interaction scale is stated explicitly [2412.07901].

A related but distinct line of work defines higher-order homophily locally in ordinary graphs. In heterophilous graphs, higher-hop neighborhoods can exhibit more homophily than immediate neighbors, motivating definitions based on paths, motifs, or \(k\)-hop neighborhoods rather than only direct edges. This use of “higher-order” is topological rather than hypergraphic, but it serves the same purpose: it captures similarity patterns that are invisible to first-order adjacency alone [2306.13532] [2112.13562].

## 2. Formal definitions and measurement frameworks

One influential hypergraph formalization uses type-\(t\) affinity scores in a \(k\)-uniform hypergraph. For a class \(X\), the affinity score is
\[
h_t(X) = \frac{D_t(X)}{D(X)},
\]
where \(D_t(X)\) counts participations of nodes in \(X\) in groups with exactly \(t\) members from \(X\), and \(D(X)\) is total group participations by \(X\). The associated baseline is
\[
b_t(X) = \frac{\binom{|X| - 1}{t - 1} \binom{n - |X|}{k - t}}{\binom{n - 1}{k - 1}},
\]
and the ratio score is \(\text{Ratio}_t(X) = h_t(X)/b_t(X)\). This framework supports notions such as simple homophily, order-\(j\) majority homophily, strict majority homophily, strict monotonic homophily, and the indices MaHI and MoHI [2103.11818].

A complementary framework is maximum entropy over clique types. For clique size \(c\), the clique-type distribution is
\[
F_{c,i} = \frac{1}{Z} \exp(\theta_1 i + \theta_2 h_{c,i}),
\]
where \(h_{c,i}\) is the Coleman Homophily Index for a \(c\)-clique with \(i\) red nodes. This construction yields one homophily parameter per group size and treats the stochastic block model as a special case of the dyadic layer [2412.07901].

Hyperedge-centric measurement is represented by the Perplexity-Homophily Index. For a hyperedge \(e\), interaction perplexity is
\[
D(e) = 2^{-\sum_{i \in M} p_{i,e} \log_2 p_{i,e}},
\]
the diversity gap is \(\Delta(e)=B_{|e|}-D(e)\), the normalized hyperedge score is
\[
\phi(e) = \frac{B_{|e|}-D(e)}{B_{|e|}-1},
\]
and the global score is
\[
\Phi(H) = \frac{1}{|E|} \sum_{e \in E} \phi(e).
\]
This framework is explicitly hyperedge-size-resolved and compares observed diversity with a degree-preserving random baseline [2511.19170].

In hypergraph neural-network analysis, homophily has also been defined through message passing. For a hyperedge \(e\), the 0-level score is
\[
h^0_e(c) = \frac{1}{|e|} \sum_{v \in e} \mathds{1}_{y_v = c},
\]
and higher-order homophily is updated recursively by alternating node and hyperedge aggregation. The stability of homophily across propagation steps is summarized by
\[
\Delta_\mu^t = \frac{1}{|\mathcal{V}|} \sum_{v \in \mathcal{V}} \mathds{1}_{|h_v^{t} - h_v^{t-1}| < \mu}.
\]
This makes homophily an explicitly dynamical property of a message-passing process rather than only a static composition statistic [2310.07684].

| Framework | Core object | Main emphasis |
|---|---|---|
| Affinity / baseline ratios | Group composition counts by size and type | Over- or under-representation relative to random mixing |
| Maximum-entropy clique model | Clique-type distributions \(F_{c,i}\) | Decomposition within and across group sizes |
| Perplexity-Homophily Index | Hyperedge diversity via perplexity | Hyperedge-centric, size-resolved homophily |
| Message-passing homophily | Node/hyperedge scores over propagation steps | Homophily as an iterative structural signal |

These frameworks are not interchangeable. Some are class-specific, some hyperedge-specific, some global, and some recursive. The survey literature emphasizes that higher-order homophily is high-dimensional: instead of a single number, one often obtains a family of scores indexed by class, group size, composition, or propagation depth [2606.02537].

## 3. Generative models, null models, and inference

Measurement depends critically on the baseline against which observed group compositions are compared. In higher-order settings, baselines may preserve hyperedge sizes, node degrees, joint degree distributions, or nesting relations, and these choices change the interpretation of any homophily score [2509.18289] [2606.02537].

The \(\texttt{H3}\) model is a generative hypergraph model with hyperedge homophily, a hyperedge size-dependent property, and tunable degree distribution. Nodes carry binary group labels \(g_v \in \{0,1\}\), hyperedges have size \(s_e\) and type \(r_e\), and the model controls the exact counts \(m_{s,r}\) of hyperedges of each size and type. The associated size- and type-specific homophily score is
\[
h^{(g)}_{s,r} = \frac{a^{(g)}_{s,r}}{b^{(g)}_{s,r}},
\]
where \(a^{(g)}_{s,r}\) is the affinity score and \(b^{(g)}_{s,r}\) is the random baseline conditioned on at least one node from group \(g\) being present. Because \(m_{s,r}\) is directly specified, the model can realize neutral, homophilous, heterophilous, or mixed homophily patterns across hyperedge sizes [2506.00156].

Directed hypergraph null models make the baseline more stringent. The Directed Hypergraph Configuration Model preserves node in- and out-degree sequences together with hyperedge head and tail size sequences, while the Directed Hypergraph JOINT Model preserves the full joint tensor of in-/out-degrees and hyperedge size characteristics. These ensembles are sampled with NuDHy-Degs and NuDHy-JOINT, and were used to analyze group affinity in the US Congress. In that application, each bill is a directed hyperedge with a single sponsor in the head and multiple cosponsors in the tail, and the simplified affinity is
\[
\textsf{A}_k(X_i) =
\frac{\sum_{v \in X_i} H^k_{v, X_i}}{\sum_{v \in X_i} H^k_v}.
\]
Observed affinity is then compared to the null-model mean to obtain an affinity ratio [2402.18470].

Maximum-entropy methods address a different inferential problem. Rather than preserving fine-grained hypergraph structure, they fit the least-biased clique-type distribution that matches empirical class proportions and scale-specific homophily targets. This is particularly useful when the question is whether homophily varies across clique sizes even when aggregate assortativity appears uniform [2412.07901].

Even in pairwise graphs, the distinction between choice homophily and outcome homophily requires a principled ensemble. The statistical network-ensemble approach of “Unveiling homophily beyond the pool of opportunities” fixes group sizes and activity disparities and estimates homophily beyond the pool of opportunities. A plausible implication for higher-order work is that analogous structural controls are indispensable whenever group-size imbalance or participation heterogeneity could induce apparent homophily without a corresponding choice bias [2401.13642].

## 4. Dynamical consequences in social systems

Higher-order homophily changes collective dynamics because group composition affects who is exposed to whom, how dissent enters a local interaction, and which scales of social organization dominate contagion or coordination.

In a dynamical framework on hypergraphs, opinions evolve according to
\[
\dot{x}_i = -x_i + \sum_{m=1}^M \lambda^{(m)} \sum_{\gamma \in \Gamma_i^{(m)}} w_i^\gamma
\tanh\left(\sum_{j\in \gamma,\,j\ne i} \frac{x_j}{m}\right),
\]
with higher-order homophilic weights
\[
w_i^{\gamma} = \frac{\left(\sum_{j\in \gamma} |x_i - x_j| + \epsilon^{(m)}\right)^{-\beta}}
{\sum_{\xi \in \Gamma_i^{(m)}} \left(\sum_{l\in\xi} |x_i - x_l| + \epsilon^{(m)}\right)^{-\beta}}.
\]
Within this model, sparse higher-order structures amplify polarization by limiting exposure to dissenting views, whereas densifying group interactions suppresses polarization by increasing cross-cutting memberships. The exposure metric
\[
E_i^{(2)} = \frac{1}{|\Gamma_i^{(2)}|} \sum_{\gamma \in \Gamma_i^{(2)}} (1 - \delta_{\sigma_i,\sigma_\gamma})
\]
shows that sparse structures produce many agents with \(E_i^{(2)}=0\), while full connectivity raises the critical homophily threshold \(\beta_c\) required for stable polarization, especially as group size increases [2507.12325].

Higher-order homophily also shapes inequality in information access. The \(\texttt{H3}\) model combined with the naSI contagion process introduces group-dependent asymmetric transmission with rate
\[
\beta_{g}(e) = (s_e-i_{e,g})\left[\lambda_\mathrm{in} \, i_{e,g}^{\nu_\mathrm{in}} + \lambda_\mathrm{out} \, i_{e,g'}^{\nu_\mathrm{out}}\right].
\]
Stochastic simulations and empirical hypergraphs show that homophily together with asymmetric contagion yields the highest inequality in time to receive information and ability to spread information; which hyperedge sizes are homophilous or heterophilous matters, especially under nonlinear contagion. The paper further reports that even adding a small proportion of neutral or mixed hyperedges at a key size can sharply reduce information-access disparities [2506.00156].

In structural balance dynamics, higher-order homophily appears through similarity across many underlying attributes rather than through hyperedges. Agents carry \(G\) Boolean attributes and link weights are
\[
x_{ij} = \frac{1}{2G}\mathbf{A}_i^T \cdot \mathbf{A}_j.
\]
A triad-updating rule changes one attribute of one agent per update, so local attempts to balance one triad create accidental changes elsewhere. In the large-\(G\) limit, the link-weight distribution obeys a Fokker-Planck equation, and the fully positive “paradise state” requires \(G > O(N^2)\) and \(p>0.5\). The stated conclusion is that homophily based on few attributes can impede structural balance [2001.06573].

Microscopic face-to-face group formation shows another mechanism. In the Group Attractiveness Model, a group’s attractiveness is
\[
a_g = \prod_{j \in g} a_j,
\qquad
p_i(t) = \frac{1}{|\mathcal{N}(i)|}\sum_{g \in \mathcal{N}(i)} a_g,
\]
and higher-order homophily is parameterized by matrices \(H^{(2)}\), \(H^{(3)}\), and their extensions. The model reproduces the observed distribution of group sizes, the correlation in group participations across size, and the persistence of groups in empirical face-to-face data, while also showing that pairwise homophily is insufficient to match triplet-level mixing patterns [2406.05026].

## 5. Higher-order homophily in machine learning and network representation

In graph and hypergraph learning, higher-order homophily is treated both as a measurable property of data and as a signal that architectures should exploit explicitly rather than approximate through deeper first-order propagation.

PathMLP is motivated by the empirical observation that heterophilous graphs often contain higher-order neighborhoods with higher homophily. It defines edge homophily as
\[
H_\text{edge}(G)=\frac{|\{(v_i,v_j)\in E\mid y_i=y_j \}|}{|E|},
\]
and samples smooth paths by feature similarity so that path aggregation captures semantically coherent higher-order information. The model aggregates sampled path encodings through learnable weights and is reported to outperform baselines on 16 out of 20 datasets, while being immune to over-smoothing because it does not rely on stacked message passing [2306.13532].

HOG-GCN modifies propagation directly by learning a homophily degree matrix
\[
H = \alpha S + \beta T,
\]
where \(S\) is attribute-based and \(T\) is topology-based, both defined over \(k\)-hop neighborhoods. The propagation rule is
\[
Z^{(l)} = \sigma\left(\gamma Z^{(l-1)} W^{(l)} + \left[D^{-1} (A_k \odot H) Z^{(l-1)} W^{(l)}\right]\right).
\]
Theoretical analysis shows that this minimizes a similarity constraint
\[
\mathcal{L} = \sum_{i} \sum_{j \in N_k(i)} H_{ij} \| Z_i - Z_j \|^2,
\]
so representation similarity is explicitly modulated by learned homophily degree. On heterophilic datasets, using \(k=2\) improves performance substantially relative to \(k=1\), illustrating the value of higher-order homophily [2112.13562].

Motif-based transformation offers another route. H\(^2\)NT defines a motif adjacency matrix \(\mathbf{A}_M\), a heterophily matrix \(\mathbf{H} = -\mathbf{A}_M + \mathbf{M}\), and a unified proximity
\[
\mathbf{Q} = \mathbf{A}_M + \lambda \mathbf{H}.
\]
Micro-level walk paths capture homophily and macro-level walk paths capture heterophily, so the transformed network can be fed to existing embedding methods. The paper reports that DeepWalk-based H\(^2\)NT achieves 24% improvement in terms of precision on motif prediction while reducing 46% computational time compared to the original DeepWalk [2012.11400].

For hypergraphs, message-passing homophily informs architecture design directly. MultiSet and MultiSetMixer maintain hyperedge-dependent node representations rather than collapsing all hyperedge messages into one state at each layer. The tutorial-style conclusion is that datasets where homophily is preserved across message-passing steps are precisely those where hypergraph neural networks benefit most from higher-order structure, and that clique-expanded homophily is often a weaker predictor than recursive message-passing homophily [2310.07684].

## 6. Combinatorial limits, paradoxes, and interpretive cautions

Higher-order homophily is constrained not only by behavior but by combinatorics. In two-class \(k\)-uniform hypergraphs, it is impossible except under trivial or degenerate groupings for both classes to simultaneously exhibit strict majority homophily or strict monotonic homophily in the natural sense defined by affinity-over-baseline ratios. For odd \(k\), both classes cannot have strict monotonic homophily; for even \(k\), the tie case prevents the analogous simultaneous condition. The implication stated in the paper is that differences in higher-order homophily between classes may be unavoidable consequences of combinatorial constraints rather than direct evidence of asymmetric preferences [2103.11818].

This interpretive warning extends beyond hypergraphs. In ordinary two-type graphs, the paradox of second-order homophily shows that if there is homophily diversity among red nodes, then red friends of red nodes are on average more homophilous than red friends of blue nodes. The red gap is
\[
g^{(R)} = \mu^{(R)}_R - \mu^{(R)}_B > 0,
\]
and in a random-graph analysis with degrees held constant,
\[
g^{(R)} = \frac{\sigma_R^2}{\lambda_R} + \frac{\sigma_R^2}{1-\lambda_R}.
\]
This gap holds in both globally homophilous and heterophilous networks, so neighborhood-level homophily comparisons can contain intrinsic structural bias [2107.07751].

A further caution concerns projection and aggregation. Tutorials on higher-order homophily emphasize that clique projection can erase hyperedge size information and can make strong heterophily at one scale and strong homophily at another appear neutral in aggregate. Likewise, a single global homophily parameter can obscure group-level and scale-dependent variation that materially affects percolation, epidemic thresholds, and intervention design [2509.18289] [2606.02537].

The accumulated literature therefore converges on a consistent methodological point. Higher-order homophily should be interpreted relative to a stated interaction representation, a stated scale, and a stated null model. Without those choices, claims about “more homophily” or “less homophily” are often incomplete; with them, higher-order homophily becomes a precise language for analyzing how group composition shapes social organization, dynamical processes, and learning systems [2412.07901] [2402.18470].

Source: https://www.emergentmind.com/topics/higher-order-homophily