---
title: Graph Label Smoothing Methods
url: https://www.emergentmind.com/topics/graph-label-smoothing
type: topic
---

# Graph Label Smoothing Methods

Graph label smoothing denotes a family of graph-based supervision and regularization methods in which labels, soft labels, class scores, or closely related label signals are modified using graph structure. In the narrow sense used in node classification, it replaces one-hot targets with graph-informed soft targets derived from neighborhood label statistics, posterior label distributions, or propagated label priors. In a broader literature, the same phrase is also used more loosely for Laplacian smoothing of class-indicator signals, diffusion of predicted labels, and smoothing of representation signals that only indirectly affect predictions. The topic therefore spans both genuine target-space methods and adjacent graph-signal formulations that should be distinguished carefully [2112.00499][2108.13555][2406.00410][1905.00301].

## 1. Terminological scope

Standard label smoothing in classification replaces a one-hot target by a mixture with a uniform class distribution, for example
\[
q^{\mathrm{LS}}=(1-\epsilon)q+\epsilon u_c
\]
or, equivalently in node classification notation,
\[
\mathbf{y}_i^{LS}=(1-\alpha)\mathbf{y}_i+\alpha \mathbf{1}/C.
\]
This regularizes overconfidence, but it is graph-agnostic: the residual mass is redistributed uniformly across classes rather than according to graph structure [2112.00499][2108.13555].

Graph label smoothing departs from this uniform construction by making the smoothing distribution depend on neighborhood labels, propagated label statistics, or graph-conditioned posteriors. SALS uses the class distribution among a node’s labeled neighbors; ALS uses propagated neighborhood labels together with a learnable class-relevance matrix; PosteL uses a posterior distribution conditioned on neighboring labels and estimated from global class priors and edgewise class-conditionals [2112.00499][2108.13555][2406.00410].

The literature also contains several neighboring formulations that are not label smoothing in the standard neural-network sense. The graph smoothness loss of Frecon et al. minimizes the graph smoothness of class-indicator signals on a similarity graph built from network outputs, which is equivalent to maximizing distances between outputs of examples from distinct classes; it replaces cross-entropy but does not soften targets [1905.00301]. TDSS in unsupervised graph domain adaptation smooths target-domain node representations rather than labels [2412.11654]. The structurally smoothed graphlet kernel smooths distributions over graphlets rather than node labels [1403.0598]. These distinctions are substantive, not terminological accidents.

## 2. Core mathematical formulations

A central formulation is Laplacian smoothness of a node-wise signal. For a weighted undirected graph with Laplacian \(L=D-W\), the standard quadratic form is
\[
\mathcal{Q}(L)=\mathrm{tr}(X^\top L X)=\frac{1}{2}\sum_{i,j} w_{i,j}\|x_i-x_j\|^2.
\]
When \(X\) is replaced by a label matrix \(Y\), this becomes the standard label-smoothness penalty
\[
\mathrm{tr}(Y^\top L Y)=\frac{1}{2}\sum_{i,j} w_{i,j}\|y_i-y_j\|^2,
\]
which encodes the homophily-style prior that connected nodes should have similar labels or class scores [2112.05887].

A second canonical formulation is Tikhonov graph smoothing. Given a graph signal \(y\in\mathbb{R}^n\), one solves
\[
\hat{x} = \argmin_{z\in\mathbb{R}^n} q \left\| y-z \right\|^2 + z^\top L z,
\]
with closed-form solution
\[
\hat{x} = K y \quad\text{with}\quad K=q(qI+L)^{-1}.
\]
In semi-supervised learning, the signal \(y\) may be a class-indicator vector or a class-specific seed-label function, so the smoother acts directly on label signals [1910.07963].

A third formulation treats smoothing as repeated diffusion. For mean aggregation with row-stochastic operator \(L=D^{-1}A\),
\[
Z^{(k)} = L^k Z.
\]
This linear message-passing rule captures the finite-step denoising behavior underlying many GNNs, but on connected graphs it also yields oversmoothing:
\[
L^k \xrightarrow[k\to\infty]{} \mathbf{1}_n \bar d_A^\top,
\qquad
Z^{(k)} \to \mathbf{1}_n v^\top.
\]
Hence sufficiently many smoothing steps collapse node-specific information [2205.12156].

A fourth formulation uses class-indicator graph signals explicitly. In graph smoothness loss, the label signal for class \(c\) is a binary indicator \(\mathbf{s}_c\), and the training objective is
\[
\mathcal{L}_{G_k}(f)=\sum_{c=1}^{C} \mathbf{s}_c^\top \mathbf{L}\mathbf{s}_c.
\]
Because only cross-class edges contribute, minimizing this objective pushes apart outputs of examples from distinct classes while leaving within-class distances unconstrained [1905.00301].

## 3. Graph-aware soft-target methods for node classification

The most direct strand of graph label smoothing operates in target space: one replaces a hard node label by a node-specific soft distribution computed from graph structure.

| Method | Smoothed object | Core construction |
|---|---|---|
| SALS [2112.00499] | Training targets for labeled nodes | Mixture of one-hot target, neighborhood label distribution, and uniform prior |
| ALS [2108.13555] | Training targets in scalable graph training | Propagated labels, learnable class-relevance matrix, and smooth pacing |
| PosteL [2406.00410] | Transductive node targets | Posterior \(P(Y_i=k \mid \text{neighbor labels})\) with global priors and edgewise conditionals |

SALS defines, for node \(i\), the neighborhood class ratio
\[
r_c(i)\coloneqq \frac{\sum_{j\in \mathcal{N}(i)} 1[y_j=c]}{|\mathcal{N}(i)|},
\]
the neighborhood label distribution
\[
\eta(i)\coloneqq \frac{1}{|\mathcal{N}(i)|}\sum_{j\in \mathcal{N}(i)} \delta_{c, y_j},
\]
and the structure-aware target
\[
q^{\mathrm{SALS}}(c\mid i) = (1-\epsilon)\delta_{c,y_i} + \epsilon\Big(\gamma \eta(i) + (1-\gamma)u_c\Big).
\]
It changes only the training targets, introduces no extra inference cost, and is applied to GCN, ResGCN, GraphSAGE, GraphSAINT, and SIGN. On the reported transductive benchmarks, GCN + SALS improves from \(88.3\) to \(88.9\) on Cora, from \(86.4\) to \(87.6\) on Pubmed, and from \(64.5\) to \(66.2\) on CoraFull [2112.00499].

ALS is designed for large-scale graph training with partitioning or subgraph sampling, where mini-batches exhibit label bias. It first propagates training labels by
\[
\mathbf{Y}^{(k+1)}=(1-\beta)\mathbf{D}^{-1}\mathbf{A}\mathbf{Y}^{(k)}+\beta \mathbf{Y}^{(0)},
\]
then refines the propagated label prior with a learnable class-relevance matrix,
\[
\mathbf{y}_i^{\mathrm{soft}}=\mathrm{Softmax}(\mathbf{W}\mathbf{y}_i^{(K)}),
\]
and finally constructs
\[
\mathbf{y}_i^{ALS}=(1-\alpha)\mathbf{y}_i+\alpha \mathbf{y}_i^{\mathrm{soft}}.
\]
The full loss includes both cross-entropy against \(\mathbf{y}_i^{ALS}\) and a KL term that prevents the learned soft target from degenerating. ALS is reported as best in \(18\) out of \(20\) backbone-dataset combinations; for example, GraphSAINT on ogbn-products improves from \(79.07\) to \(79.48\), and GraphSAGE on ogbn-mag improves from \(46.70\) to \(47.06\) [2108.13555].

PosteL replaces uniform smoothing by a posterior target conditioned on neighboring labels:
\[
P(Y_i = k \mid \{Y_j = y_j\}_{j\in\mathbf{N}(i)}) = \frac{P(\{Y_j = y_j\}_{j\in\mathbf{N}(i)}\mid Y_i=k)\,P(Y_i=k)} {\sum_{\ell=1}^K P(\{Y_j = y_j\}_{j\in\mathbf{N}(i)}\mid Y_i=\ell)\,P(Y_i=\ell)}.
\]
The likelihood is factorized by conditional independence over neighbors, and the edgewise conditional label distributions are estimated empirically from labeled edges. A uniform-noise term is then added, and the final soft label is
\[
\hat{\mathbf e}_i = (1-\alpha)\tilde{\mathbf e}_i + \alpha \mathbf e_i.
\]
PosteL is architecture-agnostic, applied to MLP, GCN, GAT, APPNP, ChebNet, GPR-GNN, and BernNet, and improves the hard-label baseline in \(67\) out of \(70\) model-dataset settings. The reported GCN gains include \(65.90 \to 80.33\) on Cornell, \(59.61 \to 65.80\) on Chameleon, and \(46.78 \to 52.76\) on Squirrel [2406.00410].

## 4. Propagation-based smoothing of predictions and label signals

A second strand smooths predicted label distributions or class-score signals rather than the supervision targets themselves. In NDLS-L, the smoothed object is the soft predicted label distribution \(\hat{\mathbf Y}=f(\widetilde{\mathbf X})\). Standard propagation is
\[
\hat{\mathbf Y}^{(k)}=\hat{\mathbf A}^k \hat{\mathbf Y},
\]
but NDLS replaces a graph-wide fixed depth by a node-specific local smoothing iteration
\[
K(i,\epsilon)=\min\{k:\|\tilde I_i-I(k)_i\|_2<\epsilon\},
\]
where \(I(k)=\hat{\mathbf A}^k\) and \(\tilde I=\hat{\mathbf A}^{\infty}\). The final node-wise smoothed prediction is
\[
\widetilde{\mathbf Y}_i(\epsilon)= \frac{1}{K(i,\epsilon)+1} \sum_{k=0}^{K(i,\epsilon)} \hat{\mathbf Y}_i^{(k)}.
\]
This post-processing view yields large improvements for MLP baselines; on Cora, MLP improves from \(61.1\) to \(83.9\), and on ogbn-papers100M from \(47.2\) to \(64.6\) [2110.14377].

Elastic GNN reframes graph propagation as graph denoising with an elastic combination of \(\ell_1\)- and \(\ell_2\)-based smoothness:
\[
\argmin_{F \in \mathbb{R}^{n \times d}} \lambda_1 \| \tilde \Delta F \|_{1 \text{ or } 21} + \frac{\lambda_2}{2} \mathrm{tr}(F^{\top} L F) + \frac{1}{2}\|F-F_{\text{in}}\|_F^2.
\]
The resulting Elastic Message Passing scheme smooths class-related signals while preserving local discontinuities. Relative to APPNP, it increases the ratio of average difference on wrong edges to average difference on correct edges from \(1.57\) to \(2.03\) on Cora, from \(1.35\) to \(1.94\) on CiteSeer, and from \(1.43\) to \(1.79\) on PubMed, indicating stronger within-class smoothing and less blurring across class boundaries [2107.06996].

Random-spanning-forest methods provide a computational route to exact Laplacian smoothing. For the Tikhonov smoother \(K=q(qI+L)^{-1}\), the identity
\[
\mathbb{P}\big(r_{\Phi_q}(i)=j\big)=K_{ij}
\]
links the smoothing matrix to root-location probabilities in a random spanning forest. This yields unbiased Monte Carlo estimators for the smoothed signal, including the tree-average estimator
\[
\bar{x}(i)=\frac{1}{|\mathcal{V}_{t(i)}|}\sum_{j\in\mathcal{V}_{t(i)}} y_j,
\qquad
\mathbb{E}[\bar{x}]=Ky.
\]
In semi-supervised learning, the class labels are encoded as one scalar signal per class, smoothed classwise, and the final class is chosen by \(\arg\max_l f_l(i)\) [1910.07963].

## 5. Adjacent literatures often conflated with graph label smoothing

Several important papers use graph smoothness of label-related signals but are not target-smoothing methods. The graph smoothness loss of Frecon et al. builds a \(k\)-nearest-neighbor graph on the current network outputs, defines one binary class-indicator signal per class, and minimizes
\[
\mathcal{L}_{G_k}(f)=\sum_{c=1}^{C} s_{G_k}(\mathbf{s}_c).
\]
Because only edges connecting different classes contribute, the loss encourages large between-class distances but does not explicitly encourage small within-class distances. The paper is explicit that this is not standard label smoothing and that the training “does not prevent inputs from the same class to be mapped to distant locations in the output domain” [1905.00301].

TDSS in unsupervised graph domain adaptation is likewise not label smoothing. Its regularizer,
\[
\mathcal{L}_{\text{SR}} = \frac{1}{2} \sum_i \sum_j \widetilde{\mathbf{A}}_{ij} \left\| \frac{f(\mathbf{x}_i)}{\sqrt{d_i}} - \frac{f(\mathbf{x}_j)}{\sqrt{d_j}} \right\|^2,
\]
acts on target-domain node representations over sampled neighborhoods. The intended effect is local consistency of target representations under structural shift, not smoothing of one-hot labels or logits [2412.11654].

The structurally smoothed graphlet kernel smooths multinomial distributions over graphlets. Its core objects are graphlet counts \(c_i\), the normalized graphlet histogram
\[
f_G = \left(\frac{c_1}{\sum_j c_j}, \ldots, \frac{c_{n_k}}{\sum_j c_j}\right)^T,
\]
and a Kneser-Ney-style redistribution of probability mass across graphlets via a DAG relating size-\(k\) and size-\((k+1)\) graphlets. The paper did not use edge or node labels in the experiments [1403.0598].

Distributed graph learning with smooth data priors addresses a different problem: learning the graph itself from signals assumed smooth on the unknown graph. Its smoothness objective is again
\[
\mathrm{tr}(X^\top L X)=\frac{1}{2}\sum_{i,j}W_{ij}\|x_i-x_j\|^2.
\]
If one sets \(X=Y\), this becomes a label-smoothness prior, but the paper itself studies unsupervised graph structure inference rather than label smoothing or node classification [2112.05887].

A related Bayesian literature smooths node-wise latent signals by placing priors built from powers of \((L+\epsilon I)^{-1}\). In “Optimal Bayesian Smoothing of Functional Observations over a Large Graph,” the latent quantity is a function at each node rather than a class label, but the mechanism remains Laplacian spectral shrinkage of high graph frequencies [2104.10335].

## 6. Theory, operating regimes, and limitations

The dominant theoretical theme is that smoothing is beneficial only at finite depth. For mean aggregation, repeated graph averaging initially denoises by shrinking non-principal directions faster than principal ones in regression, and by shrinking nodes within communities faster than the communities collapse together in classification. Yet for connected graphs, the same process converges to a non-informative constant profile. The paper “Not too little, not too much” therefore proves both the existence of a useful finite \(k^\star>0\) in specific models and the inevitability of oversmoothing in the limit [2205.12156].

This finite-step perspective is consistent with node-adaptive propagation schemes. NDLS makes smoothing depth node-specific because high-degree nodes in dense regions smooth quickly, whereas low-degree nodes in sparse regions need more steps. The locality bound
\[
K(i,\epsilon)\le \max\{K(j,\epsilon):j\in N(i)\}+1
\]
formalizes that useful smoothing depth is driven by local graph structure rather than a single global propagation budget [2110.14377].

Direct target-space methods also have explicit operating assumptions. SALS relies on labeled neighbors in the training set and uses only their class histogram, so its neighborhood signal weakens when labeled neighbors are scarce [2112.00499]. PosteL assumes that the conditional distributions \(\hat P(Y_j=m\mid Y_i=n)\) vary meaningfully across classes; the paper identifies Actor as a case where these conditionals are relatively similar and gains are smaller [2406.00410]. ALS is motivated by positive label correlation and mini-batch label bias in scalable graph training, so its strongest benefits appear in partitioned or sampled large-graph regimes [2108.13555].

The broader smoothing literature supplies additional statistical structure. Random-spanning-forest estimators are unbiased for the exact Laplacian smoother, and the tree-average estimator has variance
\[
\mathbb{E}\left(\|\bar{x}-\hat{x}\|^2\right)=y^\top(K-K^2)y,
\]
which is lower than that of the root-value estimator [1910.07963]. In the Bayesian functional setting, the graph-Laplacian prior attains the minimax rate
\[
n^{-\beta \gamma /(2\beta\gamma+\beta+ r\gamma)},
\]
and a random-series prior achieves the minimax rate up to a logarithmic factor, while credible regions of optimal order can have arbitrarily high frequentist coverage in the fixed-smoothness setting [2104.10335].

Taken together, these results delimit the topic precisely. Graph label smoothing is not a single method but a spectrum of constructions ranging from graph-aware soft targets, through propagation of predicted label distributions, to Laplacian regularization of class-indicator signals. What unifies them is the assumption that label-related information should vary more smoothly over a graph than one-hot supervision alone would suggest. What separates them is the object being smoothed: targets, predictions, class-indicator signals, representations, graphlet distributions, or even the graph structure itself.

Source: https://www.emergentmind.com/topics/graph-label-smoothing