---
title: 'SM-netFusion: Supervised Cross Diffusion'
url: https://www.emergentmind.com/topics/supervised-cross-diffusion-sm-netfusion
type: topic
---

# SM-netFusion: Supervised Cross Diffusion

Supervised Cross Diffusion (SM-netFusion) is a methodological framework for estimating class-specific, representative, and discriminative Brain Network Atlases (BNAs) by leveraging supervised multi-topology network cross-diffusion. It is designed to address limitations in prior brain network fusion methods that rely solely on single topological measures and unsupervised similarity network diffusion, thereby enhancing both the representativeness and discriminative capacity of learned BMAs, particularly for population-level neuroimaging analysis [2009.11054].

## 1. Motivation and Conceptual Overview

SM-netFusion is constructed to estimate a population-driven BNA that is (i) representative—capturing traits shared among subjects, (ii) centered—optimally close, in a metric sense, to all subjects in a class, and (iii) discriminative—easily identifying connections distinguishing between clinical and control populations. Classical BNA estimation methods employ similarity network diffusion and fusion, typically using only node degree as a topological descriptor and operating in an entirely unsupervised manner. Such approaches can obscure informative centrality structure and lack discriminative supervision, reducing performance in downstream classification tasks, especially for clinical prediction.

To address these gaps, SM-netFusion introduces (i) multiple complementary graph centrality measures—degree, closeness, and eigenvector centrality—into the kernelization and diffusion processes, and (ii) a supervised, cluster-aware multiple kernel learning (MKL) scheme that guides the fusion toward discriminative network features.

## 2. Mathematical Foundations

Let $\{\mathbf{X}^c_i\}_{i=1}^{N^c}$, $\mathbf{X}^c_i\in\mathbb{R}^{r\times r}$, denote the set of symmetric connectivity matrices for $N^c$ subjects in class $c$. For each subject $i$, SM-netFusion constructs three diffusion kernels corresponding to:

- **Degree centrality**: $\mathbf{D}^c_i = \mathrm{diag}(\mathbf{X}^c_i\mathbf{1})$, producing kernel
  $$ K^{(\mathrm{deg}),c}_i(k,l) = \exp\left(-\frac{|D^c_i(k,k)-D^c_i(l,l)|}{\sigma_{\mathrm{deg}}}\right). $$
- **Closeness centrality**: with node $n$,
  $$ C^c_i(n)=\frac{r-1}{\sum_{k\neq n}d_{nk}}, $$
  forming $\mathbf{C}^c_i=\mathrm{diag}(C^c_i(1),...,C^c_i(r))$ and
  $$ K^{(\mathrm{clo}),c}_i(k,l) = \exp\left(-\frac{|C^c_i(k,k)-C^c_i(l,l)|}{\sigma_{\mathrm{clo}}}\right). $$
- **Eigenvector centrality**: $\mathbf{A}^c_i\mathbf{x}=\lambda_1\mathbf{x}$, $\mathbf{E}^c_i=\mathrm{diag}(\mathbf{x})$,
  $$ K^{(\mathrm{eig}),c}_i(k,l) = \exp\left(-\frac{|E^c_i(k,k)-E^c_i(l,l)|}{\sigma_{\mathrm{eig}}}\right). $$

These centrality-based kernels are concatenated into a third-order tensor per subject,
$$ \mathcal{T}^c_i = [K^{(\mathrm{deg}),c}_i,\ K^{(\mathrm{clo}),c}_i,\ K^{(\mathrm{eig}),c}_i ], $$
and fused through arithmetic averaging:
$$ \bar{\mathbf{T}}^c_i = \frac{1}{3}\Bigl(K^{(\mathrm{deg}),c}_i + K^{(\mathrm{clo}),c}_i + K^{(\mathrm{eig}),c}_i\Bigr). $$

## 3. Supervised Learning and Kernel Weight Optimization

To incorporate class structure and population heterogeneity, SM-netFusion initially clusters the training data $\{\mathbf{X}^c_i\}$ into $n_c$ subspaces using a method such as SIMLR. For MKL, nonnegative weights $\mathbf{w} = (w_1, ..., w_{N^c})^\top$ are learned to optimally map the subjectwise multi-topology kernels to the cluster labels. Using a diagonal label matrix $\mathbf{Y} = \operatorname{diag}(y_1,...,y_{N^c})$ and label vector $y_i\in\{1,...,n_c\}$, the EasyMKL-style objective is:

$$
\min_{\mathbf{w}\succeq\mathbf{0},\,\|\mathbf{w}\|_2=1}
\;\min_{\boldsymbol\gamma\in\Gamma}
\; \boldsymbol\gamma^\top\,\mathbf{Y}\,\left(\sum_{i=1}^{N^c}w_i\,\bar{\mathbf{T}}^c_i\right)\mathbf{Y}\, \boldsymbol\gamma
+\lambda\,\|\boldsymbol\gamma\|_2^2,
$$
with
$$
\Gamma =\left\{\boldsymbol\gamma\in\mathbb{R}_+^{N^c}\,\big|\:\sum_{i\in\text{cluster }j}\gamma_i=1\ \forall j=1,...,n_c\right\}.
$$

Closed-form expressions exist for the optimal weights:

$$
w_i = \frac{\boldsymbol\gamma^\top \mathbf{Y} (\bar{\mathbf{T}}^c_i/\operatorname{Tr}(\bar{\mathbf{T}}^c_i)) \mathbf{Y} \boldsymbol\gamma}
          {\sqrt{\sum_{j=1}^{N^c}(\boldsymbol\gamma^\top \mathbf{Y} (\bar{\mathbf{T}}^c_j/\operatorname{Tr}(\bar{\mathbf{T}}^c_j)) \mathbf{Y} \boldsymbol\gamma)^2}},
$$

where $\lambda>0$ is the regularization parameter.

## 4. Cross-Diffusion and Atlas Construction

After learning $\{w_i\}$, each subject’s normalization kernel is constructed as
$$
\mathbf{K}^c_i = w_i\,\bar{\mathbf{T}}^c_i,
$$
with inverse $\bigl(\mathbf{K}^c_i\bigr)^{-1}$. The procedure is as follows:

1. **Initialization:** Multi-topology normalization yields
   $$
   \mathbf{P}^c_i(0)(k,l)=
      \begin{cases}
      \frac{1}{2}\bigl(\mathbf{K}^c_i\bigr)^{-1}(k,k)\,\mathbf{X}^c_i(k,l), & k\neq l, \\
      \frac{1}{2}, & k=l.
      \end{cases}
   $$
2. **Local Kernel Computation:** For each $i$,
   $$
   \mathbf{Q}^c_i(k,l) =
      \begin{cases}
      \mathbf{X}^c_i(k,l)/\sum_{p\in\mathcal{N}_k}\mathbf{X}^c_i(k,p), & l\in\mathcal{N}_k, \\
      0, & \text{otherwise}
      \end{cases}
   $$
   where $\mathcal{N}_k$ denotes the set of $K$ nearest neighbors of ROI $k$.

3. **Iterative Cross-Diffusion (for $t = 1,...,T$):**
   $$
   \mathbf{P}^c_i(t) = \mathbf{Q}^c_i \left(\frac{1}{N^c-1}\sum_{j\neq i} \mathbf{P}^c_j(t-1)\right) \mathbf{Q}^c_i{}^\top
   $$
4. **Atlas Fusion:** The class-level atlas is
   $$
   \mathbf{A}^c = \frac{1}{N^c}\sum_{i=1}^{N^c} \mathbf{P}^c_i(T)
   $$

## 5. Representativeness and Discriminative Power

Representativeness and centrality of $\mathbf{A}^c$ are measured by average Frobenius distance:
$$
\overline{d}_F = \frac{1}{N^c}\sum_{i=1}^{N^c} \|\mathbf{A}^c-\mathbf{X}^c_i\|_F
$$
SM-netFusion achieves the lowest $\overline{d}_F$ among all evaluated baselines, as detailed below.

| Method              | $\overline{d}_F$(ASD) | $\overline{d}_F$(NC) |
|---------------------|----------------------|----------------------|
| D-SNF (deg)         | 1.23                 | 1.18                 |
| C-SNF (clo)         | 1.21                 | 1.16                 |
| E-SNF (eig)         | 1.22                 | 1.17                 |
| netNorm             | 1.19                 | 1.14                 |
| NAGFS               | 1.17                 | 1.12                 |
| **SM-netFusion**    | **1.09**             | **1.04**             |

Discriminativeness is assessed by forming the residual
$$
\mathbf{R} = |\mathbf{A}^{(1)} - \mathbf{A}^{(2)}|
$$
and using the top $N_f$ features to train a linear SVM. On the ABIDE dataset (505 subjects: 266 ASD, 239 NC), SM-netFusion surpasses all baselines, with accuracy improvements from 5–15% ($p<0.05$, paired two-tailed $t$–test):

| Method             | Accuracy (%)      |
|--------------------|------------------|
| IFS+SVM            | 72.4             |
| netNorm+SVM        | 74.1             |
| RF-RFE             | 75.0             |
| LLCFS+SVM          | 75.8             |
| **SM-netFusion+SVM** | **82.3 (+5–15%)** |

## 6. Experimental Protocol and Parameterization

- **Dataset:** ABIDE preprocessed resting-state fMRI, $r = 116$ regions of interest (ROIs).
- **Cross-validation:** 5-fold stratified; feature selection nested within each training split.
- **Parameter Choices:** $n_c=3$ clusters via SIMLR; $T=20$ diffusion iterations; $K=25$ neighbors; MKL regularizer $\lambda = 10^{-3}$.
- **Metrics:** Mean Frobenius distance $\overline{d}_F$, classification accuracy, AUC, and statistical significance via paired two-tailed $t$-tests ($\alpha=0.05$).

## 7. Extension to Graph Feature Selection

By producing class-specific, centrally located atlases $\mathbf{A}^c$, SM-netFusion natively enables scalable, supervised graph feature selection:
- Compute $\mathbf{A}^c$ per class.
- Form $\mathbf{R} = |\mathbf{A}^{(1)}-\mathbf{A}^{(2)}|$.
- Rank off-diagonal elements $R_{kl}$; select the top $N_f$ features.
- Employ these features in downstream predictive learners.

This operationalizes SM-netFusion not only as an atlas estimator but as a systematic framework for identifying discriminative graph features relevant to network neuroscience and clinical prediction.

---

In summary, SM-netFusion enriches conventional similarity network fusion by integrating degree, closeness, and eigenvector centrality measures; employing supervised, cluster-aware kernel weight learning; and providing a high-fidelity, discriminative cross-diffusion process. The result is a methodologically rigorous approach that produces state-of-the-art representative and discriminative BNAs, yielding marked improvements in clinical group classification and offering a principled pipeline for graph-based feature selection in population neuroscience [2009.11054].

Source: https://www.emergentmind.com/topics/supervised-cross-diffusion-sm-netfusion