MurreNet: Decoupling Multimodal Data for Survival

• The paper introduces MurreNet, a framework that decouples pathology and genomic inputs into modality-common and modality-specific representations to improve survival prediction.
• It employs a Multimodal Representation Decomposition module with cross-attention and transformer decoders, reinforced by similarity, difference, and reconstruction regularizers.
• Empirical evaluations on six TCGA cohorts show state-of-the-art C-index performance, highlighting the effectiveness of explicit decoupling and the DHOF fusion strategy.

MurreNet, introduced in "MurreNet: Modeling Holistic Multimodal Interactions Between Histopathology and Genomic Profiles for Survival Prediction" (Liu et al., 7 Jul 2025), is a multimodal survival prediction framework for paired histopathology whole-slide images (WSIs) and genomic profiles. Its defining principle is explicit representation decoupling: pathology–genomics inputs are decomposed into modality-specific and modality-common components, shaped by similarity, difference, and reconstruction regularizers, refined through cross-attention and transformer decoders, and fused by a Deep Holistic Orthogonal Fusion (DHOF) strategy before discrete-time hazard prediction. In the paper’s formulation, the central motivation is that straightforward fusion strategies do not comprehensively capture modality-specific and modality-common interactions, which leads to a limited understanding of multimodal correlations and suboptimal predictive performance (Liu et al., 7 Jul 2025).

1. Task setting and conceptual motivation

MurreNet is designed for cancer survival analysis from paired pathology and genomics. The task is discrete-time survival modeling: for each patient, the model takes pathology data $P$ and genomic data $G$, learns a joint representation, and predicts the hazard function, defined as the probability of death immediately after discrete time point $t$, conditioned on survival up to $t$. The corresponding survival function is obtained by accumulating the negated hazards. This setting is difficult because the two modalities are highly heterogeneous: WSIs are high-resolution, weakly supervised visual bags with rich spatial and morphological variation, whereas genomic profiles are low-sample-size, high-dimensional molecular vectors (Liu et al., 7 Jul 2025).

The paper’s argument is that not all cross-modal correlations are equally useful for prognosis. A naive fusion mechanism may overemphasize shared information while suppressing complementary modality-specific prognostic cues. MurreNet therefore assumes that pathology–genomics data contain both modality-common information, reflecting cross-modal biological correspondence, and modality-specific information, reflecting cues unique to either tissue morphology or molecular measurements. Its decoupling strategy is intended to reduce redundancy between modalities while preserving complementary factors that remain prognostically informative.

This formulation places MurreNet in a specific subclass of multimodal methods. It is neither a purely unimodal MIL model for pathology nor a simple concatenation-based pathology–genomics predictor. Its central claim is that prognosis depends on jointly modeling both inter-modality commonality and intra-modality specificity.

2. Input encoding and end-to-end pipeline

The full pipeline has four stages: feature extraction, multimodal representation decomposition, holistic multimodal interaction learning and fusion, and survival prediction (Liu et al., 7 Jul 2025).

For pathology, each WSI is first partitioned using CLAM into non-overlapping $256\times 256$ patches at $20\times$ magnification. A frozen pathology foundation model, CHIEF, embeds each patch into an instance-level feature vector. These patch features are then converted into a 768-dimensional pathology embedding, denoted $\mathrm{h}_p^o$, using a learnable fully connected layer.

For genomics, the model uses RNA-seq, copy number variation (CNV), and mutation status. To mitigate the high-dimensional low-sample-size issue, these variables are grouped into six biologically motivated sub-sequences: protein kinases, tumor suppressor genes, oncogenes, cell differentiation markers, transcription, and cytokines and growth. The grouped sequences are stacked and passed through a fully connected layer to obtain a $d$-dimensional genomic embedding $\mathrm{h}_g^o$.

These two modality embeddings are then processed by the Multimodal Representation Decomposition (MRD) module, which produces four latent representations: pathology-specific $\mathrm{h}_p^s$, genomic-specific $G$0, pathology-side common $G$1, and genomics-side common $G$2. MurreNet then forms multimodal specific and common feature groups by concatenating the corresponding decomposed features across modalities, refines them through cross-attention and transformer decoders, fuses them by DHOF, and sends the resulting multimodal representation $G$3 to a survival head trained with negative log-likelihood survival loss (Liu et al., 7 Jul 2025).

The pipeline is therefore explicitly factorized rather than monolithic. Its modality interface is established at the level of learned pathology and genomic embeddings, and its multimodal interaction mechanism is applied after the shared/specific split.

3. Multimodal Representation Decomposition

MRD is the core mechanism of MurreNet. It explicitly factorizes each paired sample into specific and shared components (Liu et al., 7 Jul 2025).

Let $G$4 be the pathology embedding and $G$5 the genomic embedding. The paper introduces three encoders: $G$6 for pathology-specific encoding, $G$7 for genomic-specific encoding, and $G$8 for modality-common encoding. The modality-specific branches are MLPs: $G$9

The modality-common encoder is a two-branch parallel MLP with a co-attention block: $t$0 with co-attention matrix

$t$1

Here, $t$2 consists of two fully connected layers with layer normalization and GELU activation; $t$3 denotes element-wise multiplication; and $t$4 models cross-modal interactions between the initial pathology and genomics embeddings. In this decomposition, $t$5 and $t$6 are intended to capture pathology-only and genomics-only information, whereas $t$7 and $t$8 are intended to capture aligned cross-modal information.

The paper does not formulate MRD as a probabilistic latent-variable model with explicit priors. Instead, decoupling is encouraged by architectural separation plus downstream regularization. This is important for interpretation: MurreNet’s decomposition is learned through neural branches and constraints rather than through a variational or generative disentanglement framework.

4. Regularization, interaction refinement, and Deep Holistic Orthogonal Fusion

After MRD, MurreNet imposes three regularizers: similarity, difference, and reconstruction. The total training objective is

$t$9

with $t$0 and $t$1 (Liu et al., 7 Jul 2025).

The stated purpose of $t$2 is to reduce discrepancy between the two modality-common representations and align them in a shared space, but the printed formula is

$t$3

As written, this compares the original pathology embedding to the pathology common representation rather than directly comparing $t$4 and $t$5. The paper itself therefore contains a mismatch between the prose description and the printed equation.

To separate common and specific branches, MurreNet applies a KL-divergence-based difference term: $t$6 Its role is to prevent common and specific representations from collapsing to similar embeddings.

To keep the latent decomposition informative, the model reconstructs the original modality embeddings using two MLP decoders, producing $t$7 and $t$8, and applies

$t$9

MurreNet then forms a modality-specific combined feature $256\times 256$0 and a modality-common combined feature $256\times 256$1 by concatenation. A cross-attention module with two transformer decoders is used to integrate these representations and mine contextual information. The paper states that the decoder uses multi-head self-attention, layer normalization, Pyramid Position Encoding Generator (PPEG) from TransMIL, and Nystrom attention to reduce computational burden.

The final fusion step is DHOF. Given refined specific feature $256\times 256$2 and common feature $256\times 256$3, DHOF projects each specific feature element onto the common representation and subtracts that projection: $256\times 256$4 The stated objective is to remove from the specific representation the component already explained by the common representation, so that the remaining orthogonal residual retains complementary prognostic content rather than redundancy. The described process then pools the concatenation of $256\times 256$5 and $256\times 256$6 and applies a fully connected layer to obtain the final multimodal representation $256\times 256$7.

5. Survival prediction and empirical evidence

The final representation $256\times 256$8 is used for discrete-time survival prediction. MurreNet follows prior multimodal survival works and uses negative log-likelihood survival loss. Evaluation uses Concordance index (C-index) as the main quantitative metric, together with Kaplan–Meier survival curves and Log-rank significance testing for risk stratification (Liu et al., 7 Jul 2025).

MurreNet is evaluated on six TCGA cohorts. The main reported results are as follows.

Cohort	Sample size	MurreNet C-index
BLCA	373	$256\times 256$9
BRCA	956	$20\times$0
COADREAD	340	$20\times$1
LUAD	453	$20\times$2
UCEC	480	$20\times$3
STAD	349	$20\times$4

Under the reported protocol, MurreNet achieves the best C-index on all six cohorts and is described as state of the art relative to the listed recent multimodal survival baselines: MLP, SNN, Coxnnet, ABMIL, DSMIL, CLAM, TransMIL, DTFD-MIL, M3IF, MCAT, CMTA, MoME, MOTCat, SurvPath, and PORPOISE. The paper particularly highlights relative gains over MCAT of 4.87% on BLCA, 3.91% on BRCA, 11.71% on COADREAD, 2.37% on LUAD, 14.29% on UCEC, and 11.09% on STAD.

The ablation sequence is also central to the paper’s argument. The stages are: A, simple multimodal concatenation; B, A + MRD; C, B + DHOF; D, C + $20\times$5; E, D + $20\times$6; and F, E + $20\times$7, which is the full MurreNet. Reported C-index values on BLCA, LUAD, UCEC, and STAD improve monotonically from $20\times$8 in A to $20\times$9 in F. The paper interprets this as evidence for three claims: MRD matters, DHOF matters, and the three regularizers each contribute incremental gains.

For clinical stratification, predicted risk scores are used to split patients into low- and high-risk groups at the median. Kaplan–Meier curves across all six cohorts show statistically significant separation, with reported Log-rank $\mathrm{h}_p^o$0-values below 0.05. The paper presents this as evidence that MurreNet’s benefit is not confined to C-index improvement but also extends to risk-group separation.

The reported training setup uses Adam for 20 epochs with learning rate $\mathrm{h}_p^o$1, weight decay $\mathrm{h}_p^o$2, 5-fold Monte Carlo cross-validation, and $\mathrm{h}_p^o$3, $\mathrm{h}_p^o$4. For the SurvPath baseline, 4,096 patches per WSI are randomly sampled because of memory constraints.

6. Position within multimodal decoupling research and documented limitations

MurreNet’s notion of decoupling is an explicit shared/specific factorization for paired pathology and genomics, followed by orthogonal fusion. In this respect it differs from several other multimodal decoupling formulations. DMRNet decouples the representation that receives supervision during training from the representation used for inference in incomplete multimodal learning under missing modalities (Wei et al., 2024). DeCUR partitions the embedding into common and unique dimensions for multimodal self-supervised learning and trains those dimensions with different cross-correlation targets (Wang et al., 2023). DecAlign uses explicit modality-unique and modality-common encoders, then aligns the former with prototype-guided optimal transport and the latter with semantic statistic matching and MMD (Qian et al., 14 Mar 2025). MurreNet belongs to the same broad family of decoupled multimodal representation learning, but its target problem is discrete-time survival modeling from pathology and genomics rather than robustness to missing modalities, multimodal self-supervision, or affective multimodal prediction (Liu et al., 7 Jul 2025).

Several caveats are visible in the paper’s own presentation. First, some mathematical descriptions appear inconsistent or typeset incorrectly, especially the similarity loss and the cross-attention equation. Second, the common-representation alignment objective is therefore not fully clear from the printed formulas. Third, the method operates on pre-extracted slide-level pathology features rather than end-to-end patch-level multimodal alignment. Fourth, interpretability remains mostly conceptual: the paper does not include detailed feature attribution maps, gene or pathway saliency, or pathology region visualization. Fifth, external validation beyond TCGA is not reported.

A common misunderstanding would be to treat MurreNet as a generic multimodal decoupling architecture independent of domain assumptions. The paper does not support that reading. Its design assumes paired WSI and genomic data, grouped genomic sub-sequences, and discrete-time hazard modeling. A more precise characterization is that MurreNet is a pathology–genomics survival model whose core technical contribution is to decompose multimodal inputs into modality-common and modality-specific representations, regularize those representations, orthogonalize fusion to reduce redundancy, and use the resulting joint embedding for prognosis prediction.