---
title: 'C-Mixup: Regression Data Augmentation'
url: https://www.emergentmind.com/topics/c-mixup
type: topic
---

# C-Mixup: Regression Data Augmentation

C-Mixup is a data augmentation technique designed to improve generalization and robustness in supervised regression tasks by constructing synthetic training points via convex combinations of instances with semantically similar labels. The method extends the classical Mixup approach, which was originally optimized for classification, by selecting mixed pairs in a manner that respects the geometric structure of the label space. This controlled interpolation is shown to reduce the creation of implausible targets and yields measurable gains in mean-squared error, domain-invariance, and generalization for regression problems where the output space is continuous and often multimodal.

## 1. Motivation: Challenges in Regression Data Augmentation

Classical Mixup generates synthetic samples by interpolating pairs uniformly sampled from the training set, combining both inputs and their associated outputs through a randomly drawn mixing coefficient $\lambda \sim \mathrm{Beta}(\alpha, \alpha)$:
\[
\tilde{x} = \lambda x_i + (1-\lambda)x_j, \qquad \tilde{y} = \lambda y_i + (1-\lambda)y_j.
\]
While this is effective for classification, where interpolating between discrete label vectors (e.g., one-hot encodings) produces valid soft labels, it fails in regression settings. If two samples with distant labels $y_i, y_j$ are mixed, the resulting $\tilde{y}$ may not correspond to any plausible or meaningful value in the problem domain, leading to degraded model performance, especially under covariate or correlation shifts [2210.05775, 2405.17938].

C-Mixup addresses this limitation by ensuring that only pairs with proximate labels are mixed, resulting in synthetic targets that remain semantically valid.

## 2. Algorithmic Formulation

For each anchor input-label pair $(x_i, y_i)$ in a dataset $D = \{(x_i, y_i)\}_{i=1}^n$, C-Mixup defines a probabilistic selection mechanism over candidate partners $(x_j, y_j)$ using a kernel function over the label space:
\[
P((x_j, y_j) \mid (x_i, y_i)) = \frac{\exp\left(-d(y_i, y_j)/b^2\right)}{\sum_{k=1}^n \exp\left(-d(y_i, y_k)/b^2\right)}
\]
where $d(y_i, y_j)$ is typically the Euclidean distance and $b > 0$ is a bandwidth hyperparameter controlling kernel sharpness [Eq (1), 2405.17938]. The partner $j$ is sampled according to $P(\cdot \mid i)$, and the corresponding input and label are linearly interpolated:
\[
\tilde{x} = \lambda x_i + (1-\lambda) x_j, \qquad \tilde{y} = \lambda y_i + (1-\lambda) y_j
\]
with $\lambda \sim \mathrm{Beta}(\alpha, \alpha)$.

The process results in a mixed dataset $S = \{(\tilde{x}, \tilde{y})\}$, which augments the original dataset for model training [Algorithm 3, 2405.17938].

## 3. Hyperparameters and Sampling Behavior

C-Mixup's effectiveness depends on two main hyperparameters:

- **Bandwidth $b$:** Governs the selectivity in label space. Small $b$ confines mixing to very close label-neighbors, approximating empirical risk minimization. Large $b$ broadens the kernel, making C-Mixup approach uniform Mixup behavior [2405.17938].
- **Beta Parameter $\alpha$:** Controls the symmetry of the linear interpolation. Large $\alpha$ (e.g., $\gg1$) yields mixing coefficients near 0.5; small $\alpha$ produces coefficients near 0 or 1, favoring nearly original samples [2405.17938, 2210.05775].

There is no explicit distance threshold; the kernel provides a soft weighting, and both parameters can be tuned via cross-validation or data-driven procedures.

## 4. Theoretical Properties and Generalization Guarantees

C-Mixup is theoretically justified in regression by minimizing the risk of generating synthetic points in low-density or semantically invalid regions of label space. The approach provably yields strictly lower mean squared error (MSE) than both vanilla Mixup (uniform over instances) and Mixup with feature-similarity-based pairing, under a noisy single-index model:
\[
\mathrm{MSE}(\theta^*_{\rm C\text{-}Mixup}) < \min \left\{\mathrm{MSE}(\theta^*_{\rm mixup}),\, \mathrm{MSE}(\theta^*_{\rm feat})\right\}
\]
where $\theta^*_{\rm feat}$ is learned via feature similarity Mixup [2210.05775, Theorem 1].

C-Mixup also yields tighter bounds for meta-regression (few-shot task generalization) and under covariate shift, outperforming both classical and feature-based Mixup across these settings [2210.05775, Theorems 2–3].

Empirically, C-Mixup outperforms strong baselines (ERM, vanilla mixup, Manifold Mixup, etc.) with improvements of +6.56% in-distribution generalization, +4.76% few-shot generalization, and +5.82% out-of-distribution robustness across a spectrum of tasks (tabular, time-series, image, video, drug–target binding) [2210.05775]. C-Mixup is also robust to moderate label noise and the choice of kernel width and Beta parameter.

## 5. Extensions and Applications Beyond Tabular Regression

C-Mixup has been adapted for hierarchical and domain-specific representations, such as in multidimensional music aesthetic evaluation. In this setting, C-Mixup operates on pooled feature vectors from multiple scales (e.g., segment and track-level) rather than raw inputs, using a kernel over these semantic representations to enforce "semantic consistency"—mixing only those examples close in the pooled feature space [2511.18869].

In hierarchical augmentation pipelines, C-Mixup is often applied after base-level augmentations (like waveform perturbations), particularly for structured regression targets (e.g., multidimensional audio quality scores). Empirical ablations show that injecting C-Mixup produces measurable increases in top-tier ranking metrics (e.g., +0.99 Top-Tier Accuracy over baseline on music evaluation benchmarks) [2511.18869].

## 6. Limitations and Sensitivity to Noisy Labels

A core limitation of C-Mixup is its inability to distinguish clean from noisy samples. The kernel-based selection considers only label proximity, not the reliability of labels. In noise-corrupted settings, this can lead to harmful mixings, as confirmed by degradation in performance proportional to increasing noise ratios—on par with baseline ERM and vanilla Mixup [Section 3, Fig. 2(a), 2405.17938]. Further, the optimal kernel width $b$ shifts with noise level, necessitating adaptive tuning [Fig. 2(b), 2405.17938].

The RC-Mixup extension addresses this by embedding C-Mixup within a robust training framework: C-Mixup is applied only to a dynamically curated set of presumed-clean examples, as determined by robust model selection. Bandwidth $b$ is also periodically re-tuned throughout training [Section 4, Algorithm 1, 2405.17938].

## 7. Comparative Perspective and Related Work

C-Mixup complements and differs from other advanced mixup-type methods. For instance, in contrast with Co-Mixup—which leverages discrete optimization for maximizing saliency guidance and supermodular diversity in the batch for classification [2102.03065]—C-Mixup's principal novelty lies in label-space locality for regression. 

A plausible implication is that while C-Mixup chiefly addresses plausibility of synthetic labels in continuous output domains, methods such as Co-Mixup focus on spatial or semantic diversity in input construction and are primarily geared toward classification or detection scenarios.

C-Mixup has also been successfully integrated (via label-similarity sampling) with other augmentation pipelines like CutMix, PuzzleMix, and AutoMix, leading to further gains across diverse data modalities [2210.05775].

---

**Key References:**  
- "RC-Mixup: A Data Augmentation Strategy against Noisy Data for Regression Tasks" [2405.17938]  
- "C-Mixup: Improving Generalization in Regression" [2210.05775]  
- "Multidimensional Music Aesthetic Evaluation via Semantically Consistent C-Mixup Augmentation" [2511.18869]  
- "Co-Mixup: Saliency Guided Joint Mixup with Supermodular Diversity" [2102.03065]

Source: https://www.emergentmind.com/topics/c-mixup