---
title: Quaternion Nuclear Norm Regularization
url: https://www.emergentmind.com/topics/quaternion-nuclear-norm-regularization
type: topic
---

# Quaternion Nuclear Norm Regularization

Quaternion nuclear norm regularization extends low-rank regularization to hypercomplex-valued (specifically, quaternionic) matrices. By exploiting the quaternion structure, these methods provide principled frameworks for modeling and recovering multi-channel signals—especially color images and videos—where exploiting inter-channel coupling is critical. Modern quaternion nuclear norm regularization encompasses convex relaxations (e.g., the quaternion nuclear norm), nonconvex enhancements (e.g., truncated, weighted, and ratio-based norms), and robust optimization algorithms enabling effective image inpainting, denoising, robust PCA, and classification.

## 1. Quaternion Nuclear and Frobenius Norms

A quaternion matrix $\dot X\in\mathbb{Q}^{m\times n}$ is typically encoded as $\dot X = X_0 + X_1\,\mathbf{i} + X_2\,\mathbf{j} + X_3\,\mathbf{k}$, where each $X_r\in\mathbb{R}^{m\times n}$. For such matrices, the Singular Value Decomposition (QSVD) gives unitary factors $U,V$ and singular values $\{\sigma_i\}$ (real, nonnegative). The quaternion nuclear norm (QNN) and Frobenius norm are defined as:
\[
\|\dot X\|_* = \sum_{i=1}^{\min\{m, n\}} \sigma_i(\dot X), \qquad
\|\dot X\|_F = \sqrt{\sum_i \sigma_i(\dot X)^2}
\]
These norms retain key properties—unitary invariance under left/right quaternion rotations and real scaling invariance—making them natural extensions of their real-valued counterparts [2101.02443][2410.15006]. The QNN is the tightest convex surrogate for the rank, but uniformly shrinks all singular values, often leading to over-penalization of the dominant signal components.

## 2. Nonconvex Surrogates: QNOF, QNMF, Truncated, and Weighted Norms

To bridge the gap between convex relaxations and true rank, several nonconvex surrogates have emerged:

- **Quaternion Nuclear Norm Over Frobenius (QNOF):**
  \[
  \|\dot X\|_{\mathrm{QNOF}} := \frac{\|\dot X\|_*}{\|\dot X\|_F}
  \]
  This is a scale-invariant, parameter-free, nonconvex proxy, tightly approximating the rank (since $\|\sigma\|_1/\|\sigma\|_2$ closely tracks $\|\sigma\|_0$). QNOF satisfies $1 \leq \|\dot X\|_{\mathrm{QNOF}} \leq \sqrt{\mathrm{rank}(\dot X)}$ and exhibits both scaling and unitary invariance. Its optimization reduces to an $L_1/L_2$ penalty on the singular values [2504.21468].

- **Quaternion Nuclear Norm Minus Frobenius Norm (QNMF):**
  \[
  R(\dot X) = \|\dot X\|_* - \alpha \|\dot X\|_F\,,\qquad \alpha>0.
  \]
  This hybrid penalty sharply suppresses small singular values while reducing shrinkage on dominant ones. The closed-form proximal mapping leads to exact global solutions in the denoising setting [2409.07797].

- **Truncated and Weighted Norms:** Truncated versions ($\|\dot X\|_* - \sum_{i=1}^r \sigma_i(\dot X)$) restrict shrinkage to the tail singular spectrum [2101.02443][2204.08629]. Weighted nuclear norms (e.g., QWNNM) and weighted Schatten $p$-norms (QWSNM) introduce elementwise weights or nonconvex exponents, further enhancing rank-approximation [2307.12656][2209.02964].

- **Bilinear and Factor Norms:** Bilinear-factor surrogates such as quaternion double nuclear norm (Q-DNN) and quaternion Frobenius/nuclear norm (Q-FNN) offer efficient nonconvex Schatten-$p$ proxies, directly optimizing the factor representations to avoid large-scale QSVD [2005.02886].

## 3. Optimization Algorithms: Proximal and ADMM Frameworks

Most quaternion nuclear norm regularized models, including nonconvex extensions, are solved via ADMM frameworks. Key algorithmic features include:

- **Proximal Operator via QSVD:** The central step is computation of the QSVD, followed by shrinking singular values via the corresponding thresholding or nonconvex operation. For QNOF and QNMF, the optimal singular value update solves either a root-finding or closed-form piecewise system [2504.21468][2409.07797].

- **Auxiliary Splits and Augmented Lagrangian:** To decouple complex nonconvex objectives, models use auxiliary variables (splits) and Lagrange multipliers, alternating updates for primal and dual variables and increasing penalty parameters to guarantee convergence [2504.21468][2410.15006][2101.02443].

- **Weighted and Structured Steps:** Weighted and truncated methods build weights from observed data patterns, and the row/entry structure, accelerating convergence under missing or irregular observation patterns [2101.02443][2209.02964].

Tables summarizing the main quaternion regularizers and their optimization properties:

| Regularizer           | Expression                                | Optimization Complexity              |
|----------------------|-------------------------------------------|--------------------------------------|
| QNN                  | $\|\dot X\|_*$                            | QSVD + soft-threshold per iter ($O(n^3)$) [2410.15006] |
| QNOF                 | $\|\dot X\|_* / \|\dot X\|_F$             | QSVD + $L_1/L_2$-shrinkage per iter [2504.21468]   |
| QNMF                 | $\|\dot X\|_* - \alpha\|\dot X\|_F$       | QSVD + piecewise shrinkage [2409.07797]           |
| QTNN                 | $\|\dot X\|_* - \sum_{i=1}^r\sigma_i$     | QSVD + low-rank factorization [2101.02443]        |
| QWNNM/QWSNM          | $\sum w_i \sigma_i^p$                     | QSVD + Generalized Soft-Threshold [2307.12656]    |
| Q-DNN/Q-FNN          | Bilinear factorization surrogates          | Small-matrix QSVD per iter [2005.02886]           |

## 4. Applications in Imaging and Machine Learning

Quaternion nuclear norm regularization is foundational in modern color image and video restoration, classification, and completion:

- **Matrix Completion and Inpainting:** QNOF and truncated/weighted methods deliver superior PSNR and SSIM in color-image inpainting, especially under high missing or impulse noise, leveraging stronger rank approximation than convex nuclear norm models [2504.21468][2204.08629][2101.02443][2410.15006].
  
- **Robust Principal Component Analysis:** Joint QNOF/$L_1$ models achieve state-of-the-art denoising and impurity removal, robust to heavy-tailed and sparse errors [2504.21468][2409.07797].

- **Classification:** Low-rank support quaternion matrix machines (LSQMM) integrate QNN regularization with hinge-loss, resulting in noise-robust classification, outperforming matrix-based SVMs [2512.08327].

- **Color Video and Tensor Completion:** Tensorial extensions (QTNN, QWNN, log-nuclear norms) promote both global low-rankness and sparse local detail in 3D/color video tensors, leveraging quaternion transforms (e.g., QTDCT) [2212.08361][2209.02964].

Empirically, QNOF was found to recover low-rank quaternion matrices with relative error $\le 10^{-7}$ when $95\%$ entries are observed and to offer superior performance (best PSNR/SSIM) on standard color imaging benchmarks for $50$–$80\%$ missing rates [2504.21468]. QNMF ranks first on average PSNR/SSIM in Gaussian/real-noise denoising, inpainting, and deblurring [2409.07797].

## 5. Theoretical Guarantees and Practical Behavior

- **Convergence:** All convex models (QNN, QWNNM/QWSNM) admit global convergence via standard ADMM arguments; nonconvex formulations (QNOF, QNMF) show weak or fixed-point convergence provided penalties increase and primal variables remain bounded [2504.21468][2307.12656][2101.02443].

- **Rank Approximation Fidelity:** Nonconvex surrogates (QNOF, QNMF, truncated/weighted norms, MCP/logarithmic norms) provide tighter and less biased proxies to the true rank function, evidenced both by theoretical approximation bounds and practical gains in reconstruction accuracy [2504.21468][2409.07797][2410.15006].

- **Robustness and Efficiency:** QNOF-based completion converges 2-3× faster than other nonconvex methods; LSQMM classification accuracy remains $>84\%$ even under noise ratio $R=1.0$ [2504.21468][2512.08327].

## 6. Extensions: Weighted, Sparse, and Transformed Domains

Several extensions further increase modeling flexibility and efficacy:

- **Weighted Norms:** QWNN/QWSNM in tensor settings differentially penalize singular values of unfoldings, enabling more flexible low-rank structure capture. Weights can be data- or spectrum-dependent [2307.12656][2209.02964].
  
- **Sparse Regularization:** Integrating sparse penalties (e.g., quaternion $L_1$ norm in QDCT/QTDCT domains) enables simultaneous low-rank and sparse recovery, which is critical for fine-detail restoration and denoising [2204.08629][2212.08361].

- **Tensorial Generalizations:** Quaternion nuclear norm regularizers generalize naturally to higher-order tensors (QTNN, QTLN, QTT-rank minimization), enabling global and local structured recovery in color video [2212.08361][2209.02964].

## 7. Comparative Effectiveness and Principal Results

Extensive numerical results affirm the effectiveness of quaternion nuclear norm regularization and its extensions. QNOF consistently achieves best or top performance in color-image matrix completion, robust PCA, and denoising under standard and adverse corruptions [2504.21468]. QNMF provides state-of-the-art results across denoising, deblurring, and inpainting benchmarks [2409.07797]. Weighted and truncated variants offer further accuracy gains and computational benefits, especially as missing data rates increase or under more challenging noise regimes [2101.02443][2209.02964][2212.08361].

In summary, quaternion nuclear norm regularization and its nonconvex, weighted, and tensorial extensions represent a systematic, theoretically-grounded approach to low-rank modeling in hypercomplex domains where cross-channel coupling is essential. They yield scalable, convergent algorithms with demonstrably superior empirical performance in complex, high-dimensional imaging and machine learning tasks.

Source: https://www.emergentmind.com/topics/quaternion-nuclear-norm-regularization