---
title: 'Riemann-Oracle: Matrix Nearness Framework'
url: https://www.emergentmind.com/topics/riemann-oracle
type: topic
---

# Riemann-Oracle: Matrix Nearness Framework

Riemann-Oracle is a general-purpose framework for matrix nearness problems, possibly with additional linear constraints, in which the original minimization is split into two nested problems: an inner problem that is solved exactly or cheaply, and an outer problem that is recast as unconstrained optimization over a smooth real Riemannian manifold. In this framework, the “oracle” is an auxiliary parameter \(\theta\) encoding extra information about a minimizer—such as an eigenvector, a set of eigenvectors, or a null vector—while the “Riemann” component is the manifold structure of the outer search space. The framework is developed for a broad class of matrix and matrix-polynomial problems, including nearest structured singular matrices, nearest singular matrix polynomials, approximate greatest common divisor problems, structured distance to instability, and nearest matrices with prescribed nullity [2407.03957].

## 1. General formulation

The basic problem treated by Riemann-Oracle is the classical matrix nearness task
\[
\min_{X\in \mathcal Q}\|A-X\|,
\]
with emphasis on the Frobenius norm and with an extension to matrix polynomials \(A(x)=\sum_{i=0}^d A_i x^i\), where distance is measured by the coefficientwise Frobenius norm. The key structural step is to decompose the admissible set as
\[
\mathcal Q=\bigcup_\theta \mathcal Q_\theta,
\]
and, for fixed \(\theta\), solve the stiffened subproblem
\[
f(\theta)=\min \|A-X\| \quad \text{s.t. } X\in\mathcal Q_\theta.
\]
The original problem is then reduced to
\[
\min_\theta f(\theta).
\]
In the examples studied, \(\theta\) is often naturally constrained to lie on a manifold such as a unit sphere, a Stiefel manifold, or a Grassmann manifold, and the outer problem is therefore treated as optimization on a smooth real embedded Riemannian manifold [2407.03957].

This formulation is intended to expose a common nested structure across problems that are usually presented separately. The paper’s central claim is that many matrix nearness problems of practical interest are equivalent, in this sense, to a Riemannian optimization problem. A notable feature is that the outer objective need not be everywhere well behaved: the paper shows that it can be discontinuous, so the reduction is not merely formal and requires regularization to become computationally reliable [2407.03957].

## 2. Core model: nearest structured singular matrix

The framework is developed most explicitly for the nearest structured singular matrix problem. Let \(A\in\mathbb F^{m\times n}\), \(m\ge n\), and let admissible perturbations lie in the linear space
\[
\mathcal S=\left\{\Delta=\sum_{i=1}^p P^{(i)}\delta_i:\delta\in\mathbb F^p\right\},
\]
with linearly independent basis matrices \(P^{(i)}\). Under the standing normalization
\[
\mathcal P^*\mathcal P=I_p, \qquad \mathcal P=\begin{bmatrix}\mathrm{vec}(P^{(1)}) & \cdots & \mathrm{vec}(P^{(p)})\end{bmatrix},
\]
one has \(\|\Delta\|_F=\|\delta\|\).

Singularity of \(A+\Delta\) is encoded by the existence of a unit vector \(v\) such that
\[
(A+\Delta)v=0.
\]
For fixed \(v\), the paper defines
\[
M(v)=\begin{bmatrix}P^{(1)}v & \cdots & P^{(p)}v\end{bmatrix}\in\mathbb F^{m\times p}, \qquad r(v)=-Av,
\]
so that the constraint becomes
\[
M(v)\delta=r(v).
\]
The inner problem is therefore
\[
f(v)=\min_{\delta\in\mathbb F^p}\|\delta\|^2 \quad\text{s.t. } M(v)\delta=r(v),
\]
equivalently
\[
f(v)=\min \|\Delta\|_F^2 \quad\text{s.t. } (A+\Delta)v=0,\ \Delta\in\mathcal S.
\]

When \(r(v)\in \operatorname{Im}M(v)\), the minimum is attained at
\[
\delta_* = M^\dagger r, \qquad \Delta_*=\sum_{i=1}^p P^{(i)}(\delta_*)_i.
\]
If \(M\) has full row rank, this simplifies to
\[
\delta_* = M^*(MM^*)^{-1}r, \qquad f(v)=r^*(MM^*)^{-1}r.
\]
The outer problem then becomes
\[
\min_{\|v\|=1} f(v),
\]
with the unit sphere as the outer manifold. Even in the complex case, the sphere is treated as a smooth real embedded Riemannian manifold. This model is the template from which the paper derives its other specializations [2407.03957].

## 3. Discontinuity and regularization

A central technical point is that the unregularized outer objective is not automatically smooth. It is defined by
\[
f(v)= \begin{cases} g(v) & \text{if } r(v)\in \operatorname{Im}M(v),\\[2mm] +\infty & \text{otherwise}, \end{cases} \qquad g(v)=\|M(v)^\dagger r(v)\|^2.
\]
The paper shows that \(f\) can have jump discontinuities, even at a global minimizer. In the structured singular matrix setting, discontinuity is tied to feasibility and rank changes of \(M(v)\). For polynomial problems, additional mechanisms appear: the degree of a kernel vector \(v(x)\) may drop, or \(v(x)\) may cease to be a minimal basis vector. These phenomena make direct application of smooth manifold methods unreliable [2407.03957].

To remove this obstruction, the framework introduces Tikhonov regularization:
\[
f_\varepsilon(v) = \min_{\Delta\in\mathcal S} \|\Delta\|_F^2+\varepsilon^{-1}\|(A+\Delta)v\|^2, \qquad \varepsilon>0.
\]
This regularized objective has the closed form
\[
f_\varepsilon(v)=r^*(MM^*+\varepsilon I)^{-1}r,
\]
with minimizer
\[
\delta_*=M^*(MM^*+\varepsilon I)^{-1}r = (M^*M+\varepsilon I)^{-1}M^*r.
\]
No rank assumptions are required, and the paper proves the pointwise limit
\[
\lim_{\varepsilon\to 0} f_\varepsilon(v)=f(v)\quad \forall v.
\]

The resulting algorithm solves a sequence of smooth regularized problems with \(\varepsilon\downarrow 0\), using each solution to initialize the next. The paper embeds this into two classical outer strategies. In the penalty method,
\[
v_{k+1}\approx \arg\min_{v\in\mathcal M} f_{\varepsilon_k}(v), \qquad \varepsilon_{k+1}=\mu\varepsilon_k,\ \mu<1.
\]
In the augmented Lagrangian formulation, starting from
\[
\min_{\Delta,v}\ \|\Delta\|_F^2 \quad \text{s.t. } (A+\Delta)v=0,\ (\Delta,v)\in \mathcal S\times\mathcal M,
\]
one introduces \(y\in\mathbb F^m\) and
\[
\mathcal L_\varepsilon(\Delta,v;y) = \|\Delta\|_F^2+\varepsilon^{-1}\|(A+\Delta)v\|^2 +2\langle y,(A+\Delta)v\rangle.
\]
The inner minimization remains explicit, yielding
\[
f_{\varepsilon,y}(v)=r^*(MM^*+\varepsilon I)^{-1}r, \qquad r=-Av-\varepsilon y,
\]
with multiplier update
\[
y \leftarrow y+\varepsilon^{-1}(A+\Delta_*)v_*.
\]
The paper notes that augmented Lagrangian is often faster and more robust than pure penalty, while retaining the same nested structure [2407.03957].

## 4. Riemannian optimization and differential structure

After regularization, the outer problem is smooth on the manifold \(\mathcal M\). The implementation described in the paper uses Manopt’s Riemannian trust-region method. For the regularized augmented Lagrangian objective, letting
\[
z=(MM^*+\varepsilon I)^{-1}r, \qquad \Delta_*=\sum_{i=1}^p P^{(i)}(\delta_*)_i,
\]
the Euclidean gradient is
\[
\nabla f_{\varepsilon,y}(v)= -2(A+\Delta_*)^*z.
\]
The Hessian action on a direction \(w\) is
\[
H_{\varepsilon,y}(v)w = -2(\dot\Delta_*)^*z -2(A+\Delta_*)^*\dot z,
\]
with
\[
\dot z = -(MM^*+\varepsilon I)^{-1}\bigl(M\dot M^*z + (A+\Delta_*)w\bigr), \quad \dot M=M(w).
\]
Manopt then forms the Riemannian gradient by orthogonal projection onto the tangent space and the Riemannian Hessian using the Weingarten correction [2407.03957].

The paper also records cases where second-order information is less useful. For some problems, only first-order methods are recommended because the dependence of the outer minimizer on additional variables is nonsmooth. This is especially relevant in settings such as distance to instability, where a closed-form parameter minimizer is reused inside the outer Riemannian iteration [2407.03957].

The convergence discussion is correspondingly local and stationarity-based. The paper cites Riemannian augmented Lagrangian results stating that if the inner solver returns iterates with gradient norm below a tolerance and the outer sequence has a limit point satisfying LICQ, then the limit point satisfies KKT conditions for the original constrained problem. In the structured singular matrix setting, LICQ reduces to a rank condition on
\[
\begin{bmatrix} M(v)^* & (I-vv^*)(A+\Delta)^* \end{bmatrix}.
\]
Because the implementation uses a gradient-based stopping criterion, the strongest guaranteed outcome reported is convergence to stationary points [2407.03957].

## 5. Principal specializations

The framework is presented as a common reduction for several nearness problems that are usually treated by separate algorithms. The paper emphasizes that each specialization retains the same architecture: an inner least-squares-type problem in perturbation variables and an outer manifold problem in an oracle parameter [2407.03957].

| Problem class | Outer variable / manifold | Key reduction |
|---|---|---|
| Sparse structured singular matrix | \(v\) on the sphere | \(MM^*\) becomes diagonal |
| Singular matrix polynomials | kernel vector via Toeplitz lifting | reduced to structured singular matrix problem |
| Approximate GCD | cofactor-based oracle | structured singularity of \(S_d(p,q)\) |
| Distance to instability | \(v\) on the sphere with closed-form \(\lambda_*\) | nested minimization over \(\lambda\in\Omega^c\) |
| Prescribed nullity | orthonormal basis \(V\) on the Grassmannian | stacked constraints for multiple null vectors |

For sparse structured singular matrices, if \(\mathcal S\) is a sparsity pattern then \(M(v)\) and \(MM^*\) simplify substantially; in fact \(MM^*\) becomes diagonal, and the regularized objective reduces to
\[
f_{\varepsilon,y}(v)=\|(Av+\varepsilon y)\odot h\|^2,
\]
with elementwise weights \(h_i=(d_i+\varepsilon)^{-1/2}\). The paper states that this permits \(O(\#\mathcal J)\) evaluation [2407.03957].

For singular matrix polynomials \(A(x)=\sum_{i=0}^k A_i x^i\), Toeplitz lifting is used:
\[
\mathcal T_d(A)\in \mathbb F^{n(k+d+1)\times n(d+1)}, \qquad
A(x)v(x)=0 \iff \mathcal T_d(A)\,\mathrm{vec}(v)=0.
\]
This converts polynomial singularity to an ordinary structured singular matrix problem. In the unstructured polynomial case, the paper uses the Kronecker form
\[
M(v)=\mathcal T_k(v^T)\otimes I_n, \qquad r(v)=-M(v)\alpha,
\]
which is described as a much cheaper implementation [2407.03957].

For approximate GCD, the criterion is the existence of cofactors \(u,w\) such that
\[
u(x)p(x)+w(x)q(x)=0,
\]
with prescribed degrees, leading to a scaled Sylvester-type matrix \(S_d(p,q)\). For distance to instability, the nested problem is
\[
\operatorname{dist}^2(A,\Omega^c) = \min_{v\in\mathcal M} \min_{\lambda\in\Omega^c} \min_{\Delta\in\mathcal S} \|\Delta\|_F^2 \quad \text{s.t. } (A+\Delta-\lambda I)v=0,
\]
and, for fixed \(v\), the \(\lambda\)-minimizer has the closed form
\[
\lambda_*=\operatorname{proj}_{\Omega^c}(\lambda_0), \qquad
\lambda_0=\frac{v^*(MM^*+\varepsilon I)^{-1}Av}{v^*(MM^*+\varepsilon I)^{-1}v}.
\]
For prescribed nullity, the outer oracle is an orthonormal basis \(V\in\mathbb F^{n\times \ell}\) and the natural manifold is the Grassmannian \(G_{n,\ell}(\mathbb F)\), with stacked inner constraints across the basis vectors [2407.03957].

## 6. Numerical behavior and empirical profile

The numerical study is used to support two claims: first, that the framework is not tied to a single algebraic structure; second, that the regularized manifold formulation can be competitive with or superior to specialized methods on demanding instances [2407.03957].

For the nearest sparse singular matrix problem, the benchmark `orani678` has size \(2529\times 2529\) with 90158 nonzeros. The method is reported to converge rapidly despite severe ill-conditioning of \(M\) throughout the iterations, reaching a structured distance to singularity of about
\[
2.6813\times 10^{-2}.
\]
The paper remarks that the unregularized objective can be numerically unreliable near the minimizer, whereas the regularized objective behaves stably. Compared with the method of Sicilia et al., the competing approach is reported to use over 500 seconds per outer iteration, while Riemann-Oracle produced output in under a minute [2407.03957].

The clearest head-to-head comparison is for singular matrix polynomials against the algorithm of Das–Bora. For random quadratic matrix polynomials, performance improves with size: at \(n=30\), Riemann-Oracle found a better solution in 99 out of 100 trials and achieved an average distance about 16% smaller. When degree is varied with \(n=15\), it is reported to be slightly better in objective value for all degrees \(2\) through \(6\), and for \(d=6\) about 3 times faster in median runtime [2407.03957].

In approximate GCD experiments, the method matched the best known results in most cases and often did so without postprocessing. The paper also records two caveats: slight underperformance in a very challenging, badly scaled case where the objective was near machine precision, and convergence to a local minimum with spurious factors in another case. For prescribed nullity, on a structured \(8\times 8\) Grcar matrix, the algorithm computed distances for nullity levels \(\ell=1,\dots,7\) under both sparsity-preserving and Toeplitz perturbations, and in every case found a solution of exact nullity \(\ell\) [2407.03957].

These results support the paper’s broader interpretation of Riemann-Oracle as a systematic reduction rather than a problem-specific heuristic. Its mathematical novelty is described as the identification of a common oracle-plus-manifold structure across many matrix nearness problems, while its practical strength lies in combining explicit inner solves, regularization, and Riemannian outer optimization in a single implementation strategy [2407.03957].

## 7. Terminology and relation to other arXiv usages

The name “Riemann-Oracle” is specific to the matrix-nearness framework above and should not be conflated with other arXiv uses of “Riemann” or “oracle.” In query-based foundations of analysis, a real number can be represented as an oracle that answers yes/no questions about inclusive rational intervals [2305.00981]. In complexity theory, oracle real Turing machines extend binary Turing machines by adding a real tape and basic arithmetic, leading to oracle separation results for the real polynomial hierarchy [2502.09279]. In analytic number theory, recent work on Riemann’s Nachlass studies an entire function \(\chi(z)\) connected to \(\zeta(s)\) and its Fourier-analytic properties [2406.19717]. In Reverse Mathematics, global domination principles for everywhere Riemann integrable functions are shown to be equivalent to \(\mathsf{ATR}_0\) [2606.01420].

Within the matrix-nearness literature, however, the terminology is narrower. The “oracle” is the auxiliary parameter \(\theta\) encoding structural information about a minimizer, and the “Riemann” aspect is the recasting of the outer search as optimization on a smooth real Riemannian manifold. A plausible implication is that the title is intended to emphasize this dual structure: oracle parametrization for the inner constraint geometry, and Riemannian optimization for the outer nonlinear search [2407.03957].

Source: https://www.emergentmind.com/topics/riemann-oracle