Papers
Topics
Authors
Recent
Search
2000 character limit reached

Metric-Aware PCA (MAPCA): A Geometric Approach

Updated 5 July 2026
  • MAPCA is a family of PCA-like methods that replaces standard Euclidean constraints with metric-aware alternatives to maximize variance or minimize reconstruction error.
  • It adapts to specific data structures by using generalized eigenproblems, Lipschitz constraints, and Riemannian formulations to tailor projections to the task.
  • MAPCA underpins diverse applications from network analysis to image processing, clarifying misconceptions about scale invariance and integrability in high-dimensional settings.

Searching arXiv for the cited MAPCA-related papers to ground the article in current preprints. Metric-Aware Principal Component Analysis (MAPCA) is used in recent literature for PCA-like procedures that replace standard Euclidean projections or orthonormality constraints with geometry-, metric-, or task-aware structure. The label has been attached to principal observable analysis on metric measure spaces, generalized eigenproblems with a symmetric positive definite metric matrix, intrinsic manifold constructions, and weighted or asymmetric alternatives to classical PCA (Karacam et al., 4 Jun 2025, Leznik, 15 Apr 2026, Rodríguez, 30 May 2025, Sommer, 2018). Taken together, these works suggest that MAPCA is better understood as a family of variance-maximizing or reconstruction-minimizing schemes in which the relevant notion of distance, covariance, whitening, or task discrepancy is no longer the default Euclidean one.

1. Classical baseline and the MAPCA principle

Classical PCA chooses an orthogonal projection P∈Rd×KP\in\mathbb R^{d\times K} by minimizing reconstruction error

min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,

or equivalently by maximizing

max⁡P⊤P=IK  trace⁡(P⊤AP),A=X⊤X,\max_{P^\top P=I_K}\;\operatorname{trace}(P^\top A P), \qquad A=X^\top X,

so that the columns of PP are the top-KK eigenvectors of AA (Luo et al., 2017). In the metric-matrix formulation of MAPCA, the orthonormality constraint is replaced by

max⁡W∈Rp×r  Tr⁡(W⊤ΣW)subject toW⊤MW=Ir,\max_{W\in\mathbb R^{p\times r}}\;\operatorname{Tr}(W^\top \Sigma W) \quad\text{subject to}\quad W^\top M W=I_r,

where Σ=(1/n)X⊤X\Sigma=(1/n)X^\top X is the sample covariance and MM is a symmetric positive definite metric matrix; the resulting optimality condition is the generalized eigenproblem ΣW=MWΛ\Sigma W = M W\Lambda, and the low-dimensional representation is min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,0 (Leznik, 15 Apr 2026).

This suggests a common MAPCA pattern: the principal directions remain solutions of a PCA-like variational problem, but the admissible directions, the covariance proxy, or the projection geometry are changed. In different strands of the literature, the metric-aware ingredient is a Lipschitz constraint, a Riemannian metric, a diagonal or spectral metric matrix, heteroskedastic noise weights, a between-class scatter surrogate, or an asymmetric norm.

2. Principal observable analysis on metric spaces

In the metric-space formulation introduced as principal observable analysis, one begins with a compact metric space min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,1 equipped with a Borel probability measure min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,2. A metric observable is a real-valued field min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,3 that is min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,4-Lipschitz,

min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,5

and the set of all such observables is denoted min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,6. Each observable induces a push-forward probability measure

min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,7

on min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,8, so the geometry of min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,9 is probed through one-dimensional reductions. The observable mean is

max⁡P⊤P=IK  trace⁡(P⊤AP),A=X⊤X,\max_{P^\top P=I_K}\;\operatorname{trace}(P^\top A P), \qquad A=X^\top X,0

the centered observables are

max⁡P⊤P=IK  trace⁡(P⊤AP),A=X⊤X,\max_{P^\top P=I_K}\;\operatorname{trace}(P^\top A P), \qquad A=X^\top X,1

and the observable covariance is the positive semidefinite bilinear form

max⁡P⊤P=IK  trace⁡(P⊤AP),A=X⊤X,\max_{P^\top P=I_K}\;\operatorname{trace}(P^\top A P), \qquad A=X^\top X,2

For max⁡P⊤P=IK  trace⁡(P⊤AP),A=X⊤X,\max_{P^\top P=I_K}\;\operatorname{trace}(P^\top A P), \qquad A=X^\top X,3, the variance is

max⁡P⊤P=IK  trace⁡(P⊤AP),A=X⊤X,\max_{P^\top P=I_K}\;\operatorname{trace}(P^\top A P), \qquad A=X^\top X,4

In max⁡P⊤P=IK  trace⁡(P⊤AP),A=X⊤X,\max_{P^\top P=I_K}\;\operatorname{trace}(P^\top A P), \qquad A=X^\top X,5 language, max⁡P⊤P=IK  trace⁡(P⊤AP),A=X⊤X,\max_{P^\top P=I_K}\;\operatorname{trace}(P^\top A P), \qquad A=X^\top X,6 is the restriction of max⁡P⊤P=IK  trace⁡(P⊤AP),A=X⊤X,\max_{P^\top P=I_K}\;\operatorname{trace}(P^\top A P), \qquad A=X^\top X,7 to max⁡P⊤P=IK  trace⁡(P⊤AP),A=X⊤X,\max_{P^\top P=I_K}\;\operatorname{trace}(P^\top A P), \qquad A=X^\top X,8 (Karacam et al., 4 Jun 2025).

Principal observables are defined by a variance-maximization principle. A first principal observable max⁡P⊤P=IK  trace⁡(P⊤AP),A=X⊤X,\max_{P^\top P=I_K}\;\operatorname{trace}(P^\top A P), \qquad A=X^\top X,9 is any centered PP0-Lipschitz function of maximal variance,

PP1

Inductively, PP2 is obtained by maximizing the same quadratic form under PP3-orthogonality to PP4 and the constraint PP5. Abstractly this yields the eigenproblem

PP6

so the principal observables play the role of normalized covariance eigenfunctions.

The discrete implementation takes PP7 with uniform counting measure PP8, represents an observable by its value vector PP9, and uses the empirical covariance

KK0

The KK1-Lipschitz condition becomes the finite system of linear inequalities

KK2

The KK3-th principal observable is therefore found by a convex–quadratic maximization, or equivalently a difference-of-convex program, with linear Lipschitz constraints, centering, and orthogonality constraints. The practical workflow is: build the distance matrix KK4 or only edge lengths on a sparse graph; solve

KK5

subject to KK6, KK7, and KK8 for KK9; extract AA0; orthogonalize and normalize; repeat. If there are AA1 active Lipschitz constraints, a general interior-point solver costs roughly AA2, while tailored convex–concave programming can exploit sparsity and structure.

The outputs are both geometric and functional. The solutions embed the original metric space into AA3, and after normalization AA4, AA5, any signal AA6 admits the observable-domain expansion

AA7

Truncation to the first AA8 modes gives the best AA9 approximation among all max⁡W∈Rp×r  Tr⁡(W⊤ΣW)subject toW⊤MW=Ir,\max_{W\in\mathbb R^{p\times r}}\;\operatorname{Tr}(W^\top \Sigma W) \quad\text{subject to}\quad W^\top M W=I_r,0-Lipschitz expansions of the same form. Reported examples include a line graph of max⁡W∈Rp×r  Tr⁡(W⊤ΣW)subject toW⊤MW=Ir,\max_{W\in\mathbb R^{p\times r}}\;\operatorname{Tr}(W^\top \Sigma W) \quad\text{subject to}\quad W^\top M W=I_r,1 points, a binary tree benchmark, protein interaction networks, and rotating T-shape images from COIL-100, where max⁡W∈Rp×r  Tr⁡(W⊤ΣW)subject toW⊤MW=Ir,\max_{W\in\mathbb R^{p\times r}}\;\operatorname{Tr}(W^\top \Sigma W) \quad\text{subject to}\quad W^\top M W=I_r,2 views in max⁡W∈Rp×r  Tr⁡(W⊤ΣW)subject toW⊤MW=Ir,\max_{W\in\mathbb R^{p\times r}}\;\operatorname{Tr}(W^\top \Sigma W) \quad\text{subject to}\quad W^\top M W=I_r,3 yield a nearly circular max⁡W∈Rp×r  Tr⁡(W⊤ΣW)subject toW⊤MW=Ir,\max_{W\in\mathbb R^{p\times r}}\;\operatorname{Tr}(W^\top \Sigma W) \quad\text{subject to}\quad W^\top M W=I_r,4-D embedding.

3. Metric matrices, spectral bias, and scale invariance

In the unified scale-invariant representation-learning framework, MAPCA is the generalized eigenproblem

max⁡W∈Rp×r  Tr⁡(W⊤ΣW)subject toW⊤MW=Ir,\max_{W\in\mathbb R^{p\times r}}\;\operatorname{Tr}(W^\top \Sigma W) \quad\text{subject to}\quad W^\top M W=I_r,5

with max⁡W∈Rp×r  Tr⁡(W⊤ΣW)subject toW⊤MW=Ir,\max_{W\in\mathbb R^{p\times r}}\;\operatorname{Tr}(W^\top \Sigma W) \quad\text{subject to}\quad W^\top M W=I_r,6. The choice of max⁡W∈Rp×r  Tr⁡(W⊤ΣW)subject toW⊤MW=Ir,\max_{W\in\mathbb R^{p\times r}}\;\operatorname{Tr}(W^\top \Sigma W) \quad\text{subject to}\quad W^\top M W=I_r,7 determines the representation geometry, and the variance explained by the max⁡W∈Rp×r  Tr⁡(W⊤ΣW)subject toW⊤MW=Ir,\max_{W\in\mathbb R^{p\times r}}\;\operatorname{Tr}(W^\top \Sigma W) \quad\text{subject to}\quad W^\top M W=I_r,8-th component is max⁡W∈Rp×r  Tr⁡(W⊤ΣW)subject toW⊤MW=Ir,\max_{W\in\mathbb R^{p\times r}}\;\operatorname{Tr}(W^\top \Sigma W) \quad\text{subject to}\quad W^\top M W=I_r,9. A central one-parameter family is

Σ=(1/n)X⊤X\Sigma=(1/n)X^\top X0

If Σ=(1/n)X⊤X\Sigma=(1/n)X^\top X1, then Σ=(1/n)X⊤X\Sigma=(1/n)X^\top X2, the generalized eigenproblem reduces to the ordinary eigenproblem for Σ=(1/n)X⊤X\Sigma=(1/n)X^\top X3, and the solutions satisfy

Σ=(1/n)X⊤X\Sigma=(1/n)X^\top X4

The effective operator Σ=(1/n)X⊤X\Sigma=(1/n)X^\top X5 has condition number

Σ=(1/n)X⊤X\Sigma=(1/n)X^\top X6

which decreases monotonically from Σ=(1/n)X⊤X\Sigma=(1/n)X^\top X7 at standard PCA to Σ=(1/n)X⊤X\Sigma=(1/n)X^\top X8 at full output whitening. In this formulation, Σ=(1/n)X⊤X\Sigma=(1/n)X^\top X9 continuously trades off spectral bias against isotropy (Leznik, 15 Apr 2026).

A distinguishing theoretical result concerns invariance under diagonal feature rescaling. If MM0 and the rescaled covariance is MM1, then the MAPCA spectrum and eigenvectors satisfy MM2 and MM3 for all MM4 if and only if

MM5

The diagonal metric MM6 satisfies this exactly, so IPCA is strictly invariant under arbitrary diagonal rescaling. By contrast, for the MM7-family,

MM8

unless MM9 or ΣW=MWΛ\Sigma W = M W\Lambda0. A common misconception is therefore avoided: in this formulation, metric awareness does not imply scale invariance.

The same framework also places several classical and self-supervised objectives into a single geometric language. Standard PCA corresponds to ΣW=MWΛ\Sigma W = M W\Lambda1. IPCA corresponds to ΣW=MWΛ\Sigma W = M W\Lambda2, described as the diagonal regression metric and rooted in Frisch (1928). Full output whitening, ZCA whitening, and Barlow Twins correspond to ΣW=MWΛ\Sigma W = M W\Lambda3, for which all generalized eigenvalues equal ΣW=MWΛ\Sigma W = M W\Lambda4. VICReg’s variance term corresponds geometrically to ΣW=MWΛ\Sigma W = M W\Lambda5. W-MSE, although described as whitening-based, corresponds to ΣW=MWΛ\Sigma W = M W\Lambda6, formally ΣW=MWΛ\Sigma W = M W\Lambda7, so the effective operator becomes ΣW=MWΛ\Sigma W = M W\Lambda8: the spectral bias is amplified rather than compressed. The distinction between input whitening and output whitening becomes precise only at the level of the metric matrix.

4. Intrinsic manifold and Riemannian formulations

One intrinsic manifold-valued formulation starts from probabilistic PCA and replaces Euclidean latent structure by stochastic development on a manifold ΣW=MWΛ\Sigma W = M W\Lambda9. Let min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,00 satisfy min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,01, choose a base point min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,02 and an initial frame min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,03, and let min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,04 be the horizontal vector fields on the frame bundle min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,05 induced by a connection min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,06. The development process min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,07 solves

min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,08

and its projection min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,09 is an anisotropic diffusion on min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,10 with infinitesimal covariance encoded by min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,11. Since min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,12 and min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,13 with min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,14 induce the same covariance, the construction can be passed to the quotient min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,15, the bundle of positive-definite covariant min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,16-tensors min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,17. The resulting sub-Riemannian geometry is governed by

min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,18

on the horizontal bundle. A central geometric fact is that curvature makes the horizontal distribution non-integrable whenever min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,19, so there is usually no global min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,20-dimensional submanifold whose tangent spaces are exactly the principal directions; the construction therefore works with stochastic flows rather than principal subspaces (Sommer, 2018).

The associated statistical model introduces parameters min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,21, with min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,22, min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,23, and min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,24, and defines a marginal law min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,25 for min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,26. The log-likelihood

min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,27

has no closed form in general and is approximated either by short-time asymptotics or by conditioned diffusion-bridge simulation. Estimation can be performed by maximum likelihood or EM: the E-step simulates bridges of min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,28 conditioned on min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,29, while the M-step updates min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,30, usually by stochastic gradient ascent. Principal coordinates are then the conditional expectations min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,31. The paper’s examples on min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,32 and an embedded ellipsoid emphasize that tangent-space PCA can overestimate orthogonal variance when curvature is high, whereas the intrinsic model lets covariance “roll” with the connection.

A second manifold formulation, termed Riemannian Principal Component Analysis, works through tangent-space linearization at the Fréchet mean

min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,33

Using the logarithm map min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,34, one defines the empirical covariance operator

min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,35

and solves

min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,36

The principal geodesics are min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,37, and the coordinates of min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,38 in min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,39 dimensions are min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,40. When min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,41 with the identity metric, min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,42, min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,43, and the usual Euclidean PCA covariance is recovered. The algorithmic pipeline is: compute the Fréchet mean, map the data with min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,44, build min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,45, solve the eigenproblem in min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,46, reconstruct geodesics if desired, and project the data. Reported experiments include synthetic min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,47-dimensional clustered data, where classical PCA’s first two components explain min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,48 of total variance versus min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,49 for R-PCA with a local UMAP-derived metric, and Olivetti faces, where first-plane inertia is min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,50 for PCA and min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,51 for R-PCA, with clearer subject separation (Rodríguez, 30 May 2025).

5. Weighted, supervised, and asymmetric variants

Beyond geometry in the strict metric-space or manifold sense, several papers make PCA metric-aware by redefining the loss, covariance surrogate, or optimization norm.

Variant Core objective or proxy Source
Noise-weighted EM-PCA Minimize min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,52 with min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,53 and min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,54 for missing data (Bailey, 2012)
Maximum Margin Principal Components Apply PCA to a between-class scatter matrix min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,55 built from margin-difference proxies (Luo et al., 2017)
Asymmetric-norm PCA Minimize asymmetric min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,56 error or maximize min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,57-variance in quantile/expectile geometry (Tran et al., 2014)

In noise-weighted EM-PCA, the data matrix min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,58 is approximated by min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,59, but heteroskedastic uncertainties enter explicitly through min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,60. The E-step solves

min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,61

or, in the diagonal-noise case,

min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,62

and the M-step updates principal components one at a time by weighted least squares, followed by renormalization. Missing values are handled by setting their weights to zero. The method is reported to recover underlying sine modes in simulated data with heteroskedastic noise and missing chunks, and to produce much cleaner eigenspectra than classical PCA on SDSS DR7 QSO spectra. Numerical stabilization may require replacing min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,63 by min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,64 for a tiny ridge parameter, and convergence is typically rapid, although saddle points can occur when data are extremely patchy.

Maximum Margin Principal Components adapts PCA to binary classification by preserving the empirical margin distribution rather than least-squares reconstruction. For a classifier min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,65, the signed margins are min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,66. Since min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,67 is not known a priori, the method builds proxy difference vectors min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,68 and runs ordinary eigendecomposition on min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,69. The main variants are M-PCA0 using all opposite-class pairs min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,70, M-PCA1a replacing the opposite class by its mean, M-PCA1b replacing means by coordinate-wise medoids, and M-PCA2 using opposite-class nearest neighbors. After computing the top-min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,71 eigenvectors of min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,72, one projects min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,73 and trains any linear classifier in the reduced space. On benchmark datasets, these variants typically outperformed vanilla PCA and were often competitive with Partial Least Squares and Lasso; for example, on Ionosphere with min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,74, SVM error was min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,75 for PCA versus min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,76 for M-PCA1b, and on Colon with min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,77, logistic error was min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,78 for PCA versus min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,79 for M-PCA1b.

Asymmetric-norm PCA replaces the symmetric min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,80 geometry of ordinary PCA by quantile or expectile norms. For min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,81,

min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,82

and the first principal expectile component is

min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,83

A difficulty specific to this setting is that there is no natural basis and no canonical nested sequence of subspaces. The paper therefore proposes LAWS, TopDown, BottomUp, and PrincipalExpectile algorithms based on iterative least squares and weight updates. Theoretical results include convergence of LAWS to critical points, finite-time bounds for univariate expectiles, and consistency of the empirical principal expectile component under uniqueness. In the Chinese weather dataset, the first two principal expectile components explain approximately min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,84 of variance at min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,85, approximately min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,86 at min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,87, and approximately min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,88 at min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,89, emphasizing that tail variation depends materially on min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,90.

6. Outputs, applications, and recurring misconceptions

The literature surveyed here suggests that MAPCA should not be treated as a single standardized algorithm. In one usage, the principal directions are min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,91-Lipschitz scalar fields on a metric space rather than linear forms on min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,92, and the output is both an embedding into min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,93 and an orthonormal basis for signal processing (Karacam et al., 4 Jun 2025). In another, the output is a generalized eigenspace determined by a metric matrix min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,94, with explicit control over spectral bias and isotropy (Leznik, 15 Apr 2026). On manifolds, the principal coordinates may be conditional expectations of latent Euclidean variables under a diffusion model, or coordinates in the tangent space at the Fréchet mean under the Riemannian metric (Sommer, 2018, Rodríguez, 30 May 2025). In weighted, supervised, and asymmetric settings, the output may instead be a denoised low-rank factorization, a discriminative subspace, or tail-focused expectile components (Bailey, 2012, Luo et al., 2017, Tran et al., 2014).

Several recurring misconceptions are explicitly resolved by these papers. First, metric awareness does not automatically mean scale invariance: in the generalized eigenproblem framework, exact invariance under diagonal rescaling holds if and only if min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,95, which is satisfied by the diagonal metric but not by intermediate members of the min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,96-family (Leznik, 15 Apr 2026). Second, manifold principal directions need not integrate to a global principal submanifold, because curvature makes the relevant horizontal distribution non-integrable (Sommer, 2018). Third, asymmetric-norm PCA does not inherit the canonical nested basis structure of ordinary PCA (Tran et al., 2014). Fourth, observable MAPCA is not defined by linear projections min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,97, but by min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,98-Lipschitz probes min⁡P∈Rd×K, P⊤P=IK  ∥X−XPP⊤∥F2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,99 (Karacam et al., 4 Jun 2025).

The application range is correspondingly broad: shapes, networks, images, and signals overlaid on geometric objects; sparse graphs; protein interaction networks; rotating object images; manifold-valued shape or surface data; noisy spectra with missing entries; binary classification benchmarks; and weather curves. What unifies these cases is not a single implementation, but the replacement of classical PCA’s fixed Euclidean geometry by a geometry that is intrinsic to the data, the observation process, or the downstream task.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Metric-Aware Principal Component Analysis (MAPCA).