Papers
Topics
Authors
Recent
Search
2000 character limit reached

Metric-Aware PCA (MAPCA): A Geometric Approach

Updated 5 July 2026
  • MAPCA is a family of PCA-like methods that replaces standard Euclidean constraints with metric-aware alternatives to maximize variance or minimize reconstruction error.
  • It adapts to specific data structures by using generalized eigenproblems, Lipschitz constraints, and Riemannian formulations to tailor projections to the task.
  • MAPCA underpins diverse applications from network analysis to image processing, clarifying misconceptions about scale invariance and integrability in high-dimensional settings.

Searching arXiv for the cited MAPCA-related papers to ground the article in current preprints. Metric-Aware Principal Component Analysis (MAPCA) is used in recent literature for PCA-like procedures that replace standard Euclidean projections or orthonormality constraints with geometry-, metric-, or task-aware structure. The label has been attached to principal observable analysis on metric measure spaces, generalized eigenproblems with a symmetric positive definite metric matrix, intrinsic manifold constructions, and weighted or asymmetric alternatives to classical PCA (Karacam et al., 4 Jun 2025, Leznik, 15 Apr 2026, Rodríguez, 30 May 2025, Sommer, 2018). Taken together, these works suggest that MAPCA is better understood as a family of variance-maximizing or reconstruction-minimizing schemes in which the relevant notion of distance, covariance, whitening, or task discrepancy is no longer the default Euclidean one.

1. Classical baseline and the MAPCA principle

Classical PCA chooses an orthogonal projection PRd×KP\in\mathbb R^{d\times K} by minimizing reconstruction error

minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,

or equivalently by maximizing

maxPP=IK  trace(PAP),A=XX,\max_{P^\top P=I_K}\;\operatorname{trace}(P^\top A P), \qquad A=X^\top X,

so that the columns of PP are the top-KK eigenvectors of AA (Luo et al., 2017). In the metric-matrix formulation of MAPCA, the orthonormality constraint is replaced by

maxWRp×r  Tr(WΣW)subject toWMW=Ir,\max_{W\in\mathbb R^{p\times r}}\;\operatorname{Tr}(W^\top \Sigma W) \quad\text{subject to}\quad W^\top M W=I_r,

where Σ=(1/n)XX\Sigma=(1/n)X^\top X is the sample covariance and MM is a symmetric positive definite metric matrix; the resulting optimality condition is the generalized eigenproblem ΣW=MWΛ\Sigma W = M W\Lambda, and the low-dimensional representation is minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,0 (Leznik, 15 Apr 2026).

This suggests a common MAPCA pattern: the principal directions remain solutions of a PCA-like variational problem, but the admissible directions, the covariance proxy, or the projection geometry are changed. In different strands of the literature, the metric-aware ingredient is a Lipschitz constraint, a Riemannian metric, a diagonal or spectral metric matrix, heteroskedastic noise weights, a between-class scatter surrogate, or an asymmetric norm.

2. Principal observable analysis on metric spaces

In the metric-space formulation introduced as principal observable analysis, one begins with a compact metric space minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,1 equipped with a Borel probability measure minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,2. A metric observable is a real-valued field minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,3 that is minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,4-Lipschitz,

minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,5

and the set of all such observables is denoted minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,6. Each observable induces a push-forward probability measure

minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,7

on minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,8, so the geometry of minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,9 is probed through one-dimensional reductions. The observable mean is

maxPP=IK  trace(PAP),A=XX,\max_{P^\top P=I_K}\;\operatorname{trace}(P^\top A P), \qquad A=X^\top X,0

the centered observables are

maxPP=IK  trace(PAP),A=XX,\max_{P^\top P=I_K}\;\operatorname{trace}(P^\top A P), \qquad A=X^\top X,1

and the observable covariance is the positive semidefinite bilinear form

maxPP=IK  trace(PAP),A=XX,\max_{P^\top P=I_K}\;\operatorname{trace}(P^\top A P), \qquad A=X^\top X,2

For maxPP=IK  trace(PAP),A=XX,\max_{P^\top P=I_K}\;\operatorname{trace}(P^\top A P), \qquad A=X^\top X,3, the variance is

maxPP=IK  trace(PAP),A=XX,\max_{P^\top P=I_K}\;\operatorname{trace}(P^\top A P), \qquad A=X^\top X,4

In maxPP=IK  trace(PAP),A=XX,\max_{P^\top P=I_K}\;\operatorname{trace}(P^\top A P), \qquad A=X^\top X,5 language, maxPP=IK  trace(PAP),A=XX,\max_{P^\top P=I_K}\;\operatorname{trace}(P^\top A P), \qquad A=X^\top X,6 is the restriction of maxPP=IK  trace(PAP),A=XX,\max_{P^\top P=I_K}\;\operatorname{trace}(P^\top A P), \qquad A=X^\top X,7 to maxPP=IK  trace(PAP),A=XX,\max_{P^\top P=I_K}\;\operatorname{trace}(P^\top A P), \qquad A=X^\top X,8 (Karacam et al., 4 Jun 2025).

Principal observables are defined by a variance-maximization principle. A first principal observable maxPP=IK  trace(PAP),A=XX,\max_{P^\top P=I_K}\;\operatorname{trace}(P^\top A P), \qquad A=X^\top X,9 is any centered PP0-Lipschitz function of maximal variance,

PP1

Inductively, PP2 is obtained by maximizing the same quadratic form under PP3-orthogonality to PP4 and the constraint PP5. Abstractly this yields the eigenproblem

PP6

so the principal observables play the role of normalized covariance eigenfunctions.

The discrete implementation takes PP7 with uniform counting measure PP8, represents an observable by its value vector PP9, and uses the empirical covariance

KK0

The KK1-Lipschitz condition becomes the finite system of linear inequalities

KK2

The KK3-th principal observable is therefore found by a convex–quadratic maximization, or equivalently a difference-of-convex program, with linear Lipschitz constraints, centering, and orthogonality constraints. The practical workflow is: build the distance matrix KK4 or only edge lengths on a sparse graph; solve

KK5

subject to KK6, KK7, and KK8 for KK9; extract AA0; orthogonalize and normalize; repeat. If there are AA1 active Lipschitz constraints, a general interior-point solver costs roughly AA2, while tailored convex–concave programming can exploit sparsity and structure.

The outputs are both geometric and functional. The solutions embed the original metric space into AA3, and after normalization AA4, AA5, any signal AA6 admits the observable-domain expansion

AA7

Truncation to the first AA8 modes gives the best AA9 approximation among all maxWRp×r  Tr(WΣW)subject toWMW=Ir,\max_{W\in\mathbb R^{p\times r}}\;\operatorname{Tr}(W^\top \Sigma W) \quad\text{subject to}\quad W^\top M W=I_r,0-Lipschitz expansions of the same form. Reported examples include a line graph of maxWRp×r  Tr(WΣW)subject toWMW=Ir,\max_{W\in\mathbb R^{p\times r}}\;\operatorname{Tr}(W^\top \Sigma W) \quad\text{subject to}\quad W^\top M W=I_r,1 points, a binary tree benchmark, protein interaction networks, and rotating T-shape images from COIL-100, where maxWRp×r  Tr(WΣW)subject toWMW=Ir,\max_{W\in\mathbb R^{p\times r}}\;\operatorname{Tr}(W^\top \Sigma W) \quad\text{subject to}\quad W^\top M W=I_r,2 views in maxWRp×r  Tr(WΣW)subject toWMW=Ir,\max_{W\in\mathbb R^{p\times r}}\;\operatorname{Tr}(W^\top \Sigma W) \quad\text{subject to}\quad W^\top M W=I_r,3 yield a nearly circular maxWRp×r  Tr(WΣW)subject toWMW=Ir,\max_{W\in\mathbb R^{p\times r}}\;\operatorname{Tr}(W^\top \Sigma W) \quad\text{subject to}\quad W^\top M W=I_r,4-D embedding.

3. Metric matrices, spectral bias, and scale invariance

In the unified scale-invariant representation-learning framework, MAPCA is the generalized eigenproblem

maxWRp×r  Tr(WΣW)subject toWMW=Ir,\max_{W\in\mathbb R^{p\times r}}\;\operatorname{Tr}(W^\top \Sigma W) \quad\text{subject to}\quad W^\top M W=I_r,5

with maxWRp×r  Tr(WΣW)subject toWMW=Ir,\max_{W\in\mathbb R^{p\times r}}\;\operatorname{Tr}(W^\top \Sigma W) \quad\text{subject to}\quad W^\top M W=I_r,6. The choice of maxWRp×r  Tr(WΣW)subject toWMW=Ir,\max_{W\in\mathbb R^{p\times r}}\;\operatorname{Tr}(W^\top \Sigma W) \quad\text{subject to}\quad W^\top M W=I_r,7 determines the representation geometry, and the variance explained by the maxWRp×r  Tr(WΣW)subject toWMW=Ir,\max_{W\in\mathbb R^{p\times r}}\;\operatorname{Tr}(W^\top \Sigma W) \quad\text{subject to}\quad W^\top M W=I_r,8-th component is maxWRp×r  Tr(WΣW)subject toWMW=Ir,\max_{W\in\mathbb R^{p\times r}}\;\operatorname{Tr}(W^\top \Sigma W) \quad\text{subject to}\quad W^\top M W=I_r,9. A central one-parameter family is

Σ=(1/n)XX\Sigma=(1/n)X^\top X0

If Σ=(1/n)XX\Sigma=(1/n)X^\top X1, then Σ=(1/n)XX\Sigma=(1/n)X^\top X2, the generalized eigenproblem reduces to the ordinary eigenproblem for Σ=(1/n)XX\Sigma=(1/n)X^\top X3, and the solutions satisfy

Σ=(1/n)XX\Sigma=(1/n)X^\top X4

The effective operator Σ=(1/n)XX\Sigma=(1/n)X^\top X5 has condition number

Σ=(1/n)XX\Sigma=(1/n)X^\top X6

which decreases monotonically from Σ=(1/n)XX\Sigma=(1/n)X^\top X7 at standard PCA to Σ=(1/n)XX\Sigma=(1/n)X^\top X8 at full output whitening. In this formulation, Σ=(1/n)XX\Sigma=(1/n)X^\top X9 continuously trades off spectral bias against isotropy (Leznik, 15 Apr 2026).

A distinguishing theoretical result concerns invariance under diagonal feature rescaling. If MM0 and the rescaled covariance is MM1, then the MAPCA spectrum and eigenvectors satisfy MM2 and MM3 for all MM4 if and only if

MM5

The diagonal metric MM6 satisfies this exactly, so IPCA is strictly invariant under arbitrary diagonal rescaling. By contrast, for the MM7-family,

MM8

unless MM9 or ΣW=MWΛ\Sigma W = M W\Lambda0. A common misconception is therefore avoided: in this formulation, metric awareness does not imply scale invariance.

The same framework also places several classical and self-supervised objectives into a single geometric language. Standard PCA corresponds to ΣW=MWΛ\Sigma W = M W\Lambda1. IPCA corresponds to ΣW=MWΛ\Sigma W = M W\Lambda2, described as the diagonal regression metric and rooted in Frisch (1928). Full output whitening, ZCA whitening, and Barlow Twins correspond to ΣW=MWΛ\Sigma W = M W\Lambda3, for which all generalized eigenvalues equal ΣW=MWΛ\Sigma W = M W\Lambda4. VICReg’s variance term corresponds geometrically to ΣW=MWΛ\Sigma W = M W\Lambda5. W-MSE, although described as whitening-based, corresponds to ΣW=MWΛ\Sigma W = M W\Lambda6, formally ΣW=MWΛ\Sigma W = M W\Lambda7, so the effective operator becomes ΣW=MWΛ\Sigma W = M W\Lambda8: the spectral bias is amplified rather than compressed. The distinction between input whitening and output whitening becomes precise only at the level of the metric matrix.

4. Intrinsic manifold and Riemannian formulations

One intrinsic manifold-valued formulation starts from probabilistic PCA and replaces Euclidean latent structure by stochastic development on a manifold ΣW=MWΛ\Sigma W = M W\Lambda9. Let minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,00 satisfy minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,01, choose a base point minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,02 and an initial frame minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,03, and let minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,04 be the horizontal vector fields on the frame bundle minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,05 induced by a connection minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,06. The development process minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,07 solves

minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,08

and its projection minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,09 is an anisotropic diffusion on minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,10 with infinitesimal covariance encoded by minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,11. Since minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,12 and minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,13 with minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,14 induce the same covariance, the construction can be passed to the quotient minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,15, the bundle of positive-definite covariant minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,16-tensors minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,17. The resulting sub-Riemannian geometry is governed by

minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,18

on the horizontal bundle. A central geometric fact is that curvature makes the horizontal distribution non-integrable whenever minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,19, so there is usually no global minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,20-dimensional submanifold whose tangent spaces are exactly the principal directions; the construction therefore works with stochastic flows rather than principal subspaces (Sommer, 2018).

The associated statistical model introduces parameters minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,21, with minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,22, minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,23, and minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,24, and defines a marginal law minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,25 for minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,26. The log-likelihood

minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,27

has no closed form in general and is approximated either by short-time asymptotics or by conditioned diffusion-bridge simulation. Estimation can be performed by maximum likelihood or EM: the E-step simulates bridges of minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,28 conditioned on minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,29, while the M-step updates minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,30, usually by stochastic gradient ascent. Principal coordinates are then the conditional expectations minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,31. The paper’s examples on minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,32 and an embedded ellipsoid emphasize that tangent-space PCA can overestimate orthogonal variance when curvature is high, whereas the intrinsic model lets covariance “roll” with the connection.

A second manifold formulation, termed Riemannian Principal Component Analysis, works through tangent-space linearization at the Fréchet mean

minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,33

Using the logarithm map minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,34, one defines the empirical covariance operator

minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,35

and solves

minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,36

The principal geodesics are minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,37, and the coordinates of minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,38 in minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,39 dimensions are minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,40. When minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,41 with the identity metric, minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,42, minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,43, and the usual Euclidean PCA covariance is recovered. The algorithmic pipeline is: compute the Fréchet mean, map the data with minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,44, build minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,45, solve the eigenproblem in minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,46, reconstruct geodesics if desired, and project the data. Reported experiments include synthetic minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,47-dimensional clustered data, where classical PCA’s first two components explain minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,48 of total variance versus minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,49 for R-PCA with a local UMAP-derived metric, and Olivetti faces, where first-plane inertia is minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,50 for PCA and minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,51 for R-PCA, with clearer subject separation (Rodríguez, 30 May 2025).

5. Weighted, supervised, and asymmetric variants

Beyond geometry in the strict metric-space or manifold sense, several papers make PCA metric-aware by redefining the loss, covariance surrogate, or optimization norm.

Variant Core objective or proxy Source
Noise-weighted EM-PCA Minimize minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,52 with minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,53 and minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,54 for missing data (Bailey, 2012)
Maximum Margin Principal Components Apply PCA to a between-class scatter matrix minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,55 built from margin-difference proxies (Luo et al., 2017)
Asymmetric-norm PCA Minimize asymmetric minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,56 error or maximize minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,57-variance in quantile/expectile geometry (Tran et al., 2014)

In noise-weighted EM-PCA, the data matrix minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,58 is approximated by minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,59, but heteroskedastic uncertainties enter explicitly through minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,60. The E-step solves

minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,61

or, in the diagonal-noise case,

minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,62

and the M-step updates principal components one at a time by weighted least squares, followed by renormalization. Missing values are handled by setting their weights to zero. The method is reported to recover underlying sine modes in simulated data with heteroskedastic noise and missing chunks, and to produce much cleaner eigenspectra than classical PCA on SDSS DR7 QSO spectra. Numerical stabilization may require replacing minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,63 by minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,64 for a tiny ridge parameter, and convergence is typically rapid, although saddle points can occur when data are extremely patchy.

Maximum Margin Principal Components adapts PCA to binary classification by preserving the empirical margin distribution rather than least-squares reconstruction. For a classifier minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,65, the signed margins are minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,66. Since minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,67 is not known a priori, the method builds proxy difference vectors minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,68 and runs ordinary eigendecomposition on minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,69. The main variants are M-PCA0 using all opposite-class pairs minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,70, M-PCA1a replacing the opposite class by its mean, M-PCA1b replacing means by coordinate-wise medoids, and M-PCA2 using opposite-class nearest neighbors. After computing the top-minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,71 eigenvectors of minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,72, one projects minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,73 and trains any linear classifier in the reduced space. On benchmark datasets, these variants typically outperformed vanilla PCA and were often competitive with Partial Least Squares and Lasso; for example, on Ionosphere with minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,74, SVM error was minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,75 for PCA versus minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,76 for M-PCA1b, and on Colon with minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,77, logistic error was minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,78 for PCA versus minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,79 for M-PCA1b.

Asymmetric-norm PCA replaces the symmetric minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,80 geometry of ordinary PCA by quantile or expectile norms. For minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,81,

minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,82

and the first principal expectile component is

minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,83

A difficulty specific to this setting is that there is no natural basis and no canonical nested sequence of subspaces. The paper therefore proposes LAWS, TopDown, BottomUp, and PrincipalExpectile algorithms based on iterative least squares and weight updates. Theoretical results include convergence of LAWS to critical points, finite-time bounds for univariate expectiles, and consistency of the empirical principal expectile component under uniqueness. In the Chinese weather dataset, the first two principal expectile components explain approximately minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,84 of variance at minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,85, approximately minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,86 at minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,87, and approximately minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,88 at minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,89, emphasizing that tail variation depends materially on minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,90.

6. Outputs, applications, and recurring misconceptions

The literature surveyed here suggests that MAPCA should not be treated as a single standardized algorithm. In one usage, the principal directions are minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,91-Lipschitz scalar fields on a metric space rather than linear forms on minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,92, and the output is both an embedding into minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,93 and an orthonormal basis for signal processing (Karacam et al., 4 Jun 2025). In another, the output is a generalized eigenspace determined by a metric matrix minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,94, with explicit control over spectral bias and isotropy (Leznik, 15 Apr 2026). On manifolds, the principal coordinates may be conditional expectations of latent Euclidean variables under a diffusion model, or coordinates in the tangent space at the Fréchet mean under the Riemannian metric (Sommer, 2018, Rodríguez, 30 May 2025). In weighted, supervised, and asymmetric settings, the output may instead be a denoised low-rank factorization, a discriminative subspace, or tail-focused expectile components (Bailey, 2012, Luo et al., 2017, Tran et al., 2014).

Several recurring misconceptions are explicitly resolved by these papers. First, metric awareness does not automatically mean scale invariance: in the generalized eigenproblem framework, exact invariance under diagonal rescaling holds if and only if minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,95, which is satisfied by the diagonal metric but not by intermediate members of the minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,96-family (Leznik, 15 Apr 2026). Second, manifold principal directions need not integrate to a global principal submanifold, because curvature makes the relevant horizontal distribution non-integrable (Sommer, 2018). Third, asymmetric-norm PCA does not inherit the canonical nested basis structure of ordinary PCA (Tran et al., 2014). Fourth, observable MAPCA is not defined by linear projections minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,97, but by minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,98-Lipschitz probes minPRd×K,PP=IK  XXPPF2,\min_{P\in\mathbb R^{d\times K},\,P^\top P=I_K}\;\|X-XPP^\top\|_F^2,99 (Karacam et al., 4 Jun 2025).

The application range is correspondingly broad: shapes, networks, images, and signals overlaid on geometric objects; sparse graphs; protein interaction networks; rotating object images; manifold-valued shape or surface data; noisy spectra with missing entries; binary classification benchmarks; and weather curves. What unifies these cases is not a single implementation, but the replacement of classical PCA’s fixed Euclidean geometry by a geometry that is intrinsic to the data, the observation process, or the downstream task.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Metric-Aware Principal Component Analysis (MAPCA).