MAPCA is a family of PCA-like methods that replaces standard Euclidean constraints with metric-aware alternatives to maximize variance or minimize reconstruction error.
It adapts to specific data structures by using generalized eigenproblems, Lipschitz constraints, and Riemannian formulations to tailor projections to the task.
MAPCA underpins diverse applications from network analysis to image processing, clarifying misconceptions about scale invariance and integrability in high-dimensional settings.
Searching arXiv for the cited MAPCA-related papers to ground the article in current preprints.
Metric-Aware Principal Component Analysis (MAPCA) is used in recent literature for PCA-like procedures that replace standard Euclidean projections or orthonormality constraints with geometry-, metric-, or task-aware structure. The label has been attached to principal observable analysis on metric measure spaces, generalized eigenproblems with a symmetric positive definite metric matrix, intrinsic manifold constructions, and weighted or asymmetric alternatives to classical PCA (Karacam et al., 4 Jun 2025, Leznik, 15 Apr 2026, Rodríguez, 30 May 2025, Sommer, 2018). Taken together, these works suggest that MAPCA is better understood as a family of variance-maximizing or reconstruction-minimizing schemes in which the relevant notion of distance, covariance, whitening, or task discrepancy is no longer the default Euclidean one.
1. Classical baseline and the MAPCA principle
Classical PCA chooses an orthogonal projectionP∈Rd×K by minimizing reconstruction error
P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,
or equivalently by maximizing
P⊤P=IKmaxtrace(P⊤AP),A=X⊤X,
so that the columns of P are the top-K eigenvectors of A (Luo et al., 2017). In the metric-matrix formulation of MAPCA, the orthonormality constraint is replaced by
W∈Rp×rmaxTr(W⊤ΣW)subject toW⊤MW=Ir,
where Σ=(1/n)X⊤X is the sample covariance and M is a symmetric positive definite metric matrix; the resulting optimality condition is the generalized eigenproblem ΣW=MWΛ, and the low-dimensional representation is P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,0 (Leznik, 15 Apr 2026).
This suggests a common MAPCA pattern: the principal directions remain solutions of a PCA-like variational problem, but the admissible directions, the covariance proxy, or the projection geometry are changed. In different strands of the literature, the metric-aware ingredient is a Lipschitz constraint, a Riemannian metric, a diagonal or spectral metric matrix, heteroskedastic noise weights, a between-class scatter surrogate, or an asymmetric norm.
2. Principal observable analysis on metric spaces
In the metric-space formulation introduced as principal observable analysis, one begins with a compact metric space P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,1 equipped with a Borel probability measure P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,2. A metric observable is a real-valued field P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,3 that is P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,4-Lipschitz,
P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,5
and the set of all such observables is denoted P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,6. Each observable induces a push-forward probability measure
P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,7
on P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,8, so the geometry of P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,9 is probed through one-dimensional reductions. The observable mean is
P⊤P=IKmaxtrace(P⊤AP),A=X⊤X,0
the centered observables are
P⊤P=IKmaxtrace(P⊤AP),A=X⊤X,1
and the observable covariance is the positive semidefinite bilinear form
P⊤P=IKmaxtrace(P⊤AP),A=X⊤X,2
For P⊤P=IKmaxtrace(P⊤AP),A=X⊤X,3, the variance is
P⊤P=IKmaxtrace(P⊤AP),A=X⊤X,4
In P⊤P=IKmaxtrace(P⊤AP),A=X⊤X,5 language, P⊤P=IKmaxtrace(P⊤AP),A=X⊤X,6 is the restriction of P⊤P=IKmaxtrace(P⊤AP),A=X⊤X,7 to P⊤P=IKmaxtrace(P⊤AP),A=X⊤X,8 (Karacam et al., 4 Jun 2025).
Principal observables are defined by a variance-maximization principle. A first principal observable P⊤P=IKmaxtrace(P⊤AP),A=X⊤X,9 is any centered P0-Lipschitz function of maximal variance,
P1
Inductively, P2 is obtained by maximizing the same quadratic form under P3-orthogonality to P4 and the constraint P5. Abstractly this yields the eigenproblem
P6
so the principal observables play the role of normalized covariance eigenfunctions.
The discrete implementation takes P7 with uniform counting measure P8, represents an observable by its value vector P9, and uses the empirical covariance
K0
The K1-Lipschitz condition becomes the finite system of linear inequalities
K2
The K3-th principal observable is therefore found by a convex–quadratic maximization, or equivalently a difference-of-convex program, with linear Lipschitz constraints, centering, and orthogonality constraints. The practical workflow is: build the distance matrix K4 or only edge lengths on a sparse graph; solve
K5
subject to K6, K7, and K8 for K9; extract A0; orthogonalize and normalize; repeat. If there are A1 active Lipschitz constraints, a general interior-point solver costs roughly A2, while tailored convex–concave programming can exploit sparsity and structure.
The outputs are both geometric and functional. The solutions embed the original metric space into A3, and after normalization A4, A5, any signal A6 admits the observable-domain expansion
A7
Truncation to the first A8 modes gives the best A9 approximation among all W∈Rp×rmaxTr(W⊤ΣW)subject toW⊤MW=Ir,0-Lipschitz expansions of the same form. Reported examples include a line graph of W∈Rp×rmaxTr(W⊤ΣW)subject toW⊤MW=Ir,1 points, a binary tree benchmark, protein interaction networks, and rotating T-shape images from COIL-100, where W∈Rp×rmaxTr(W⊤ΣW)subject toW⊤MW=Ir,2 views in W∈Rp×rmaxTr(W⊤ΣW)subject toW⊤MW=Ir,3 yield a nearly circular W∈Rp×rmaxTr(W⊤ΣW)subject toW⊤MW=Ir,4-D embedding.
3. Metric matrices, spectral bias, and scale invariance
In the unified scale-invariant representation-learning framework, MAPCA is the generalized eigenproblem
W∈Rp×rmaxTr(W⊤ΣW)subject toW⊤MW=Ir,5
with W∈Rp×rmaxTr(W⊤ΣW)subject toW⊤MW=Ir,6. The choice of W∈Rp×rmaxTr(W⊤ΣW)subject toW⊤MW=Ir,7 determines the representation geometry, and the variance explained by the W∈Rp×rmaxTr(W⊤ΣW)subject toW⊤MW=Ir,8-th component is W∈Rp×rmaxTr(W⊤ΣW)subject toW⊤MW=Ir,9. A central one-parameter family is
Σ=(1/n)X⊤X0
If Σ=(1/n)X⊤X1, then Σ=(1/n)X⊤X2, the generalized eigenproblem reduces to the ordinary eigenproblem for Σ=(1/n)X⊤X3, and the solutions satisfy
Σ=(1/n)X⊤X4
The effective operator Σ=(1/n)X⊤X5 has condition number
Σ=(1/n)X⊤X6
which decreases monotonically from Σ=(1/n)X⊤X7 at standard PCA to Σ=(1/n)X⊤X8 at full output whitening. In this formulation, Σ=(1/n)X⊤X9 continuously trades off spectral bias against isotropy (Leznik, 15 Apr 2026).
A distinguishing theoretical result concerns invariance under diagonal feature rescaling. If M0 and the rescaled covariance is M1, then the MAPCA spectrum and eigenvectors satisfy M2 and M3 for all M4 if and only if
M5
The diagonal metric M6 satisfies this exactly, so IPCA is strictly invariant under arbitrary diagonal rescaling. By contrast, for the M7-family,
M8
unless M9 or ΣW=MWΛ0. A common misconception is therefore avoided: in this formulation, metric awareness does not imply scale invariance.
The same framework also places several classical and self-supervised objectives into a single geometric language. Standard PCA corresponds to ΣW=MWΛ1. IPCA corresponds to ΣW=MWΛ2, described as the diagonal regression metric and rooted in Frisch (1928). Full output whitening, ZCA whitening, and Barlow Twins correspond to ΣW=MWΛ3, for which all generalized eigenvalues equal ΣW=MWΛ4. VICReg’s variance term corresponds geometrically to ΣW=MWΛ5. W-MSE, although described as whitening-based, corresponds to ΣW=MWΛ6, formally ΣW=MWΛ7, so the effective operator becomes ΣW=MWΛ8: the spectral bias is amplified rather than compressed. The distinction between input whitening and output whitening becomes precise only at the level of the metric matrix.
4. Intrinsic manifold and Riemannian formulations
One intrinsic manifold-valued formulation starts from probabilistic PCA and replaces Euclidean latent structure by stochastic development on a manifold ΣW=MWΛ9. Let P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,00 satisfy P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,01, choose a base point P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,02 and an initial frame P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,03, and let P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,04 be the horizontal vector fields on the frame bundle P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,05 induced by a connection P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,06. The development process P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,07 solves
P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,08
and its projection P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,09 is an anisotropic diffusion on P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,10 with infinitesimal covariance encoded by P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,11. Since P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,12 and P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,13 with P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,14 induce the same covariance, the construction can be passed to the quotient P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,15, the bundle of positive-definite covariant P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,16-tensors P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,17. The resulting sub-Riemannian geometry is governed by
P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,18
on the horizontal bundle. A central geometric fact is that curvature makes the horizontal distribution non-integrable whenever P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,19, so there is usually no global P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,20-dimensional submanifold whose tangent spaces are exactly the principal directions; the construction therefore works with stochastic flows rather than principal subspaces (Sommer, 2018).
The associated statistical model introduces parameters P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,21, with P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,22, P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,23, and P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,24, and defines a marginal law P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,25 for P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,26. The log-likelihood
P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,27
has no closed form in general and is approximated either by short-time asymptotics or by conditioned diffusion-bridge simulation. Estimation can be performed by maximum likelihood or EM: the E-step simulates bridges of P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,28 conditioned on P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,29, while the M-step updates P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,30, usually by stochastic gradient ascent. Principal coordinates are then the conditional expectations P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,31. The paper’s examples on P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,32 and an embedded ellipsoid emphasize that tangent-space PCA can overestimate orthogonal variance when curvature is high, whereas the intrinsic model lets covariance “roll” with the connection.
A second manifold formulation, termed Riemannian Principal Component Analysis, works through tangent-space linearization at the Fréchet mean
P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,33
Using the logarithm map P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,34, one defines the empirical covariance operator
P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,35
and solves
P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,36
The principal geodesics are P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,37, and the coordinates of P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,38 in P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,39 dimensions are P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,40. When P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,41 with the identity metric, P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,42, P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,43, and the usual Euclidean PCA covariance is recovered. The algorithmic pipeline is: compute the Fréchet mean, map the data with P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,44, build P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,45, solve the eigenproblem in P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,46, reconstruct geodesics if desired, and project the data. Reported experiments include synthetic P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,47-dimensional clustered data, where classical PCA’s first two components explain P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,48 of total variance versus P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,49 for R-PCA with a local UMAP-derived metric, and Olivetti faces, where first-plane inertia is P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,50 for PCA and P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,51 for R-PCA, with clearer subject separation (Rodríguez, 30 May 2025).
5. Weighted, supervised, and asymmetric variants
Beyond geometry in the strict metric-space or manifold sense, several papers make PCA metric-aware by redefining the loss, covariance surrogate, or optimization norm.
Variant
Core objective or proxy
Source
Noise-weighted EM-PCA
Minimize P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,52 with P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,53 and P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,54 for missing data
In noise-weighted EM-PCA, the data matrix P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,58 is approximated by P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,59, but heteroskedastic uncertainties enter explicitly through P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,60. The E-step solves
P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,61
or, in the diagonal-noise case,
P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,62
and the M-step updates principal components one at a time by weighted least squares, followed by renormalization. Missing values are handled by setting their weights to zero. The method is reported to recover underlying sine modes in simulated data with heteroskedastic noise and missing chunks, and to produce much cleaner eigenspectra than classical PCA on SDSS DR7 QSO spectra. Numerical stabilization may require replacing P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,63 by P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,64 for a tiny ridge parameter, and convergence is typically rapid, although saddle points can occur when data are extremely patchy.
Maximum Margin Principal Components adapts PCA to binary classification by preserving the empirical margin distribution rather than least-squares reconstruction. For a classifier P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,65, the signed margins are P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,66. Since P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,67 is not known a priori, the method builds proxy difference vectors P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,68 and runs ordinary eigendecomposition on P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,69. The main variants are M-PCA0 using all opposite-class pairs P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,70, M-PCA1a replacing the opposite class by its mean, M-PCA1b replacing means by coordinate-wise medoids, and M-PCA2 using opposite-class nearest neighbors. After computing the top-P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,71 eigenvectors of P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,72, one projects P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,73 and trains any linear classifier in the reduced space. On benchmark datasets, these variants typically outperformed vanilla PCA and were often competitive with Partial Least Squares and Lasso; for example, on Ionosphere with P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,74, SVM error was P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,75 for PCA versus P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,76 for M-PCA1b, and on Colon with P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,77, logistic error was P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,78 for PCA versus P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,79 for M-PCA1b.
Asymmetric-norm PCA replaces the symmetric P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,80 geometry of ordinary PCA by quantile or expectile norms. For P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,81,
P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,82
and the first principal expectile component is
P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,83
A difficulty specific to this setting is that there is no natural basis and no canonical nested sequence of subspaces. The paper therefore proposes LAWS, TopDown, BottomUp, and PrincipalExpectile algorithms based on iterative least squares and weight updates. Theoretical results include convergence of LAWS to critical points, finite-time bounds for univariate expectiles, and consistency of the empirical principal expectile component under uniqueness. In the Chinese weather dataset, the first two principal expectile components explain approximately P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,84 of variance at P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,85, approximately P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,86 at P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,87, and approximately P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,88 at P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,89, emphasizing that tail variation depends materially on P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,90.
6. Outputs, applications, and recurring misconceptions
The literature surveyed here suggests that MAPCA should not be treated as a single standardized algorithm. In one usage, the principal directions are P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,91-Lipschitz scalar fields on a metric space rather than linear forms on P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,92, and the output is both an embedding into P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,93 and an orthonormal basis for signal processing (Karacam et al., 4 Jun 2025). In another, the output is a generalized eigenspace determined by a metric matrix P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,94, with explicit control over spectral bias and isotropy (Leznik, 15 Apr 2026). On manifolds, the principal coordinates may be conditional expectations of latent Euclidean variables under a diffusion model, or coordinates in the tangent space at the Fréchet mean under the Riemannian metric (Sommer, 2018, Rodríguez, 30 May 2025). In weighted, supervised, and asymmetric settings, the output may instead be a denoised low-rank factorization, a discriminative subspace, or tail-focused expectile components (Bailey, 2012, Luo et al., 2017, Tran et al., 2014).
Several recurring misconceptions are explicitly resolved by these papers. First, metric awareness does not automatically mean scale invariance: in the generalized eigenproblem framework, exact invariance under diagonal rescaling holds if and only if P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,95, which is satisfied by the diagonal metric but not by intermediate members of the P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,96-family (Leznik, 15 Apr 2026). Second, manifold principal directions need not integrate to a global principal submanifold, because curvature makes the relevant horizontal distribution non-integrable (Sommer, 2018). Third, asymmetric-norm PCA does not inherit the canonical nested basis structure of ordinary PCA (Tran et al., 2014). Fourth, observable MAPCA is not defined by linear projections P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,97, but by P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,98-Lipschitz probes P∈Rd×K,P⊤P=IKmin∥X−XPP⊤∥F2,99 (Karacam et al., 4 Jun 2025).
The application range is correspondingly broad: shapes, networks, images, and signals overlaid on geometric objects; sparse graphs; protein interaction networks; rotating object images; manifold-valued shape or surface data; noisy spectra with missing entries; binary classification benchmarks; and weather curves. What unifies these cases is not a single implementation, but the replacement of classical PCA’s fixed Euclidean geometry by a geometry that is intrinsic to the data, the observation process, or the downstream task.