Coordinatewise Gaussian Privatization
- Coordinatewise Gaussian privatization is a family of privacy mechanisms that applies independent Gaussian noise per coordinate, either in the original or transformed basis.
- It distinguishes between additive i.i.d., anisotropic, and transformed approaches to optimize noise allocation and minimize mean squared error under differential privacy constraints.
- Applications span high-dimensional estimation, linear recoverability, and federated learning, emphasizing the importance of preconditioning and basis transformations.
Coordinatewise Gaussian privatization denotes a family of privacy mechanisms in which Gaussian perturbation is applied separately across coordinates, either in the original basis or in a transformed basis. In the literature, the phrase covers several distinct constructions: additive i.i.d. Gaussian perturbation of each sensitive coordinate, diagonal but anisotropic Gaussian mechanisms with coordinate-specific variances, and basis-dependent schemes that become coordinatewise only after an orthogonal or singular-vector transformation. It also appears as a contrast class against more general multivariate Gaussian privatizers that use full linear mixing and correlated Gaussian noise. As a result, the term is best understood as a structured subclass within a broader landscape of Gaussian privacy mechanisms rather than as a single canonical method (Muthukrishnan et al., 2023, Nageswaran, 2023, Hayati et al., 2021, Bongole et al., 22 Jun 2026).
1. Coordinatewise structure and basis dependence
In its most literal form, coordinatewise Gaussian privatization releases
with independent perturbations across coordinates. This is the diagonal form explicitly identified as a special case of a broader multivariate Gaussian mechanism in the inference-privacy literature, where the general release takes the form
with full matrix and full Gaussian covariance for . In that broader setting, coordinatewise privatization corresponds to restricting both and to diagonal matrices, which the general theory does not impose (Hayati et al., 2021).
A second usage arises when the problem is diagonal only after a change of basis. For linear-function recoverability, the relevant coordinates are the singular directions of a matrix , not necessarily the original coordinates of . The optimal mechanism is diagonal in the singular basis, and it becomes genuinely coordinatewise in the original basis only when the singular directions coincide with coordinate axes, as in coordinate projection, diagonal scaling, or identity release (Nageswaran, 2023).
A third usage appears in interactive mutual-information privacy, where the sensitive object is itself a coordinate vector
and the privatization channel is
Here the mechanism is explicitly coordinatewise in the original basis, with i.i.d. Gaussian perturbations and common variance 0 (Bongole et al., 22 Jun 2026).
2. Differential privacy and diagonal Gaussian mechanisms
Under central differential privacy, the most direct formalization is the independent but non-identically distributed Gaussian mechanism
1
where
2
independently across coordinates. The paper on coordinate-wise disparity defines the sensitivity profile
3
and proves that the mechanism is 4-DP if and only if
5
This is a necessary and sufficient condition, and it reduces to the standard exact Gaussian condition when all 6 are equal (Muthukrishnan et al., 2023).
The same work solves the optimal variance-allocation problem under mean squared error. If 7 is the largest value satisfying the exact privacy equation, then the MSE-optimal assignment is
8
Hence the optimal diagonal Gaussian mechanism allocates more variance to coordinates with larger sensitivity. Its total MSE is
9
whereas the i.i.d. Gaussian benchmark has MSE
0
The improvement factor is
1
so the diagonal anisotropic mechanism is always at least as good as the isotropic one under this criterion (Muthukrishnan et al., 2023).
A complementary privacy-accounting perspective is provided by Gaussian Differential Privacy. For a scalar statistic 2 with sensitivity 3, the Gaussian mechanism
4
is 5-GDP. GDP composes algebraically: 6 which makes separate coordinate releases naturally analyzable as compositions of scalar Gaussian mechanisms (Dong et al., 2019).
3. Modewise privatization under linear recoverability
A different, exact theory appears in Gaussian data privacy under linear function recoverability. There the data are
7
the querier wants a linear function
8
and the release 9 must satisfy the recoverability constraint
0
Privacy is measured by
1
and the optimal privacy value is characterized exactly as a piecewise function of the singular values 2 of 3. In particular,
4
and once
5
one can release something independent of 6, so
7
The full tradeoff between these endpoints is piecewise affine (Nageswaran, 2023).
The optimal achievability scheme is diagonal in reduced singular coordinates: 8 with
9
The mechanism therefore consists of linear attenuation plus independent additive Gaussian noise in each singular direction. Distortion is allocated first to the smallest singular values: the paper describes this as a thresholding or filling rule, rather than deriving a water-filling formula (Nageswaran, 2023).
When 0 is a coordinate-selection matrix extracting 1 coordinates, all nonzero singular values equal 2, and the theory becomes explicitly coordinatewise. Then
3
and an optimal release is
4
In this coordinate-aligned case the mechanism is genuinely coordinatewise and non-unique, because any allocation satisfying the budget constraint yields the same MMSE when 5 (Nageswaran, 2023).
4. Inference privacy versus coordinatewise independence
The synthesis paper on Gaussian mechanisms against statistical inference studies a more general setting with a private Gaussian vector 6, a disclosed/query vector 7, and a release mechanism
8
Privacy is measured by the mutual information
9
and utility is constrained through weighted distortion
0
For jointly Gaussian variables,
1
so privacy improvement corresponds to enlarging the posterior covariance 2 (Hayati et al., 2021).
The central point for coordinatewise Gaussian privatization is negative: the mechanism is not coordinatewise in the original basis. Both 3 and 4 are unconstrained matrices, and correlated Gaussian noise is explicitly allowed. The paper reformulates the design problem as a convex log-det semidefinite program over 5, 6, and an auxiliary matrix 7, thereby optimizing the linear transformation and the full Gaussian covariance rather than per-coordinate noise scales (Hayati et al., 2021).
The noise covariance can always be diagonalized after an orthogonal change of basis,
8
so the additive noise becomes coordinatewise independent in rotated output coordinates. However, the paper does not prove that the jointly optimal pair 9 diagonalizes together with 0, 1, and 2. The transformed problem therefore remains coupled through the signal term and the distortion term. A common misconception is that every linear-Gaussian privacy mechanism is effectively coordinate-separable; the paper explicitly does not establish that conclusion (Hayati et al., 2021).
5. High-dimensional Gaussian estimation and the role of preconditioning
For private learning of general multivariate Gaussians, several papers argue that naive coordinatewise privatization is inadequate in the original basis. The core reason is that, for a general covariance matrix, coordinatewise means and variances do not determine the covariance, off-diagonal correlations matter for total variation distance, and sensitivity in the original coordinates can be dominated by poorly conditioned directions (Kamath et al., 2018).
The 2018 zCDP work on privately learning high-dimensional distributions makes this point explicitly. It notes that coordinatewise privatization works naturally only when the covariance is diagonal, whereas for a general Gaussian one should first privately find a transformation 3 such that
4
This recursive private preconditioning step turns the problem into an approximately isotropic one, after which coordinatewise mean estimation and simpler private covariance estimation become effective (Kamath et al., 2018).
The 2021 paper on unbounded Gaussians generalizes the same philosophy to arbitrary Gaussian distributions without prior parameter bounds. Its main preconditioner theorem states that, for 5 of rank 6, a polynomial-time 7-DP algorithm outputs 8 such that
9
The method is spectral rather than coordinatewise: it privately estimates eigenvalues, recovers eigenspaces, and applies subspace-dependent rescaling. Only after this transformed-coordinate step do clipped empirical statistics plus Gaussian perturbation become well behaved (Kamath et al., 2021).
The 2022 robust-and-optimal paper reaches a closely related conclusion from a different angle. In its approximate-DP covariance release, it argues that entrywise Gaussian noise can completely destroy the eigenstructure and thus lead to arbitrarily large total variation error. Instead, it uses a covariance-aware Gaussian sampling mechanism, releasing the empirical covariance of samples drawn from a stabilized Gaussian estimate. In its pure-DP algorithm, recursive private preconditioning again produces a matrix 0 such that
1
Taken together, these results indicate that high-dimensional Gaussian privatization is generally geometry-aware and matrix-coupled; coordinatewise treatment becomes principled only after private whitening or preconditioning (Alabi et al., 2022).
6. Interactive, personalized, and federated extensions
In interactive statistical decision making with mutual-information privacy, coordinatewise Gaussian privatization is treated as a special private channel class. The sensitive object is
2
the mechanism is
3
and feasible procedures must satisfy
4
For this class the paper derives a general minimax-quantile lower-bound template in which privacy appears through the variance-inflation factor
5
In Gaussian mean estimation, for example,
6
and the lower bound becomes
7
The paper’s interpretation is that privacy acts as Gaussian variance inflation in high-confidence lower bounds (Bongole et al., 22 Jun 2026).
Personalized differential privacy introduces another axis of heterogeneity. The 2026 scalar Gaussian mean-estimation paper studies
8
with per-record privacy budgets 9. Its estimator is not an additive Gaussian mechanism; instead it is a clip-then-estimate procedure combining a private range estimator, clipping, saturated privacy-budget weights, and Laplace noise. The lower bound has the form
0
matched up to logarithmic factors. A plausible implication is that this scalar construction can serve as a building block for coordinatewise multivariate procedures, but the paper itself analyzes only the one-dimensional case (Dong et al., 22 Jan 2026).
A different boundary case is vertical federated learning with client-wise missingness. The Gaussian-copula framework in that setting is a conceptual rather than direct match to coordinatewise Gaussian privatization. Dependence is modeled through a latent Gaussian copula
1
but privacy is enforced through randomized response on pairwise ranks and Laplace-noised Bernstein marginal estimation, not by additive Gaussian noise on each coordinate. The method is nevertheless coordinate-structured: marginals are privatized separately, dependence is reconstructed pairwise, and synthetic data are generated coordinatewise from privatized marginals and a Gaussian latent dependence model (Tang et al., 25 Nov 2025).
Coordinatewise Gaussian privatization is therefore a precise technique in some settings, an exact optimal mechanism in some coordinate-aligned Gaussian problems, and only a restricted special case in others. The literature consistently distinguishes between three regimes: diagonal Gaussian perturbation with per-coordinate control, transformed-coordinate diagonalization in singular or rotated bases, and fully multivariate Gaussian privatization with essential cross-coordinate coupling.