Quantum Natural Gradient Descent
- Quantum Natural Gradient Descent is a quantum optimization method that uses the Fubini–Study metric and quantum Fisher information to guide parameter updates.
- It adapts classical natural gradient descent to the quantum state manifold, enabling efficient optimization for variational algorithms under noisy and mixed-state conditions.
- Empirical studies show QNGD converges faster than Euclidean methods, reducing iterations in tasks such as VQE and QAOA.
Searching arXiv for recent and foundational papers on Quantum Natural Gradient Descent. Quantum Natural Gradient Descent (QNGD), often abbreviated QNG or NatGrad in the variational-quantum literature, is a quantum generalization of natural gradient descent in which the update direction is defined by the information geometry of quantum states rather than by the Euclidean geometry of parameter space. For a parametrized pure state and a cost such as , the canonical update is
where is the quantum Fisher information matrix, equivalently the pull-back of the Fubini–Study metric or the real part of the Quantum Geometric Tensor. In this form, QNGD is steepest gradient descent on the variational manifold of quantum states; later work generalized the same principle to mixed, noisy, and thermal-state models, and also to non-monotone quantum metrics (Stokes et al., 2019, Koczor et al., 2019, Minervini et al., 26 Feb 2025, Sasaki et al., 2024).
1. Geometric formulation and core update rule
The foundational formulation of QNGD begins from the observation that the parameter vector is not itself the physically relevant object. The relevant manifold is the manifold of quantum states prepared by the ansatz. For a normalized pure state , the Quantum Geometric Tensor is
and its real part
is the Fubini–Study metric tensor. Infinitesimally,
which coincides, to second order, with the squared Fubini–Study angle (Stokes et al., 2019).
Replacing the Euclidean norm by the norm induced by 0 yields the manifold-aware steepest-descent problem
1
whose first-order optimality condition gives
2
Equivalent constrained formulations use the local Fubini–Study or fidelity-based distance and lead to the same preconditioned direction (Stokes et al., 2019, Wang et al., 2023).
For pure-state ansätze, the matrix elements are commonly written as
3
or, with a convention differing by a factor of 4, as the pure-state quantum Fisher information matrix. When each parametrized gate is 5 with Hermitian generator 6, the same matrix can be expressed through generator moments and covariances (Wierichs et al., 2020). In the classical limit where a variational quantum state is restricted to real amplitudes 7, one finds 8, where 9 is the classical Fisher matrix, so QNG is a direct generalization of classical natural gradient to fully complex quantum states (Stokes et al., 2019).
Several works also place QNGD in relation to neighboring variational principles. For noise-free unitary circuits it was introduced as mathematically equivalent to stochastic reconfiguration in quantum Monte Carlo settings, and for pure-state ansätze it was shown to be equivalent to McLachlan’s variational imaginary-time evolution (Sasaki et al., 2024, Koczor et al., 2019).
2. Metric tensors, mixed states, and generalized quantum geometries
The pure-state Fubini–Study metric is only the first member of a broader family. For arbitrary quantum states 0 generated by completely positive trace-preserving maps, the natural replacement is the quantum Fisher information defined through the symmetric logarithmic derivatives 1, which satisfy
2
The corresponding matrix is
3
This yields the mixed-state natural-gradient update
4
for costs such as 5 or any smooth objective (Koczor et al., 2019).
Noisy and non-unitary generalizations emphasize that the geometry of density operators need not be restricted to exact QFI estimation. A modification of Error Suppression by Derangements and Virtual Distillation enables an experimentally efficient approximation of the QFI via the Hilbert–Schmidt metric tensor
6
The same work proves that the geometry of typical noisy quantum states is approximately identical in either the Hilbert–Schmidt metric or as characterized by the QFI, and numerical simulations on noisy circuits report that this metric-aware optimizer can significantly outperform other variational techniques (Koczor et al., 2019).
Thermal-state extensions replace the pure-state Fubini–Study geometry by metrics native to Gibbs families. For parameterized thermal states
7
closed-form expressions were established for the Fisher–Bures and Kubo–Mori information matrices, together with quantum algorithms for estimating their entries via classical sampling, Hamiltonian simulation, and the Hadamard test (Patel et al., 2024). For parameterized quantum circuits initialized with thermal states, exact methods were later given for three quantum generalizations of the Fisher information matrix—Fisher–Bures, Wigner–Yanase, and Kubo–Mori—with the ordering
8
and with unbiased estimation procedures based on the Hadamard test, classical random sampling, and Hamiltonian simulation (Minervini et al., 26 Feb 2025).
A distinct generalization removes monotonicity as a design principle. Conventional QNG is built from the symmetric-logarithmic-derivative metric, one of the monotone metrics singled out by CPTP monotonicity. The non-monotone program retains the generic update
9
but allows a broader family of Petz-function-induced metrics, including those derived from sandwiched Rényi-0 divergences. That work states that monotonicity is a crucial condition for conventional QNG to be optimal, and provides analytical and numerical evidence that non-monotone QNG can outperform conventional QNG based on the SLD metric in terms of convergence speed (Sasaki et al., 2024).
3. Metric estimation, approximations, and computational structure
In practical VQAs, the central difficulty is not the form of the update but the cost of obtaining a usable metric tensor. A direct VQE loop with QNG typically proceeds by estimating the energy and the ordinary gradient, assembling the Fubini–Study matrix from overlaps of derivative states, regularizing the metric, and solving the linear system for the natural-gradient step. In one explicit workflow, the ordinary gradient is estimated by analytic parameter-shift, symmetric finite-difference, or SPSA; the Fubini–Study matrix is built from estimates of 1 and 2; and Tikhonov regularization is applied through 3 before inversion (Wierichs et al., 2020).
The resulting asymptotic cost is typically quadratic in the number of parameters. In one detailed accounting for VQE, if 4 is the number of parameters, 5 the number of Pauli terms in the Hamiltonian, 6 the shots per measurement basis for energy and gradient, 7 the shots for metric elements, and 8 the time to run one circuit of depth 9 plus readout, then the ordinary gradient by symmetric finite-difference costs 0, the Fubini matrix costs 1, and the NatGrad per-epoch cost scales as 2. The same source notes that in spin-chain models with translation symmetry 3 is small, so the Fubini cost is dominant for NatGrad, whereas in chemistry applications with 4 the relative overhead may be smaller (Wierichs et al., 2020).
To reduce this overhead, the foundational QNG work introduced a block-diagonal approximation for layered ansätze. If
5
with each 6 a product of commuting Pauli rotations, then one ignores inter-layer couplings and computes a local block
7
Under this approximation, each optimization step requires 8 circuit evaluations for the parameter-shift gradient and 9 further runs to measure the commuting observables needed for the blocks, for a total quantum cost per step of approximately 0 circuit evaluations (Stokes et al., 2019).
There are also specialized estimators tailored to hardware. In a silicon-photonic experiment, a Simultaneous Perturbation Stochastic Approximation estimator of the metric used four state overlaps 1 and the matrix estimate
2
followed by exponential smoothing and the stabilized inverse power 3 with 4. For a 5 ansatz, the per-iteration overhead was reported as 6 runs for the gradient, 7 runs for the SPSA overlap metric, and additional runs for the cost-function projectors, yet the total circuit-execution time was reduced by 8 on average because the iteration count decreased substantially (Wang et al., 2023).
On the classical-simulation side, QNG introduces its own bottleneck. For unitary ansätze, one analysis showed that state-vector simulation does not dominate the runtime; rather, the Fisher information matrix does. A recurrence-based strategy computes the metric exactly in 9 gates and 0 state-vectors, improving over a naïve 1 gate count while relying only on “apply gate,” “clone state,” and “inner product” primitives (Jones, 2020).
A more radical complexity reduction appears in Quantum Natural Stochastic Pairwise Coordinate Descent. There, an ensemble-based quantum Fisher information metric is estimated through a random 2 coordinate block using single-shot measurements, and the update only touches a randomly selected parameter pair. The method uses 3 samples for the gradient and 4 for the metric per iteration, giving 5 quantum measurements per step, in contrast with the 6 copy complexity attributed to conventional full-metric QNGD (Sohail et al., 2024).
4. Empirical behavior in variational eigensolvers and related VQAs
Empirical work on QNGD has concentrated on the optimization pathologies of VQEs and QAOA. In early numerical demonstrations, minimizing 7 on 8 qubits with 9 layers of alternating 0 rotations and CZ entanglers, using 1 shots per expectation, showed that vanilla gradient descent fails to find the global minimum, Adam eventually converges but requires many iterations, and QNG—both with block-diagonal and diagonal metric approximations—converges in far fewer steps; the advantage persists as the circuit is made deeper (Stokes et al., 2019).
A systematic VQE study on the transverse-field Ising model sharpened this picture. For a QAOA-type ansatz with depth 2, 3 parameters, and 4 random starts, BFGS was reported to fail beyond 5, ADAM with 6 to converge up to 7 but with epoch count scaling 8 and rapidly exceeding 9 epochs above a threshold 0, and NatGrad with regularization and 1 to always find the global minimum up to 2, with epoch scaling 3 and low variance. The same study also found that seemingly benign overparametrization degrades the performance of all optimizers, with BFGS and ADAM failing more often and more severely than NatGrad (Wierichs et al., 2020).
The overparametrized-QAOA experiments are especially notable because they contradict the common expectation that more parameters help first-order training. When one or two Pauli-4 rotation layers were added, the BFGS success fraction fell below 5 for two extra layers at 6, ADAM with 7 had success rate zero by 8, and NatGrad with 9 maintained success rates above 0 even with two extra layers. On the Heisenberg XXZ model with Trotter ansatz, BFGS failed for 1, ADAM with 2 showed abrupt jumps in epoch count at 3 and 4, and NatGrad with 5 occasionally stalled because of tiny parameter-step interrupts in flat regions but still attained better final precision than BFGS (Wierichs et al., 2020).
These results anchor a recurring empirical claim in the literature: QNGD often improves reliability of convergence in nonconvex quantum landscapes, particularly when local minima, plateaus, or poor conditioning dominate the behavior of Euclidean first-order methods. At the same time, the same benchmark record shows that QNG is not uniformly immune to pathologies such as flat-region stalling or metric singularity, and that the per-iteration or per-epoch gain must be weighed against metric-estimation overhead (Wierichs et al., 2020).
5. Variants, domain-specific adaptations, and experimental realizations
The QNG framework has been adapted to multiple hardware platforms, cost structures, and distributed settings. In optical quantum circuits, the method was generalized to a complex-valued parameter space containing both real parameters and complex parameters treated through Wirtinger calculus. On two state-preparation tasks—a single-photon source and a Gottesman–Kitaev–Preskill state source—the natural-gradient approach was compared with vanilla gradient descent and Adam. For the single-photon source, an 6-layer single-mode circuit with 7 parameters reached fidelity 8 in approximately 9 steps for QNGD, compared with approximately 00 for Adam and approximately 01 for SGD; for the Hex-GKP source, a 02-layer circuit with 03 parameters achieved cost 04 in approximately 05 steps for QNGD, while Adam required approximately 06 steps and SGD stalled around cost 07 (Yao et al., 2021).
A hardware-level realization was reported on a fully programmable silicon photonic chip for the dissociation curve of the He-H08 cation. There, rigorous full QNG reached 09 in approximately 10 iterations at 11 Å, SPSA-QNG with 12 took approximately 13 iterations averaged over ten runs, and vanilla gradient descent needed approximately 14 iterations. The final state fidelity with the exact ground state was 15, and the dissociation-curve energies, after a constant shift of 16, lay within 17 Hartree of theory across all 18 (Wang et al., 2023).
In distributed learning, federated quantum natural gradient descent embeds QNG preconditioning into a federated QNN architecture. Each client computes a local block-diagonal QFIM approximation, applies the pseudoinverse locally, and sends only the preconditioned gradient vector to the server. On MNIST tasks with six local VQC clients and equal-sized training splits, FQNGD was reported to converge in roughly half the rounds of Adam and Adagrad, with binary classification accuracy 19 versus 20 for Adam and ternary accuracy 21 versus 22 for Adam. Because each client still transmits only one vector of length 23 per round, the reduction in rounds directly reduces total communication cost (Qi et al., 2023).
For structured Hamiltonians, several task-aware preconditioners have been proposed. Weighted Approximate QNG defines
24
where each 25 is the Hilbert–Schmidt metric tensor of a 26-qubit reduced state and the weights are 27. Under weakly entangling assumptions this method is exactly Gauss–Newton for an approximate weighted nonlinear least-squares reformulation, and numerical experiments on 28, 29, and 30 qubits reported fewer iterations than standard QNG, with lower final energy for the 31- and 32-qubit Ising cases (Shi et al., 7 Apr 2025). A closely related Hamiltonian-aware QNG constructs a pullback metric directly from the lower-dimensional subspace spanned by the Hamiltonian terms, yielding 33 measurement overhead rather than the 34 of standard QNG. In noiseless molecular benchmarks, it was reported to reach the same accuracy as QNG with approximately 35 fewer circuits on 36-qubit H37 and approximately 38 fewer circuits on 39-qubit LiH and H40 (Shi et al., 18 Nov 2025).
Optimizer-level modifications further diversify the family. Momentum-QNG derives from a discretized Langevin equation and updates
41
with benchmark evidence on portfolio VQE and QAOA minimum-vertex-cover instances indicating lower mean 42 and improved convergence behavior relative to basic QNG in regimes with barriers or plateaus (Borysenko et al., 2024). Modified Conjugate Quantum Natural Gradient combines QNG with nonlinear conjugate-gradient search directions and a two-dimensional line-search over 43; in simulations on H44 and Heisenberg chains up to 45 qubits, it was reported to converge 46–47 faster than QNG on H48 and to outperform QNG across tested qubit counts and depths (Halla, 10 Jan 2025).
6. Limitations, controversies, and current directions
The principal limitation of QNGD is computational. Multiple sources state that full-metric estimation requires 49 quantum measurements and 50 classical inversion, or equivalent 51 and 52 scaling depending on notation. This motivates block-diagonal, diagonal, SPSA, low-rank, moving-average, and coordinate-sampled approximations, but these approximations trade geometric fidelity against cost and noise sensitivity (Stokes et al., 2019, Wierichs et al., 2020, Lisart-Liebermann et al., 23 Apr 2025).
Metric singularity and ill-conditioning are a second recurrent issue. In simple VQE case studies, the pure-state Fisher matrix becomes singular at poles or on separable submanifolds, and natural-gradient trajectories can overshoot and oscillate indefinitely unless the step size is reduced adaptively. Regularization by 53, pseudoinversion, step-size decay, or switching to neighboring methods such as imaginary-time evolution are explicit remedies proposed in the literature (Yamamoto, 2019).
A common misconception is that QNG always dominates Euclidean methods. The published record is more conditional. Adaptive QNGD with Armijo backtracking was shown to consistently outperform the original fixed-step QNGD, whose competitiveness depends on near-optimal step-size tuning; however, the same benchmarking also found that a simple Euclidean SGD algorithm equipped with the same adaptive scheme can yield performances similar to the QNG scheme with optimal step size (Atif et al., 2022). Likewise, in shallow-QAOA MaxCut benchmarks under shot noise, block-QNGD reduced iteration counts on very small circuits, but a secant-penalized quasi-Newton method, SP-BFGS, was reported as the recommended optimizer when the shot budget or circuit depth precluded high-precision metric estimation, because QNGD suffered extra shot noise in every entry of the QFIM and the inversion amplified statistical errors (Lisart-Liebermann et al., 23 Apr 2025).
Another ongoing controversy concerns the choice of metric itself. Conventional QNG is built from the symmetric-logarithmic-derivative metric and inherits monotonicity under CPTP maps. The generalized non-monotone program argues that this criterion is not necessary for optimization, proves that conventional QNG is optimal only under the monotonicity requirement, and reports 54–55 faster collapse of the cost in a single-qubit mixed-state experiment for certain Rényi-induced non-monotone metrics (Sasaki et al., 2024). This does not invalidate the standard Fubini–Study or SLD formulation; it instead reframes QNG as a design space of quantum metrics rather than as a single fixed optimizer.
Current directions extend that design space in several dimensions already present in the literature: exact mixed-state metrics for thermal-state initialization, subsystem-weighted and Hamiltonian-aware pullback metrics, communication-aware federated natural gradients, and stochastic estimators with dimension-independent per-step sample complexity (Minervini et al., 26 Feb 2025, Shi et al., 7 Apr 2025, Shi et al., 18 Nov 2025, Sohail et al., 2024). A plausible implication is that “quantum natural gradient descent” now names a family of geometry-aware preconditioners whose practical performance depends as much on metric choice and estimation strategy as on the basic update formula itself.