---
title: Dually Flat Manifold
url: https://www.emergentmind.com/topics/dually-flat-manifold
type: topic
---

# Dually Flat Manifold

A dually flat manifold is a smooth manifold equipped with a Riemannian metric and two flat, torsion-free affine connections that are dual with respect to the metric. This structure underpins much of information geometry, providing the background for the geometry of exponential and mixture families, and supports canonical divergences satisfying generalized Pythagorean theorems. Dually flat manifolds admit coordinate systems and potentials that allow for tractable analysis of geodesics, divergences, and orthogonality, and can be interpreted both in terms of convex analysis and contact geometry. Their structure appears in statistics, statistical mechanics, Finsler geometry, optimization, and symplectic/Kähler geometry via torification.

## 1. Core Definition and Dual Connections

A dually flat manifold is a quadruple $(M, g, \nabla, \nabla^*)$, where $M$ is a smooth manifold of dimension $n$, $g$ is a Riemannian (or pseudo-Riemannian) metric, $\nabla$ is a torsion-free flat affine connection, and $\nabla^*$ is the $g$-dual connection defined by
\[
X\,g(Y, Z) = g(\nabla_X Y, Z) + g(Y, \nabla^*_X Z), \quad \forall X,Y,Z \in \Gamma(TM)
\]
Both $\nabla$ and $\nabla^*$ must be flat (i.e., have vanishing curvature and torsion) [2305.08422][1803.07225][2109.04839][1812.04461]. The Levi-Civita connection need not be flat unless the manifold is Euclidean.

The existence of this structure entails that there are coordinate systems—called $\nabla$-affine (or "exponential," $e$-) and $\nabla^*$-affine (or "mixture," $m$-) coordinates—that are flat for each connection, respectively. Moreover, in such coordinates, the metric has a Hessian form and is generated via a strictly convex potential. The key transformation linking these coordinates is Legendre duality:
\[
\eta_i = \frac{\partial \psi}{\partial \theta^i}, \quad \phi(\eta) = \theta^i \eta_i - \psi(\theta),
\]
where $\psi$ and $\phi$ are Legendre-conjugate convex functions [2305.08422][1803.07225][1812.04461].

## 2. Convex Potentials, Affine Coordinates, and Bregman Divergence

On a dually flat manifold, a strictly convex $C^2$ function $\psi: U \to \mathbb{R}$ on a simply connected open set $U \subset \mathbb{R}^n$ defines the metric and dually flat structure:
\[
g_{ij}(\theta) = \frac{\partial^2 \psi}{\partial \theta^i \partial \theta^j}, \quad \eta_i = \frac{\partial \psi}{\partial \theta^i}
\]
The dual coordinate $\eta$ parametrizes an alternative affine system for the dual connection $\nabla^*$. The Legendre transform gives a dual potential $\phi(\eta) = \theta \cdot \eta - \psi(\theta)$.

The canonical divergence is the Bregman divergence generated from the potential:
\[
D(\theta \| \theta') = \psi(\theta) - \psi(\theta') - (\theta - \theta') \cdot \nabla \psi(\theta')
\]
Or, equivalently, in mixed coordinates:
\[
D(\theta, \eta') = \psi(\theta) + \phi(\eta') - \theta \cdot \eta'
\]
This divergence is central; it is nonnegative, vanishes only for coinciding points, and generates the metric by second derivatives. Geodesics for $\nabla$ and $\nabla^*$ correspond to straight lines in $\theta$ and $\eta$ coordinates, respectively [2305.08422][1803.07225][1808.06482][1910.03935][1812.04461].

## 3. Geometric Principles: Generalized Pythagorean Theorem and Projections

The geometry of dually flat spaces generalizes various classical geometric relationships:
- **Generalized Pythagorean theorem**: For points $p \to r$ via $\nabla$-geodesic and $r \to q$ via $\nabla^*$-geodesic that are $g$-orthogonal at $r$, the canonical divergence satisfies
  \[
  D(p \| q) = D(p \| r) + D(r \| q)
  \]
  This underpins the optimality properties of statistical projections and is tied to the convex structure of the underlying manifold [2305.08422][1812.04461][2011.11219][1910.03935][1808.06482].

- **Triangular relation**: For any $P,Q,R$,
  \[
  D(P\|Q) + D(Q\|R) - D(P\|R) = (\eta(R) - \eta(Q)) \cdot (\theta(P) - \theta(Q))
  \]
  Orthogonality of the connecting geodesics at $Q$ recovers the Pythagorean identity [1808.06482][1910.03935].

- **Projection theorem**: The $\nabla^*$-projection of $p$ onto a submanifold $S$ is the point $q$ where the $\nabla^*$-geodesic $pq$ meets $S$ orthogonally; the canonical divergence is minimized at $q$ [2011.11219].

The theory extends to cases with boundary or singularities, using quasi-Hessian and coherent tangent bundle generalizations, maintaining the essential divergence and projection properties even in degenerate settings [2011.11219].

## 4. Statistical and Contact Geometric Realizations

Dually flat manifolds arise naturally in statistics:
- **Exponential families**: The natural parameterization ($\theta$) yields a $\nabla$-flat geometry. The log-partition function is the potential generating the Fisher metric, and expectation coordinates are the dual ($\eta$-affine) system. The Kullback-Leibler divergence is the canonical Bregman divergence [1803.07225][2104.13801][2512.09358].
- **Mixture families** and other parameterized probabilistic models similarly fit into the dual flatness structure, often using negative entropy as the potential.

In contact geometry, a dually flat structure arises from Legendre submanifolds: starting from a contact manifold $(\mathcal{C}, \theta)$ and a strictly convex function $\psi(x)$, the Legendre submanifold $\mathcal{L}_{\psi}$ admits a natural dually flat structure, with induced metric and dual flat connections stemming from pullbacks of the contact form [1512.00950].

Dually flat structures are thus the geometric substrate for both exponential and mixture connections and divergences in information geometry, unifying statistical and contact/symplectic perspectives.

## 5. Advanced Structures: Toric Geometry, Kähler Correspondence, and Finsler Extensions

Dually flat geometry is compatible with more advanced symplectic and complex-geometric structures:
- **Toric correspondence**: There is a bijective correspondence between regular toric Kähler manifolds and toric dually flat manifolds. Symplectic potentials on Delzant polytopes define dually flat metrics on open orbits, which compactify to Kähler toric manifolds via torification. Canonical divergences and Pythagorean formulas extend to boundary strata and facets [2305.08422][2109.04839][2309.12123].
- **Finsler generalizations**: Dually flatness has been completely classified for general $(\alpha,\beta)$-metrics in Finsler geometry, revealing a deep connection with projective flatness and providing explicit ODE/PDE characterizations of the allowable metric functions $\phi$ [1401.0061][1305.3767].
- **Twisted and warped product manifolds**: Dual flatness can be characterized in higher-dimensional product manifolds under specific curvature and warping conditions, often reducing to combinations where the base manifold is dually flat and the fiber has constant sectional curvature [1408.3450].

## 6. Divergences, Dynamics, and Algorithmic Applications

Several divergences arise canonically in dually flat spaces:
- **Canonical/Bregman divergence**: Encodes the dually flat geometry, generates geodesics, and is critical in projection theorems [1808.06482][1812.04461].
- **Affine divergence**: Reduces to the Jeffreys divergence in probabilistic models [1808.06482].
- **Jensen, Bhattacharyya, Jensen-Shannon**: Associated with convex potential combinations, naturally consistent with mixture and exponential families [1808.06482][2104.13801].

The canonical divergence also serves as a Hamilton principal function, allowing for variational and dynamical interpretations:
- **Gradient flows and geodesic generation**: The gradient of the divergence with respect to one argument (time-rescaled) generates $\nabla$- and $\nabla^*$-geodesics. The dynamical systems induced by canonical divergence are integrable and coincide with geodesic equations in the appropriate coordinates [1812.04461].
- **Optimization**: In statistical manifolds (especially exponential families), geodesic-based (e.g., $m$-geodesic and $e$-geodesic) optimization achieves one-step convergence to maximum-likelihood estimators or enables unconstrained optimization, leveraging the dually flat structure. This gives geometric backing to mirror descent, exponentiated gradient, and natural gradient algorithms [2512.09358].

Practical computation of dually flat structure in high-dimensional spaces with intractable potentials is addressed by Monte Carlo Information Geometry, which replaces integrals by sample-based estimators of the potential. These estimators preserve the strict convexity needed for Bregman generators and thus maintain the dually flat structure almost surely, enabling efficient geometric algorithms [1803.07225].

## 7. Special Models, Classification, and Boundary Cases

Dually flat manifolds encompass important cases in statistics and geometry:
- **Simplex and categorical models**: The simplex with KL divergence is a prototypical dually flat manifold, directly related to the Fubini-Study metric on $\mathbb{CP}^n$ [2305.08422][2109.04839].
- **Escort probability geometry**: By a projective conformal flattening of $\alpha$-geometry, the probability simplex with escort probabilities as affine coordinates admits a dually flat structure where the $\alpha$-divergence becomes the canonical Bregman divergence [1010.4965].
- **Singular and quasi-Hessian structures**: In statistical models with degenerate Fisher metrics or boundary singularities (e.g., mixture models on the simplex), the dually flat framework generalizes to quasi-Hessian manifolds, preserving key geometric properties (theorems on divergence and projection) via gluing and coherent tangent bundles [2011.11219].
- **1D toric models and complex space forms**: The classification of toric dually flat manifolds in dimension one connects these objects to complex space forms (e.g., projective line, complex plane, unit disk) and yields explicit curvature and metric expressions [2309.12123].

---

**References**:  
[2305.08422], [1803.07225], [2109.04839], [1512.00950], [2104.13801], [1812.04461], [1910.03935], [1808.06482], [1401.0061], [1408.3450], [1305.3767], [1010.4965], [2512.09358], [2011.11219], [2309.12123].

Source: https://www.emergentmind.com/topics/dually-flat-manifold