Generalized Alpha-Beta Divergence

• Generalized Alpha-Beta Divergence is a parameterized class of discrepancy measures that unifies approaches like KL, Hellinger, and chi-square through adjustable alpha and beta parameters.
• It leverages the Tweedie variance-function and dual cumulant frameworks to derive divergences from exponential dispersion models, enhancing robustness and exact computations in statistical settings.
• Its versatile formulations extend to matrices, operators, and graphical models, offering scale-invariance and geometric insights for applications in high-dimensional and variational inference contexts.

Generalized Alpha-Beta divergence denotes a class of parameterized divergence constructions that unify or interpolate many standard discrepancy measures, including Kullback–Leibler, Hellinger, Itakura–Saito, squared Euclidean, chi-square-type, Rényi-related, Gamma-related, and log-det divergences. In the literature, the expression is used in several closely related senses: a Tweedie/variance-function framework that generates $\alpha$- and $\beta$-divergences from a common dual cumulant; the two-parameter Cichocki–Amari Alpha–Beta family and its scale-invariant and logarithmic variants; matrix and operator-valued log-det analogues; and a recent $\psi$-generated superfamily called generalized alpha-beta divergence (Yilmaz et al., 2012, Cichocki et al., 2014, Regli et al., 2018, Roy et al., 7 Jul 2025).

1. Terminological scope and canonical definitions

A standard discrete formulation writes the Alpha–Beta divergence between positive measures $P$ and $Q$ on a finite set $\mathcal{X}$ as

$$D_{AB}^{\alpha,\beta}(P,Q)=\sum_{x\in\mathcal{X}} d_{AB}^{(\alpha,\beta)}(P(x),Q(x)),$$

with pointwise term

$$d_{AB}^{(\alpha,\beta)}(p, q) = \frac{-1}{\alpha\beta}\left( p^{\alpha}q^{\beta} - \frac{\alpha\,p^{\alpha+\beta}}{\alpha+\beta} - \frac{\beta\,q^{\alpha+\beta}}{\alpha+\beta} \right), \qquad \alpha,\beta\neq 0,\ \alpha+\beta\neq 0,$$

together with continuous extensions for $\alpha=0$, $\beta=0$, $\beta$0, and $\beta$1 (Lee et al., 2023). This family is the basic two-parameter AB divergence used in generalized divergence theory, in robust NMF, and in exact divergence computation for decomposable graphical models (Lee et al., 2021).

A more recent superfamily replaces the raw power terms by a scalar generating function $\beta$2. With

$\beta$3

the generalized alpha-beta divergence is

$\beta$4

for $\beta$5, with edge-case extensions defined by limits and derivatives (Roy et al., 7 Jul 2025). This construction is explicitly presented as a superfamily of Hellinger distance, power divergence, density power divergence, logarithmic density power divergence, S-divergence, logarithmic S-divergence, Gamma divergence, and $\beta$6-divergence (Roy et al., 7 Jul 2025).

The validity of this $\beta$7-generated family is characterized in the log-domain by $\beta$8. For $\beta$9 and $\psi$0, the divergence is nonnegative for all dominated sub-probability measures if and only if $\psi$1 is strictly increasing and convex; on the special line $\psi$2, the admissibility condition weakens to local monotonicity conditions near $\psi$3 (Roy et al., 7 Jul 2025). This establishes a general mechanism for constructing new alpha-beta-type divergences from admissible $\psi$4.

2. Variance-function and Tweedie construction

A distinct but foundational line derives $\psi$5- and $\psi$6-divergences from exponential dispersion models (EDMs). For scalar, separable divergences $\psi$7, an EDM has density

$\psi$8

mean $\psi$9, and variance function $P$0. In the Tweedie case, $P$1, and the corresponding dual cumulant $P$2 generates both divergence families (Yilmaz et al., 2012).

The Tweedie-generated $P$3-divergence is the Bregman divergence of $P$4,

$P$5

with special cases

$P$6

The same $P$7, reparameterized by the ratio $P$8, yields the $P$9-divergence as a Csiszár $Q$0-divergence,

$Q$1

with notable cases including forward KL at $Q$2, reverse KL at $Q$3, and Hellinger at $Q$4 (Yilmaz et al., 2012).

The same idea extends beyond Tweedie power laws. For a general EDM variance function $Q$5, the dual cumulant satisfies $Q$6, and the generalized beta divergence admits the compact integral form

$Q$7

This generalization replaces the power variance function $Q$8 by an arbitrary $Q$9, thereby extending beta divergence from the Tweedie family to any EDM, with explicit examples for Bernoulli, negative binomial, and hyperbolic secant variance functions (Yilmaz, 2013). A plausible implication is that, in this variance-function view, the “beta parameter” is replaced by a functional choice of $\mathcal{X}$0.

3. Special cases, identities, and geometry

Within the Tweedie framework, the same index $\mathcal{X}$1 simultaneously specifies the variance function $\mathcal{X}$2, the corresponding Tweedie law $\mathcal{X}$3, the $\mathcal{X}$4-divergence, and the $\mathcal{X}$5-divergence (Yilmaz et al., 2012). The relation

$\mathcal{X}$6

implies that KL divergence at $\mathcal{X}$7 is the unique divergence that is both an $\mathcal{X}$8- and a $\mathcal{X}$9-divergence. Moreover, $$D_{AB}^{\alpha,\beta}(P,Q)=\sum_{x\in\mathcal{X}} d_{AB}^{(\alpha,\beta)}(P(x),Q(x)),$$0 if and only if $$D_{AB}^{\alpha,\beta}(P,Q)=\sum_{x\in\mathcal{X}} d_{AB}^{(\alpha,\beta)}(P(x),Q(x)),$$1, so symmetry occurs at $$D_{AB}^{\alpha,\beta}(P,Q)=\sum_{x\in\mathcal{X}} d_{AB}^{(\alpha,\beta)}(P(x),Q(x)),$$2, yielding the Hellinger case (Yilmaz et al., 2012).

The same family also exhibits scale relations. Tweedie models satisfy

$$D_{AB}^{\alpha,\beta}(P,Q)=\sum_{x\in\mathcal{X}} d_{AB}^{(\alpha,\beta)}(P(x),Q(x)),$$3

and the induced divergences obey

$$D_{AB}^{\alpha,\beta}(P,Q)=\sum_{x\in\mathcal{X}} d_{AB}^{(\alpha,\beta)}(P(x),Q(x)),$$4

These identities explain, for example, the scale behavior associated with the Gamma/Itakura–Saito case $$D_{AB}^{\alpha,\beta}(P,Q)=\sum_{x\in\mathcal{X}} d_{AB}^{(\alpha,\beta)}(P(x),Q(x)),$$5 (Yilmaz et al., 2012).

The principal scalar specializations can be summarized as follows.

$$D_{AB}^{\alpha,\beta}(P,Q)=\sum_{x\in\mathcal{X}} d_{AB}^{(\alpha,\beta)}(P(x),Q(x)),$$6	Distribution	Divergence specializations
$$D_{AB}^{\alpha,\beta}(P,Q)=\sum_{x\in\mathcal{X}} d_{AB}^{(\alpha,\beta)}(P(x),Q(x)),$$7	Gaussian	$$D_{AB}^{\alpha,\beta}(P,Q)=\sum_{x\in\mathcal{X}} d_{AB}^{(\alpha,\beta)}(P(x),Q(x)),$$8: squared Euclidean; $$D_{AB}^{\alpha,\beta}(P,Q)=\sum_{x\in\mathcal{X}} d_{AB}^{(\alpha,\beta)}(P(x),Q(x)),$$9: Pearson-type $$d_{AB}^{(\alpha,\beta)}(p, q) = \frac{-1}{\alpha\beta}\left( p^{\alpha}q^{\beta} - \frac{\alpha\,p^{\alpha+\beta}}{\alpha+\beta} - \frac{\beta\,q^{\alpha+\beta}}{\alpha+\beta} \right), \qquad \alpha,\beta\neq 0,\ \alpha+\beta\neq 0,$$0
$$d_{AB}^{(\alpha,\beta)}(p, q) = \frac{-1}{\alpha\beta}\left( p^{\alpha}q^{\beta} - \frac{\alpha\,p^{\alpha+\beta}}{\alpha+\beta} - \frac{\beta\,q^{\alpha+\beta}}{\alpha+\beta} \right), \qquad \alpha,\beta\neq 0,\ \alpha+\beta\neq 0,$$1	Poisson	$$d_{AB}^{(\alpha,\beta)}(p, q) = \frac{-1}{\alpha\beta}\left( p^{\alpha}q^{\beta} - \frac{\alpha\,p^{\alpha+\beta}}{\alpha+\beta} - \frac{\beta\,q^{\alpha+\beta}}{\alpha+\beta} \right), \qquad \alpha,\beta\neq 0,\ \alpha+\beta\neq 0,$$2 KL
$$d_{AB}^{(\alpha,\beta)}(p, q) = \frac{-1}{\alpha\beta}\left( p^{\alpha}q^{\beta} - \frac{\alpha\,p^{\alpha+\beta}}{\alpha+\beta} - \frac{\beta\,q^{\alpha+\beta}}{\alpha+\beta} \right), \qquad \alpha,\beta\neq 0,\ \alpha+\beta\neq 0,$$3	compound Poisson	$$d_{AB}^{(\alpha,\beta)}(p, q) = \frac{-1}{\alpha\beta}\left( p^{\alpha}q^{\beta} - \frac{\alpha\,p^{\alpha+\beta}}{\alpha+\beta} - \frac{\beta\,q^{\alpha+\beta}}{\alpha+\beta} \right), \qquad \alpha,\beta\neq 0,\ \alpha+\beta\neq 0,$$4: Hellinger
$$d_{AB}^{(\alpha,\beta)}(p, q) = \frac{-1}{\alpha\beta}\left( p^{\alpha}q^{\beta} - \frac{\alpha\,p^{\alpha+\beta}}{\alpha+\beta} - \frac{\beta\,q^{\alpha+\beta}}{\alpha+\beta} \right), \qquad \alpha,\beta\neq 0,\ \alpha+\beta\neq 0,$$5	Gamma	$$d_{AB}^{(\alpha,\beta)}(p, q) = \frac{-1}{\alpha\beta}\left( p^{\alpha}q^{\beta} - \frac{\alpha\,p^{\alpha+\beta}}{\alpha+\beta} - \frac{\beta\,q^{\alpha+\beta}}{\alpha+\beta} \right), \qquad \alpha,\beta\neq 0,\ \alpha+\beta\neq 0,$$6: Itakura–Saito; $$d_{AB}^{(\alpha,\beta)}(p, q) = \frac{-1}{\alpha\beta}\left( p^{\alpha}q^{\beta} - \frac{\alpha\,p^{\alpha+\beta}}{\alpha+\beta} - \frac{\beta\,q^{\alpha+\beta}}{\alpha+\beta} \right), \qquad \alpha,\beta\neq 0,\ \alpha+\beta\neq 0,$$7: reverse KL
$$d_{AB}^{(\alpha,\beta)}(p, q) = \frac{-1}{\alpha\beta}\left( p^{\alpha}q^{\beta} - \frac{\alpha\,p^{\alpha+\beta}}{\alpha+\beta} - \frac{\beta\,q^{\alpha+\beta}}{\alpha+\beta} \right), \qquad \alpha,\beta\neq 0,\ \alpha+\beta\neq 0,$$8	inverse Gaussian	$$d_{AB}^{(\alpha,\beta)}(p, q) = \frac{-1}{\alpha\beta}\left( p^{\alpha}q^{\beta} - \frac{\alpha\,p^{\alpha+\beta}}{\alpha+\beta} - \frac{\beta\,q^{\alpha+\beta}}{\alpha+\beta} \right), \qquad \alpha,\beta\neq 0,\ \alpha+\beta\neq 0,$$9: reverse Pearson

Along the $\alpha=0$0-line generated by negative Tsallis entropies, the geometric behavior on the probability simplex has recently been quantified by a sharp Pinsker-type inequality. For $\alpha=0$1,

$\alpha=0$2

with explicit optimal constants $\alpha=0$3: dimension-free $\alpha=0$4 for $\alpha=0$5, dimension-dependent $\alpha=0$6 for $\alpha=0$7, and no global positive constant for $\alpha=0$8 when $\alpha=0$9 (Beretta et al., 5 Feb 2026). This identifies a precise metric profile for one canonical $\beta=0$0-slice inside the broader alpha-beta landscape.

4. Statistical interpretation, estimation, and variational objectives

The Tweedie construction gives $\beta=0$1-divergence a direct probabilistic interpretation. For EDMs,

$\beta=0$2

where $\beta=0$3 is the unit deviance and $\beta=0$4 is the log-likelihood evaluated at mean parameter $\beta=0$5. Hence, for fixed $\beta=0$6, minimizing $\beta=0$7-divergence is equivalent to maximizing the log-likelihood. The Gaussian least-squares identity at $\beta=0$8 is therefore generalized to the whole Tweedie class (Yilmaz et al., 2012).

For model selection across divergence families, one approach is to place $\beta=0$9 under an explicit likelihood. The Exponential Divergence with Augmentation (EDA) density

$\beta$00

exists for all $\beta$01 and supports maximum-likelihood selection of the best $\beta$02. Alpha-divergence is then selected by the transformation

$\beta$03

which reuses the same likelihood machinery. The same framework extends to $\beta$04- and Rényi divergences through scale-normalized reductions to $\beta$05- or $\beta$06-minimization (Dikmen et al., 2014).

A different generalization arises in variational inference through the scale invariant Alpha–Beta divergence

$\beta$07

with continuous extensions on the parameter boundaries. This objective contains $\beta$08, $\beta$09, Rényi divergence on the line $\beta$10, Gamma divergence on the line $\beta$11, Hellinger-type and chi-square-type cases, and a log-Euclidean limit at $\beta$12 (Regli et al., 2018). In the variational setting, $\beta$13 governs robustness to outliers, while $\beta$14 controls mass-covering versus mode-seeking behavior (Regli et al., 2018).

5. Superfamilies and further generalizations

One route to broader alpha-type generalization replaces arithmetic and geometric means by pairs of strictly comparable quasi-arithmetic means. For strictly increasing generators $\beta$15 with $\beta$16 strictly convex, the quasi-arithmetic $\beta$17-divergence is

$\beta$18

with limit cases

$\beta$19

These generalized $\beta$20- and $\beta$21-divergences decompose as generalized cross-entropies minus entropies and admit conformal Bregman representations through monotone embeddings (Nielsen, 2020). A plausible implication is that mean-comparison geometry supplies an alternative route to alpha-beta-type families without starting from power functions.

The $\beta$22-generated GAB framework broadens this program further. It contains AB divergence when $\beta$23, logarithmic AB/AC divergence when $\beta$24, and, through reparameterizations, power divergence, density power divergence, logarithmic density power divergence, S-divergence, logarithmic S-divergence, Gamma divergence, and $\beta$25-divergence (Roy et al., 7 Jul 2025). The characterization by strict increase and convexity of $\beta$26 provides a necessary and sufficient criterion for the validity of the generalized divergence away from the special line $\beta$27 (Roy et al., 7 Jul 2025).

Another branch extends AB divergence from non-negative scalars to real and complex vectors. For $\beta$28,

$\beta$29

where the angular term uses the Euclidean angle defined through the Hermitian inner product. This construction particularizes to $\beta$30 when $\beta$31, and its weighted form

$\beta$32

particularizes to Mahalanobis squared distance at $\beta$33 (Cruces, 5 Aug 2025). The associated right-sided centroid has the closed form

$\beta$34

which makes the roles of $\beta$35 and $\beta$36 explicit: $\beta$37 controls weighting and mean type, while $\beta$38 modulates the effect of angular dispersion (Cruces, 5 Aug 2025).

A separate symmetrization line constructs the Alpha-Beta-Symmetric divergence, a symmetric Hilbertian metric on $\beta$39 and on probability measures that recovers Euclidean, Hellinger, Jeffreys, and symmetrized Itakura–Saito-type cases and induces positive definite kernels for kernel methods (Ndaw et al., 2018).

6. Matrix, operator, and structured-distribution formulations

For symmetric positive definite matrices $\beta$40, the Alpha–Beta log-det divergence is

$\beta$41

equivalently

$\beta$42

where $\beta$43 are the eigenvalues of $\beta$44 (Cichocki et al., 2014). This family contains, through parameter choices and limits, Stein’s loss, S-divergence/Jensen-Bregman LogDet divergence, Logdet Zero (Bhattacharyya) divergence, and the affine invariant Riemannian metric, with $\beta$45 yielding

$\beta$46

and therefore the squared AIRM (Cichocki et al., 2014).

The same log-det idea extends to positive definite unitized trace class operators on a Hilbert space. The resulting infinite-dimensional Alpha-Beta Log-Det divergences generalize finite-dimensional Alpha-Beta Log-Det divergences, include the infinite-dimensional affine-invariant Riemannian distance and the infinite-dimensional Alpha Log-Det divergences as special cases, and admit closed-form formulas via Gram matrices for covariance operators on an RKHS (Quang, 2016).

For high-dimensional discrete distributions, alpha-beta divergence can be computed exactly when the distributions are represented as decomposable models, i.e. chordal Markov networks. Exact computation of the joint divergence is tractable in time exponential in the treewidth of the computation graph, and this framework extends to exact marginal and conditional alpha-beta divergence by decomposing marginals through $\beta$47-partitions and conditionals through quotient constructions on chordal graphs (Lee et al., 2021, Lee et al., 2023). Applications in the literature include pixelwise analysis of distributional changes in QMNIST and a divergence-based quantification of error behavior in superconducting quantum computers (Lee et al., 2023).

Across these formulations, the recurrent theme is unchanged: generalized alpha-beta divergence is a parameterized bridge between Bregman-type, $\beta$48-divergence-type, log-det, and power-divergence geometries. What varies is the underlying domain—nonnegative scalars, probability measures, complex vectors, SPD matrices, operators, or graphical models—and the structural object from which the divergence is generated: a Tweedie variance function, a power-law AB kernel, a scale-invariant log-integral functional, a quasi-arithmetic mean pair, or a general $\beta$49-transform.