---
title: Symmetric Uniform Quantization Overview
url: https://www.emergentmind.com/topics/symmetric-uniform-quantization
type: topic
---

# Symmetric Uniform Quantization Overview

Symmetric uniform quantization denotes a family of quantization schemes in which reconstruction levels or decision regions are arranged with a uniform spacing rule and a symmetry constraint. In the literature, this phrase covers several closely related but nonidentical constructions: zero-centered signed scalar quantizers with no zero-point for neural-network weights and activations; optimal quadratic quantizers for uniform measures supported on symmetric geometric sets; randomized or dithered quantizers whose error is uniform over a symmetric set; and periodic quantizers on angular domains. Across these settings, the common structural theme is that symmetry is imposed either on the quantizer grid, on the support of the source distribution, or on the error law itself [2105.01868, 2104.00210, 2305.06788].

## 1. Formal scope and core meanings

A general quadratic quantization problem starts from a Borel probability measure \(P\) on \(\mathbb R^d\) and the distortion functional
\[
V_n:=V_n(P)=\inf \Big\{\int \min_{a\in\alpha} \|x-a\|^2 dP(x) : \alpha \subset \mathbb R^d,\ \operatorname{card}(\alpha) \leq n \Big\}.
\]
A minimizer is an optimal set of \(n\)-means, and its geometry is governed by Voronoi regions and the centroid condition
\[
a=E(X\mid X\in M(a\mid \alpha)).
\]
This formulation underlies the studies of uniform distributions on an equilateral triangle, on symmetric curves, on polygonal boundaries, and on the stretched Sierpiński triangle [1508.00498, 1809.08364, 1902.03887, 1605.09701].

In neural-network quantization, “symmetric” usually means that the quantizer is zero-centered, signed, and uses no zero-point. Q-Rater explicitly assumes “layer-wise and symmetric quantization structure for both weights and activations,” with clipping interval \([-Th_c,Th_c]\) and scale \(s=Th_c/(2^{q-1}-1)\) [2105.01868]. LG-LSQ is explicitly a linear symmetric uniform quantizer with learned positive scale \(a\), while UniQ defines a strict symmetric weight quantizer whose levels are centered around zero through an offset \(\alpha=\Delta(N-1)/2\) [2202.09009, 2104.00210]. By contrast, SYQ uses symmetric binary or ternary weight codebooks with learned subgroup scales, but for weights it is not ordinary multi-level uniform quantization in the usual equal-step sense [1807.00301].

The phrase “uniform” also changes meaning across domains. On a line segment or circle it refers to normalized length or arc-length measure; on the equilateral triangle it refers to constant area density; on self-similar fractals it refers to equal mass across congruent similarity branches; in randomized vector quantization it can mean that the error is uniform over a prescribed set such as a ball; and in TurboAngle it refers to equal-width angular bins on \([0,2\pi)\) [1809.08364, 1508.00498, 1605.09701, 2402.03030, 2603.27467].

| Domain | Meaning of symmetry | Meaning of uniformity |
|---|---|---|
| DNN weight/activation quantization | Zero-centered signed grid, usually no zero-point | Equal step size in value space |
| Geometric optimal quantization | Symmetry of support and Voronoi structure | Uniform source measure on support |
| Dithered/vector quantization | Symmetric support of error law | Constant density over a target set |
| Angular quantization | Rotational or periodic symmetry | Equal angular bin width |

## 2. Canonical quantizer forms

In LG-LSQ, the \(k\)-bit quantizer is given by
\[
x_i^q=\mathrm{quantize}_k(x_i^l,a)=\mathrm{clamp}\!\left(\mathrm{round}\!\left(\frac{x_i^l}{a}\right),Q_{\min},Q_{\max}\right),
\qquad
\hat{x}_i=x_i^q\cdot a.
\]
For ReLU activations, the paper states that activations are clamped to \([0,2^{bit}-1]\), so that
\[
x_i^q\in \{0,1,\ldots,2^b-1\},\qquad \hat{x}_i\in \{0,a,2a,\ldots,(2^b-1)a\}.
\]
Because code \(0\) is present, zero is represented exactly. The paper further states that the quantizer is inferably mid-tread because it uses rounding to the nearest integer and includes an exact zero reconstruction level [2202.09009].

Q-Rater keeps the symmetric uniform grid fixed and changes clipping and rounding. It clips weights as
\[
w_c=\max(\min(w,Th_c),-Th_c),
\]
defines
\[
s=\frac{Th_c}{2^{q-1}-1},
\]
and uses the conventional rounding-to-nearest baseline
\[
w_r=\left\lfloor \frac{w_c}{s}+0.5\right\rfloor.
\]
Its 1st-order and 2nd-order schemes modify only the rounding boundary, not the uniformly spaced output grid. The paper explicitly emphasizes that the formulation remains symmetric signed quantization for both weights and activations, with no affine offset or zero-point [2105.01868].

UniQ gives a different strict symmetric form for weights:
\[
Q_w(x)=\left\lfloor \operatorname{clip}_N\left(\frac{x+\alpha}{\Delta}\right)\right\rceil \Delta-\alpha,
\qquad
\alpha=\Delta\cdot \frac{N-1}{2},
\]
with
\[
\operatorname{clip}_N(x)=\min(\max(x,0),N-1).
\]
Its reconstruction levels are
\[
q_k=\left(k-\frac{N-1}{2}\right)\Delta,\qquad k=0,\dots,N-1,
\]
so they are uniformly spaced and exactly symmetric around zero. For even \(N\), the paper explicitly notes that zero is not a reconstruction level for weights. Activations instead use
\[
Q_a(x)=\left\lfloor \operatorname{clip}_N\left(\frac{x}{\Delta}\right)\right\rceil \Delta,
\]
which is uniform but nonnegative rather than symmetric [2104.00210].

SYQ clarifies a recurrent distinction. Its weight quantization is symmetric because every positive codebook value has a negative counterpart of equal magnitude, but for weights it is not standard uniform quantization over many evenly spaced levels. Binary weights use \(\{-\alpha,+\alpha\}\), ternary weights use \(\{-\alpha,0,+\alpha\}\), and learned positive scales are shared across structured subgroups [1807.00301].

## 3. Symmetry, Voronoi geometry, and optimal quantization of uniform measures

In the geometric literature, symmetric uniform quantization is studied through exact optimal \(n\)-means for highly symmetric supports. On a line segment \([a,b]\), the optimal set of \(n\)-means is
\[
\alpha_n=\left\{a+\frac{2i-1}{2n}(b-a):1\le i\le n\right\},
\]
with
\[
V_n=\frac{(a-b)^2}{12n^2}.
\]
This is the classical case where symmetry of the support and uniformity of the source coincide with equal-length Voronoi cells and equally spaced centroids [1809.08364].

On the unit circle, the optimal \(n\)-means remain uniformly spaced in angle, but the centroids lie on a smaller concentric circle:
\[
\alpha_n=
\left\{
\left(
\frac{n}{\pi}\sin\frac{\pi}{n}\cos\frac{(2j-1)\pi}{n},
\frac{n}{\pi}\sin\frac{\pi}{n}\sin\frac{(2j-1)\pi}{n}
\right): j=1,\dots,n
\right\},
\]
and
\[
V_n=1-\frac{n^2}{\pi^2}\sin^2\!\left(\frac{\pi}{n}\right).
\]
Uniformity is therefore intrinsic to arc length rather than Euclidean coordinate spacing [1809.08364].

For the uniform distribution on the equilateral triangle with vertices
\[
(0,0),\quad (1,0),\quad \left(\frac12,\frac{\sqrt3}{2}\right),
\]
the density is constant over the area, the mean is
\[
E(X)=\left(\frac12,\frac{\sqrt3}{6}\right),
\]
and
\[
V_1=\frac1{12}.
\]
The equilateral triangle has full dihedral symmetry \(D_3\), and the paper repeatedly exploits the three medians and three rotations by multiples of \(2\pi/3\). For \(n=2\), symmetry yields three equivalent optimal configurations along the medians; for \(n=3\), the optimal set forms a smaller equilateral triangle with sides parallel to the original; for \(n=4\), the numerically verified arrangement is reflection-symmetric, with three equivalent orientations [1508.00498].

The same structural role of symmetry appears on one-dimensional supports embedded in \(\mathbb R^2\). For the boundary of a regular hexagon, the support and law have full dihedral symmetry \(D_6\), and for \(n=6k\) the optimal codebook is built from one prototype side or corner configuration replicated six times. The paper gives, for example,
\[
E(X)=\left(\frac12,\frac{\sqrt3}{2}\right),\qquad V(X)=\frac56,
\]
and an optimal two-mean set
\[
\left\{\left(\frac12,\frac{\sqrt3}{2}\right),\left(-\frac12,\frac{\sqrt3}{2}\right)\right\},
\qquad
V_2=\frac{71}{144}=0.493056.
\]
For the semicircular boundary mixture, symmetry is only with respect to the vertical axis \(x_1=0\), so optimal codebooks are mirror-symmetric rather than fully rotationally symmetric. For the ellipse \(x_1^2+4x_2^2=4\), only the major and minor axes remain as reflection symmetries, and even and odd \(n\) exhibit different optimality patterns [1902.03887].

The stretched Sierpiński triangle gives a recursive self-similar counterpart. Its support is generated by three similarities of ratio \(1/3\), its measure assigns equal mass \(1/3\) to the three first-level pieces, and the mean is again
\[
E(X)=\left(\frac12,\frac{\sqrt3}{6}\right),
\qquad
V_1=\frac16.
\]
For \(n=3^\ell\), the unique optimal set is the set of centroids of all level-\(\ell\) basic triangles:
\[
\alpha_{3^\ell}=\{a(w):w\in I^\ell\},
\qquad
V_n=\frac{1}{6\cdot 9^\ell}.
\]
For intermediate \(n\), optimal sets are obtained by replacing selected level-\(\ell\) centroids by scaled copies of optimal 2-point or 3-point local codebooks. The quantization dimension exists and equals \(1\), but the \(1\)-dimensional quantization coefficient does not exist [1605.09701].

These examples show a consistent pattern. Symmetry reduces the search space, but it does not force globally equal Euclidean spacing. Corner singularities, curvature, or self-similar refinement can preserve symmetry while producing nontrivial local structure [1508.00498, 1809.08364].

## 4. Randomized, dithered, and periodic variants

A second major interpretation of symmetric uniform quantization comes from randomized constructions. In universal quantization for neural compression, the central identity is
\[
\lfloor y-U\rceil + U \sim y+U',
\qquad U,U'\sim U([-0.5,0.5)),
\]
so additive uniform noise can be implemented at test time as randomized shifted-lattice quantization. This removes the train/test mismatch between differentiable additive-noise training and discrete inference. The underlying quantizer is uniform with equal-width bins, but for fixed dither realization it is not necessarily centered at zero; it is a randomly shifted uniform lattice [2006.09952].

The deep image compression literature studies the same unit-step rounding quantizer
\[
\tilde y_i=\lfloor y_i\rceil
\]
together with training-time approximations such as additive uniform noise,
\[
\tilde y_i=y_i+u_i,\qquad u_i\sim U\!\left[-\frac12,\frac12\right],
\]
and universal quantization,
\[
\tilde y_i=\lfloor y_i+u\rceil-u,\qquad u\sim U\!\left[-\frac12,\frac12\right].
\]
Here the operative test-time quantizer is the standard integer-lattice uniform quantizer, while symmetry appears through the centered interval \([-\tfrac12,\tfrac12]\) used for noise or dither [2303.00587].

Higher-dimensional generalizations make the error law itself uniform over a symmetric set. One construction introduces shift-periodic vector quantizers whose error is uniformly distributed over an arbitrary bounded measurable set \(A\), and in particular over the unit \(n\)-ball \(B_n\). With subtractive dithering, the error becomes exactly independent of the input and equal to the prescribed law \(\mathrm{Unif}(A)\) [2305.06788]. A closely related construction, rejection-sampled universal quantization, starts from subtractive dithered lattice quantization
\[
Q(\mathbf{x},\mathbf{v})=Q_{\mathcal P}(\mathbf{x}-\mathbf{v})+\mathbf{v},
\qquad
\mathbf{V}\sim \mathrm{Unif}(\mathcal P),
\]
and rejects proposals until the error lands in a target set \(\mathcal A\subseteq \mathcal P\). The accepted error then satisfies
\[
Q_{\mathcal A,\mathcal P}(\mathbf x,S)-\mathbf x\sim \mathrm{Unif}(\mathcal A).
\]
For \(\mathcal A=rB^n\), the error is uniform over a symmetric ball, and the paper gives
\[
\mathbb E\|Q(\mathbf X,S)-\mathbf X\|^2=\frac{nr^2}{n+2}.
\]
This is a randomized vector analogue of symmetric uniform quantization with a ball-shaped error law [2402.03030].

Blind-Adaptive Quantizers attack a different problem: source–quantizer mismatch. The paper keeps a bounded uniform quantizer over a symmetric interval \([-\lambda,\lambda]\), but inserts a preprocessing map
\[
x_{a,\lambda}[n]=\mathcal M_{a,\lambda}(x[n])=(a\,x[n]+\lambda)\ \mathrm{mod}\ 2\lambda-\lambda.
\]
The modulo-folded signal always lies in \([-\lambda,\lambda]\), and for sufficiently large amplification \(a\) the folded distribution approaches \(\mathcal U[-\lambda,\lambda]\) for Gaussian, exponential, and uniform source families. This does not redefine the quantizer; it improves the operating conditions of a bounded symmetric uniform quantizer [2409.04077].

TurboAngle extends the notion of uniform quantization to a periodic angular domain. After a random diagonal sign matrix and normalized Fast Walsh–Hadamard transform,
\[
y=HDx,
\]
each consecutive pair \((y_{2i},y_{2i+1})\) is converted to polar coordinates and the angle is quantized by
\[
k_i\leftarrow \Big\lfloor n\cdot \theta_i /(2\pi)\Big\rceil \bmod n,
\qquad
\hat{\theta}_i=\frac{2\pi k_i}{n}.
\]
The codebook is
\[
\mathcal C_\theta=\left\{\frac{2\pi k}{n}:k=0,\dots,n-1\right\},
\]
with equal angular width \(2\pi/n\). This is uniform and symmetric on a periodic circle rather than on a zero-centered real interval [2603.27467].

## 5. Neural, communication, and coding applications

In low-bit neural-network inference and training, symmetric uniform quantization is valued because it eliminates zero-point arithmetic and keeps the hardware interface simple. Q-Rater uses a plain symmetric signed layer-wise uniform quantizer and argues that low-bit post-training quantization should optimize clipping and rounding directly against task loss rather than rely on convex surrogates. The reported low-bit gains are large: for ResNet-18 on ImageNet at \(4/4\) bits, the MSE baseline gives \(32.16\%\) whereas Q-Rater with Bayesian optimization gives \(60.77\%\); for ResNet-32 on CIFAR-10 at \(3/3\) bits, the MSE baseline gives \(16.86\%\) and Q-Rater full gives \(79.69\%\) [2105.01868].

LG-LSQ addresses quantization-aware training. It introduces SSG for scale learning, ASR as a differentiable soft-round surrogate, and MDE for reducing the mismatch between full-precision and quantized values. The paper reports full-precision baseline accuracy in various 3-bit networks including ResNet18, ResNet34, and ResNet50, and less than \(1\%\) accuracy drop for \(4\)-bit weights and \(4\)-bit activations in lightweight models such as MobileNetV2 and ShuffleNetV2 [2202.09009].

UniQ shows that a strict symmetric quantizer can unify multi-bit quantization and 1-bit binarization. For ImageNet, the paper reports, for example, ResNet-34 accuracies of \(75.0\) at \(4/4\), \(74.2\) at \(3/3\), and \(72.1\) at \(2/2\), compared with LSQ values of \(74.1\), \(73.4\), and \(71.6\). It attributes the gains to the combined result of the symmetric quantizer and optimal initialization [2104.00210]. SYQ, in turn, keeps activations uniform and nonnegative but uses subgroup-wise learned symmetric binary or ternary weight codebooks. On ImageNet, it reports, for example, ResNet-50 accuracies of \(68.8/88.7\) for \(1w\)-\(4a\), \(70.9/90.2\) for \(2w\)-\(4a\), and \(72.3/90.9\) for \(2w\)-\(8a\) [1807.00301].

Deep image compression uses a standard unit-step uniform quantizer at test time, but the best training surrogate is architecture dependent. Across three architectures and two datasets, the combination using universal quantization for the entropy model and differentiable soft quantization for the decoder is reported as a comparatively good choice, with average BD-rate \(-5.69\%\) across the three architectures [2303.00587].

In federated learning, symmetric clipped uniform quantization is used for communication reduction. The clipping interval is explicitly \([-s,s]\), the number of levels is \(L=2^b\), and stochastic quantization adds noise from
\[
\left(-\frac{\Delta_L}{2},\frac{\Delta_L}{2}\right).
\]
The paper reports, for a model with 80,848 weights, about \(8\times\) communication saving for \(4\)-\(4\)-\(4\)-\(4\) bits, about \(15.53\times\) for \(4\)-\(2\)-\(2\)-\(4\), about \(15.98\times\) for \(2\)-\(2\)-\(2\)-\(2\), and about \(31.12\times\) for \(2\)-\(1\)-\(1\)-\(2\) [2405.13365].

In channel coding, uniform quantization is used as a hardware simplification inside low-resolution LDPC decoders. The proposed symmetric uniform quantizer is
\[
Q(y)=\operatorname{sgn}(y)\min\left(\lfloor |y|/2^r\rfloor+1,2^{w-1}\right).
\]
The paper reports that the uniformly quantized decoder causes only minor performance degradation within \(0.01\) dB compared to the non-uniform alternative, while reducing node-operation complexity approximately by half [2205.01503].

In information theory, uniform output quantization is studied through saturation and wrapping. For wrapping quantization with levels \(Y_i=(i-1)p\), the capacity-achieving input is an equiprobable \(N\)-point constellation
\[
u_i=(u_0+ip)\bmod Np,\qquad i=0,\dots,N-1.
\]
For arbitrarily many uniform quantization levels, the paper further shows that the gap between Ihara’s upper and lower bounds is only \(0.26\) bits [0901.2545].

## 6. Distinctions, misconceptions, and recurrent trade-offs

A central distinction is that symmetric does not mean the same thing as uniform. A quantizer can be symmetric without being ordinary equal-step multi-level quantization, as in SYQ’s symmetric binary and ternary weight codebooks [1807.00301]. Conversely, a quantizer can be uniform without being zero-centered, as in universal quantization with random dither or in activations quantized over a nonnegative range [2006.09952, 2104.00210].

Zero handling is another point of divergence. In LG-LSQ and Q-Rater, zero is represented exactly because the integer code \(0\) is included and the quantizer has no zero-point [2202.09009, 2105.01868]. UniQ explicitly notes the opposite for even-level weight quantization: strict symmetry around zero implies that zero is not itself a weight reconstruction level [2104.00210]. In the LDPC decoder setting, the exchanged message alphabet is symmetric in sign-magnitude form but has no zero output symbol at all [2205.01503]. The literature therefore does not support a single universal rule that “symmetric quantizers always include zero.”

Uniformity itself is domain dependent. On a line segment it means equal subintervals; on a circle it means equal arc-length sectors; on an equilateral triangle or polygonal boundary it means a uniform source measure whose optimal Voronoi cells are shaped by symmetry but also by corners and curvature; in vector quantization it can mean error uniform over a ball; in TurboAngle it means equal angular bins on a periodic manifold [1809.08364, 1508.00498, 2305.06788, 2603.27467]. It follows that “uniform” is not restricted to equal-width bins on the real line.

Several papers also identify a low-bit optimization tension. Q-Rater states that for low-bit post-training quantization, non-convex optimization is unavoidable, because task loss is non-convex and weight MSE correlates poorly with task loss [2105.01868]. Blind-Adaptive Quantizers identify a different mismatch: a bounded symmetric uniform quantizer performs best when the input distribution is close to uniform on its support, motivating modulo-based preprocessing [2409.04077]. The geometric papers show an analogous phenomenon in a non-neural setting: even under perfect support symmetry, corners or self-similar hierarchy can prevent globally uniform cell shapes and can even destroy the existence of the quantization coefficient, as in the stretched Sierpiński triangle [1605.09701].

Taken together, these results define symmetric uniform quantization not as a single formula but as a design principle. The principle is to exploit symmetry, regular spacing, or uniform source structure to simplify representation, hardware, or analysis, while accepting that exact implementation details vary sharply between scalar, vector, geometric, periodic, and neural settings.

Source: https://www.emergentmind.com/topics/symmetric-uniform-quantization