Logarithmic Source Representation
- Logarithmic Source Representation is a collection of methods that employ logarithmic transforms to encode objects and reveal properties like positivity and concavity in diverse mathematical settings.
- It underpins analytic series, integral and probabilistic representations, and log-domain quantization in neural networks to improve both theoretical insights and computational efficiency.
- The approach extends to operator theory, inverse problems, PDEs, and geometric frameworks, thereby facilitating robust representations in contexts from unbounded generators to defect fields.
“Logarithmic Source Representation” is not a single standardized construction. Across the cited literature, it denotes several distinct but structurally related practices in which a logarithm, a logarithmic loss, or a logarithmic transform is used to encode the object of interest: a scalar function, a source reconstruction, a neural-network tensor, an infinitesimal generator, a nonlocal operator, or a defect-local field (Bradley, 2012, Courtade et al., 2011, Miyashita et al., 2016, Iwata, 2020, Chen et al., 2017, Shimamori et al., 15 Oct 2025). In each case, the logarithmic layer reorganizes the underlying problem: it can expose positivity and concavity, convert residual uncertainty into an entropy, replace multiplication by shifts or exponent addition, regularize unbounded generators through bounded logarithms, or encode localized disorder through Jordan-block defect operators.
1. Analytic representations of the logarithm
A foundational usage is the direct representation of the logarithm itself. Bradley derives a globally convergent infinite series
equivalently
with convergence on the full natural domain rather than only on the local interval associated with the Taylor series for (Bradley, 2012). The derivation uses the sequence , whose limit is , and rewrites as a telescoping sum that becomes a sum of manifestly nonnegative squares. The same paper proves convergence by limit comparison with , obtaining the asymptotic term
and uses termwise positivity to make the inequality and the concavity of 0 transparent. Through Jensen’s inequality, that concavity yields the arithmetic–geometric mean inequality (Bradley, 2012).
A second analytic line uses integral representations. One exact identity is
1
extended in the paper to 2 (Merhav et al., 2019). This converts expectations of logarithms into Laplace-transform expressions, such as
3
and similarly for 4 when the 5 are positive i.i.d. The paper applies this to entropy, differential entropy, empirical entropy, universal compression redundancy, and ergodic capacity, and presents the method as a rigorous alternative to replica-style manipulations in some settings (Merhav et al., 2019).
A third line concerns divergent Mellin-type integrals with logarithmic singularities. For finite-part integrals of the form
6
the logarithmic factor is generated by parameter differentiation,
7
and the finite part admits exact contour-integral representations (Ylanan et al., 19 Feb 2026). For noninteger 8, the coefficients are expressed through Stirling numbers of the second kind; for integer 9, Bernoulli numbers appear after taking a regularized limit. This extends earlier contour representations of Hadamard finite parts to arbitrary logarithmic order 0 (Ylanan et al., 19 Feb 2026).
2. Probabilistic source representation under logarithmic loss
In information theory, “logarithmic source representation” acquires a precise operational meaning: the decoder does not reproduce a source symbol by a hard decision, but by a probability distribution over source symbols (Courtade et al., 2011). For finite alphabet 1, the reproduction alphabet is
2
and the per-letter distortion is
3
Under this loss, reconstruction is best understood as posterior representation. If the decoder outputs the posterior distribution induced by the received messages, then expected log loss equals conditional entropy (Courtade et al., 2011).
This identity is the central reason the multiterminal problem becomes exactly characterizable. In the two-encoder model, the achievable rate–distortion region is the set of 4 for which there exist auxiliaries 5 satisfying
6
7
8
and the paper proves this Berger–Tung-style region is exact (Courtade et al., 2011). The same phenomenon holds for the CEO problem under logarithmic loss, where the distortion becomes 9, and the paper extends the exact characterization to the 0-encoder CEO problem (Courtade et al., 2011).
This formulation makes “source representation” literal: the compressed description is evaluated by how well it supports a decoder-side posterior. The paper also links the framework to distributed approximation of the posterior 1, to list decoding, and to a relaxed Slepian–Wolf region in the special case 2, where the lossless bounds are shifted by the distortion level 3 (Courtade et al., 2011).
3. Log-domain data representations in neural computation
A different usage appears in low-precision neural computation. In “logarithmic data representation” for CNNs, a tensor value is stored through a quantized logarithm—typically base 4—so that reconstruction is a power of two and multiplication is replaced by bit-shifts or exponent addition (Miyashita et al., 2016). The paper is explicit that this is not a general-purpose source-coding theory, but a task-specific quantization and arithmetic scheme for CNN weights, activations, and gradients.
For inference, one variant encodes only one operand: 5 A second variant encodes both operands: 6 Zero is represented exactly, signs are carried separately when needed, and the paper defines an explicit elementwise quantizer 7 with clipping to a full-scale range (Miyashita et al., 2016).
The motivation is empirical and architectural. The paper argues that trained weights and ReLU activations are highly concentrated near zero, so uniform fixed-point quantization wastes representational density. In one reported activation-distribution experiment, the mean 8 quantization error was 9 for log quantization and 0 for linear quantization at the same bitwidth (Miyashita et al., 2016). The hardware consequence is that bulky digital multipliers can be eliminated.
The reported performance supports this interpretation. On ImageNet validation without retraining, VGG16 with log 3b activations achieved 1 top-5 accuracy, whereas linear 3b activations gave 2; log 4b activations reached 3, matching float32 (Miyashita et al., 2016). For convolutional weights, plain base-2 log quantization was fragile, but base-4 log 5b substantially improved performance: on VGG16 it gave 5, compared with 6 for base-2 log 5b and 7 for linear 5b (Miyashita et al., 2016). In end-to-end low-precision training on CIFAR10, the log-quantized network achieved 8, compared with 9 for linear-5b and 0 for BinaryNet (Miyashita et al., 2016).
4. Operator-theoretic representations and logarithmic source conditions
In operator theory, logarithmic representation is used to encode generally unbounded infinitesimal generators through bounded logarithmic objects. One formulation assumes an evolution family 1 on a Banach space, a dense subspace 2, and commutativity between 3 and 4. The generator is then represented by
5
with 6 as the bounded logarithmic representative (Iwata, 2017). The same paper shows that the logarithmic images can be organized into algebraic structures: 7 is a normed vector space, and 8 is a module over the Banach algebra 9 under the stated commutativity hypotheses (Iwata, 2017).
A related formulation introduces a weaker operator topology tailored to a single trajectory. In the locally-strong topology, 0 means 1 for one fixed 2, and the paper proves that this topology is weaker than the strong topology and not necessarily stronger than the weak topology (Iwata, 2020). Within that framework, the alternative infinitesimal generator
3
is bounded, and the possibly unbounded generator is recovered by
4
with 5 understood in the localized weak sense induced by locally-strong convergence (Iwata, 2020).
For unbounded evolution operators 6, the same program is extended by resolvent regularization. With
7
the paper replaces 8 by logarithms of bounded resolvent transforms. In its one-log version,
9
and the generator is represented as
0
under the stated resolvent assumptions (Iwata, 2021). The same paper also formulates a two-log representation using alternative infinitesimal generators 1 and 2 (Iwata, 2021).
In inverse problems, “logarithmic source representation” becomes a smoothness condition. For a bounded injective operator 3 with nonclosed range, the paper studies solutions satisfying
4
equivalently 5 with 6 (Plato, 5 Sep 2025). This is explicitly described as weaker than a Hölder-type source condition 7. For a broad class of regularization schemes,
8
and the resulting error rate has logarithmic order,
9
with both a priori and discrepancy-principle parameter choices analyzed (Plato, 5 Sep 2025). The paper also gives a concrete example for the integration operator 0, showing that a borderline-smooth function of the form 1, 2, belongs to 3 (Plato, 5 Sep 2025).
5. Nonlocal operators and variational source formulations
In PDE and nonlocal analysis, logarithmic source representation often means either an explicit singular-kernel formula for a logarithmic operator or a weak bilinear source formulation for the equation it defines. For the logarithmic Laplacian 4, the Fourier symbol is
5
and the real-space formula is
6
with 7 and 8 (Chen et al., 2017). The paper treats the source problem
9
through the weak identity
0
where 1 is the natural energy space. It emphasizes that no explicit Green kernel 2 is constructed; the available representation is variational and operator-theoretic rather than an explicit integral solution formula (Chen et al., 2017).
For the fractional logarithmic Schrödinger operator 3, the symbol is
4
and the physical-space representation is the principal-value singular integral
5
with
6
built from the stable heat kernel (Feulefack, 2023). The paper proves
7
for 8, and gives a whole-space Green representation
9
for the Poisson problem 00 in 01, together with asymptotics of 02 at zero and infinity (Feulefack, 2023).
On weighted graphs, the logarithmic Laplacian is defined spectrally as 03 and admits the Bochner formula
04
in 05 (Chen et al., 8 Jul 2025). Under stochastic completeness, the pointwise representation becomes
06
with
07
The paper interprets this as a short-time symmetric nonlocal interaction term, a long-time source term, and an onsite correction. On weighted lattice graphs, it proves 08 and shows that 09 is not bounded on 10 (Chen et al., 8 Jul 2025).
For Schrödinger operators with potential, 11, the logarithmic operator is defined spectrally and also through the Frullani-type semigroup formula
12
in 13 (Betancor et al., 1 Apr 2026). When 14, 15, the pointwise representation is
16
where the nonconstant correction 17 reflects the non-Markovian fact that 18 (Betancor et al., 1 Apr 2026). The associated evolution problem
19
is solved by
20
for the stated data class (Betancor et al., 1 Apr 2026).
6. Defect, tensorial, and geometric extensions
A further extension arises from subdimensional disorder. The UV deformation
21
introduces a random coupling supported only on a 22-dimensional subspace, with Gaussian disorder
23
(Shimamori et al., 15 Oct 2025). The paper proposes that the disorder-averaged IR theory is a conformal defect in which bulk operators remain in ordinary conformal representations, while defect-local operators assemble into logarithmic multiplets. A rank-24 defect multiplet is characterized by a Jordan block for the defect dilatation operator, and for rank 25 the finite transformation law is
26
(Shimamori et al., 15 Oct 2025).
The defect two-point functions are then logarithmic polynomials over power laws. For rank 27,
28
and bulk–defect correlators involve powers of
29
(Shimamori et al., 15 Oct 2025). In the free scalar with random pinning, the defect restriction 30 and the source field 31 form a rank-32 logarithmic pair, and the replica analysis yields a half-line of fixed points
33
in codimension two (Shimamori et al., 15 Oct 2025). This is a direct instance in which the localized source itself becomes the logarithmic partner of a defect operator.
In continuum mechanics, logarithmic representation appears in a tensorial rather than defect-theoretic form. For the Hencky strain
34
the logarithmic spin tensor is represented by
35
where 36 is the commutator operator (Bathory et al., 22 Apr 2025). This replaces the classical eigenprojection formula by a commutator-based functional calculus. The paper emphasizes that if 37 and 38 commute, then 39 and 40 (Bathory et al., 22 Apr 2025).
A geometric variant appears in the representation of logarithmic connections by Fuchsian equations. A logarithmic connection on a rank-41 bundle over 42 with parabolic points 43 can be represented by a scalar Fuchsian equation of order 44 whose prescribed singularities are the 45 and whose additional singularities are apparent (Ivanics, 2019). In rank 46, this gives a third-order equation and
47
apparent singularities, with coordinates 48 on a dense open subset of the moduli space (Ivanics, 2019). In this setting, “representation” means preservation of the monodromy representation up to conjugation, and logarithmic singularities of the connection are encoded as regular singular points of the scalar equation (Ivanics, 2019).
Taken together, these constructions show that “Logarithmic Source Representation” functions as a cross-disciplinary label for methods that move a problem into a logarithmic layer where structure becomes explicit: positivity for 49, posterior uncertainty under log loss, shift-based arithmetic in CNNs, bounded representatives of unbounded generators, singular-kernel source terms in nonlocal operators, or localized Jordan-block degrees of freedom on defects (Bradley, 2012, Courtade et al., 2011, Miyashita et al., 2016, Iwata, 2020, Chen et al., 2017, Shimamori et al., 15 Oct 2025).