Shifted Composition I: Harnack and Reverse Transport Inequalities (2311.14520v1)
Abstract: We formulate a new information-theoretic principle--the shifted composition rule--which bounds the divergence (e.g., Kullback-Leibler or R\'enyi) between the laws of two stochastic processes via the introduction of auxiliary shifts. In this paper, we apply this principle to prove reverse transport inequalities for diffusions which, by duality, imply F.-Y. Wang's celebrated dimension-free Harnack inequalities. Our approach bridges continuous-time coupling methods from geometric analysis with the discrete-time shifted divergence technique from differential privacy and sampling. It also naturally gives rise to (1) an alternative continuous-time coupling method based on optimal transport, which bypasses Girsanov transformations, (2) functional inequalities for discrete-time processes, and (3) a family of "reverse" Harnack inequalities.
- “Short time asymptotics of a certain infinite dimensional diffusion process” In Stochastic analysis and related topics, VII (Kusadasi, 1998) 48, Progr. Probab. Birkhäuser Boston, Boston, MA, 2001, pp. 77–124
- “On the small time asymptotics of diffusion processes on path groups” In Potential Anal. 16.1, 2002, pp. 67–78
- Jason M. Altschuler and Sinho Chewi “Faster high-accuracy log-concave sampling via algorithmic warm starts” In Symposium on Foundations of Computer Science, 2023
- Jason M. Altschuler and Kunal Talwar “Privacy of noisy stochastic gradient descent: more iterations without more privacy loss” In Advances in Neural Information Processing Systems, 2022
- Jason M. Altschuler and Kunal Talwar “Resolving the mixing time of the Langevin algorithm to its stationary distribution for log-concave sampling” In Conference on Learning Theory 195 PMLR, 2023, pp. 2509–2510
- Luigi Ambrosio, Nicola Gigli and Giuseppe Savaré “Gradient flows in metric spaces and in the space of probability measures”, Lectures in Mathematics ETH Zürich Birkhäuser Verlag, Basel, 2008, pp. x+334
- “Bilateral Harnack inequalities for stochastic differential equation with multiplicative noise” In J. Funct. Spaces, 2022, pp. Art. ID 5464688\bibrangessep11
- Marc Arnaudon, Anton Thalmaier and Feng-Yu Wang “Harnack inequality and heat kernel estimates on manifolds with curvature unbounded below” In Bull. Sci. Math. 130.3, 2006, pp. 223–233
- Marc Arnaudon, Anton Thalmaier and Feng-Yu Wang “Gradient estimates and Harnack inequalities on non-compact Riemannian manifolds” In Stochastic Process. Appl. 119.10, 2009, pp. 3653–3670
- Julio D. Backhoff-Veraguas and Gudmund Pammer “Applications of weak transport theory” In Bernoulli 28.1, 2022, pp. 370–394
- Dominique Bakry, Ivan Gentil and Michel Ledoux “Analysis and geometry of Markov diffusion operators” Springer, 2014
- Amir Beck “First-order methods in optimization” 25, MOS-SIAM Series on Optimization Society for IndustrialApplied Mathematics, Mathematical Optimization Society, 2017, pp. xii+475
- Sergey G. Bobkov, Ivan Gentil and Michel Ledoux “Hypercontractivity of Hamilton–Jacobi equations” In Journal de Mathématiques Pures et Appliquées 80.7, 2001, pp. 669–696
- Christer Borell “Diffusion equations and geometric inequalities” In Potential Anal. 12.1, 2000, pp. 49–71
- “Semi log-concave Markov diffusions” In Séminaire de Probabilités XLVI 2123, Lecture Notes in Math. Springer, Cham, 2014, pp. 231–292
- “Improved analysis for a proximal algorithm for sampling” In Conference on Learning Theory 178 PMLR, 2022, pp. 2984–3014
- “An entropic generalization of Caffarelli’s contraction theorem via covariance inequalities” In arXiv preprint 2203.04954, 2022
- Giuseppe Da Prato, Michael Röckner and Feng-Yu Wang “Singular stochastic equations on Hilbert spaces: Harnack inequalities for their transition semigroups” In J. Funct. Anal. 257.4, 2009, pp. 992–1017
- Hacène Djellout, Arnaud Guillin and Li Ming Wu “Transportation cost-information inequalities and applications to random dynamical systems and diffusions” In Ann. Probab. 32.3B, 2004, pp. 2702–2732
- Ronen Eldan and James R. Lee “Regularization under diffusion and anticoncentration of the information content” In Duke Math. J. 167.5, 2018, pp. 969–993
- Xiliang Fan “Stochastic Volterra equations driven by fractional Brownian motion” In Front. Math. China 10.3, 2015, pp. 595–620
- “Privacy amplification by iteration” In Symposium on Foundations of Computer Science, 2018, pp. 521–532 IEEE
- Hans Föllmer “An entropy approach to the time reversal of diffusion processes” In Stochastic differential systems (Marseille-Luminy, 1984) 69, Lect. Notes Control Inf. Sci. Springer, Berlin, 1985, pp. 156–163
- “Heat kernel estimates with application to compactness of manifolds” In Q. J. Math. 52.2, 2001, pp. 171–180
- “On Gromov’s theorem and L2superscript𝐿2L^{2}italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT-Hodge decomposition” In Int. J. Math. Math. Sci., 2004, pp. 25–44
- “Kantorovich duality for general transport costs and applications” In J. Funct. Anal. 273.11, 2017, pp. 3327–3405
- “Distribution dependent SDEs with singular coefficients” In Stochastic Process. Appl. 129.11, 2019, pp. 4747–4770
- “Log-Harnack inequality and Bismut formula for singular McKean–Vlasov SDEs” In arXiv preprint 2207.11536, 2022
- “Mild solutions and Harnack inequality for functional stochastic partial differential equations with Dini drift” In J. Theoret. Probab. 32.1, 2019, pp. 303–329
- Richard Jordan, David Kinderlehrer and Felix Otto “The variational formulation of the Fokker–Planck equation” In SIAM Journal on Mathematical Analysis 29.1 SIAM, 1998, pp. 1–17
- “Spectral monotonicity under Gaussian convolution” arXiv preprint arXiv:2107.09496, 2021
- Jean-François Le Gall “Brownian motion, martingales, and stochastic calculus” 274, Graduate Texts in Mathematics Springer, 2016, pp. 273
- Joseph Lehec “Representation formula for the entropy and functional inequalities” In Ann. Inst. Henri Poincaré Probab. Stat. 49.3, 2013, pp. 885–899
- “On the parabolic kernel of the Schrödinger operator” In Acta Math. 156.3-4, 1986, pp. 153–201
- Wei Liu “Harnack inequality and applications for stochastic evolution equations with monotone drifts” In J. Evol. Equ. 9.4, 2009, pp. 747–770
- “Harnack inequality and strong Feller property for stochastic fast-diffusion equations” In J. Math. Anal. Appl. 342.1, 2008, pp. 651–662
- “The Brownian transport map” In arXiv preprint 2111.11521, 2021
- Ilya Mironov “Rényi differential privacy” In Computer Security Foundations Symposium, 2017, pp. 263–275 IEEE
- Felix Otto “The geometry of dissipative evolution equations: the porous medium equation” In Comm. Partial Differential Equations 26.1-2, 2001, pp. 101–174
- Shun-Xiang Ouyang “Harnack inequalities and applications for multivalued stochastic evolution equations” In Infin. Dimens. Anal. Quantum Probab. Relat. Top. 14.2, 2011, pp. 261–278
- Shun-Xiang Ouyang, Michael Röckner and Feng-Yu Wang “Harnack inequalities and applications for Ornstein–Uhlenbeck semigroups with jump” In Potential Anal. 36.2, 2012, pp. 301–315
- R Tyrrell Rockafellar “Convex analysis” Princeton University Press, 1997
- Filippo Santambrogio “Optimal transport for applied mathematicians” Calculus of variations, PDEs, and modeling 87, Progress in Nonlinear Differential Equations and their Applications Birkhäuser/Springer, Cham, 2015, pp. xxvii+353
- Abdelhadi Es-Sarhir, Max-K. Renesse and Michael Scheutzow “Harnack inequality for functional SDEs with bounded memory” In Electron. Commun. Probab. 14, 2009, pp. 560–565
- Jinghai Shao “Harnack inequalities and heat kernel estimates for SDEs with singular drifts” In Bull. Sci. Math. 137.5, 2013, pp. 589–601
- Aad W. Vaart “Asymptotic statistics” 3, Cambridge Series in Statistical and Probabilistic Mathematics Cambridge University Press, Cambridge, 1998, pp. xvi+443
- Tim Van Erven and Peter Harremos “Rényi divergence and Kullback–Leibler divergence” In IEEE Transactions on Information Theory 60.7 IEEE, 2014, pp. 3797–3820
- “Rapid convergence of the unadjusted Langevin algorithm: isoperimetry suffices” In Advances in Neural Information Processing Systems 32, 2019, pp. 8092–8104
- Cédric Villani “Topics in optimal transportation” 58, Graduate Studies in Mathematics American Mathematical Society, Providence, RI, 2003, pp. xvi+370
- Cédric Villani “Optimal transport: old and new” 338, Grundlehren der Mathematischen Wissenschaften Springer-Verlag, Berlin, 2009, pp. 973
- Feng-Yu Wang “Logarithmic Sobolev inequalities on noncompact Riemannian manifolds” In Probab. Theory Related Fields 109.3, 1997, pp. 417–424
- Feng-Yu Wang “Harnack inequalities for log-Sobolev functions and estimates of log-Sobolev constants” In Ann. Probab. 27.2, 1999, pp. 653–663
- Feng-Yu Wang “Logarithmic Sobolev inequalities: conditions and counterexamples” In J. Operator Theory 46.1, 2001, pp. 183–197
- Feng-Yu Wang “Functional inequalities and spectrum estimates: the infinite measure case” In J. Funct. Anal. 194.2, 2002, pp. 288–310
- Feng-Yu Wang “Dimension-free Harnack inequality and its applications” In Front. Math. China 1.1, 2006, pp. 53–72
- Feng-Yu Wang “Harnack inequality and applications for stochastic generalized porous media equations” In Ann. Probab. 35.4, 2007, pp. 1333–1350
- Feng-Yu Wang “Harnack inequalities on manifolds with boundary and applications” In J. Math. Pures Appl. (9) 94.3, 2010, pp. 304–321
- Feng-Yu Wang “Coupling for Ornstein–Uhlenbeck processes with jumps” In Bernoulli 17.4, 2011, pp. 1136–1158
- Feng-Yu Wang “Harnack inequality for SDE with multiplicative noise and extension to Neumann semigroup on nonconvex manifolds” In Ann. Probab. 39.4, 2011, pp. 1449–1467
- Feng-Yu Wang “Coupling and applications” In Stochastic analysis and applications to finance 13, Interdiscip. Math. Sci. World Sci. Publ., Hackensack, NJ, 2012, pp. 411–424
- Feng-Yu Wang “Harnack inequalities for stochastic partial differential equations”, SpringerBriefs in Mathematics Springer, New York, 2013, pp. x+125
- Feng-Yu Wang “Analysis for diffusion processes on Riemannian manifolds” 18, Advanced Series on Statistical Science & Applied Probability World Scientific Publishing Co. Pte. Ltd., Hackensack, NJ, 2014, pp. xii+379
- Feng-Yu Wang “Integration by parts formula and shift Harnack inequality for stochastic equations” In Ann. Probab. 42.3, 2014, pp. 994–1019
- Feng-Yu Wang “Hypercontractivity and applications for stochastic Hamiltonian systems” In J. Funct. Anal. 272.12, 2017, pp. 5360–5383
- Feng-Yu Wang “Distribution dependent SDEs for Landau type equations” In Stochastic Process. Appl. 128.2, 2018, pp. 595–621
- “Harnack inequalities for functional SDEs with multiplicative noise and applications” In Stochastic Process. Appl. 121.11, 2011, pp. 2692–2710
- “Derivative formula and applications for degenerate diffusion semigroups” In J. Math. Pures Appl. (9) 99.6, 2013, pp. 726–740
- “Harnack inequalities for SDEs driven by cylindrical α𝛼\alphaitalic_α-stable processes” In Potential Anal. 42.3, 2015, pp. 657–669
- “A Zvonkin’s transformation for stochastic differential equations with singular drift and applications” In J. Differential Equations 297, 2021, pp. 277–319
- Tusheng Zhang “White noise driven SPDEs with reflection: strong Feller properties and Harnack inequalities” In Potential Anal. 33.2, 2010, pp. 137–151