Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
112 tokens/sec
GPT-4o
8 tokens/sec
Gemini 2.5 Pro Pro
47 tokens/sec
o3 Pro
5 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Shifted Composition I: Harnack and Reverse Transport Inequalities (2311.14520v1)

Published 24 Nov 2023 in math.PR, cs.IT, math.AP, math.FA, and math.IT

Abstract: We formulate a new information-theoretic principle--the shifted composition rule--which bounds the divergence (e.g., Kullback-Leibler or R\'enyi) between the laws of two stochastic processes via the introduction of auxiliary shifts. In this paper, we apply this principle to prove reverse transport inequalities for diffusions which, by duality, imply F.-Y. Wang's celebrated dimension-free Harnack inequalities. Our approach bridges continuous-time coupling methods from geometric analysis with the discrete-time shifted divergence technique from differential privacy and sampling. It also naturally gives rise to (1) an alternative continuous-time coupling method based on optimal transport, which bypasses Girsanov transformations, (2) functional inequalities for discrete-time processes, and (3) a family of "reverse" Harnack inequalities.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (70)
  1. “Short time asymptotics of a certain infinite dimensional diffusion process” In Stochastic analysis and related topics, VII (Kusadasi, 1998) 48, Progr. Probab. Birkhäuser Boston, Boston, MA, 2001, pp. 77–124
  2. “On the small time asymptotics of diffusion processes on path groups” In Potential Anal. 16.1, 2002, pp. 67–78
  3. Jason M. Altschuler and Sinho Chewi “Faster high-accuracy log-concave sampling via algorithmic warm starts” In Symposium on Foundations of Computer Science, 2023
  4. Jason M. Altschuler and Kunal Talwar “Privacy of noisy stochastic gradient descent: more iterations without more privacy loss” In Advances in Neural Information Processing Systems, 2022
  5. Jason M. Altschuler and Kunal Talwar “Resolving the mixing time of the Langevin algorithm to its stationary distribution for log-concave sampling” In Conference on Learning Theory 195 PMLR, 2023, pp. 2509–2510
  6. Luigi Ambrosio, Nicola Gigli and Giuseppe Savaré “Gradient flows in metric spaces and in the space of probability measures”, Lectures in Mathematics ETH Zürich Birkhäuser Verlag, Basel, 2008, pp. x+334
  7. “Bilateral Harnack inequalities for stochastic differential equation with multiplicative noise” In J. Funct. Spaces, 2022, pp. Art. ID 5464688\bibrangessep11
  8. Marc Arnaudon, Anton Thalmaier and Feng-Yu Wang “Harnack inequality and heat kernel estimates on manifolds with curvature unbounded below” In Bull. Sci. Math. 130.3, 2006, pp. 223–233
  9. Marc Arnaudon, Anton Thalmaier and Feng-Yu Wang “Gradient estimates and Harnack inequalities on non-compact Riemannian manifolds” In Stochastic Process. Appl. 119.10, 2009, pp. 3653–3670
  10. Julio D. Backhoff-Veraguas and Gudmund Pammer “Applications of weak transport theory” In Bernoulli 28.1, 2022, pp. 370–394
  11. Dominique Bakry, Ivan Gentil and Michel Ledoux “Analysis and geometry of Markov diffusion operators” Springer, 2014
  12. Amir Beck “First-order methods in optimization” 25, MOS-SIAM Series on Optimization Society for IndustrialApplied Mathematics, Mathematical Optimization Society, 2017, pp. xii+475
  13. Sergey G. Bobkov, Ivan Gentil and Michel Ledoux “Hypercontractivity of Hamilton–Jacobi equations” In Journal de Mathématiques Pures et Appliquées 80.7, 2001, pp. 669–696
  14. Christer Borell “Diffusion equations and geometric inequalities” In Potential Anal. 12.1, 2000, pp. 49–71
  15. “Semi log-concave Markov diffusions” In Séminaire de Probabilités XLVI 2123, Lecture Notes in Math. Springer, Cham, 2014, pp. 231–292
  16. “Improved analysis for a proximal algorithm for sampling” In Conference on Learning Theory 178 PMLR, 2022, pp. 2984–3014
  17. “An entropic generalization of Caffarelli’s contraction theorem via covariance inequalities” In arXiv preprint 2203.04954, 2022
  18. Giuseppe Da Prato, Michael Röckner and Feng-Yu Wang “Singular stochastic equations on Hilbert spaces: Harnack inequalities for their transition semigroups” In J. Funct. Anal. 257.4, 2009, pp. 992–1017
  19. Hacène Djellout, Arnaud Guillin and Li Ming Wu “Transportation cost-information inequalities and applications to random dynamical systems and diffusions” In Ann. Probab. 32.3B, 2004, pp. 2702–2732
  20. Ronen Eldan and James R. Lee “Regularization under diffusion and anticoncentration of the information content” In Duke Math. J. 167.5, 2018, pp. 969–993
  21. Xiliang Fan “Stochastic Volterra equations driven by fractional Brownian motion” In Front. Math. China 10.3, 2015, pp. 595–620
  22. “Privacy amplification by iteration” In Symposium on Foundations of Computer Science, 2018, pp. 521–532 IEEE
  23. Hans Föllmer “An entropy approach to the time reversal of diffusion processes” In Stochastic differential systems (Marseille-Luminy, 1984) 69, Lect. Notes Control Inf. Sci. Springer, Berlin, 1985, pp. 156–163
  24. “Heat kernel estimates with application to compactness of manifolds” In Q. J. Math. 52.2, 2001, pp. 171–180
  25. “On Gromov’s theorem and L2superscript𝐿2L^{2}italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT-Hodge decomposition” In Int. J. Math. Math. Sci., 2004, pp. 25–44
  26. “Kantorovich duality for general transport costs and applications” In J. Funct. Anal. 273.11, 2017, pp. 3327–3405
  27. “Distribution dependent SDEs with singular coefficients” In Stochastic Process. Appl. 129.11, 2019, pp. 4747–4770
  28. “Log-Harnack inequality and Bismut formula for singular McKean–Vlasov SDEs” In arXiv preprint 2207.11536, 2022
  29. “Mild solutions and Harnack inequality for functional stochastic partial differential equations with Dini drift” In J. Theoret. Probab. 32.1, 2019, pp. 303–329
  30. Richard Jordan, David Kinderlehrer and Felix Otto “The variational formulation of the Fokker–Planck equation” In SIAM Journal on Mathematical Analysis 29.1 SIAM, 1998, pp. 1–17
  31. “Spectral monotonicity under Gaussian convolution” arXiv preprint arXiv:2107.09496, 2021
  32. Jean-François Le Gall “Brownian motion, martingales, and stochastic calculus” 274, Graduate Texts in Mathematics Springer, 2016, pp. 273
  33. Joseph Lehec “Representation formula for the entropy and functional inequalities” In Ann. Inst. Henri Poincaré Probab. Stat. 49.3, 2013, pp. 885–899
  34. “On the parabolic kernel of the Schrödinger operator” In Acta Math. 156.3-4, 1986, pp. 153–201
  35. Wei Liu “Harnack inequality and applications for stochastic evolution equations with monotone drifts” In J. Evol. Equ. 9.4, 2009, pp. 747–770
  36. “Harnack inequality and strong Feller property for stochastic fast-diffusion equations” In J. Math. Anal. Appl. 342.1, 2008, pp. 651–662
  37. “The Brownian transport map” In arXiv preprint 2111.11521, 2021
  38. Ilya Mironov “Rényi differential privacy” In Computer Security Foundations Symposium, 2017, pp. 263–275 IEEE
  39. Felix Otto “The geometry of dissipative evolution equations: the porous medium equation” In Comm. Partial Differential Equations 26.1-2, 2001, pp. 101–174
  40. Shun-Xiang Ouyang “Harnack inequalities and applications for multivalued stochastic evolution equations” In Infin. Dimens. Anal. Quantum Probab. Relat. Top. 14.2, 2011, pp. 261–278
  41. Shun-Xiang Ouyang, Michael Röckner and Feng-Yu Wang “Harnack inequalities and applications for Ornstein–Uhlenbeck semigroups with jump” In Potential Anal. 36.2, 2012, pp. 301–315
  42. R Tyrrell Rockafellar “Convex analysis” Princeton University Press, 1997
  43. Filippo Santambrogio “Optimal transport for applied mathematicians” Calculus of variations, PDEs, and modeling 87, Progress in Nonlinear Differential Equations and their Applications Birkhäuser/Springer, Cham, 2015, pp. xxvii+353
  44. Abdelhadi Es-Sarhir, Max-K. Renesse and Michael Scheutzow “Harnack inequality for functional SDEs with bounded memory” In Electron. Commun. Probab. 14, 2009, pp. 560–565
  45. Jinghai Shao “Harnack inequalities and heat kernel estimates for SDEs with singular drifts” In Bull. Sci. Math. 137.5, 2013, pp. 589–601
  46. Aad W. Vaart “Asymptotic statistics” 3, Cambridge Series in Statistical and Probabilistic Mathematics Cambridge University Press, Cambridge, 1998, pp. xvi+443
  47. Tim Van Erven and Peter Harremos “Rényi divergence and Kullback–Leibler divergence” In IEEE Transactions on Information Theory 60.7 IEEE, 2014, pp. 3797–3820
  48. “Rapid convergence of the unadjusted Langevin algorithm: isoperimetry suffices” In Advances in Neural Information Processing Systems 32, 2019, pp. 8092–8104
  49. Cédric Villani “Topics in optimal transportation” 58, Graduate Studies in Mathematics American Mathematical Society, Providence, RI, 2003, pp. xvi+370
  50. Cédric Villani “Optimal transport: old and new” 338, Grundlehren der Mathematischen Wissenschaften Springer-Verlag, Berlin, 2009, pp. 973
  51. Feng-Yu Wang “Logarithmic Sobolev inequalities on noncompact Riemannian manifolds” In Probab. Theory Related Fields 109.3, 1997, pp. 417–424
  52. Feng-Yu Wang “Harnack inequalities for log-Sobolev functions and estimates of log-Sobolev constants” In Ann. Probab. 27.2, 1999, pp. 653–663
  53. Feng-Yu Wang “Logarithmic Sobolev inequalities: conditions and counterexamples” In J. Operator Theory 46.1, 2001, pp. 183–197
  54. Feng-Yu Wang “Functional inequalities and spectrum estimates: the infinite measure case” In J. Funct. Anal. 194.2, 2002, pp. 288–310
  55. Feng-Yu Wang “Dimension-free Harnack inequality and its applications” In Front. Math. China 1.1, 2006, pp. 53–72
  56. Feng-Yu Wang “Harnack inequality and applications for stochastic generalized porous media equations” In Ann. Probab. 35.4, 2007, pp. 1333–1350
  57. Feng-Yu Wang “Harnack inequalities on manifolds with boundary and applications” In J. Math. Pures Appl. (9) 94.3, 2010, pp. 304–321
  58. Feng-Yu Wang “Coupling for Ornstein–Uhlenbeck processes with jumps” In Bernoulli 17.4, 2011, pp. 1136–1158
  59. Feng-Yu Wang “Harnack inequality for SDE with multiplicative noise and extension to Neumann semigroup on nonconvex manifolds” In Ann. Probab. 39.4, 2011, pp. 1449–1467
  60. Feng-Yu Wang “Coupling and applications” In Stochastic analysis and applications to finance 13, Interdiscip. Math. Sci. World Sci. Publ., Hackensack, NJ, 2012, pp. 411–424
  61. Feng-Yu Wang “Harnack inequalities for stochastic partial differential equations”, SpringerBriefs in Mathematics Springer, New York, 2013, pp. x+125
  62. Feng-Yu Wang “Analysis for diffusion processes on Riemannian manifolds” 18, Advanced Series on Statistical Science & Applied Probability World Scientific Publishing Co. Pte. Ltd., Hackensack, NJ, 2014, pp. xii+379
  63. Feng-Yu Wang “Integration by parts formula and shift Harnack inequality for stochastic equations” In Ann. Probab. 42.3, 2014, pp. 994–1019
  64. Feng-Yu Wang “Hypercontractivity and applications for stochastic Hamiltonian systems” In J. Funct. Anal. 272.12, 2017, pp. 5360–5383
  65. Feng-Yu Wang “Distribution dependent SDEs for Landau type equations” In Stochastic Process. Appl. 128.2, 2018, pp. 595–621
  66. “Harnack inequalities for functional SDEs with multiplicative noise and applications” In Stochastic Process. Appl. 121.11, 2011, pp. 2692–2710
  67. “Derivative formula and applications for degenerate diffusion semigroups” In J. Math. Pures Appl. (9) 99.6, 2013, pp. 726–740
  68. “Harnack inequalities for SDEs driven by cylindrical α𝛼\alphaitalic_α-stable processes” In Potential Anal. 42.3, 2015, pp. 657–669
  69. “A Zvonkin’s transformation for stochastic differential equations with singular drift and applications” In J. Differential Equations 297, 2021, pp. 277–319
  70. Tusheng Zhang “White noise driven SPDEs with reflection: strong Feller properties and Harnack inequalities” In Potential Anal. 33.2, 2010, pp. 137–151
Citations (2)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now