Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
126 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

The complexity of computing in continuous time: space complexity is precision (2403.02499v1)

Published 4 Mar 2024 in cs.CC

Abstract: Models of computations over the integers are equivalent from a computability and complexity theory point of view by the Church-Turing thesis. It is not possible to unify discrete-time models over the reals. The situation is unclear but simpler for continuous-time models, as there is a unifying mathematical model provided by ordinary differential equations (ODEs). For example, the GPAC model of Shannon is known to correspond to polynomial ODEs. However, the question of a robust complexity theory for such models and its relations to classical (discrete) computation theory is an old problem. There was some recent significant progress: it has been proved that (classical) time complexity corresponds to the length of the involved curves. The question of whether there is a simple and robust way to measure space complexity remains. We argue that space complexity corresponds to precision and conversely. We propose and prove an algebraic characterisation of FPSPACE, using continuous ODEs. Recent papers proposed algebraic characterisations of polynomial-time and -space complexity classes over the reals, but with a discrete-time: those algebras rely on discrete ODE schemes. Here, we use classical (continuous) ODEs, with the classic definition of derivation and hence with the more natural context of continuous-time associated with ODEs. We characterise both the case of polynomial space functions over the integers and the reals. We prove that Turing machines, with a proper representation of real numbers, can be simulated by continuous ODEs and not just discrete ODEs. A major consequence is that the associated space complexity is provably related to the numerical stability of involved schemas and the associated required precision. We obtain that a problem can be solved in polynomial space if and only if it can be simulated by some numerically stable ODE, using a polynomial precision.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (62)
  1. Oliver Aberth. The failure in computable analysis of a classical existence theorem for differential equations. Proceedings of the American Mathematical Society, 30:151–156, 1971.
  2. Training Fully Connected Neural Networks is ∃ℝℝ\exists\mathbb{R}∃ blackboard_R-Complete. Preprint, https://doi. org/10.48550/arXiv, 2204, 2022.
  3. A characterization of polynomial time computable functions from the integers to the reals using discrete ordinary differential equations. In Jérôme Durand-Lose and György Vaszil, editors, Machines, Computations, and Universality - 9th International Conference, MCU 2022, Debrecen, Hungary, August 31 - September 2, 2022, Proceedings, volume 13419 of Lecture Notes in Computer Science, pages 58–74. Springer, 2022. MCU’22 Best Student Paper Award. doi:10.1007/978-3-031-13502-6_4.
  4. A characterisation of functions computable in polynomial time and space over the reals with discrete ordinary differential equations: Simulation of turing machines with analytic discrete odes (MFCS’2023 best paper award). In 48th International Symposium on Mathematical Foundations of Computer Science (MFCS 2023), volume 272. Schloss Dagstuhl-Leibniz-Zentrum für Informatik, 2023.
  5. Simulation of turing machines with analytic discrete ODEs: FPTIME and FPSPACE over the reals characterised with discrete ordinary differential equations. arXiv preprint arXiv:2307.11747, 2023.
  6. Quantifiying the robustness of dynamical systems. relating time and space to length and precision. In Computer Science Logic CSL’24, Naples, Italy, February 2024.
  7. Complexity and Real Computation. Springer, 1998.
  8. On a theory of computation and complexity over the real numbers; NP completeness, recursive functions and universal machines. Bulletin of the American Mathematical Society, 21(1):1–46, July 1989.
  9. Recursion schemes, discrete differential equations and characterization of polynomial time computation. In Peter Rossmanith, Pinar Heggernes, and Joost-Pieter Katoen, editors, 44th Int Symposium on Mathematical Foundations of Computer Science, MFCS, volume 138 of LIPIcs, pages 23:1–23:14. Schloss Dagstuhl - Leibniz-Zentrum für Informatik, 2019.
  10. A characterization of functions over the integers computable in polynomial time using discrete ordinary differential equations. Computational Complexity, 32(2):7, 2023.
  11. A continuous characterization of PSPACE using polynomial ordinary differential equations. Journal of Complexity, 77:101755, august 2023. URL: https://www.sciencedirect.com/science/article/pii/S0885064X23000249?dgcid)=author.
  12. On the Functions Generated by the General Purpose Analog Computer. Information and Computation, 257:34–57, 2017. arXiv:1602.00546, doi:10.1016/j.ic.2017.09.015.
  13. Computing with polynomial ordinary differential equations. Journal of Complexity, 36:106 – 140, 2016. URL: http://www.sciencedirect.com/science/article/pii/S0885064X16300255, doi:http://dx.doi.org/10.1016/j.jco.2016.05.002.
  14. On the complexity of solving initial value problems. In Proceedings of the 37th International Symposium on Symbolic and Algebraic Computation, pages 115–121, 2012.
  15. Polynomial Time corresponds to Solutions of Polynomial Ordinary Differential Equations of Polynomial Length. The General Purpose Analog Computer and Computable Analysis are two efficiently equivalent models of computations (ICALP’2017 Track B best paper award). In 43rd International Colloquium on Automata, Languages, and Programming, ICALP 2016, July 11-15, 2016, Rome, Italy, volume 55 of LIPIcs, pages 109:1–109:15. Schloss Dagstuhl - Leibniz-Zentrum fuer Informatik, 2016.
  16. Polynomial Time corresponds to Solutions of Polynomial Ordinary Differential Equations of Polynomial Length. Journal of the ACM, 64(6):38:1–38:76, 2017. doi:10.1145/3127496.
  17. A universal ordinary differential equation. In International Colloquium on Automata Language Programming, ICALP’2017, 2017.
  18. A survey on analog models of computation. In Handbook of Computability and Complexity in Analysis, pages 173–226. Springer, 2021.
  19. M. S. Branicky. Universal computation and other capabilities of hybrid and continuous dynamical systems. Theoretical Computer Science, 138(1):67–100, 6 February 1995.
  20. A tutorial on computable analysis. In New computational paradigms, pages 425–491. Springer, 2008.
  21. Mark Braverman. Hyperbolic Julia sets are poly-time computable. Electronic Notes in Theoretical Computer Science, 120:17–30, 2005.
  22. Iteration, inequalities, and differentiability in analog computers. Journal of Complexity, 16(4):642–660, 2000.
  23. Neural ordinary differential equations. In Advances in Neural Information Processing Systems, pages 6571–6583, 2018.
  24. P. Clote. Computational models and function algebras. In Edward R. Griffor, editor, Handbook of Computability Theory, pages 589–681. North-Holland, Amsterdam, 1998.
  25. Boolean functions and computation models. Springer Science & Business Media, 2013.
  26. Alan Cobham. The intrinsic computational difficulty of functions. In Y. Bar-Hillel, editor, Proceedings of the International Conference on Logic, Methodology, and Philosophy of Science, pages 24–30. North-Holland, Amsterdam, 1962.
  27. Effective computability of solutions of ordinary differential equations the thousand monkeys approach. Electronic Notes in Theoretical Computer Science, 221:103–114, 2008.
  28. Effective Computability of Solutions of Differential Inclusions The Ten Thousand Monkeys Approach. Journal of Universal Computer Science, 15(6):1162–1185, 2009.
  29. J.-P. Demailly. Analyse Numérique et Équations Différentielles. Presses Universitaires de Grenoble, 1996.
  30. R. L. Devaney. An Introduction to Chaotic Dynamical Systems. Addison-Wesley, 2nd edition, 1989.
  31. On the complexity of Nash equilibria and other fixed points. SIAM Journal on Computing, 39(6):2531–2597, 2010.
  32. Strong turing completeness of continuous chemical reaction networks and compilation of mixed analog-digital programs. In Computational Methods in Systems Biology-CMSB 2017, 2017. CMSB’2017 Best Paper Award.
  33. Riccardo Gozzi. Analog Characterization of Complexity Classes. PhD thesis, Instituto Superior Técnico, Lisbon, Portugal and University of Algarve, Faro, Portugal, 2022.
  34. Daniel S. Graça. Computability with Polynomial Differential Equations. PhD thesis, Instituto Superior Técnico, 2007.
  35. Robust simulations of Turing machines with analytic maps and flows. In B. Cooper, B. Loewe, and L. Torenvliet, editors, Proceedings of CiE’05, New Computational Paradigms, volume 3526 of Lecture Notes in Computer Science, pages 169–179. Springer-Verlag, 2005.
  36. Analog computers and recursive functions over the reals. 19(5):644–664, 2003.
  37. Computability, noncomputability and undecidability of maximal intervals of IVPs. Transactions of the American Mathematical Society, 2006. To appear.
  38. Handbook of Computability and Complexity in Analysis, chapter Computability of Differential Equations. Springer., 2018.
  39. Robust non-computability and stability of dynamical systems. arXiv preprint arXiv:2305.14448, 2023.
  40. Differential Equations, Dynamical Systems, and an Introduction to Chaos. Elsevier Academic Press, 2003.
  41. Akitoshi Kawamura. Lipschitz continuous ordinary differential equations are polynomial-space complete. In 2009 24th Annual IEEE Conference on Computational Complexity, pages 149–160. IEEE, 2009.
  42. Computational complexity of smooth differential equations. Logical Methods in Computer Science, 10, 2014.
  43. Parameterized complexity for uniform operators on multidimensional analytic functions and ode solving. In International Workshop on Logic, Language, Information, and Computation, pages 223–236. Springer, 2018.
  44. Patrick Kidger. On neural differential equations. arXiv preprint arXiv:2202.02435, 2022.
  45. Ker-I Ko. On the computational complexity of ordinary differential equations. Information and Control, 58(1-3):157–194, July/August/September 1983.
  46. Ker-I Ko. Complexity Theory of Real Functions. Progress in Theoretical Computer Science. Birkhaüser, Boston, 1991.
  47. E. N. Lorenz. Deterministic nonperiodic flow. Journal of the Atmospheric Science, 20:130–141, 1963.
  48. Webb Miller. Recursive function theory and numerical analysis. Journal of Computer and System Sciences, 4(5):465–472, October 1970.
  49. John Milnor. On the concept of attractor. Communications in Mathematical Physics, 99:177–195, 1985.
  50. Computational complexity of solving polynomial differential equations over unbounded domains. Theoretical Computer Science, 2016.
  51. A computable ordinary differential equation which possesses no computable solution. Annals of Mathematical Logic, 17:61–90, 1979.
  52. On the algorithmic descriptive complexity of attractors in topological dynamics. arXiv preprint arXiv:2311.15234, 2023.
  53. Keijo Ruohonen. An effective Cauchy-Peano existence theorem for unique solutions. International Journal of Foundations of Computer Science, 7(2):151–160, 1996.
  54. Claude E. Shannon. Mathematical theory of the differential analyser. Journal of Mathematics and Physics MIT, 20:337–354, 1941.
  55. Michael Sipser. Introduction to the Theory of Computation. PWS Publishing Company, 1997.
  56. Holger Thies. Uniform computational complexity of ordinary differential equations with applications to dynamical systems and exact real arithmetic. PhD thesis, University of Tokyo, Graduate School of Arts and Sciences, 2018.
  57. Warwick Tucker. A rigorous ODE solver and Smale’s 14th problem. Foundations of Computational Mathematics, 2:53–117, 2002.
  58. Alan Turing. On computable numbers, with an application to the Entscheidungsproblem. Proceedings of the London Mathematical Society, 42(2):230–265, 1936. Reprinted in Martin Davis. The Undecidable: Basic Papers on Undecidable Propositions, Unsolvable Problems and Computable Functions. Raven Press, 1965.
  59. Bernd Ulmann. Analog computing. Walter de Gruyter, 2013.
  60. Bernd Ulmann. Analog and hybrid computer programming. De Gruyter Oldenbourg, 2020.
  61. Veritasum. Future computers will be radically different (analog computing). Youtube video, 2022. URL: https://www.youtube.com/watch?v=GVsUOuSjvcg.
  62. Klaus Weihrauch. Computable Analysis: an Introduction. Springer, 2000.
Citations (1)

Summary

We haven't generated a summary for this paper yet.