Existence of a universal hard instance for basic Newton’s method exceeding 1/ε^2 iterations
Determine whether there exists a single smooth function f:R^n→R such that the basic Newton’s method with unit steps (solving ∇^2 f(x^k) s^k = −∇ f(x^k) and taking x^{k+1} = x^k + s^k) requires more than 1/ε^2 iterations to find an iterate x with ∥∇ f(x)∥ ≤ ε for arbitrary ε > 0.
Sponsor
References
Although this example is compelling, the construction of f depends on the choice of ε1; it is unclear whether there exists a function f for which the basic Newton's method above requires more than 1/ε{2} iterations for an arbitrary ε.
— Optimization in Theory and Practice
(2510.15734 - Wright, 17 Oct 2025) in Section 5, Unconstrained Optimization, Subsection "Newton’s Method"