Universal objective for all line-search parameters

Determine whether there exists a single smooth function bounded below on which every method in the conjugacy class \(\mathcal{C}\) fails to converge for all line-search parameter pairs \(0<c_1<c_2<1\) simultaneously.

Background

The paper constructs, for each prescribed pair of line-search parameters (c1,c2)(c_1,c_2) with 0<c1<c2<10<c_1<c_2<1, a parameter-specific function fC(R2)f\in C^\infty(\mathbb{R}^2) that is bounded below and has Lipschitz continuous gradient. On this function, every method in the conjugacy class C\mathcal{C}—including full-memory BFGS, L-BFGS, the Broyden positive family, and the Hestenes–Stiefel conjugate-gradient method—generates a nonconvergent sequence under the corresponding first-local-minimizer line search.

The unresolved issue is whether the dependence of the constructed objective on (c1,c2)(c_1,c_2) can be eliminated: namely, whether one universal smooth, lower-bounded objective can force nonconvergence for the entire parameter range simultaneously.

References

Whether there exists a single universal smooth function f bounded below on which Class~\mathcal C fails to converge for all 0<c_1<c_2<1 simultaneously remains an intriguing open question.

Counterexamples for BFGS-type methods under arbitrary strong Wolfe constants  (2609.09686 - Diao, 9 Sep 2026) in Section "Remarks", paragraph "Universal versus parameter-specific objective functions"