Assess optimality of the Lipschitz regularity assumption (H4)
Determine whether the uniform Lipschitz continuity assumption on the activation function (H4) is optimal (in the Gaussian case) for establishing the functional large deviation principle for the covariance process, or whether weaker growth/regularity conditions suffice to obtain the LDP in the infinite-dimensional setting.
References
We expect that stronger growth conditions on \sigma are necessary to obtain an LDP, although we cannot yet determine whether~\ref{H4} is optimal (in the Gaussian case).
                — LDP for the covariance process in fully connected neural networks
                
                (2505.08062 - Andreis et al., 12 May 2025) in Section 3.4 (Literature review and comparison)