Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
194 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

On best approximation by multivariate ridge functions with applications to generalized translation networks (2412.08453v3)

Published 11 Dec 2024 in math.FA, cs.LG, and stat.ML

Abstract: In this paper, we prove sharp upper and lower bounds for the approximation of Sobolev functions by sums of multivariate ridge functions, i.e., for approximation by functions of the form $\mathbb{R}d \ni x \mapsto \sum_{k=1}n \varrho_k(A_k x) \in \mathbb{R}$ with $\varrho_k : \mathbb{R}\ell \to \mathbb{R}$ and $A_k \in \mathbb{R}{\ell \times d}$. We show that the order of approximation asymptotically behaves as $n{-r/(d-\ell)}$, where $r$ is the regularity (order of differentiability) of the Sobolev functions to be approximated. Our lower bound even holds when approximating $L\infty$-Sobolev functions of regularity $r$ with error measured in $L1$, while our upper bound applies to the approximation of $Lp$-Sobolev functions in $Lp$ for any $1 \leq p \leq \infty$. These bounds generalize well-known results regarding the approximation properties of univariate ridge functions to the multivariate case. We use our results to obtain sharp asymptotic bounds for the approximation of Sobolev functions using generalized translation networks and complex-valued neural networks.

Summary

We haven't generated a summary for this paper yet.