Dice Question Streamline Icon: https://streamlinehq.com

Estimating opt_C(f) with a bounded prover in PAC‑verification

Determine whether a verifier, interacting with a computationally bounded prover, can estimate opt_C(f)=min_{c∈C}dist(f,c) for expressive hypothesis classes C within the PAC‑verification framework, thereby enabling verification of near‑optimal hypotheses without relying on unbounded provers.

Information Square Streamline Icon: https://streamlinehq.com

Background

In realizable learning, a verifier can estimate hypothesis error directly from random examples, but agnostic settings require comparing against the unknown best‑in‑class error opt_C(f).

The paper points out that, for reasonably powerful classes, it is unclear how to estimate opt_C(f) with only a bounded prover, highlighting a central obstacle in designing doubly efficient PAC‑verification protocols.

References

On the other hand, estimating the closeness of the purported hypothesis with respect to the best approximation of $f$ with respect to reasonably powerful $\mathcal{H}$ is quite challenging, since it is unclear how to estimate $\mathsf{opt}_\mathcal{H}(f)$ using a prover with bounded computational power.

On the Power of Interactive Proofs for Learning (2404.08158 - Gur et al., 11 Apr 2024) in Interactive Proofs for Agnostic Learning (Section 2.2), remarks after Definition of PAC‑verification