Extend query-to-sample reductions to adaptive query algorithms
Establish whether the query-to-sample reduction framework for PAC-verification of agnostic learning can be extended to settings where the verifier’s query construction is adaptive, including adaptivity that may depend on interaction with the prover; characterize the necessary conditions (e.g., embeddability and marginal distributions) under which such adaptive reductions are possible and sound.
References
Moreover, we use non-adaptivity to embed the random example in the query set, and we leave the study of extending this framework to handle adaptive queries, which may or may not depend on the interaction with the prover, as an interesting direction for future work.
— On the Power of Interactive Proofs for Learning
(2404.08158 - Gur et al., 11 Apr 2024) in Technical Overview, Proof Outline of Theorem 1 (Query-to-sample reductions), Discussion