Generalization of memory-guided selection beyond Text-to-SQL

Determine whether memory-guided selection and group-based permutation generalize beyond Text-to-SQL.

Background

The paper evaluates memory-guided listwise selection and group-based permutation specifically for Text-to-SQL, where candidates are SQL queries accompanied by database schemas and execution results. The authors leave unresolved whether these techniques transfer to other tasks or domains that also require selecting among multiple generated candidates.