Most Effective Interface Between LLMs and External Tools

Determine the most effective interface between large language models and external software tools to enable reliable and performant tool usage within compound AI systems.

Background

The paper studies how LLMs can query databases through function calling and discusses broader patterns for tool integration in compound AI systems. While function calling has emerged as a common approach, other paradigms and variations exist, and the authors note that identifying the best overall interface is unresolved.

This open question motivates the work’s proposed tool schema for database querying and the DBGorilla benchmark to evaluate LLMs’ ability to format appropriate tool arguments. Despite these contributions, the general design question of the optimal interface for connecting LLMs to external tools remains explicitly open.