Industrial deployment: response time and API-mapping automation for siwarex

Determine the end-to-end response time experienced by end users—including both the natural-language-to-SQL formulation time and the execution time—when deploying the siwarex declarative framework, which represents user intent in SQL and integrates external APIs via user-defined functions, within real industrial environments that contain heterogeneous data sources; and ascertain the extent to which creation of siwarex API Mapping Schemas for existing APIs can be automated to enable rapid deployment with minimal configuration.

Background

The paper introduces siwarex, a declarative approach that expresses user intent in SQL and integrates external APIs via user-defined functions to answer natural-language queries over heterogeneous data sources. It also proposes two benchmarks to evaluate such systems and presents empirical results showing advantages over imperative and agentic approaches.

In the Limitations section, the authors note that while their focus was on accuracy in controlled benchmarks, real-world industrial deployment raises practical concerns that are not yet resolved. Specifically, they highlight uncertainty about end-to-end response time as perceived by users (covering both query formulation and execution) and about how much of the API mapping process can be automated to support quick deployment across new environments.