Resource-Abuse Detection and Economic DoS Prevention
Determine how to distinguish legitimate high-volume use from adversarial resource abuse, detect prompts that induce excessive reasoning or tool calls, and control economic denial-of-service risks in cloud-based LLM services.
References
How to properly calibrate models is an open problem.
Although rate limiting, resource capping, and anomaly detection provide practical defenses, key challenges remain. It is still difficult to distinguish legitimate high-volume use from adversarial resource abuse, detect adversarial prompts that trigger excessive reasoning or tool calls, and control economic denial-of-service risks in cloud-based LLM services. Autonomous agents further amplify this risk by chaining model interactions, API calls, and external tools.
Slurm already supports mechanisms such as per-QoS limits and bounded job-array concurrency, but deciding where these constraints should be enforced, either in the agent, its harness, or the scheduler, remains an open question.