Integrating performance-aware scheduling into Kubernetes-based hybrid quantum–classical workflows
Develop and integrate performance-aware or telemetry-driven decision-making into the Kubernetes-based orchestration stack—specifically Argo Workflows combined with Kueue—to enable predictive scheduling and automated backend selection across CPU, GPU, and quantum processing unit resources in hybrid quantum–classical workflows.
References
Additional limitations include latency, I/O bottlenecks arising from persistent volume usage at larger scales, and the absence of predictive scheduling or automated backend selection based on real-time telemetry. While Kueue provides fair queue-based scheduling, integrating performance-aware or telemetry-driven decision-making remains an open challenge.
The first is that the basic theory of heterogeneous architectures is poorly developed. We do not currently have a good understanding of how best to distribute the tasks between GPUs and CPUs to maximise the compute throughput and avoid processors idling while they wait for others to finish their calculations.