Integer-kernel deployment of QuAR

Develop an integer-kernel deployment of Quantizer-Aligned Recalibration (QuAR) and characterize its latency, memory, and energy on an integer-only inference stack.

Background

QuAR is evaluated as a single-pass, parameter-free adaptation method for post-training-quantized vision transformers, but the reported implementation uses an explicit per-channel multiply/add wrapper around frozen quantizers. Although the paper verifies that this wrapper is representable in ONNX, it does not implement the method within an end-to-end integer-only inference kernel. The unresolved deployment problem is therefore to determine the practical latency, memory, and energy costs of QuAR on such hardware and software stacks.

References

We have not implemented QuAR down to an integer-kernel deployment, so its latency, memory, and energy on such a stack are left to future work.

— Test-Time Adaptation of Quantized ViTs via Single-Pass Quantizer-Aligned Recalibration  (2610.08358 - Cha et al., 6 Oct 2026) in Section 5, Limitations