Relative value of learned vs. random quaternion rotations in IsoQuant
Determine the relative performance of learned normalized unit-quaternion parameters versus random fixed unit-quaternion parameters for the blockwise SO(4) rotations used by IsoQuant in stage-1 online vector quantization for KV-cache compression.
References
Although normalized quaternion parameters are simple to optimize, the relative value of learned versus random rotations remains an empirical question.
— IsoQuant: Hardware-Aligned SO(4) Isoclinic Rotations for LLM KV Cache Compression
(2603.28430 - Ji, 30 Mar 2026) in Section 10 (Limitations and Future Work)
A key direction for future work is to account for how feedback and rotation change the errors produced by the quantizer, and to examine whether learned feedback remains useful in larger pretrained models.
— Revisiting Error Feedback for Model Quantization
(2610.18139 - Keung et al., 13 Oct 2026) in Section 6, Conclusions, p. 10