Production Maturity of RISC-V for Large-Scale LLM Serving

Establish broad production maturity for large-scale large language model serving on RISC-V platforms.

Background

The survey discusses emerging RISC-V support for LLM and transformer acceleration, including the VEXP instruction-set extensions for softmax-intensive transformer kernels and the V-Seek system for reasoning inference on a server-class RISC-V platform. Although these results demonstrate substantial progress, the paper explicitly identifies the broader production maturity of RISC-V for large-scale LLM serving as unresolved.

References

These results indicate meaningful progress, although broad production maturity for large-scale LLM serving on RISC-V remains an open area.

— RISC-V and machine learning: a survey  (2609.20677 - Keshri et al., 17 Sep 2026) in Section 5.4, Performance