Robustness under stochastic decoding

Establish whether the Knowledge-Driven Analytics Framework's retrieval and generation results remain robust under stochastic decoding rather than only under deterministic temperature-zero decoding.

Background

All reported generation passes use temperature-zero decoding and produce byte-identical answers across seeds. This demonstrates reproducibility for the evaluated configuration but does not determine whether answer quality, citation traceability, or other measured properties persist when generation is sampled stochastically. The paper therefore identifies robustness under stochastic decoding as an untested issue and lists replication across random seeds as planned future work.

References

Fifth, decoding is deterministic at temperature 0, and the three generation passes reported here produced byte-identical answers. This establishes end-to-end reproducibility but is explicitly not evidence of robustness under stochastic decoding, which remains untested; readers should not interpret the absence of seed variance as stability under sampling.

— Auditable by Construction: An Ontology-Driven Framework for Trustworthy LLM Analytics in Enterprise Finance  (2608.20661 - Lunyakin, 21 Aug 2026) in Section 4.4, Limitations of the Pilot