RAG suitability for reasoning and coding tasks
Determine whether retrieval-augmented generation (RAG) can suitably address tasks such as reasoning and coding, where relevant information is difficult to retrieve, and characterize alternative mechanisms for continual learning in these domains if RAG is inadequate.
References
It's unclear how RAG would be a suitable solution on tasks like reasoning and coding where retrieval is difficult.
— Continual Learning via Sparse Memory Finetuning
(Lin et al., 16 Oct 2025) in Conclusion