Personalization of Code Readability Evaluation Based on LLM Using Collaborative Filtering (2411.10583v2)

Abstract: Code readability is an important indicator of software maintenance as it can significantly impact maintenance efforts. Recently, LLM (LLMs) have been utilized for code readability evaluation. However, readability evaluation differs among developers, so personalization of the evaluation by LLM is needed. This study proposes a method which calibrates the evaluation, using collaborative filtering. Our preliminary analysis suggested that the method effectively enhances the accuracy of the readability evaluation using LLMs.