Dice Question Streamline Icon: https://streamlinehq.com

Open questions on the usability of AI programming assistants

Investigate the usability of AI programming assistants (such as GitHub Copilot and similar tools) in real-world developer workflows to determine why developers frequently do not accept the tools’ initial code suggestions and to characterize the factors that influence suggestion acceptance and overall usability.

Information Square Streamline Icon: https://streamlinehq.com

Background

In the Related Work section, the authors note that developers often do not accept AI programming assistants’ initial suggestions. They explicitly state that this observation leaves open questions regarding the usability of these tools.

Understanding these usability issues is important for interpreting empirical findings on productivity and for guiding the design of AI programming assistants used in industry settings.

References

However, in practice, developers do not accept AI programming assistants' initial suggestions at a high frequency. This leaves a number of open questions related to the usability of these tools.

— How much does AI impact development speed? An enterprise-based randomized controlled trial (2410.12944 - Paradis et al., 16 Oct 2024) in Section 2: Related Work