AutoPipelineAI: Context-Aware CI/CD Pipeline Generation from Natural Language

Abstract: Modern software development relies on CI/CD pipelines to automate testing, building, and deployment operations. Configuring DevOps pipelines is challenging and time-consuming, as developers must understand platform-specific syntax and manually create configuration files. This complexity can lead to configuration errors and reduced productivity, especially for developers with limited DevOps experience. This paper introduces the AutoPipelineAI system, which generates CI/CD pipeline configurations using natural language descriptions. The proposed solution uses LLMs to translate developer intent, analyze repository structures, and create specific pipeline scripts for environments like GitHub Actions and GitLab CI/CD. It integrates repository-aware analysis, automated validation systems, and a feedback mechanism that confirms the accuracy and usability of the created pipelines. We present the system architecture, its implementation, and an assessment framework designed to measure generation precision, configuration validity, and reduction in setup effort compared to manual pipeline creation. AutoPipelineAI illustrates how LLMs can simplify the complexity of DevOps configuration and enhance developer access to continuous delivery methods. Evaluation results provide early evidence that repository-aware, natural-language-driven CI/CD generation is a viable and promising paradigm for reducing the complexity of DevOps configuration and enabling more accessible software delivery automation.