ViperGPT: Visual Inference via Python Execution for Reasoning

Summary: Researchers have developed a new framework called ViperGPT that uses code-generation models to create visual queries in Python, breaking them down into interpretable steps. The approach utilizes an API to access available modules and composes them by generating Python code that is later executed, achieving state-of-the-art results across various complex visual tasks.