Dynamic VLM-Guided Negative Prompting for Diffusion Models (2510.26052v1)

Abstract: We propose a novel approach for dynamic negative prompting in diffusion models that leverages Vision-LLMs (VLMs) to adaptively generate negative prompts during the denoising process. Unlike traditional Negative Prompting methods that use fixed negative prompts, our method generates intermediate image predictions at specific denoising steps and queries a VLM to produce contextually appropriate negative prompts. We evaluate our approach on various benchmark datasets and demonstrate the trade-offs between negative guidance strength and text-image alignment.