Transferability of Existing Augmentation Recipes to Vision-Language-Action Models
Determine whether image-augmentation recipes developed for conventional convolutional actor-critic policies transfer effectively to modern vision-language-action models with pretrained vision-language backbones and flow-matching action heads.
References
Yet this line of work studies small CNN encoders with Gaussian or categorical actors, a regime far from modern vision--language--action models. In VLAs the visual encoder is a large pretrained VLM whose features risk being corrupted, and the actor is a flow-matching head through which gradients must propagate. Whether existing augmentation recipes transfer to this setting remains unknown.
Our study is bounded in scope: all runs are in simulation, on one benchmark, and with one RL algorithm, so whether the conclusions hold on real hardware, on other task suites, or with off-policy algorithms remains untested.