Degraded behaviour in failed trajectories under perturbation
Determine whether input perturbations result in failed robot trajectories with meaningfully degraded behaviour in Vision-Language-Action model evaluations.
References
Interesting questions for future work, include whether perturbations result in failed trajectories with meaningfully degraded behaviour.
— Is Success All You Need? Investigating the Impact of Input Perturbations on VLA Behaviour in Tabletop Manipulation Tasks
(2610.01351 - Higham et al., 1 Oct 2026) in Section LIMITATIONS AND FUTURE WORK
Since all perturbed predictions are evaluated against the original demonstration, our results show that language influences the action, so closed-loop rollouts or counterfactual targets for meaning-changing perturbations would test whether the observed sensitivity reflects appropriate use of the instruction.
— Do Vision-Language-Action Models Understand Instructions? A Mechanistic Interpretability Study on Language Grounding
(2610.10178 - Wulff et al., 7 Oct 2026) in Section 6, Future Work