VLS: Steering Pretrained Robot Policies via Vision-Language Models
Adapts a frozen diffusion or flow policy at test time: a VLM writes differentiable rewards that steer denoising when obstacles or clutter shift the scene. Reports +31% on CALVIN and +13% on LIBERO-PRO; no retraining.在测试时适配冻结的扩散或流匹配策略:当障碍或杂物改变场景时,由 VLM 生成可微奖励来引导去噪。报告 CALVIN 提升 31%、LIBERO-PRO 提升 13%,无需重新训练。
BibTeX
@misc{liu2026vls,
title = {{VLS: Steering Pretrained Robot Policies via Vision-Language Models}},
author = {Shuo Liu and Ishneet Sukhvinder Singh and Yiqing Xu and Jiafei Duan and Ranjay Krishna},
year = {2026},
eprint = {2602.03973},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2602.03973},
}Manipulation & Dexterous Hands操作与灵巧手VLA & Robot Foundation ModelsVLA 与机器人基础模型steeringinference-timediffusion-policyvlmrewardreal