Think Proprioceptively: State-Grounded Visual Token Selection for VLA Policies
Turns robot state into VLM-vocabulary tokens that, with the instruction, choose which image patches the VLM processes. Keeping ~12% of visual tokens beats the full-token baseline on CALVIN with lower latency.把机器人状态离散成 VLM 词表 token,与指令一起决定哪些图像块进入 VLM 计算。仅保留约 12% 的视觉 token 就在 CALVIN 上超过全 token 基线,同时降低延迟。
BibTeX
@misc{wang2026think,
title = {{Think Proprioceptively: State-Grounded Visual Token Selection for VLA Policies}},
author = {Fangyuan Wang and Peng Zhou and Jiaming Qi and Shipeng Lyu and Chengyang He and David Navarro-Alarcon and Guodong Guo},
year = {2026},
eprint = {2602.06575},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2602.06575},
}