Gaze Prompts: Temporally Dense Human Attention for Vision-Language-Action Fine-Tuning
Gaze recorded in VR teleop is drawn as crosshairs on training images; at test time a small predictor supplies the gaze. With π0: 26.3% → 56.0% on six real bimanual tasks. Releases GazeMani (1,200 trajectories).把 VR 遥操作中记录的注视点画成十字准星叠加在训练图像上,部署时由轻量预测器估计注视点。基于 π0,六个真实双臂任务平均成功率从 26.3% 升至 56.0%;发布 GazeMani 数据集(1200 条轨迹)。
BibTeX
@misc{zhou2026gaze,
title = {{Gaze Prompts: Temporally Dense Human Attention for Vision-Language-Action Fine-Tuning}},
author = {Yihan Zhou and Rui Yan and Mingcong Li and Zheyuan Huang and Xu Yang and Xueyang Guo and Yilin Mo},
year = {2026},
eprint = {2609.34550},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2609.34550},
}