TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policies
Draws the robot's recent motion traces on the input image ('visual trace prompting') and fine-tunes OpenVLA on 150K trajectories; reports ~10% gains on SimplerEnv and 3.5x on real WidowX tasks; 4B variant too.把机器人近期的运动轨迹画在输入图像上（“视觉轨迹提示”），并在 15 万条轨迹上微调 OpenVLA；报告在 SimplerEnv 上提升约 10%、真实 WidowX 任务上提升 3.5 倍，另有基于 Phi-3-Vision 的 4B 精简版。
BibTeX
@misc{zheng2024tracevla,
title = {{TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policies}},
author = {Ruijie Zheng and Yongyuan Liang and Shuaiyi Huang and Jianfeng Gao and Hal Daumé and Andrey Kolobov and Furong Huang and Jianwei Yang},
year = {2024},
eprint = {2412.10345},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2412.10345},
}