GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulation
Pretrained to generate future video on 38M clips, then fine-tuned to predict frames and actions together; reports 97.7% average success over 100+ real tabletop tasks and roughly double GR-1's success in unseen scenes.先在 3800 万段视频上预训练未来帧生成，再在机器人数据上微调，同时预测视频帧与动作轨迹；报告在 100 多个真机桌面任务上平均成功率 97.7%，在未见场景中成功率约为 GR-1 的两倍。
BibTeX
@misc{cheang2024gr,
title = {{GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulation}},
author = {Chi-Lam Cheang and Guangzeng Chen and Ya Jing and Tao Kong and Hang Li and Yifeng Li and Yuxiao Liu and Hongtao Wu and Jiafeng Xu and Yichu Yang and Hanbo Zhang and Minzhao Zhu},
year = {2024},
eprint = {2410.06158},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2410.06158},
}