Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulation
GR-1 — a GPT-style model that predicts both actions and future frames; pre-training on Ego4D video prediction before robot fine-tuning lifts CALVIN unseen-scene success from 53.3% to 85.4% (as reported).GR-1：GPT 式模型同时预测动作与未来画面；先在 Ego4D 上做视频预测预训练、再用机器人数据微调，论文报告 CALVIN 未见场景成功率从 53.3% 提升到 85.4%。
BibTeX
@misc{wu2023unleashing,
title = {{Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulation}},
author = {Hongtao Wu and Ya Jing and Chilam Cheang and Guangzeng Chen and Jiafeng Xu and Xinghang Li and Minghuan Liu and Hang Li and Tao Kong},
year = {2023},
eprint = {2312.13139},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2312.13139},
}World Models世界模型Manipulation & Dexterous Hands操作与灵巧手world-action-modelvideo-predictionpretraininggpt