Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representations
VPP — fine-tunes Stable Video Diffusion on robot and human videos and feeds its one-pass predictive features to a diffusion policy; reports 4.33 average length on CALVIN ABC→D and real Franka / dexterous-hand results.VPP：在机器人与人类操作视频上微调 Stable Video Diffusion，只做一次前向提取"预测性"视觉特征再交给扩散策略；论文报告 CALVIN ABC→D 平均完成长度 4.33，并有 Franka 与灵巧手真机实验。
BibTeX
@misc{hu2024video,
title = {{Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representations}},
author = {Yucheng Hu and Yanjiang Guo and Pengchao Wang and Xiaoyu Chen and Yen-Jen Wang and Jianke Zhang and Koushil Sreenath and Chaochao Lu and Jianyu Chen},
year = {2024},
eprint = {2412.14803},
archivePrefix = {arXiv},
primaryClass = {cs.CV},
url = {https://arxiv.org/abs/2412.14803},
}World Models世界模型Manipulation & Dexterous Hands操作与灵巧手Robot arm机械臂Dexterous hand灵巧手world-action-modelvideo-diffusiondiffusion-policydexterous