Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulation
Seer forecasts the next visual state and feeds it to an inverse dynamics model that outputs actions, trained end to end and pretrained on DROID; reports 4.28 avg. length on CALVIN ABC-D plus LIBERO and real-robot gains.Seer 先预测未来视觉状态,再由逆动力学模型据此输出动作,端到端训练并在 DROID 上预训练;报告 CALVIN ABC-D 平均任务长度 4.28,在 LIBERO-LONG 和真机任务上也有提升。
BibTeX
@misc{tian2024predictive,
title = {{Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulation}},
author = {Yang Tian and Sizhe Yang and Jia Zeng and Ping Wang and Dahua Lin and Hao Dong and Jiangmiao Pang},
year = {2024},
eprint = {2412.15109},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2412.15109},
}