ELA: End-to-End Latent Action Policy Learning from Video Demonstrations
Jointly trains a latent action model, latent policy and action decoder, so plentiful action-free video plus a few labelled robot demos can train a policy. Reports beating prior latent-action baselines.联合训练潜在动作模型、潜在策略和动作解码器,用大量无动作标注的视频加少量带标注示教即可训练策略。报告在仿真和真实任务上优于已有潜在动作方法。
BibTeX
@misc{hsu2026ela,
title = {{ELA: End-to-End Latent Action Policy Learning from Video Demonstrations}},
author = {Cheng-Chun Hsu and Peter Stone},
year = {2026},
eprint = {2611.05571},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2611.05571},
}Robot Learning: RL & Imitation机器人学习:强化学习与模仿学习Manipulation & Dexterous Hands操作与灵巧手imitation-learninglatent-actionvideo-demonstrationsreal