Multi-View Latent Action Pretraining for Cross-Embodiment Robot Learning from Videos
Latent action model that fuses synchronized camera views to resolve depth and occlusion. Reports 17% better 6D action decodability than single-view and +13.5% policy success (vs +6.2%); human-hand demos help on hardware.融合多路同步相机视角的潜在动作模型(LAM),用交叉注意力解决深度与遮挡问题;报告 6D 动作可解码性比单视角高 17%,下游策略成功率提升 13.5%(单视角为 6.2%),真机上用人手演示也比纯动作策略高 20%。
BibTeX
@misc{hausdorfer2026multi,
title = {{Multi-View Latent Action Pretraining for Cross-Embodiment Robot Learning from Videos}},
author = {Oliver Hausdörfer and Felix Minzenmay and Mani Majd and Maximilian P. Christof and Shiyuan Zhang and Angela P. Schoellig},
year = {2026},
eprint = {2610.27794},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2610.27794},
}VLA & Robot Foundation ModelsVLA 与机器人基础模型Robot Learning: RL & Imitation机器人学习:强化学习与模仿学习latent-actionsmulti-viewcross-embodimenthuman-videoflow-matching