UMI-on-Legs: Making Manipulation Policies Mobile with Manipulation-Centric Whole-body Controllers
Robot-free UMI gripper demos train the manipulation policy; a sim-trained whole-body controller tracks its end-effector trajectories on a quadruped. Reports >70% success on all tasks and zero-shot reuse of an arm policy.用手持 UMI 夹爪采集无需机器人的示教来训练操作策略，再由仿真训练的全身控制器在四足机器人上跟踪其输出的末端轨迹；报告所有任务成功率超过 70%，并能零样本复用原为固定机械臂训练的策略。
BibTeX
@misc{ha2024umi,
title = {{UMI-on-Legs: Making Manipulation Policies Mobile with Manipulation-Centric Whole-body Controllers}},
author = {Huy Ha and Yihuai Gao and Zipeng Fu and Jie Tan and Shuran Song},
year = {2024},
eprint = {2407.10353},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2407.10353},
}Hardware & Open-Source Robots硬件与开源机器人Locomotion & Humanoids运动控制与人形机器人Manipulation & Dexterous Hands操作与灵巧手Quadruped / legged四足 / 足式quadrupedumiwhole-body-controlloco-manipulationsimreal