Pixel-UMI: Learning Environment-Aware Whole-Body Manipulation from Sensorized Human Demonstrations
Sensorized human demos to whole-body policies: scene-aware retargeting, masking of mismatched views in training, then DAgger corrections. Reports 87.0% task progress on five tasks.把传感化的人类示范变成全身策略:结合重建的场景几何做重定向,训练时用重定向误差遮蔽不匹配的视角,再用 DAgger 人工纠正补足接触。作者报告五个任务平均进度 87.0%。
BibTeX
@misc{liu2026pixel,
title = {{Pixel-UMI: Learning Environment-Aware Whole-Body Manipulation from Sensorized Human Demonstrations}},
author = {Jason Jingzhou Liu and Tony Tao and Deepak Pathak and Ruslan Salakhutdinov},
year = {2026},
eprint = {2611.03647},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2611.03647},
}Manipulation & Dexterous Hands操作与灵巧手Hardware & Open-Source Robots硬件与开源机器人mobile-manipulationhuman-demonstrationsretargetingwhole-bodyreal