COWBOY: A Scalable Sim-to-Real Framework for Learning Contextual Whole-Body Manipulation
Mobile dexterous grasping learned in sim: a whole-body controller does reaching and active vision, local RL experts the object, all distilled into one point-cloud policy; reports zero-shot real transfer.在仿真中学习移动灵巧抓取:全身控制器负责底盘-手臂协同到达与主动视觉,局部强化学习专家负责物体交互,二者蒸馏成一个基于点云的视觉策略;报告可零样本迁移到真实世界的数百个物体与场景。
BibTeX
@misc{yang2026cowboy,
title = {{COWBOY: A Scalable Sim-to-Real Framework for Learning Contextual Whole-Body Manipulation}},
author = {Jiahui Yang and Jason Jingzhou Liu and Ray Muxin Liu and Andrew E. Wang and Kenneth Shaw and Deepak Pathak and Ruslan Salakhutdinov},
year = {2026},
eprint = {2610.28948},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2610.28948},
}Manipulation & Dexterous Hands操作与灵巧手Robot Learning: RL & Imitation机器人学习:强化学习与模仿学习Dexterous hand灵巧手mobile-manipulationwhole-bodydexterous-handsim2realdistillationpoint-cloudactive-vision