HITCH: Teaching a Vision-Language Model to Operate a Humanoid through a Whole-Body Harness
Harness that lets a VLM drive a humanoid: it points at image locations for 3D positions and issues pelvis, torso, hand, walk and gaze commands. After fine-tuning, a real G1 carries a box with no real data.为 VLM 控制人形机器人提供“挽具”接口:在图像上点选即得 3D 位置,并下达骨盆、躯干、手、行走和视线指令。用教师轨迹微调后,真实 G1 无需真机数据即可搬箱子。
BibTeX
@misc{lu2026hitch,
title = {{HITCH: Teaching a Vision-Language Model to Operate a Humanoid through a Whole-Body Harness}},
author = {Qingzhou Lu and Chenxin Liu and Xinming Wang and Liu Cao and Yanjiang Guo and Mengdi Xu and Jianyu Chen},
year = {2026},
eprint = {2611.08039},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2611.08039},
}Locomotion & Humanoids运动控制与人形机器人VLA & Robot Foundation ModelsVLA 与机器人基础模型Humanoid人形humanoidvlmwhole-bodyharnessg1real