ViT-H: Generative Video-To-Humanoid Control with Motion Tracking Feedback
Skips reconstruction and retargeting: a diffusion model turns monocular human video straight into humanoid reference motion, post-trained with DPO on tracking outcomes; real-time variant teleoperates a G1 under 400 ms.跳过人体重建与重定向:扩散模型直接把单目人类视频生成为人形机器人参考动作,并以运动跟踪结果做 DPO 后训练;自回归版本可在 Unitree G1 上实现低于 400 ms 延迟的实时视频遥操作。
BibTeX
@misc{he2026vit,
title = {{ViT-H: Generative Video-To-Humanoid Control with Motion Tracking Feedback}},
author = {Zimo He and Tianyi Bian and Zizhong Yang and Hongjie Li and Nan Jiang and Jieming Cui and Baoxiong Jia and Yizhou Wang and Siyuan Huang and Yixin Zhu},
year = {2026},
eprint = {2610.32966},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2610.32966},
}Locomotion & Humanoids运动控制与人形机器人Humanoid人形realhumanoidmotion-trackinghuman-videodiffusionteleoperation