VLM-Guided Contact Retargeting and Generative Partner Modeling for Humanoid-Human Interaction
REACT learns humanoid-human contact interactions from human-human mocap: VLM-guided contact retargeting, then onboard-depth policies that also predict the occluded partner. A real G1 does all five interactions.REACT 从人-人动捕中学习人形与人的接触交互:VLM 引导接触重定向,再蒸馏为只用机载深度的策略,并预测被遮挡伙伴的状态。真实 G1 完成全部五种交互。
BibTeX
@misc{shibata2026vlm,
title = {{VLM-Guided Contact Retargeting and Generative Partner Modeling for Humanoid-Human Interaction}},
author = {Yuto Shibata and Kotaro Amaya and Kashu Yamazaki and Lalit Jayanti and Yoshimitsu Aoki and Mariko Isogawa and Katerina Fragkiadaki},
year = {2026},
eprint = {2610.28523},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2610.28523},
}Locomotion & Humanoids运动控制与人形机器人Humanoid人形humanoidhuman-robot-interactioncontactretargetingegocentric-depthg1real