VLK: Learning Humanoid Loco-Manipulation from Synthetic Interactions in Reconstructed Scenes
Generates 48,000 vision-language-kinematics trajectories in 3DGS-reconstructed rooms with no human input, trains a policy that outputs whole-body kinematics, and runs it on a real G1 via a tracker.在 3D 高斯泼溅重建的室内场景中无人工合成 4.8 万条“视觉-语言-运动学”轨迹,训练输出全身运动学轨迹的策略,并通过全身跟踪器在真实 G1 上运行。
BibTeX
@misc{wang2026vlk,
title = {{VLK: Learning Humanoid Loco-Manipulation from Synthetic Interactions in Reconstructed Scenes}},
author = {Yen-Jen Wang and Jiaman Li and Sirui Chen and Takara E. Truong and Pei Xu and Pieter Abbeel and Rocky Duan and Koushil Sreenath and Angjoo Kanazawa and Carmelo Sferrazza and Guanya Shi and Karen Liu},
year = {2026},
eprint = {2606.30645},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2606.30645},
}Locomotion & Humanoids运动控制与人形机器人Humanoid人形humanoidgaussian-splattingsynthetic-datanavigationunitree-g1