Reconstruction-Augmented Visuomotor Pre-Training of 3D-Grounded Bimanual Dexterity from RGB-Only Human Videos
SpatialDex pre-trains a VLM-based dexterous policy on scene geometry and hand motion reconstructed from 1M RGB-only human clips. Reports +38.3 pts over prior methods on 6 real bimanual tasks.SpatialDex 从 100 万段纯 RGB 人类视频中重建场景几何与手部运动，并以几何作为输入和预测目标预训练基于 VLM 的灵巧策略；报告在 9 个仿真任务上比现有方法高 16.5 分、6 个真实双臂灵巧任务上高 38.3 分。
BibTeX
@misc{he2026reconstruction,
title = {{Reconstruction-Augmented Visuomotor Pre-Training of 3D-Grounded Bimanual Dexterity from RGB-Only Human Videos}},
author = {Xingyi He and Zhiwen Qiu and Adhitya Polavaram and Yunhao Cao and Cory Fan and Julius Samwer and Saleh Kalantari and Kuan Fang},
year = {2026},
eprint = {2610.29716},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2610.29716},
}Manipulation & Dexterous Hands操作与灵巧手Robot Learning: RL & Imitation机器人学习：强化学习与模仿学习Robot arm机械臂Dexterous hand灵巧手dexterousbimanualhuman-video3d-reconstructionpretrainingrealsim