Real2Sem2Real: 3D Semantic Augmentations for Robot Learning from a Single Human RGB Demonstration
Turns one monocular RGB human demo into thousands of robot demos across object instances: Gaussian-splat pose tracking, aligned 'digital cousins', replay in IsaacSim or MuJoCo. Reports VLAs matching teleop-trained ones.把一段单目 RGB 人类演示扩展为同类别不同物体上的数千条机器人演示：用 DINOv3 蒸馏的高斯溅射跟踪物体位姿，对齐由照片生成的“数字表亲”，在 IsaacSim 或 MuJoCo 中生成数据（约 2 小时 2000+ 条）；报告所训练的 VLA 在真机上达到或超过遥操作数据训练的策略。
BibTeX
@misc{strong2026real,
title = {{Real2Sem2Real: 3D Semantic Augmentations for Robot Learning from a Single Human RGB Demonstration}},
author = {Matthew Strong and Ankush K. Dhawan and Julien Poffet and Giuse Pham and Jinho So and Monroe Kennedy},
year = {2026},
eprint = {2610.28880},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2610.28880},
}Manipulation & Dexterous Hands操作与灵巧手Robot Learning: RL & Imitation机器人学习：强化学习与模仿学习human-videodata-generationgaussian-splattingdigital-cousinsvlareal