Unified Motion-Action Modeling for Heterogeneous Robot Learning
Uses 3D object motion as a shared interface: object motion and robot actions are modelled jointly with masking, so one pretrained model serves as policy, dynamics model and few-shot adapter. Robot, human and sim data.以 3D 物体运动轨迹作为统一接口，用掩码生成目标联合建模物体运动与机器人动作，同一套预训练参数可作为策略、动力学模型或少样本适配器。混合机器人、人类视频与仿真数据预训练。
BibTeX
@misc{cao2026unified,
title = {{Unified Motion-Action Modeling for Heterogeneous Robot Learning}},
author = {Yunhao Cao and Shitong Liu and Chao Feng and Meryl Zhang and Xuanchen Lu and Andrew Owens and Kuan Fang},
year = {2026},
eprint = {2606.16917},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2606.16917},
}Robot Learning: RL & Imitation机器人学习：强化学习与模仿学习object-motionmasked-generativehuman-videocross-embodimentreal