Beyond Imitation: Reinforcement Learning-Based Sim-Real Co-Training for VLA Models
RL-Co: SFT on mixed real and sim demos, then RL in simulation with an auxiliary supervised loss on real data to avoid forgetting. Tested on four real tabletop tasks with OpenVLA and π0.5.RL-Co：先在真实与仿真混合示教上做监督微调，再在仿真中强化学习，同时加入真实数据的辅助监督损失以防遗忘。用 OpenVLA 和 π0.5 在四个真实桌面任务上验证。
BibTeX
@misc{shi2026beyond,
title = {{Beyond Imitation: Reinforcement Learning-Based Sim-Real Co-Training for VLA Models}},
author = {Liangzhi Shi and Shuaihang Chen and Feng Gao and Yinuo Chen and Kang Chen and Tonghe Zhang and Hongzhi Zang and Jiakai Zhou and Weinan Zhang and Chao Yu and Yu Wang},
year = {2026},
eprint = {2602.12628},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2602.12628},
}