RARM: Confidence-Gated Progress Reward Modeling for RL in Manipulation
Video comparator trained once on general videos that turns one successful demo into a dense progress reward, paying only for confident forward progress. Best RL success on 9 sim and 4 real tasks.只在通用视频上训练一次的视觉比较器,可把一条成功演示变成稠密的进度奖励,并只奖励置信度高的前进。在 9 个仿真和 4 个真机任务的强化学习中成功率最高。
BibTeX
@misc{yang2026rarm,
title = {{RARM: Confidence-Gated Progress Reward Modeling for RL in Manipulation}},
author = {Pengzhi Yang and Xinyu Wang and Pengyu Jing and Kehan Wen and Yiduo Qu and Zhenhao Huang and Minghao Fu and Xin Liu and Yaheng Shen and Fan Shi},
year = {2026},
eprint = {2606.22027},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2606.22027},
}