Preference-Calibrated Human-in-the-Loop Reinforcement Learning for Robotic Manipulation
Human-in-the-loop RL that treats each intervention as a preference (human action over policy action) and corrects credit on suboptimal segments. Reports +24.5% average success and 1.3x faster convergence.人在回路强化学习：把每次人工干预视为偏好（人类动作优于策略动作），对次优片段做信用重新分配。报告五个真机任务平均成功率提升 24.5%，收敛快 1.3 倍。
BibTeX
@misc{liu2026preference,
title = {{Preference-Calibrated Human-in-the-Loop Reinforcement Learning for Robotic Manipulation}},
author = {Zeyi Liu and Guangyao Liu and Yinuo Qu and Yuquan Xue and Bofang Jia and Chunhua Yang and Weihua Gui and Keke Huang and Ziwei Wang},
year = {2026},
eprint = {2606.03949},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2606.03949},
}Robot Learning: RL & Imitation机器人学习：强化学习与模仿学习human-in-the-loopcredit-assignmentpreferencesactor-criticreal