Correct Robots Before They Make Mistakes: Proactive Human-in-the-Loop Intervention via Preference Learning
PHIL shows an operator the policy's predicted motion in XR so they can step in before an error, then trains on rejected vs corrected chunks; reports 70.3% vs 44.0% for HG-DAgger with a diffusion policy.PHIL 在 XR 中预览策略预测的动作，让操作者在出错前介入，再用被否决与修正后的动作片段做偏好训练；报告相比 HG-DAgger，扩散策略成功率从 44.0% 升至 70.3%。
BibTeX
@misc{jiang2026correct,
title = {{Correct Robots Before They Make Mistakes: Proactive Human-in-the-Loop Intervention via Preference Learning}},
author = {Xinkai Jiang and Jing Jiang and Hongyi Zhou and Pankhuri Vanjani and Ahmad Baki and Jakub Suliga and Ge Li and Zhuoyue Li and Gerhard Neumann and Rudolf Lioutikov},
year = {2026},
eprint = {2611.05667},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2611.05667},
}