Q-OIL: Optimistic Exploration in Learning from Human Interventions
Real users intervene when progress stalls, often with imperfect fixes; a progress-based human model makes sim benchmarking match them. Q-OIL adds optimistic bonuses on intervention steps; reports 10-50% higher success.真实用户往往在进展停滞时介入，且纠正动作并不完美；据此建立的基于进展的人类模型让仿真评测更贴近真人。Q-OIL 对介入转移加乐观奖励并用解耦评论家稳定训练，报告成功率提升 10-50%。
BibTeX
@misc{teegavarapu2026q,
title = {{Q-OIL: Optimistic Exploration in Learning from Human Interventions}},
author = {Pranav Teegavarapu and Sriyash Poddar and Rico Qi and Cleah Winston and Krisha Khandelwal and Aykut Onyol and Natasha Jaques and Abhishek Gupta},
year = {2026},
eprint = {2611.08576},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2611.08576},
}