Rethinking the Implications of Human Feedback for Preference Learning in Human-Robot Collaboration
Shows fixed rules for deriving labels from human feedback often disagree with what people mean, and learns these implications instead. Better preference estimates, incl. a real pizza-making study.发现从人类反馈推导未选动作标签的固定规则常与人的真实意图不符，改为学习这种“隐含含义”。偏好估计更准，并在真实做披萨协作实验中验证。
BibTeX
@misc{zhang2026rethinking,
title = {{Rethinking the Implications of Human Feedback for Preference Learning in Human-Robot Collaboration}},
author = {Qiping Zhang and Kate Candon and Debasmita Ghose and Marynel Vázquez},
year = {2026},
eprint = {2609.13982},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2609.13982},
}Robot Learning: RL & Imitation机器人学习：强化学习与模仿学习preference-learninghuman-feedbackhrireward-learninguser-study