Asking Smarter Questions: Targeted Active Preference Learning for Underspecified Rewards
When teaching data under-specifies some reward features, the robot targets preference queries at those features and explains what to look at. Up to 30.8% better than standard active preference learning with few queries.当示教数据对某些奖励特征监督不足时，机器人把偏好询问集中在这些特征上，并附带解释提示人该关注什么。少量询问下比标准主动偏好学习高最多 30.8%。
BibTeX
@misc{merker2026asking,
title = {{Asking Smarter Questions: Targeted Active Preference Learning for Underspecified Rewards}},
author = {Helena Merker and Nick Walker and Andreea Bobu},
year = {2026},
eprint = {2610.22285},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2610.22285},
}Robot Learning: RL & Imitation机器人学习：强化学习与模仿学习reward-learningactive-learningpreferencesexplanationsuser-study