Freeform Preference Learning for Robotic Manipulation
Annotators define their own preference axes in language (speed, safety, care) and compare trajectories per axis; a language-conditioned reward trains a steerable policy. Reports +38 points over sparse and binary rewards.让标注者用自然语言自定义偏好维度（速度、安全、细致等）并逐维比较轨迹，训练语言条件奖励模型和可引导的策略。报告比稀疏奖励与二元偏好方法高 38 个百分点。
BibTeX
@misc{torne2026freeform,
title = {{Freeform Preference Learning for Robotic Manipulation}},
author = {Marcel Torne and Anubha Mahajan and Abhijnya Bhat and Chelsea Finn},
year = {2026},
eprint = {2606.32027},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2606.32027},
}Robot Learning: RL & Imitation机器人学习：强化学习与模仿学习preference-learningreward-modellanguagelong-horizonreal