Progress-Guided Preference Generation for Aligning Generative Control Policies
Fine-tunes diffusion and flow policies with automatic preference labels: rollouts are ranked by progress measured against a few expert demos, no human labels or reward design. Reports beating SFT on long-horizon tasks.用自动生成的偏好标签微调扩散与流匹配策略：以少量专家示教为参照衡量自主回放的顺序进度并据此排序，无需人工标注或手工奖励；报告在长时程操作任务上优于监督微调基线。
BibTeX
@misc{luu2026progress,
title = {{Progress-Guided Preference Generation for Aligning Generative Control Policies}},
author = {Tung M. Luu and Tri Ton and Duc M. Nguyen and Xuan Thanh Nguyen and Nguyen Gia Binh and Quang Tan Nguyen and Vu Duong and Daniel Sonntag and Duy M. H. Nguyen and Vien Anh Ngo and Chang D. Yoo},
year = {2026},
eprint = {2610.25692},
archivePrefix = {arXiv},
primaryClass = {cs.LG},
url = {https://arxiv.org/abs/2610.25692},
}Robot Learning: RL & Imitation机器人学习：强化学习与模仿学习Manipulation & Dexterous Hands操作与灵巧手preference-learningdiffusion-policyflow-matchingfine-tuninglong-horizon