RoboFFT: Finetuning generative robot policy via online reinforcement learning with forward process
PPO-style fine-tuning for diffusion and flow policies that builds a surrogate policy ratio from forward noising and the score/flow loss, avoiding likelihoods. Tested in sim and real.为扩散与流匹配策略做 PPO 式微调：用前向加噪与得分/流匹配损失构造替代的策略比率，绕开似然计算；在仿真与真机上验证。
BibTeX
@misc{li2026robofft,
title = {{RoboFFT: Finetuning generative robot policy via online reinforcement learning with forward process}},
author = {Yu Li and Shenghe Hu and Yuhan Wang and Yaoxiang Pu and Haotong Zhang and Yuanpei Chen and Yaodong Yang},
year = {2026},
eprint = {2609.32236},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2609.32236},
}