Flow Q-Learning
FQL — a flow-matching BC policy plus a one-step policy that maximizes Q while distilling from it; no backprop through flow steps, strong on 73 OGBench / D4RL offline and offline-to-online tasks.FQL:先用行为克隆训练流匹配策略,再训练一个最大化 Q 值、同时向流策略蒸馏的单步策略;避免对多步流采样反向传播,在 73 个 OGBench / D4RL 离线及离线转在线任务上表现突出。
BibTeX
@misc{park2025flow,
title = {{Flow Q-Learning}},
author = {Seohong Park and Qiyang Li and Sergey Levine},
year = {2025},
eprint = {2502.02538},
archivePrefix = {arXiv},
primaryClass = {cs.LG},
url = {https://arxiv.org/abs/2502.02538},
}