Steering Your Diffusion Policy with Latent Space Reinforcement Learning
DSRL — adapts a frozen diffusion policy by running RL over its input noise, not its weights; needs only forward passes, works with π0, and reports real-robot success rising from 20% to 90% in under 50 online episodes.DSRL：不改扩散策略的权重，而是对其输入的初始噪声做强化学习来"引导"输出动作；只需前向推理、可用于 π0，论文报告真机任务在不到 50 次在线交互内成功率从 20% 升至 90%。
BibTeX
@misc{wagenmaker2025steering,
title = {{Steering Your Diffusion Policy with Latent Space Reinforcement Learning}},
author = {Andrew Wagenmaker and Mitsuhiko Nakamoto and Yunchu Zhang and Seohong Park and Waleed Yagoub and Anusha Nagabandi and Abhishek Gupta and Sergey Levine},
year = {2025},
eprint = {2506.15799},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2506.15799},
}Robot Learning: RL & Imitation机器人学习：强化学习与模仿学习Manipulation & Dexterous Hands操作与灵巧手realrl-finetuningdiffusion-policysample-efficient