Diffusion Policy Policy Optimization

DPPO — fine-tunes a pre-trained diffusion policy with PPO by treating the denoising steps as part of the MDP; reports stable gains over other RL fine-tuning methods and sim-to-real transfer.DPPO：把去噪步骤视为 MDP 的一部分，用 PPO 微调预训练扩散策略；报告称比其他强化学习微调方法更稳定，并实现了仿真到真机迁移。

Paper论文 · Code代码 ★ 866

BibTeX

@misc{ren2024diffusion,
  title = {{Diffusion Policy Policy Optimization}},
  author = {Allen Z. Ren and Justin Lidard and Lars L. Ankile and Anthony Simeonov and Pulkit Agrawal and Anirudha Majumdar and Benjamin Burchfiel and Hongkai Dai and Max Simchowitz},
  year = {2024},
  eprint = {2409.00588},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2409.00588},
}

Robot Learning: RL & Imitation机器人学习：强化学习与模仿学习 Manipulation & Dexterous Hands操作与灵巧手rldiffusion-policyfine-tuningsim-to-real

Authors (from arXiv): 作者（来自 arXiv）：Allen Z. Ren, Justin Lidard, Lars L. Ankile, Anthony Simeonov, Pulkit Agrawal, Anirudha Majumdar, Benjamin Burchfiel, Hongkai Dai et al.

More from: 同机构更多条目：Princeton普林斯顿大学

Diffusion Policy Policy Optimization

More in Robot Learning: RL & Imitation更多机器人学习：强化学习与模仿学习条目