ExpertGen: Scalable Sim-to-Real Expert Policy Learning from Imperfect Behavior Priors
ExpertGen trains a diffusion prior on imperfect demos (even LLM-synthesized), then RL steers its initial noise with the policy frozen, keeping behaviour human-like under sparse rewards; experts feed sim-to-real BC.ExpertGen 先在不完美示教（甚至由大模型合成）上训练扩散先验，再冻结策略、用强化学习只优化初始噪声，在稀疏奖励下保持类人行为；得到的专家策略用于仿真到真实的行为克隆。
BibTeX
@misc{xu2026expertgen,
title = {{ExpertGen: Scalable Sim-to-Real Expert Policy Learning from Imperfect Behavior Priors}},
author = {Zifan Xu and Ran Gong and Maria Vittoria Minniti and Kausik Sivakumar and Ahmet Salih Gundogdu and Eric Rosen and Riedana Yan and Tushar Kusnur and Zixing Wang and Di Deng and Peter Stone and Xiaohan Zhang and Karl Schmeckpeper},
year = {2026},
eprint = {2603.15956},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2603.15956},
}