Rollback: Experience Backtracking in World Models for Policy Improvement
Rewinds an action-conditioned world model to key decision points to try alternative actions, turning outcomes into action-level supervision; real data keeps correcting the model. Reports +10.7–11.9 pts on 3 real tasks.把动作条件世界模型当作反事实引擎：回到关键决策点尝试其他动作并对比结果，得到动作级监督而无需单独的价值模型；真机经验再通过 LoRA 持续修正世界模型。报告在 3 个真实任务上比最强基线高 10.7–11.9 个百分点。
BibTeX
@misc{luo2026rollback,
title = {{Rollback: Experience Backtracking in World Models for Policy Improvement}},
author = {Jiayi Luo and Yang Zhang and Liliang Chen and Nan Wang and Chen Gao and Boxiang Qiu and Zhuoxuan Li and Baorui Peng and Chuankang Li and Yuxiang Yan and Si Liu and Qingyun Sun and Shuicheng Yan and Maoqing Yao and Jianxin Li and Guanghui Ren},
year = {2026},
eprint = {2610.36068},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2610.36068},
}World Models世界模型Robot Learning: RL & Imitation机器人学习：强化学习与模仿学习world-modelcounterfactualpolicy-improvementreal-world-rllorareal