Learning Robotic World Models with Semantic and Visual Feedback
RoboImagine post-trains autoregressive robot world models by comparing candidate futures, scored by a frozen multimodal judge plus pixel/perceptual terms. Reports +1.26 dB PSNR on RT-1 over continued SFT.RoboImagine 通过比较多条候选未来来后训练自回归机器人世界模型:冻结的多模态评估器给出语义偏好,像素与感知层面的一致性项约束视觉误差。在 RT-1 上报告 PSNR 比继续监督微调高 1.26 dB。
BibTeX
@misc{wu2026learning,
title = {{Learning Robotic World Models with Semantic and Visual Feedback}},
author = {Hao Wu and Yuqi Li and Yizhou Zhao and Kun Wang and Xiao Luo and Yu Cheng and Bo An and Yingli Tian and Laszlo A. Jeni and Ming-Hsuan Yang},
year = {2026},
eprint = {2611.07850},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2611.07850},
}