What Makes Video World Model Latents Action-Relevant: Prediction over Reconstruction
Probe study of which video world model latents carry action information: temporal video pretraining matters, pixel reconstruction quality does not. V-JEPA-style encoders give the best trade-off.探测哪些视频世界模型的潜变量含有动作信息:关键在于时序视频预训练,而非像素重建质量;V-JEPA 类编码器取得最佳权衡。
BibTeX
@misc{yeom2026what,
title = {{What Makes Video World Model Latents Action-Relevant: Prediction over Reconstruction}},
author = {Jewon Yeom and Hanseul Kim and Jeongjae Park and Sungmok Jung and Jaejin Lee and Taesup Kim},
year = {2026},
eprint = {2606.07687},
archivePrefix = {arXiv},
primaryClass = {cs.CV},
url = {https://arxiv.org/abs/2606.07687},
}World Models世界模型Robot Learning: RL & Imitation机器人学习:强化学习与模仿学习representationprobingv-jepainverse-dynamics