WorldFlow: Joint Video and 3D Motion Prediction via Large-Scale Pretraining
World model that jointly denoises future video and 3D point trajectories in one Mixture-of-Transformers, trained on 1.44M samples; adds WorldFlowBench, reports 54% lower ADE than the best baseline on SpatialCog.同时预测未来视频与查询点 3D 轨迹的生成式世界模型:3D 运动以与视频网格对齐的位移 token 表示,由统一的 Mixture-of-Transformers 在 rectified flow 目标下联合去噪;在 144 万样本上训练,新建 WorldFlowBench,报告 SpatialCog 上 ADE 比最强外部基线降低 54.2%。
BibTeX
@misc{lu2026worldflow,
title = {{WorldFlow: Joint Video and 3D Motion Prediction via Large-Scale Pretraining}},
author = {Yuhao Lu and Jiongxu Chen and Hexiang Wei and Jiajin Wu and Juelin Li and Mingjian Liang and Fan Yang and Zhuowei Liang and Zihao Liu and Zhennan Wang and Sheng Wang and Lin Shao},
year = {2026},
eprint = {2610.39278},
archivePrefix = {arXiv},
primaryClass = {cs.CV},
url = {https://arxiv.org/abs/2610.39278},
}