Interactive World Simulation with Cosmos for Physical AI
Adapts Cosmos models for real-time interactive simulation: streams observations in response to actions, or renders them from an external simulator's state. Shown on manipulation, video transfer and multi-view AV.将 Cosmos 模型用于实时交互仿真的统一框架：根据动作流式生成观测，或依据外部仿真器的物理状态生成观测。示例涵盖操作、可控视频迁移和多视角自动驾驶。
BibTeX
@misc{nvidia2026interactive,
title = {{Interactive World Simulation with Cosmos for Physical AI}},
author = {NVIDIA and : and Anis Ahmad and Jon Allen and Malik Aqeel Anwar and Jesse Archer and Maciej Bala and Piotr Barejko and Aarti Basant and Dan Blick and Taras Bolzhelarskyi and Henry Che and Jin Chen and Yukang Chen and Tae Eun Choe and Yuzhu Dong and Nat Duca and Liang Feng and Francesco Ferroni and Xiao Fu and Mohit Gambhir and Vivek Goel and Rony Goldenthal and Aryaman Gupta and Ali Hassani and Nathan Hayes-Roth and Yong He and Michael Honke and Shengyu Huang and Wei Huang and DeLesley Hutchins and Suneel Indupuru and Pooya Jannaty and Jingyi Jin and Janmesh Kalra and Ashna Khetan and Xin Kong and Aleksandr Korovko and Hui Kuang and Zhengfei Kuang and George Kurian and Jean-Francois Lafleche and Jayjun Lee and Justin Leung and William Lew and Xiang Li and Zhaoshuo Li and Chen-Hsuan Lin and Ming-Yu Liu and Xiangyu Lu and others},
year = {2026},
eprint = {2611.06627},
archivePrefix = {arXiv},
primaryClass = {cs.AI},
url = {https://arxiv.org/abs/2611.06627},
}World Models世界模型Sim-to-Real & Simulators仿真与 Sim-to-Realworld-foundation-modelreal-timevideosimulation