TAPESTRY: A Single Backbone for Video Generation and Robot Control
Turns a pretrained video diffusion transformer into a policy by encoding each action step as one patch in the video latent space; at test time it outputs an action chunk in one DDIM step (84 ms), no video generation.把预训练视频扩散 Transformer 改造成策略：每个时间步的动作编码为视频潜空间中的一个 patch，联合训练视频、视频+动作与纯动作三种扩散目标；测试时一步 DDIM 生成动作块（84 毫秒），无需生成视频。
BibTeX
@misc{collins2026tapestry,
title = {{TAPESTRY: A Single Backbone for Video Generation and Robot Control}},
author = {Jeremy A. Collins and Seungjae Lee and Rachanon Wachakorn and Krishnan Srinivasan and Animesh Garg and Vitor Campagnolo Guizilini and Paarth Shah},
year = {2026},
eprint = {2610.36823},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2610.36823},
}