Multimodal Diffusion Transformer: Learning Versatile Behavior from Multimodal Goals
MDT is a diffusion transformer that learns versatile behaviour from multimodal goals with few language annotations, using two self-supervised objectives.MDT 是扩散 Transformer，借助两个自监督目标，在语言标注很少时从多模态目标学习多样行为。
BibTeX
@misc{reuss2024multimodal,
title = {{Multimodal Diffusion Transformer: Learning Versatile Behavior from Multimodal Goals}},
author = {Moritz Reuss and Ömer Erdinç Yağmurlu and Fabian Wenzel and Rudolf Lioutikov},
year = {2024},
eprint = {2407.05996},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2407.05996},
}