VIMA: General Robot Manipulation with Multimodal Prompts
Casts many tabletop tasks as interleaved text-and-image prompts to one Transformer policy, with the VIMA-Bench suite for systematic generalization tests.把多种桌面任务统一成图文交错的提示,交给一个 Transformer 策略执行,并配套 VIMA-Bench 用于系统性泛化评测。
BibTeX
@misc{jiang2022vima,
title = {{VIMA: General Robot Manipulation with Multimodal Prompts}},
author = {Yunfan Jiang and Agrim Gupta and Zichen Zhang and Guanzhi Wang and Yongqiang Dou and Yanjun Chen and Li Fei-Fei and Anima Anandkumar and Yuke Zhu and Linxi Fan},
year = {2022},
eprint = {2210.03094},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2210.03094},
}