ChatVLA: Unified Multimodal Understanding and Robot Control with Vision-Language-Action Model
Keeps a VLA able to chat: phased alignment training plus a mixture-of-experts split to fight forgetting and task interference; reports strong VQA/MMMU scores and beats OpenVLA on 25 real tasks.让 VLA 保留“对话”能力:通过分阶段对齐训练和混合专家结构缓解遗忘与任务干扰;论文报告在保持 VQA/MMMU 等多模态理解成绩的同时,在 25 个真实操作任务上优于 OpenVLA。
BibTeX
@misc{zhou2025chatvla,
title = {{ChatVLA: Unified Multimodal Understanding and Robot Control with Vision-Language-Action Model}},
author = {Zhongyi Zhou and Yichen Zhu and Minjie Zhu and Junjie Wen and Ning Liu and Zhiyuan Xu and Weibin Meng and Ran Cheng and Yaxin Peng and Chaomin Shen and Feifei Feng},
year = {2025},
eprint = {2502.14420},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2502.14420},
}